alibaba /lumenx

About lumenx

LumenX is a local tool from Alibaba for motion-comic short dramas. Feed it novel text, and it builds a storyboard, art and video clips. It dubs the dialogue and stitches the final cut with FFmpeg. A paid DashScope API key is required, and the docs come in Chinese first.

Best for: Novel-adapting filmmakers who want a local tool for motion-comic short dramas.

• Reads your script and pulls out characters, scenes and props
• Generates character turnaround sheets, scene art and prop images
• Turns storyboard frames into video clips, with batch sampling
• Dubs dialogue with CosyVoice or Qwen3-TTS voices
• Edits on a timeline, then exports the finished cut with FFmpeg
• Playground mode: 6 generation types, 10+ models, no script needed

1. 1
   Install Python 3.11+, Node.js 18+ and FFmpeg.
2. 2
   Clone the repo: the command below then cd lumenx.

   git clone https://github.com/alibaba/lumenx.git

   Copy
3. 3
   Copy .env.example to .env and add your DASHSCOPE_API_KEY (required).
4. 4
   Run npm run dev. The backend starts on 17177, the frontend on 3008, and your browser opens.
5. 5
   Or start them apart: the command below and ./start_backend.sh, then the next command.

   pip install -r requirements.txt

   Copy

   cd frontend && npm install && npm run dev

   Copy
6. 6
   Open http://localhost:3008 for Studio, http://localhost:3008/#/playground for Playground, and http://localhost:17177/docs for the API.