AI/TLDR

Toonflow

Infinite-canvas workbench that turns a novel into a short drama — chapter events, script, storyboards and video nodes in one project

Video GenerationOpen source
Language
TypeScript
License
Apache-2.0

Overview

Toonflow is an open-source AI workstation for short-drama production. It closes the loop from planning to scriptwriting to storyboarding to final output inside one project, organising scripts, characters, storyboards, assets and video nodes on an infinite canvas rather than a linear timeline — so parts of a production can be reworked, backtracked or generated in parallel.

Its adaptation pipeline is event-graph driven. Toonflow extracts chapter events from the source novel and stores them structurally; script adaptation then pulls context through that event graph instead of re-reading raw long text, which is what keeps a long book from degrading into lost details. Three layers of agents — decision, execution and supervision — cover task decomposition, content generation, quality review and revision feedback, and a cross-session memory system backed by local ONNX vector retrieval holds short-term messages, long-term summaries and semantic recall across rounds.

Toonflow is model-agnostic and expects you to bring your own endpoints: a language model API, a video generation service, and an image generation model. Providers are programmable — you write vendor logic in TypeScript directly in the settings centre and it takes effect without editing source or restarting. The core prompts for ScriptAgent and ProductionAgent are externalised as Markdown skill files you can edit online. It ships as an Electron desktop app for Windows, macOS and Linux, and as a Docker or Node.js deployment, with a UI in seven languages.

What it does

  • Infinite-canvas workbench holding scripts, characters, storyboards, assets and video nodes in one arrangeable graph
  • Three-layer agent system — decision, execution and supervision — covering decomposition, generation, review and revision
  • Chapter event graph extracted from the source novel, so script adaptation calls precise context instead of re-reading long text
  • Persistent cross-session agent memory built on local ONNX vector retrieval
  • Programmable provider system: write vendor logic in TypeScript in the settings centre, effective instantly with no restart
  • ScriptAgent and ProductionAgent prompts externalised as editable Markdown skill files

Getting started

Toonflow needs three external services before it can generate anything: a language model API endpoint, a video generation service endpoint, and an image generation model API. Install the desktop build or deploy it yourself, then configure those vendors in the settings centre.

Install the desktop app

Download the official release package for Windows, Linux or macOS from GitHub Releases. On macOS you may need to allow the app under Settings → Privacy & Security before it will open. The first login is admin / admin123 — change it.

texttext
# https://github.com/HBAI-Ltd/Toonflow-app/releases

Or deploy with Docker

Clone the repository and build locally. The UI listens on port 10588; mount a host directory at /app/data to keep projects. NODE_ENV, PORT and OSSURL are the relevant environment variables.

bashbash
git clone https://github.com/HBAI-Ltd/Toonflow-app.git
cd Toonflow-app

yarn docker:local

# or build manually
docker build -t toonflow .
docker run -d -p 10588:10588 -v <local_data_path>:/app/data toonflow
# then open http://localhost:10588/index.html

Or run it on a server

Server deployment wants Ubuntu 20.04+ or CentOS 7+, Node.js 24.x (23.11.1+ minimum) and at least 2 GB of RAM, with yarn and pm2 for process management.

bashbash
nvm install 24
npm install -g yarn pm2

cd /opt
git clone https://github.com/HBAI-Ltd/Toonflow-app.git
cd Toonflow-app
yarn install
yarn build

Configure your model vendors

Open the settings centre and fill in the text, image and video model endpoints. This is where the programmable provider system lives, so a vendor that needs custom request logic can be scripted in TypeScript rather than patched into the source.

Run a production

Create a project, import the source novel and run chapter event extraction. Move to ScriptAgent for the story skeleton, adaptation strategy and structured script, then to ProductionAgent to lay out storyboards, assets and video nodes on the canvas. Refine storyboard images node by node, then return them to the workbench for stitching and export.

Commands and code are distilled from the project's own documentation — always check the official repo for the latest.

When to use it

  • Adapting a long novel into a shootable short-drama script without losing chapter-level detail to context limits
  • Running storyboard and video generation as an editable node graph so single shots can be re-rolled in isolation
  • Prototyping video concepts against your own model endpoints and keeping project data on your own machine
  • Standardising a small studio's script and production prompts as versioned Markdown skill files

How Toonflow compares

Toonflow alongside other open-source video generation tools AI/TLDR tracks, ranked by GitHub stars.

ToolStarsWhat it does
MoneyPrinterTurbo★ 125kA self-hosted WebUI, API and CLI that turns one topic or keyword into a finished short video — script, stock or generated footage, voiceover, subtitles and music.
OpenMontage★ 60.4kAn agentic video production system that gives a coding assistant 12 pipelines and 100+ tools to research, script, generate and render a video end to end.
HyperFrames★ 51.9kHeyGen's HTML-to-video renderer: author a composition in HTML, CSS and JS, preview it in a browser, then render the same input to a deterministic MP4 locally or on AWS Lambda.
Toonflow★ 15.8kInfinite-canvas workbench that turns a novel into a short drama — chapter events, script, storyboards and video nodes in one project
Palmier Pro★ 14.4kA Swift-native macOS video editor with generative models in the timeline and a built-in MCP server, so Claude, Codex or Cursor can edit the open project alongside you.
Hypit★ 11.8kA markup language and compiler that lets a coding agent rebuild a reference video as an editable workflow — footage, captions, B-roll and effects anchored to words rather than timestamps — and render variants in one command.
LTX-2★ 9.5kLightricks' official inference package for its LTX-2 audio-video model: a dozen pipelines covering text/image-to-video, keyframe interpolation, audio-to-video, retakes, dubbing and HDR/EXR, plus a LoRA trainer.
DramaClaw★ 6.2kSelf-hosted AIGC video engine pairing an infinite node canvas with an episode pipeline that carries a manuscript through assets, storyboards, shots, voice-over and export.