Manga2Animate: An Agentic Framework for Faithful Manga Animation with Script and Storyboard Planning
Organizations: Department of Computer Science, National Yang Ming Chiao Tung University
Abstract
Adapting existing manga into coherent animation that stays faithful to the source is a valuable yet challenging task. Existing methods either access the manga mainly through text, losing its characters and art style, or feed manga pages directly into video generation models, which misinterpret the manga's structure and produce incorrect storylines. In this paper, we propose Manga2Animate, a multi-agent framework that grounds every stage of generation in the source manga. We decompose the task into two intermediate representations, an animation script and a visual storyboard. Each representation is produced by a creator agent and reviewed against the source panels by a paired reviewer agent. We tailor representation-specific selection and dual-level feedback to progressively refine both before synthesizing the final animation. Extensive experiments and a user study demonstrate that Manga2Animate produces animations more faithful to the source manga and more consistent across shots than state-of-the-art approaches. Project page: https://annchenn.github.io/Manga2Animate/
Figures & tables
| Method | Model | Alignment | Video Quality | Aesthetic Quality | Cost | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| I2VS | I2VB | SC | BC | MS | DD | Shadow-v2 | Waifu-v3 | Calls (VLM) | Calls (Video Gen) | Time | ||
| AniMaker | – | 0.775 | 0.749 | 0.922 | 0.950 | 0.979 | 7.680 | 0.410 | 2.694 | 82.500 | – | 8h9m |
| ViMax | Veo 3.1 Fast | 0.774 | 0.752 | 0.881 | 0.932 | 0.978 | 1.639 | 0.368 | 4.394 | 15.125 | 6.000 | 12m18s |
| ViMax | Seedance 2.0 | 0.753 | 0.747 | 0.927 | 0.948 | 0.977 | 2.541 | 0.385 | 4.764 | 15.125 | 6.000 | 16m33s |
| ViMax | MiniMax-H3 | 0.771 | 0.767 | 0.938 | 0.957 | 0.977 | 0.977 | 0.326 | 4.505 | 15.500 | – | 28m58s |
| StoryMem | – | 0.728 | 0.731 | 0.885 | 0.922 | 0.956 | 5.203 | 0.275 | 3.602 | 10.300 | – | 2h16m8s |
| Method | Alignment | Video Quality | Aesthetic Quality | |||||
|---|---|---|---|---|---|---|---|---|
| I2VS | I2VB | SC | BC | MS | DD | Shadow-v2 | Waifu-v3 | |
| Without Script Reviewer | 0.766 | 0.752 | 0.912 | 0.949 | 0.963 | 8.592 | 0.523 | 4.789 |
| Without Storyboard Reviewer | 0.783 | 0.756 | 0.923 | 0.948 | 0.971 | 5.616 | 0.479 | 4.540 |
| Without Video Reviewer | 0.768 | 0.749 | 0.902 | 0.941 | 0.957 | 8.330 | 0.517 | 4.996 |
| Full Model | 0.791 | 0.768 | 0.931 | 0.958 | 0.960 | 9.457 | 0.518 | 5.090 |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | V.C. | C.A. | A.Q. | Cost | |||||
|---|---|---|---|---|---|---|---|---|---|
| CSD | CIDS | PA | OCCM | Shadow-v2 | Waifu-v3 | Calls (VLM) | Calls (Img Gen) | Time | |
| StoryDiffusion | 0.509 | 0.713 | 2.05 | 57.5 | 0.697 | 5.789 | – | – | 49s |
| Story-Iter | 0.486 | 0.652 | 1.85 | 66.3 | 0.615 | 6.308 | 60.000 | 11.000 | 13m20s |
| AnyStory | 0.605 | 0.792 | 2.66 | 69.3 | 0.606 | 3.781 | 10.000 | 1.000 | 2m7s |
| AniMaker | 0.508 | 0.797 | 3.34 | 67.5 | 0.448 | 4.522 | 82.500 | 18.000 | 8h9m |
| Ours (FLUX.2) | 0.622 | 0.797 | 3.14 | 73.5 | 0.552 | 3.423 | 58.000 | – | 1h59m |
| Method | Alignment | Video Quality | Aesthetic Quality | |||||
|---|---|---|---|---|---|---|---|---|
| I2VS | I2VB | SC | BC | MS | DD | Shadow-v2 | Waifu-v3 | |
| Script-wise Selection | 0.785 | 0.772 | 0.928 | 0.956 | 0.963 | 5.951 | 0.473 | 4.423 |
| Clip-wise Selection (Full Model) | 0.791 | 0.768 | 0.931 | 0.958 | 0.960 | 9.457 | 0.518 | 5.090 |
| Method | V.C. | C.A. | A.Q. | |||
|---|---|---|---|---|---|---|
| CSD | CIDS | PA | OCCM | Shadow-v2 | Waifu-v3 | |
| Without Script Feedback | 0.597 | 0.786 | 3.33 | 70.8 | 0.334 | 3.813 |
| Without Storyboard Feedback | 0.588 | 0.770 | 3.39 | 72.6 | 0.249 | 3.257 |
| Full Model | 0.605 | 0.808 | 3.50 | 72.2 | 0.350 | 3.798 |
| Method | Alignment | Video Quality | Aesthetic Quality | |||||
|---|---|---|---|---|---|---|---|---|
| I2VS | I2VB | SC | BC | MS | DD | Shadow-v2 | Waifu-v3 | |
| w/o Refinement | 0.778 | 0.754 | 0.914 | 0.952 | 0.965 | 7.872 | 0.521 | 4.818 |
| w/o Storyboard Gen. | 0.766 | 0.745 | 0.896 | 0.947 | 0.961 | 8.289 | 0.515 | 5.050 |
| Full Model | 0.791 | 0.768 | 0.931 | 0.958 | 0.960 | 9.457 | 0.518 | 5.090 |
| Mode | Alignment | Video Quality | Aesthetic Quality | |||||
|---|---|---|---|---|---|---|---|---|
| I2VS | I2VB | SC | BC | MS | DD | Shadow-v2 | Waifu-v3 | |
| Reference-conditioned | 0.791 | 0.768 | 0.931 | 0.958 | 0.960 | 9.457 | 0.518 | 5.090 |
| First-frame | 0.772 | 0.778 | 0.935 | 0.941 | 0.962 | 4.045 | 0.302 | 4.042 |
Agentic Video Generation
Agentic video generation uses AI agents to plan, create, evaluate, and refine videos through coordinated tools and feedback.
See all 40 papers