High-quality scientific illustrations are essential for communicating complex scientific and technical concepts, yet existing automated systems remain limited in editability, stylistic controllability, and efficiency. We present AutoFigure-Edit, an end-to-end system that generates fully editable scientific illustrations from long-form scientific text while enabling flexible style adaptation through user-provided reference images. By combining long-context understanding, reference-guided styling, and native SVG editing, it enables efficient creation and refinement of high-quality scientific illustrations. To facilitate further progress in this field, we release the video at https://youtu.be/10IH8SyJjAQ, full codebase at https://github.com/ResearAI/AutoFigure-Edit and provide a website for easy access and interactive use at https://deepscientist.cc/.
Figures & tables
Method
Sci. Gen.
Editable
Style Control
GUI Support
StarVector & OmniSVG ( Rodriguez et al., 2025 ; Yang et al., 2025 )
Limited
✓
Prompt (Hard)
Web Only
AutomaTikZ ( Belouadi et al., 2024a )
✓
✓
Prompt (Hard)
Web Only
DeTikZify ( Belouadi et al., 2024b )
✓
✓
Sketch (Hard)
Web Only
GPT-Image ( Hurst et al., 2024 )
✓
✗
Prompt (Hard)
Web Only
Diagram Agent ( Wei et al., 2025 )
✓
✓
Prompt (Hard)
None
PaperBanana ( Zhu et al., 2026a )
✓
✗
Prompt (Hard)
Web Only
Table 1: Comparison of AutoFigure-Edit with other relevant systems. “Sci. Gen.” denotes scientific illustration generation; “GUI Support” denotes the level of integrated graphical user interface and editing capabilities.
Figure 1: An overview of AutoFigure-Edit . This figure is also produced by AutoFigure-Edit and serves as a qualitative showcase of its generation quality.
Figure 2: Representative outputs of AutoFigure-Edit . (a)-(b) are bitmap (PNG) figures generated from long-form scientific descriptions across various domains. (c) shows the PNG-to-SVG conversion case of AutoFigure-Edit , including the original bitmap (bottom) and its corresponding vectorized SVG result (down). (d) is the web interface of AutoFigure-Edit , allowing users to select predefined style templates or upload custom reference images.
Figure 3: The embedded interactive canvas enables users to freely manipulate individual components within the generated SVG.
Figure 4: Results of the human user study. The numbers indicate the mean scores. AutoFigure-Edit achieves consistently high satisfaction in most metrics.
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 5: Qualitative results of AutoFigure-Edit .
Figure 6: Comparison between Reference Images and Generated Images.
Scientific figures are among the most effective means of communicating complex research ideas, yet producing publication-quality illustrations remains one of the most labor-intensive parts of paper preparation. Existing automated systems each target a single figure type under text-only input, leaving the diversity of types and conditions researchers actually use unaddressed; their raster outputs further cannot be locally revised. Because scientific figures are structured compositions of discrete semantic components, the localized errors generators produce on such layouts demand not a stronger backbone but a harness. We instantiate this harness in two complementary systems: Crafter, a multi-agent harness for figure generation that generalizes across figure types and input conditions without architectural changes, and CraftEditor, which applies the same pattern to convert raster outputs into editable SVGs. Moreover, we introduce CraftBench, a benchmark spanning three figure types and four input conditions with human quality annotation. Experiments show that Crafter substantially outperforms both standalone generators and the agentic baseline on PaperBanana-Bench and CraftBench, with ablations confirming each component's independent contribution; CraftEditor faithfully converts outputs into editable SVGs that surpass all baselines. Our code and benchmark are available at https://github.com/HaozheZhao/Crafter.
Haozhe Zhao, Shuzheng Si, Zhenhailong Wang +6
University of Illinois at Urbana-Champaign · Tsinghua University · Peking University
High-quality methodology figures are central to scientific communication, yet they remain difficult and time-consuming to create. Such figures must distill a method's components and information flow into a clear, revisable diagram as the paper evolves. Existing methodology diagram automation systems typically face a trade-off between editability and visual quality: TikZ- or SVG-based methods produce editable structured outputs but often lack the richness of human-designed figures, while image-generation models produce polished raster outputs that are difficult to revise. We introduce SciFig, an end-to-end multi-agent framework for generating visually rich and fully editable methodology figures from scientific text. SciFig decomposes figure generation into planning, layout synthesis, component rendering, and iterative refinement, producing XML figures that can be edited in standard diagramming tools and refined through human or VLM feedback. We also introduce SciFig-Bench, a human-verified benchmark of 435 author-drawn methodology figures from 37 arXiv domains and 15 top-tier AI/ML venues, and SciFig-Eval, a four-axis evaluation protocol for measuring figure quality. Across seven single-agent and agentic baselines, SciFig achieves the best performance on all four SciFig-Eval axes and generates editable figures in about 10 minutes on average. Qualitative examples further show that SciFig can generalize beyond methodology figures to teaser diagrams and statistical plots. Dataset and code are available at: https://shramanpramanick.github.io/SciFig/.
Siyuan Huang, Yifan Zhou, Yutong Gao +8
Johns Hopkins University · Zhejiang University · Independant Researcher +4
Vision-language models (VLMs) have shown strong performance in generating scientific figures from text or images. However, publication-ready figures often require iterative refinement, making scientific figure editing an important yet largely unexplored step toward interactive figure creation. Existing approaches rely on costly proprietary agentic systems, focus primarily on evaluation, or construct training supervision from synthetically generated edits. Instead, we leverage naturally occurring scientific revision and development trajectories as a scalable source of supervision. To this end, we introduce DaEdiTikZ, the first large-scale dataset of revision-derived scientific figure edits, constructed by mining 391K plausible TikZ edit pairs from arXiv, GitHub, and TeX SE and inferring 781K directed edit instructions with a VLM conditioned on rendered figures and TikZ code. We further introduce DaEdiTikZ-Bench, a human-refined benchmark with 690 instances, and train two compact Qwen3.5-based EdiTikZ models (4B and 9B) by jointly learning image-to-TikZ reconstruction and instruction-conditioned editing, followed by reinforcement learning (RL) with complementary rewards for rendered fidelity and edit application. Automatic evaluation places our 9B model above all tested baselines, while human evaluation with 9 annotators and 4,320 ratings places it above GPT-5.6-Sol and on par with Gemini-3.1-Pro. Under severe out-of-distribution shifts, it remains competitive with GPT-5.6-Sol near its 2K training sequence-length regime.
Christian Greisinger, Zhixue Zhao, Steffen Eger
University of Technology Nuremberg · University of Sheffield