Generating scientific manuscripts requires maintaining alignment between narrative reasoning, experimental evidence, and visual artifacts across the document lifecycle. Existing language-model generation pipelines rely on unconstrained text synthesis with validation applied only after generation, often producing structural drift, missing figures or tables, and cross-section inconsistencies. We introduce Story2Proposal, a contract-governed multi-agent framework that converts a research story into a structured manuscript through coordinated agents operating under a persistent shared visual contract. The system organizes architect, writer, refiner, and renderer agents around a contract state that tracks section structure and registered visual elements, while evaluation agents supply feedback in a generate evaluate adapt loop that updates the contract during generation. Experiments on tasks derived from the Jericho research corpus show that Story2Proposal achieved an expert evaluation score of 6.145 versus 3.963 for DirectChat (+2.182) across GPT, Claude, Gemini, and Qwen backbones. Compared with the structured generation baseline Fars, Story2Proposal obtained an average score of 5.705 versus 5.197, indicating improved structural consistency and visual alignment.
Figures & tables
Figure 1: System overview of Story2Proposal. Given a research story as input, the framework coordinates architect, writer, refiner, and renderer agents through a persistent shared visual contract that records section structure, registered visual artifacts, and validation rules. Evaluation agents inspect intermediate outputs and feed corrective signals back to the contract state, enabling provenance-aware planning, structurally constrained drafting, global refinement, and deterministic rendering of the final manuscript.
Figure 2: Schema of the shared visual contract used by Story2Proposal. The contract combines a global registry of figures, tables, and citation slots with section-level obligations and validation rules, so that all agents operate on the same structural state and the renderer can deterministically verify label uniqueness, reference resolution, and narrative–visual alignment before compilation.
Figure 3: Expert evaluation protocol used in our experiments. Each condition combines one of two generation methods, one of four LLM backbones (GPT, Claude, Gemini, and Qwen), and ten independent expert reviewers. Reviewers assess complete manuscripts on structural integrity, writing clarity, methodological rigor, experimental substance, citation hygiene, reproducibility, formatting stability, and visual communication, and the resulting scores are aggregated into the overall expert evaluation metric.
Model
E1
E2
E3
E4
E5
E6
E7
E8
E9
E10
Avg
Based on DirectChat
GPT
3.62
3.01
5.97
3.33
3.49
4.06
5.34
4.23
3.64
4.09
4.08
Claude
3.39
2.68
5.98
3.04
3.36
3.96
4.88
3.92
3.23
4.20
3.86
Gemini
3.32
2.79
6.07
3.16
3.51
3.66
5.14
3.99
3.56
4.14
3.93
Qwen
3.38
2.74
6.19
3.22
3.41
3.93
5.32
4.05
3.58
3.93
3.98
Based on Story2Proposal
Table 2: Average expert evaluation scores comparing Story2Proposal and DirectChat across four LLM settings. Higher is better.
Paper
E1
E2
E3
E4
E5
E6
E7
E8
E9
E10
Avg
Based on Fars
Escrowed Batch Reveal
4.55
4.39
6.06
4.41
4.38
5.04
6.19
4.57
4.47
5.22
4.93
Symbolic Execution
4.97
5.64
6.32
5.40
5.65
5.57
6.46
5.11
5.57
5.69
5.64
Hazard-Signature Tombstones
4.27
4.06
6.09
4.19
4.33
4.57
6.04
4.59
4.21
4.74
4.71
Poisoning LLM-Induced Rules
5.00
5.59
6.01
5.11
5.35
5.22
6.80
5.26
5.14
5.63
5.41
Based on Story2Proposal
Table 3: Average expert evaluation scores comparing Story2Proposal and Fars across four benchmark research papers. Higher is better.
Figure 4: Average performance deltas between Story2Proposal and baseline generation methods across experiments. Positive values indicate that the contract-governed multi-agent framework outperforms the comparison system under the same backbone or benchmark setting. The figure summarizes both the large gains over DirectChat in the cross-model study and the smaller but consistent improvements over the structured Fars baseline, highlighting the benefit of stronger structural control and narrative–visual alignment.
Synthesizing unstructured research materials into manuscripts is an essential yet under-explored challenge in AI-driven scientific discovery. Existing autonomous writers are rigidly coupled to specific experimental pipelines, and produce superficial literature reviews. We introduce PaperOrchestra, a multi-agent framework for automated AI research paper writing. It flexibly transforms unconstrained pre-writing materials into submission-ready LaTeX manuscripts, including comprehensive literature synthesis and generated visuals, such as plots and conceptual diagrams. To evaluate performance, we present PaperWritingBench, the first standardized benchmark of reverse-engineered raw materials from 200 top-tier AI conference papers, alongside a comprehensive suite of automated evaluators. In side-by-side human evaluations, PaperOrchestra significantly outperforms autonomous baselines, achieving an absolute win rate margin of 50%-68% in literature review quality, and 14%-38% in overall manuscript quality.
AI Scientists have shown promising progress across multiple stages of the research pipeline, among which automatic scientific paper writing remains a formidable challenge. The Introduction writing is especially challenging, which demands not only linguistic fluency, but logical soundness and verifiable faithfulness. Most AI-assisted methods treat the task as text generation instead of reasoning and structuring, leading to severe drawbacks, e.g., hallucinating citations. To address this, we first formulate the Content-Conditional Introduction Generation (CCIG) task, which requires grounding the Introduction in the paper's core evidence. We then propose LECTOR, a novel Logic-Expression Co-Reinforcement Learning framework that can strictly follow the scientist's logic, add high-quality citations and keep structured expressions. LECTOR first constructs a logic-reasoning graph from the paper's main body to serve as a verifiable logical blueprint. Subsequently, it employs a Logic-Expression Co-Rewarding mechanism to jointly optimize for both the graph's structural fidelity and the final narrative's quality. We conduct a dataset from Nature Communications papers to assess our method. Extensive experiments show consistent improvements in both logic fidelity and Introduction generation quality metrics, e.g., Graph Quality (+26.7%), Citation Quality (+8.6%), and Paper Consistency (+3.3%). Code and data are available at https://github.com/Xiao-Youth/LECTOR.
Jiabei Xiao, Yizhou Wang, Chen Tang +3
1The Chinese University of Hong Kong · 2Shanghai Artificial Intelligence Laboratory · 3Fudan University
While recent advances in large language models have enabled end-to-end automated manuscript generation, existing systems suffer from three critical deficiencies: (i) generated claims are not deterministically grounded in verifiable literature, (ii) experimental results are frequently fabricated rather than executed, and (iii) there exists no standardized, multi-dimensional framework to assess whether AI-generated manuscripts meet the quality and rigor required for real-world publication. We present Prompt-to-Paper, a multi-agent framework that directly addresses this evaluation gap through three integrated innovations. First, a deterministic retrieval-augmented generation pipeline with section-aware relevance scoring and snowball citation expansion grounds every claim in a verifiable corpus of 60--100 papers. Second, an autonomous coding agent executes real computational biology experiments replacing synthetic outputs with genuine numerical results. Third, an eight-dimensional automated quality scorer, benchmarked with approximate reference statistics from published papers and augmented with explicit hallucination penalties, provides standardized, reproducible quality assessments. The quality-driven improvement loop uses a context-rich reviser that routes each iteration to one of three researcher actions and fires a deep research cycle every ten iterations to re-run experiments and re-manuscript from stronger outputs. We validate the system on five bioinformatics case studies; all five cases compiled submission-formatted PDFs with zero out-of-range citations. The improvement loop raises manuscript quality by an average of +17.96 points on a 0--100 scale (maximum +26.04. As partial external checks, a human reviewer scored the five manuscripts at an average of 7.0 out of 10. Complete manuscripts are produced at approximately 0.31 USD per paper.
School of Interdisciplinary Engineering and Sciences (SINES), National University of Sciences and Technology (NUST), Islamabad, Pakistan · College of Electrical and Mechanical Engineering (CEME), NUST, Rawalpindi, Pakistan