cs.CVMar 26, 2026

AnyDoc: Enhancing Document Generation via Large-Scale HTML/CSS Data Synthesis and Height-Aware Reinforcement Optimization

Authors: Jiawei Lin, Wanrong Zhu, Vlad I Morariu, Christopher Tensmeyer

Organizations: Xi’an Jiaotong University · Adobe Research

Abstract

Document generation has gained growing attention in the field of AI-driven content creation. In this work, we push its boundaries by introducing AnyDoc, a framework capable of handling multiple generation tasks across a wide spectrum of document categories, all represented in a unified HTML/CSS format. To overcome the limited coverage and scale of existing human-crafted document datasets, AnyDoc first establishes a scalable data synthesis pipeline to automatically generate documents in HTML/CSS form. This pipeline yields DocHTML, a large-scale dataset containing 265,206 document samples, while spanning 111 categories and 32 distinct styles. Additionally, all documents are equipped with comprehensive metadata, including design intentions, HTML/CSS source code, visual assets, and rendered screenshots. Building on the curated dataset, AnyDoc fine-tunes multi-modal large language models (MLLMs) to achieve three practical document generation tasks: intention-to-document, document derendering, and element-to-document. To address the content overflow issue observed during fine-tuning, AnyDoc further incorporates a height-aware reinforcement learning (HARL) post-training procedure. By defining a reward function based on the difference between predicted and target document heights, overflow is penalized and gradually mitigated during HARL, thereby enhancing overall performance. Qualitative and quantitative experiments demonstrate that AnyDoc outperforms both general-purpose MLLMs and task-specific baselines across all three tasks.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. DocDjinn: Controllable Synthetic Document Generation with VLMs and Handwriting Diffusion

    Feb 25, 2026Marcel Lamott, Saifullah Saifullah, Nauman Riaz +11Synthetic Data GenerationSynthetic Data Augmentation

  2. Towards Real-World Document Parsing via Realistic Scene Synthesis and Document-Aware Training

    Mar 25, 2026Gengluo Li, Pengyuan Lyu, Chengquan Zhang +7Document ParsingMultimodal Large Language Models

  3. Size Matters: Foundation Model for Czech HTML documents

    Sep 16, 2026Martin Dvořák, Vít Tlustoš, Artyom Voronin +4Language Model PretrainingEfficient Language Model Training