MOSS-Image Technical Report
Organizations: MOSI Intelligence · SII · Fudan University · Shanghai Jiao Tong University
Abstract
Recent closed-source image generation systems can produce diverse visual content from simple compositions to information-dense graphics, yet open-weight text-to-image models still struggle with dense text and intricate layouts. To narrow this gap, we introduce MOSS-Image, an open generation system that combines high-fidelity visual synthesis with intent-aware composition. First, we pretrain a 5B single-stream diffusion transformer (DiT) from scratch with a carefully designed recipe, enabling bilingual long-form text rendering and precise layout control. Second, we develop an intention-aware agentic prompt enhancement (PE) module that translates diverse user requests into detailed content and layout specifications. Together, they enable MOSS-Image to generate text-rich and layout-coherent images. We further introduce LongLongTextBench (LLTB) for evaluating long-form English and Chinese text rendering, and RealLayoutArena (RLA) for end-to-end layout-rich generation. MOSS-Image achieves state-of-the-art performance among open-weight models on LLTB, with an average text coverage of 96.3%. On RLA, MOSS-Image ranks second in the end-to-end system comparison, while its backbone ranks first among generators evaluated with shared enhanced prompts. We will release the model, training recipe, and evaluation framework to support further research and promote the text-to-image community.
Figures & tables
Appendix figures & tables15 assets
Supplementary material from the paper’s appendix.
Appendix
| Component | Configuration |
| Diffusion generator | 5B single-stream Transformer |
| Text encoder | Qwen3.5-9B (frozen) |
| Text features | Final-layer token hidden states, dimension 4096 |
| Text adapter | Linear projection ; two text-only Transformer blocks |
| Joint backbone depth | 42 blocks, excluding the text adapter and encoder |
| Hidden size | 3072 |
| Stage 3 steps | Shift | Cutoff | Full-noise override | |
| 1–140,000 | 3 | None | 0.01 | |
| 140,001–207,000 | 1 | None | 0.01 | |
| 207,001–274,000 | 1 | 0.95 | 0 | |
| 274,001–310,000 | 1 | 0.95 | 0 |
| Setting | Value |
| Learning Rate (AdamW) | |
| Learning Rate (Muon) | , RMS-matched |
| AdamW | , , |
| Muon | , 5 N–S steps |
| Weight Decay | 0.01 |
| Gradient Clipping | 1.0 |
| Source | Input records | Retained records |
| ReLAION [ 15 ] | ||
| OmniCorpus [ 16 ] | ||
| datacomp [ 17 ] | ||
| medtrinity_25m [ 22 ] | ||
| optical-rs [ 23 ] | ||
| marqo [ 24 ] |
| Field | Retention condition |
| Width and height | Each pixels |
| Aspect ratio | and |
| Entropy | |
| Brightness | and |
| Saturation | |
| Sum of watermark area ratios |
| Training data | DPG-Bench | GenEval | OneIG | FDR6-LAION |
| Baseline | 82.420 | 0.6484 | 0.4363 | 2.4126 |
| Additional filtering | 82.411 | 0.6244 | 0.3482 | 3.2184 |
| Variant | Mean | P10 | Median | P90 |
| Short | 20.86 | 16 | 20 | 26 |
| Medium | 76.61 | 59 | 75 | 97 |
| Long | 235.12 | 153 | 193 | 293 |
| Schema | Operation | Policy |
| Scene/element | Field dropout | Activate with ; conditional on activation, apply dropout to each configured field group with . Retain gen_brief and elements . |
| Scene/element | Ordering and aliases | Randomize element order. With , use an alternative key for the appearance description. |
| Summary/items | Structural fields | Remove id and parent with . Drop the entire summary with . |
| Summary/items | Summary attributes | Within a retained summary, drop meta with , and canvas / caption with each. Replace a retained caption with the selected base prompt with . |
| Summary/items | Item attributes | Apply dropout to palettes and other optional fields. Use three equal-weight modes for tags / caption : both, tags only, or caption only. |
| Summary/items | Element order | Shuffle items with . |
| Coordinate assignment | DPG-Bench | GenEval | OneIG |
| Four-way comparison at 200K steps | |||
| Baseline | 81.94 | 0.6313 | 0.3483 |
| Modality on sequence axis | 81.41 | 0.6101 | 0.3588 |
| Modality on axis | 80.93 | 0.6280 | 0.3597 |
| Sequential text–image, | 81.89 | 0.6026 | 0.3605 |
| Mean over 800K–1.25M steps | |||
| Route | Planning priorities | Reference guidance |
| Poster | Information hierarchy, complete event or campaign content, typography, and coherent visual composition. | Search same-theme posters; typically inspect 3–5 distinct examples and compare content, density, and typography/layout. |
| Infographic | Develop factual explanations jointly with diagrams, labels, and reading order; preserve substantive content when grouping elements. | Inspect relevant visual references and consult authoritative sources for unfamiliar or uncertain facts. |
| User interface | Match the intended page, platform, viewport, version, and populated interface state. | Collect roughly 3–6 candidates and normally inspect at least 3 distinct screenshots; prefer 2 sources and 2 relevant page views when available. |
| Bin | Construction interval | Observed EN range | Observed ZH range |
| Short | 180–420 | 335–355 | 402–420 |
| Medium | 700–1,200 | 962–1,013 | 1,164–1,200 |
| Long | 1,600–2,800 | 2,238–2,334 | 1,657–1,788 |
| Refusal handling | EN-S | EN-M | EN-L | ZH-S | ZH-M | ZH-L | Mean-6 |
| Scored as zero | 44.9 | 97.9 | 97.5 | 48.8 | 59.9 | 31.8 | 63.5 |
| Excluded | 72.4 | 97.9 | 97.5 | 48.8 | 59.9 | 31.8 | 68.1 |
| Group | Participants | Votes | Model pairs | Task–pairs | Coverage |
| Main systems | 11 | 1420 | 55/55 | 1045/3355 | 31.1% |
| Prompt strategies | 9 | 1533 | 36/36 | 848/2196 | 38.6% |
| Shared natural prompts | 10 | 576 | 45/45 | 539/2745 | 19.6% |
| Model | mIoU | Detected | Det. rate | Layout AUC | |
| GPT Image 2 | 0.1431 | 0.3042 | 271 | 0.4705 | 0.1554 |
| Nano Banana Pro | 0.1493 | 0.3296 | 261 | 0.4531 | 0.1628 |
| Qwen Image 3.0 Pro | 0.1694 | 0.3148 | 310 | 0.5382 | 0.1758 |
| Seedream 5.0 Pro | 0.1670 | 0.3273 | 294 | 0.5104 | 0.1794 |
| Ideogram 4.0 | 0.2433 | 0.4449 | 315 | 0.5469 | 0.2046 |
| MOSS-Image | 0.6788 | 0.8786 | 445 | 0.7726 | 0.7031 |
| Model | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] | [email protected] |
| GPT Image 2 | 0.4055 | 0.3337 | 0.2608 | 0.1749 | 0.1194 | 0.0662 | 0.0290 | 0.0089 | 0.0000 |
| Nano Banana Pro | 0.4018 | 0.3441 | 0.2727 | 0.2046 | 0.1287 | 0.0748 | 0.0320 | 0.0067 | 0.0000 |
| Qwen Image 3.0 Pro | 0.4647 | 0.3925 | 0.2980 | 0.2083 | 0.1339 | 0.0614 | 0.0216 | 0.0015 | 0.0000 |
| Seedream 5.0 Pro | 0.4803 | 0.3973 | 0.3114 | 0.2087 | 0.1194 | 0.0714 | 0.0246 | 0.0011 | 0.0000 |
| Ideogram 4.0 | 0.4301 | 0.3813 | 0.3311 | 0.2786 | 0.2161 | 0.1484 | 0.0487 | 0.0052 | 0.0015 |
| MOSS-Image | 0.7556 | 0.7511 | 0.7481 | 0.7336 | 0.7295 | 0.7284 | 0.7221 | 0.6942 | 0.4650 |