Pixel is All You Need
Organizations: Shanghai Jiao Tong University · Shanghai Innovation Institute
Abstract
Text, images, audio, touch, and even robot actions can, in principle, all be rendered onto a single canvas, suggesting an ambitious goal of unifying all modalities within vision. Language provides the natural first test. To subsume it, a visual model must reason directly over text in pixels. Across a wide range of image, video, and unified multimodal generators, however, we find that their visual generation modules cannot perform symbolic reasoning over text on the canvas. They succeed only when an underlying text module or prompt rewriter already supplies the answer, effectively reducing the generator to a mere renderer, a limitation that post-training does little to resolve. To test whether this failure stems from pixels themselves or from current training paradigms, we train a family of purely pixel-space generative models from scratch without any text pathway. With images as their sole input and output, these models read questions, write intermediate steps, and produce answers directly on the canvas. Remarkably, they exhibit hallmark behaviors of large language models. Performance improves predictably with scale following a power law. Writing intermediate steps frame by frame substantially outperforms single-frame answering, echoing chain-of-thought, while reinforcement-learning post-training further strengthens reasoning. Moreover, sharing one canvas allows the same model to reason across modalities, a capability that text-only language models lack. To the best of our knowledge, this is the first systematic study of these phenomena in purely pixel-space generative models free of text tokens.
Figures & tables
| Model | Default | Rewrite | Delete | Render | Think |
| Image editing models | |||||
| GPT-Image-2.5 | – | 98.0 | – | – | – |
| Gemini-3-Pro-Image | – | 94.1 | – | – | – |
| Nano-Banana-2.1 | – | 92.0 | – | – | – |
| Qwen-Image-2.0-Pro | 0.0 | 91.7 | – | – | – |
| Qwen-Image-2.1 | 0.0 | 86.0 | 0.0 | – | – |
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| System, condition | Factual (paraphrase) | Factual (unseen) | Arithmetic | Instruction | Context | Visual | Copy |
| Image editing models, Rewrite (Default is 0 on every set for all six models) | |||||||
| FLUX.2-klein, official prompt upsampler | 57 | 57 | 73 | 53 | 45 | 60 | 43 |
| FLUX.3-klein, official prompt upsampler | 92 | 90 | 78 | 63 | 77 | 87 | 97 |
| Qwen-Image-2.1, API rewrite | 95 | 90 | 92 | 92 | 95 | 95 | 43 |
| LongCat-Image-Edit, upsampler-style rewrite | 37 | 45 | 25 | 5 | 17 | 12 | 2 |
| Qwen-Image-2.0-Pro, its own rewriting | 100 | – | 90 | 100 | 100 | 100 | 60 |
| Video generation model | Default, final frame | Default, any of 8 frames | Rewrite | Delete |
| Wan2.2 | 0 | 0 | 0.7 | 0 |
| OmniWeaving | 0 | 0.2 | 24.0 (any frame: 28.8) | 0 |
| Cosmos3 | 0 | 0 | 13.6 (any frame: 17.4) | 0 |
| MiniMax-H3 | 1.4 | 1.4 | 98.3 | 0 |
| Wan 3.0 | 0 | 1.7 | 83.3 | – |
| System (official interface) | Rewriter | All tasks | Copy | Instruction | Context | Visual | Arithmetic | Factual |
| Qwen-Image-2.0-Pro (image editing) | off | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| on | 91.7 | 60 | 100 | 100 | 100 | 90 | 100 | |
| Wan2.6-Image (image editing) | off | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| on | 81.7 | 30 | 90 | 80 | 100 | 90 | 100 | |
| Wan 3.0 (video generation, final frame) | off | 0 (any frame: 1.7) | 0 | 0 | 0 | 0 | 0 | 0 |
| on | 83.3 (any frame: 91.7) | 90 | 80 | 90 | 80 | 70 | 90 |
| Task, set | FLUX.2-klein | FLUX.3-klein | Qwen-Image-2.1 | LongCat-Image-Edit |
| Copy, new strings | 79.5 | 92.5 | 91.5 | 81.0 |
| Instruction, new words / new rule | 10.0 / 0 | 81.7 / 0 | 11.7 / 0 | 10.0 / 0 |
| Instruction, training items | 0 | 83.0 | 0 | 0 |
| Context, new names | 8.0 | 28.5 | 9.0 | 0.5 |
| Context, training items | 8.0 | 32.0 | 5.0 | 0 |
| Visual, new scenes | 6.5 | 7.0 | 3.5 | 8.0 |
| Size | XS | S | M | B | L |
| Width / depth / heads | 256 / 6 / 4 | 384 / 12 / 6 | 512 / 12 / 8 | 768 / 12 / 12 | 1024 / 24 / 16 |
| Parameters | 7.6M | 33M | 58M | 130M | 458M |
| Curve | Fit on 7.6M to 130M | Log RMSE | 458M predicted (90% interval) | 458M measured (90% interval) | Relative error (90% interval) | Fit on all five sizes |
| Text tasks | 49.6 N 0.360 | 0.056 | 0.0381 (0.0337–0.0443) | 0.0374 (0.0271–0.0442) | 2% ( 26% to +23%) | 52.6 N 0.363 (0.050) |
| Curve Tracing , joint model | 111 N 0.340 | 0.052 | 0.1259 (0.1126–0.1335) | 0.1359 (0.1234–0.1559) | +8% ( 4% to +24%) | 84.0 N 0.324 (0.051) |
Generative Modeling
Generative modeling learns data distributions to create new samples, from images and text to molecules, simulations, and structured records.
See all 542 papers