Can World Models Predict Rice Growth? Toward Agricultural World Models
Organizations: School of Computer Science and Technology, East China Normal University, Shanghai · Peking University
Abstract
World models can imagine how a physical scene evolves over the next few seconds, but growers need to know how a crop will develop over weeks to months: will this rice plant have headed a month from now, and how will it look at harvest? We introduce agricultural world modeling, the task of predicting how the same plant will look at a requested horizon of days to months, from one photo of it, its cultivar, and its camera view. In preliminary analysis, even state-of-the-art image generators get this wrong: they often grow the plant too little or give it the color and form of the wrong growth stage. We argue that they do not work out the plant's developmental state, which the photo reveals only indirectly. We therefore propose AgroWM, which reasons about development before it draws growth. Its reasoning module, PhenoClock, works out the current growth stage, predicts the future one, and writes a Growth Script with numeric targets for height, plant area, and color; its generation module, the Rooted Renderer, then edits the photo to follow this script, adding new organs and colors to the photographed plant. Because pixel scores can prefer an unchanged copy of the photo, we instead check each forecast's traits and developmental timing against the plant's own later photos. On rice, 54.6% of the forecasts of AgroWM are matched to the target stage (Stage R@1), against 34.8% for GPT Image 2.5, 24.0% for Qwen Image 2.1, and 47.4% for the strongest domain-specific baseline, the same backbone fine-tuned without Growth Scripts; 9 to 20 weeks ahead, it still reaches 46.4%, against 35.7% for that baseline. On maize, a crop with a different body plan and stage scale, the same design again scores best on all four measures.
Figures & tables
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Slot | View | Definition | Unit |
| Culm | F | plant height (bottom edge to top plant pixel) | % of image height |
| Leaves/area | F, T | all plant pixels / image pixels | % of image |
| Plant density | F | plant pixels / pixels of their convex hull | % |
| Canopy | T | plant pixels / pixels of their convex hull | % |
| Panicle | F, T | on or after the accession’s heading date | 0/1 |
| Color development | F, T | yellow and brown / plant pixels, HSV thresholds | % |
| Model / arm | Initialization and trainable components | Training data | Recipe |
| Rice Planner | Qwen3.8-27B; LoRA , ; all linear layers; vision tower and aligner frozen | 20,000 queries; global batch 16 | 2 epochs, 2,500 updates; LR , 3% warmup, cosine to ; grouped loss |
| Rice Simple Executor (Qwen Image 2.1 FT) | Original Qwen Image 2.1; full DiT; text and VAE encoders frozen; no Growth Script | 20,000 queries; global batch 16 | 2 epochs, 2,500 updates; peak LR ; 10% warmup, 60% stable, 30% cosine to |
| Rice CoT Executor (Rooted Renderer) | Original Qwen Image 2.1; full DiT; text and VAE encoders frozen; teacher Growth Scripts in training | 20,000 queries; global batch 16 | 2 epochs, 2,500 updates; peak LR ; 10% warmup, 60% stable, 30% cosine to ; 8 GPUs |
| Rice FLUX.2 Klein FT / LANCE FT | Corresponding pretrained image model; fine-tuned image-generation backbone; no Planner or Growth Script | 20,000 queries; global batch 16 | 2 epochs, 2,500 updates; LR ; 10% warmup, 60% stable, 30% cosine to ; 8 GPUs |
| Agricrafter | DynamiCrafter_512 initialization; UNet and image projector trained | 2,108 nine-observation windows from 178 rice training plants; global batch 4 | 6,000 updates; white letterbox canvas |
| Maize Planner | Qwen3.8-27B; LoRA , ; all linear layers; vision tower and aligner frozen | 6,400 queries; global batch 16 | 2 epochs, 800 updates; LR , 3% warmup, cosine to ; grouped loss |
| Dataset / method | Valid queries by score |
| Rice, most methods | : area, density, yellow errors; IoU, PSNR, SSIM; : height (front); : DINOv2, Stage R@1, Event R@1 |
| Rice, FLUX 3 | : height; : density and yellow |
| Maize, all methods | : DINOv2, Stage R@1, pixel scores |
| Maize, copy / GPT Image 2 | : area, culm-proxy height, density, yellow errors |
| Maize, Simple / AgroWM | each: area, culm-proxy height, density; : yellow error |
World Models
World models represent and predict how environments change, helping agents plan, act, and reason about possible futures.
See all 404 papers