Agent-R: Scaling Agents for Realistic Productivity Work via Real-Source Data Synthesis
Organizations: Zhejiang University · Baidu Inc.
Abstract
Large language models have made rapid progress in agentic reasoning and tool use, raising expectations for agents that can take over realistic productivity work from humans. However, current agents still struggle to finish such tasks, where success requires following long-horizon professional workflows, understanding heterogeneous file contexts, and producing usable deliverables under fine-grained requirements. A key bottleneck is the lack of scalable post-training data that reflects real work intent, authentic file environments, and deliverable-level evaluation. To close this gap, we introduce Agent-R, a eal-source data synthesis framework that scales training data for ealistic productivity work. Instead of relying on manually specified workflows or LLM-generated files, Agent-R grounds synthesis throughout the pipeline in real occupational seeds, corpus-derived workflow evidence, and authentic web-sourced files. From 10k web-corpus candidates, Agent-R distills 4k task instances that pair real multi-format attachments with fine-grained, deliverable-level rubrics. On this data, we train Agent-R-4B via supervised fine-tuning and rubric-based reinforcement learning, improving both end-to-end productivity performance and file-grounded reasoning. Trained on only 4k instances, Agent-R-4B surpasses Qwen3-235B-A22B-Thinking-2507 on both GDPval (51.0 vs. 48.0) and OfficeQA (14.8 vs. 13.8). Further analysis shows that Agent-R mitigates shortcut behavior, where agents produce superficially plausible deliverables before sufficiently grounding, constructing, or verifying them, while promoting sustained exploration.
Figures & tables
| Model | Office | Non-Office | Full | |||
|---|---|---|---|---|---|---|
| Pass@1 | Pass@3 | Pass@1 | Pass@3 | Pass@1 | Pass@3 | |
| Closed-Source Models | ||||||
| GPT-4.1 ( OpenAI 2025b ) | 38.0 | 51.5 | 44.9 | 55.5 | 39.4 | 52.3 |
| Gemini-2.5-Pro ( Comanici et al. 2025 ) | 57.0 | 59.4 | 61.4 | 63.3 | 57.9 | 60.2 |
| Claude-Opus-4.5 ( Anthropic 2025 ) | 73.8 | 77.4 | 68.2 | 72.3 | 72.6 | 76.3 |
| Open-Source Models | ||||||
| Model | Pass@1 | Pass@3 |
| Qwen3-4B-Thinking-2507 | 2.2 | 4.5 |
| Qwen3-30B-A3B-Thinking-2507 | 2.9 | 5.7 |
| Qwen3-235B-A22B-Thinking-2507 | 13.8 | 25.6 |
| Agent-R 2 -4B-SFT | 11.4 | 21.7 |
| Agent-R 2 -4B | 14.8 | 26.8 |
| Metric (%) | Base | SFT | RL |
|---|---|---|---|
| Re-checking the deliverable | 0.5 | 91.7 | 95.8 |
| Writing despite an unfixed error | 55.0 | 16.0 | 11.0 |
| Numerical-error fix rate | 60.7 | 79.6 | 85.7 |
| Deliverables with placeholder text | 12.5 | 9.6 | 5.7 |
| Traceable numbers in deliverables | 31.2 | 34.6 | 38.8 |
| Ablation | Method | Pass@1 |
|---|---|---|
| Data grounding | w/ synthetic files | 41.4 |
| w/ real files | 43.3 | |
| Reward design | w/o rubrics | 49.5 |
| w/ rubrics | 51.0 |
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
| Solver model | Auxiliary vision model |
|---|---|
| DeepSeek-v3.1 | DeepSeek-v4-Flash |
| Qwen3-30B-A3B-Thinking-2507 | Qwen3-VL-30B-A3B-Thinking |
| Qwen3-235B-A22B-Thinking-2507 | Qwen3-VL-235B-A22B-Thinking |
| Qwen3-4B-Thinking-2507 | Qwen3-VL-4B-Thinking |
| Agent-R 2 -4B-SFT | Qwen3-VL-4B-Thinking |
| Agent-R 2 -4B | Qwen3-VL-4B-Thinking |
| Hyperparameter | Value |
|---|---|
| batch_size | 16 |
| max_response_length | 65,536 |
| group_size | 4 |
| max_assistant_turns | 40 |
| max_tool_response_length | 4,096 |
| training_temperature | 1.0 |
| Model | Gemini-3.1-Pro | DeepSeek-v4-Flash |
|---|---|---|
| Qwen3-235B-A22B | 47.7–48.2 | 49.2–49.9 |
| Agent-R 2 -4B | 50.8–51.1 | 51.7–52.3 |
| SFT data | Held-out score | Win rate | GDPval Pass@1 |
|---|---|---|---|
| 0 (base) | 0.254 | – | 32.4 |
| 1k | 0.486 | 64% | 43.3 |
| 2k | 0.507 | 67% | 44.9 |
| 4k | 0.617 | 73% | 45.5 |
| Model | Training data | GDPval Pass@1 |
|---|---|---|
| Qwen3-4B-Thinking-2507 | – | 32.4 |
| Agent-R 2 -4B-SFT | 3k SFT | 45.3 |
| 4k-SFT control | 4k SFT | 45.5 |
| Agent-R 2 -4B | 3k SFT + 1k RL | 51.0 |
| Effective steps per task | SFT | RL |
|---|---|---|
| Computation | 11.9 | 7.3 |
| Attachment reading | 3.4 | 3.4 |
| Deliverable writing | 2.3 | 2.7 |
| Build phase (all step types) | 4.9 | 5.5 |
| Share of reading, writing, and checking | 40% | 48% |
LLM Agent Training
Large language model agent training teaches models to plan, use tools, and learn from multi-step interaction with environments.
See all 604 papers