Can Astra Solve RoboMME without Breaking the Bank?
Organizations: Stanford University
Abstract
Robotic manipulation often requires remembering information that is no longer visible, such as an object's location before occlusion or the order of a demonstrated action sequence. A large vision-language planner can read this history, but calling it before every action chunk is slow and costly. We present a three-tier system for the RoboMME benchmark. GPT-6 Astra (System 2) selects a grounded subtask from stored visual history, a vision-language-action policy (System 1) executes it, and a fine-tuned Qwen3-VL-4B monitor (System 1.5) checks after each action chunk whether the subtask is finished. The instruction is kept until the monitor reports completion or a task-specific event occurs, while the policy keeps acting on new observations. On RoboMME, the system succeeds in 79.13% of episodes with an average of 3.63 Astra calls and 80.84 seconds per episode. This is 34.62 points above the best published non-oracle baseline and 4.95 points below GroundSG+Oracle, which gives the low-level policy ground-truth subgoals.
Figures & tables
| Method | Counting | Permanence | Reference | Imitation | Overall |
|---|---|---|---|---|---|
| [ 1 ] | 28.78 | 17.00 | 17.16 | 8.78 | 17.93 |
| FrameSamp+Modul [ 3 ] | 65.22 | 25.11 | 36.33 | 51.39 | 44.51 |
| SAM2Act+ [ 4 ] | 35.33 | 26.00 | 16.83 | 7.33 | 21.37 |
| MemER [ 8 ] | 48.83 | 53.17 | 38.00 | 29.50 | 42.38 |
| GroundSG+QwenVL [ 3 ] | 38.00 | 39.34 | 31.56 | 21.89 | 32.70 |
| GroundSG+Gemini [ 3 ] | 12.75 | 15.75 | 11.25 | 6.50 | 11.56 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Suite | Task | Success | Fail | Timeout | Rate (%) |
|---|---|---|---|---|---|
| Counting | BinFill | 41 | 6 | 3 | 82.00 |
| StopCube | 9 | 41 | 0 | 18.00 | |
| PickXtimes | 48 | 1 | 1 | 96.00 | |
| SwingXtimes | 41 | 9 | 0 | 82.00 | |
| Permanence | ButtonUnmask | 50 | 0 | 0 | 100.00 |
| VideoUnmask | 46 | 1 | 3 | 92.00 |
Long-Horizon Robotic Manipulation
Long-horizon robotic manipulation studies how robots plan, remember, and recover across extended sequences of physical tasks.
See all 459 papers