FocusVLA: Future-Intent Guided Dynamic View Routing for Vision-Language-Action Models
Organizations: Nanjing Institute of Software Technology · Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences, Nanjing · Nanjing University of Posts and Telecommunications ·
Abstract
Vision-language-action (VLA) models have become an important paradigm for robotic manipulation by unifying visual perception, language understanding, and action generation. Since reliable manipulation requires sufficient observation of objects, end-effectors, and their spatial relationships, multi-view inputs are widely used to provide complementary spatial information. However, our experiments show that existing VLA models do not fully exploit such multi-view complementarity. The policy tends to persistently rely on the wrist view, lacking the ability to dynamically adjust global-local view dependency across manipulation stages, which limits stage adaptability and robustness. To address this issue, we propose FocusVLA, a stage-aware multi-view routing framework. FocusVLA predicts future interaction intent from historical actions and uses it to guide dynamic view routing during action generation. By adaptively coordinating global and local observations across different task stages, FocusVLA improves multi-view utilization. On RoboTwin 2.0, FocusVLA improves the average success rate over the strongest baseline by 10.10 pp. In real-world evaluation, FocusVLA improves the success rate from 71.7% to 85.0%, achieving a 13.3% gain over . Moreover, the intent prediction and dynamic routing modules of FocusVLA can be integrated into existing VLA frameworks without modifying their core architectures.
Figures & tables
| Model | Masking Mode | SR | SR |
| Baseline | No Mask | 85.0% | – |
| Baseline | Mask Global @Planning | 65.0% | -20.0 pp |
| Baseline | Mask Local @Planning | 20.0% | -65.0 pp |
| Short Horizon Tasks | |||||||||||
| Model | Click Alarmclock | Press Stapler | Turn Switch | Adjust Bottle | Grab Roller | Lift Pot | Scan Object | Rotate Qrcode | Place Object Scale | Click Bell | Avg. |
| RDT [ 28 ] | 61.0% | 41.0% | 35.0% | 81.0% | 74.0% | 72.0% | 4.0% | 50.0% | 1.0% | 80.0% | 49.90% |
| [ 6 ] | 63.0% | 62.0% | 27.0% | 90.0% | 96.0% | 84.0% | 18.0% | 68.0% | 10.0% | 44.0% | 56.20% |
| [ 18 ] | 28.0% | 85.0% | 46.0% | 100.0% | 100.0% | 95.0% | 35.0% | 82.0% | 56.0% | 4.0% | 63.10% |
| FocusVLA | 65.0% | 91.0% | 53.0% | 100.0% | 100.0% | 98.0% | 60.0% | 66.0% | 71.0% | 36.0% | 74.00% |
| Medium Horizon Tasks | |||||||||||
| Tasks (2 seeds each; 100 trials/task/seed): put_bottles_dustbin, place_phone_stand, move_can_pot, beat_block_hammer, place_shoe, open_laptop, move_pillbottle_pad, place_a2b_left, and handover_block. | |||
| Factor | Method | Control | SR [95% CI] (%) |
| Signal | Learned Static | Globally shared learned allocation; step-wise application | 67.5 [65.3, 69.6] |
| Signal | Reactive-Vision | Current-vision routing; step-wise application | 57.4 [55.1, 59.7] |
| Signal | Time + State | Time/state routing; step-wise application | 58.5 [56.2, 60.8] |
| Supervision | E2E Future | Action-loss-only routing | 55.7 [53.4, 58.0] |
| Intent Token | Routing Only | Intent-supervised routing without the chunk-level intent token | 63.3 [61.0, 65.5] |
| Tasks (100 trials/task): open_microwave, pick_diverse_bottles, stack_bowls_two, and pick_dual_bottles. | ||||
| Variant | Routing signal | Application | Token | SR [95% CI] (%) |
| Reactive-Vision | Current vision | Step-wise | Yes | 61.3 [56.4, 65.9] |
| Reactive ( ) | MM intent | Shared | Yes | 55.5 [50.6, 60.3] |
| Feature-side | MM intent | Pre-policy | Yes | 67.0 [62.2, 71.4] |
| BFA-style Labels | BFA-style | Step-wise | Yes | 72.0 [67.4, 76.2] |
| Reactive w/o Token | MM intent | Shared | No | 49.8 [44.9, 54.6] |
| Metric | BFA-style | Ours | Effect |
| Human F1 (%) | 65.1 | 82.9 | +17.8 |
| Intent F1/AUROC (%) | N/A | 78.4/91.2 | N/A |
| Thresh. SR (D/L/S) (%) | N/A | 78.0/75.5/74.0 | pp |
| Infer. SR (0/10/20%) (%) | N/A | 78.0/73.5/75.5 | pp |
Vision-Language-Action Models
Vision-language-action models turn visual observations and natural-language instructions into actions for robots and other embodied agents.
See all 1,186 papers