Vision-Language-Action (VLA) models are effective at understanding what task to perform, but provide limited control over how it should be executed, such as moving quickly or slowly. We introduce TempoBridge, a lightweight framework that uses frozen VLA representations to modulate actions according to tempo cues in the instruction at each task phase, without additional tempo-conditioned robot demonstrations or tempo-specific base-policy fine-tuning. TempoBridge extracts tempo cues from contextual VLM representations, aligns them with task progress through a causal phase router, and modulates nominal motion commands during execution. Across LIBERO tasks, TempoBridge improves Tempo Success Rate from 52.6% to 89.7% under canonical tempo instructions while retaining high task success. It also preserves near-baseline performance when no tempo cue is present and generalizes to unseen tempo expressions without additional training. Experiments on a physical robot further demonstrate language-conditioned tempo modulation in real-world manipulation.
Figures & tables
Fig. 2: Overview of TempoBridge. Using the frozen VLM backbone within π0.5 , a prototype-based tempo readout extracts an ordered tempo sequence from the instruction once and caches it for execution. At each replan, a causal phase router uses visual features reused from the policy forward pass and robot state to track task progress and select the active event. The corresponding tempo coefficient scales the translational components of the nominal action chunk.
Method
Spatial
Object
Goal
Long
Overall
Task Success Rate ↑
Tempo Success Rate ↑
Task Success Rate ↑
Tempo Success Rate ↑
Task Success Rate ↑
Tempo Success Rate ↑
Task Success Rate ↑
Tempo Success Rate ↑
Task Success Rate ↑
Tempo Success Rate ↑
Task & Tempo Success Rate ↑
π0.5
94.0
48.9
96.0
49.5
93.0
57.8
91.5
54.4
93.6
52.6
48.8
TempoBridge
94.5
91.0
97.5
90.8
92.5
93.8
87.0
82.9
92.9
89.7
82.0
TABLE I: Task, tempo, and task & tempo success rates (%) under quickly / slowly instructions.
Fig. 3: Qualitative examples of TempoBridge execution on LIBERO. The left two panels use quickly / slowly cues, while the right three use tempo expressions unseen during readout construction. Each panel shows the instruction and executed TCP trajectory, colored by measured TCP speed from slower motion (blue) to faster motion (red).
Method
Spatial
Object
Goal
Long
Overall
π0.5
95.0
97.0
95.0
93.0
95.0
TempoBridge
98.0
96.0
95.0
88.0
94.3
TABLE II: Task success rates (%) on LIBERO benchmark instructions without tempo cues.
Method
Spatial
Object
Goal
Long
Overall
Task Success Rate ↑
Tempo Success Rate ↑
Task Success Rate ↑
Tempo Success Rate ↑
Task Success Rate ↑
Tempo Success Rate ↑
Task Success Rate ↑
Tempo Success Rate ↑
Task Success Rate ↑
Tempo Success Rate ↑
Task & Tempo Success Rate ↑
π0.5
95.6
50.3
99.3
49.5
96.1
61.2
89.5
53.1
95.1
53.5
50.6
TempoBridge
94.8
79.7
96.1
75.2
93.8
91.0
84.8
74.2
92.3
80.1
72.9
TABLE III: Task, tempo, and task & tempo success rates (%) for tempo expressions unseen during readout construction.
Tempo expression
Target tempo
Accuracy ↑
rapidly
FAST
98.3
swiftly
FAST
98.3
carefully
SLOW
57.9
at a slower pace
SLOW
95.0
TABLE IV: Cue-specific tempo recognition accuracy (%) for expressions unseen during readout construction.
Setting
Readout Acc. ↑
Balanced Phase Agreement ↑
Median Speed Ratio
Canonical
97.5%
89.7%
1.58 ×
Unseen
78.4%
90.4%
1.52 ×
TABLE V: Component-wise diagnostics of TempoBridge under canonical and unseen tempo expressions.
Fig. 4: Real-world experimental setup with an xArm6 robot, external and wrist-mounted Azure Kinect cameras, and the three manipulation task configurations.
Fig. 5: Real-world TCP speed under Fast → Slow (FS) and Slow → Fast (SF) instructions. Columns correspond to the three tasks, with the task-adapted π0.5 baseline in the top row and TempoBridge in the bottom row. Thin lines represent individual task-successful rollouts, connecting the mean TCP speeds of Event 1 and Event 2. Bold lines indicate the median, and error bars show the interquartile range over 10 successful rollouts per condition.