VT-Bridge: Bridging Pretrained Foundation VLAs to VTLAs via Lightweight Residual Adaptation
Authors: Yansong Wu, Tuo Yang, Rongping Zhao, Lingyun Chen, Xiao Chen, Junnan Li, Fan Wu, Alois Knoll
Organizations: Technical University of Munich, Germany · Mohamed Bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE · Shanghai University, China
Vision-Tactile-Language-Action (VTLA) models have demonstrated clear advantages over Vision-Language-Action (VLA) models in contact-rich manipulation. However, developing VTLA models is severely constrained by the massive amounts of vision-tactile data and computational resources required. To address this bottleneck, we propose VT-Bridge, a lightweight residual adaptation strategy that bridges pretrained foundation VLAs to VTLAs. Rather than training a VTLA model from scratch or modifying the original architecture of a pretrained VLA, VT-Bridge employs an identical lightweight residual-adapter architecture across VLA backbones and uses backbone-specific weights to refine actions at the robot execution frequency. This design substantially lowers the data and training barriers. Specifically, it requires up to 50 vision-tactile demonstrations per task to fine-tune a VLA backbone and train a 0.98M-parameter residual adapter. Experiments with three representative VLA backbones (π0, π0.5, and SmolVLA) across four contact-rich manipulation tasks further demonstrate its consistent effectiveness across VLA architectures. On average, VT-Bridge raises the task completion rate from 11.7% with task-level VLA fine-tuning alone to 62.9%. Together, these findings demonstrate the broad applicability, effectiveness, and accessibility of VT-Bridge for contact-rich manipulation. The project page is available at https://hoxnocha.github.io/vt-bridge-web/.
Figures & tables
Fig. 1 : Representative multimodal fusion strategies in existing VTLA models. To our knowledge, only VT-Bridge (ours) retains pretrained VLA backbones without architectural modification while enabling high-frequency tactile adaptation.
Fig. 2 : Temporal scheduling of the VLA backbone, residual adapter, and robot executor.
Fig. 3 : Overview of contact-rich manipulation tasks, showing representative initial states and examples satisfying the loose and strict success criteria.
Setting
Value
Demonstration sampling rate
30Hz
Execution frequency
30Hz
Joint stiffness matrix
diag(300,300,300,200,100,60,30)
Force-history window n
50
Action-chunk horizon H
50
VLA fine-tuning steps
30,000
TABLE I : Configuration Details
Task
Strict Criterion
Loose Criterion
Pump Bottle
Full press
Press only
Clean Whiteboard
Complete cleaning
>80 % area cleaned
Insert Plug
Full insertion
>80 % insertion depth
Flip Rocker Switch
Switch triggered
Contact only
TABLE II : Success Criteria
Backbone
Method
Pump Bottle
Clean Whiteboard
Insert Plug
Flip Rocker Switch
Average
π0 [ 4 ]
Fine-tuned [ 16 ]
0.0 (0/20)
5.0 (1/20)
0.0 (0/20)
20.0 (4/20)
6.3
VLA-Touch [ 1 ]
0.0 (0/20)
5.0 (1/20)
0.0 (0/20)
50.0 (10/20)
13.8
VT-Bridge (ours)
85.0 (17/20)
20.0 (4/20)
70.0 (14/20)
85.0 (17/20)
65.0
π0.5 [ 3 ]
Fine-tuned [ 16 ]
0.0 (0/20)
35.0 (7/20)
0.0 (0/20)
55.0 (11/20)
22.5
VLA-Touch [ 1 ]
0.0 (0/20)
20.0 (4/20)
5.0 (1/20)
55.0 (11/20)
20.0
VT-Bridge (ours)
90.0 (18/20)
40.0 (8/20)
70.0 (14/20)
75.0 (15/20)
68.8
TABLE III : Strict Success Rate (%)
Backbone
Method
Pump Bottle
Clean Whiteboard
Insert Plug
Flip Rocker Switch
Average
π0 [ 4 ]
Fine-tuned [ 16 ]
0.0 (0/19)
5.3 (1/19)
0.0 (0/13)
23.5 (4/17)
7.2
VLA-Touch [ 1 ]
0.0 (0/5)
5.9 (1/17)
0.0 (0/16)
66.7 (10/15)
18.1
VT-Bridge (ours)
89.5 (17/19)
20.0 (4/20)
93.3 (14/15)
100.0 (17/17)
75.7
π0.5 [ 3 ]
Fine-tuned [ 16 ]
0.0 (0/20)
35.0 (7/20)
0.0 (0/16)
100.0 (11/11)
33.8
VLA-Touch [ 1 ]
0.0 (0/10)
20.0 (4/20)
6.3 (1/16)
84.6 (11/13)
27.7
VT-Bridge (ours)
94.7 (18/19)
40.0 (8/20)
77.8 (14/18)
100.0 (15/15)
78.1
TABLE IV : Conditional Completion Rate ρsl (%)
Fig. 4 : Average strict success rates across VLA backbones and real-world contact-rich manipulation tasks.
Fig. 5 : Interaction profiles along the z -axis for the Pump Bottle task.
Fig. 6 : Ablation of residual target construction. Strict success rates obtained using desired-pose (ours) and executed-pose (ablation) to construct the residual dataset.
Contact-rich robotic manipulation studies how robots plan and control physical interactions such as grasping, insertion, pushing, and dexterous object handling.