cs.ROOct 20, 2026

GPT-6-Astra Understands Touch and Outperform Vision--Tactile--Language--Action Models

Authors: Ziyong Wang, Yupei Lin, Runxuan Huang, Liang Lin, Dongyu Zhang, Guangrun Wang

Organizations: Sun Yat-sen University · X-Era AI Lab · The Hong Kong Polytechnic University

Abstract

General-purpose multimodal models have shown promise as direct robot action policies, yet whether they grasp the physics underlying real-world interactions and can apply that understanding to guide action remains underexplored. We investigate this question using contact-rich manipulation as a representative testbed, examining tactile understanding as a concrete instance of this broader capability. Contact-rich manipulation requires interpreting tactile feedback and adjusting actions after obstruction. Existing learned tactile policies acquire these capabilities through specialized pretraining and per-task optimization, with substantial data and training costs. We present GPT-as-Tactile-Policy, which summarizes expert demonstrations into task guidance and tactile references for contact assessment and corrective action. GPT-6-Astra combines this context with multimodal observations and interaction history to generate control commands and adjust actions through contact feedback. Without additional robotics-specific pretraining or per-task policy fine-tuning, our method achieves 93.8% mean success across five UniVTAC tasks. Overall performance is comparable to state-of-the-art policies, with higher success on selected tasks. On Insert Hole, tactile feedback improves success from 31% to 99%. Execution analysis further demonstrates contact-guided probing and correction, supporting manipulation progress through explicit expert experience and online feedback.

Figures & tables

Explore similar work

CardsList
  1. GPT-6 Astra Is a Native Visuo-Tactile Policy for Contact-Rich Manipulation

    Oct 19, 2026Chen Yang, Linzhe Shi, Hang Zhang +3Robotic ManipulationContact-Rich Robotic Manipulation

  2. SimpleTouch: Can Vision-Language-Action Models Master Contact-Rich Manipulation Without Tactile Policy Pretraining?

    Oct 2, 2026Chen Yang, Linzhe Shi, Changjie Wu +7Tactile-Vision-Language-Action ModelsContact-Rich Robotic Manipulation

  3. PredTac: Learning Contact-Rich Manipulation with Predicted Touch

    Sep 14, 2026Weijia Fan, Daqiang GuoVisual-to-Tactile PredictionTactile Sensing