cs.RONov 7, 2026

Tactile Sensors Are an Effective Substitute for Wrist Cameras in Contact-Rich or Occluded Manipulation

Authors: Aijia Yang, Arsh Tangri, Sergey Zakharov, Krishna Murthy Jatavallabhula

Organizations: Toyota Research Institute

Abstract

Learned manipulation policies often rely on wrist-mounted cameras for close-range visual feedback that complements external views of the workspace. However, contact-rich manipulation requires establishing and maintaining contacts that can remain hidden even from wrist cameras. Tactile sensors mounted on fingers can reliably and directly measure contact, without needing visual access. In this work, we show that this feedback enables policies to recover the performance advantage of wrist cameras using scene and egocentric vision together with touch. Our approach incorporates two low-cost tactile arrays into a visuotactile ACT policy, without wrist images during training or deployment. We evaluate six real-world task families spanning placement, insertion, occluded retrieval, and sustained-contact tool use. On three contact-rich tasks, we independently vary wrist-camera and tactile availability while keeping the demonstrations, policy architecture, and optimization settings fixed. Adding wrist cameras improves success by 18.3-28.3 percentage points over vision without wrist images. Adding tactile sensing instead improves success by 31.7-60.0 percentage points and yields higher observed success than vision-only policies with wrist cameras on all three tasks, with significant advantages on two under Holm-corrected tests. These results support finger-mounted tactile sensing as an effective alternative to wrist cameras in the evaluated contact-rich settings.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. FingerEye: Learning Dexterous Manipulation with Continuous Vision-Tactile Sensing

    Apr 22, 2026Zhixuan Xu, Yichen Li, Xuanye Wu +2Dexterous ManipulationRobotic Tactile Sensing

  2. Imagining the Sense of Touch: Touch-Informed Manipulation via Imagined Tactile Representations

    Jul 2, 2026Zhiyuan Zhang, Adeesh Desai, Jyun-Chi Hu +7Visual-to-Tactile PredictionContact-Rich Robotic Manipulation

  3. PredTac: Learning Contact-Rich Manipulation with Predicted Touch

    Sep 14, 2026Weijia Fan, Daqiang GuoVisual-to-Tactile PredictionTactile Sensing