Vision-Based Tactile Sensing

Overview

Vision-based tactile sensors image soft surfaces as they deform, letting robots estimate contact shape, force, slip, texture, and material properties. Methods include marker tracking and photometric reconstruction, learned models for tactile images and time sequences, and physics-based simulation or synthetic data generation. These signals support tasks such as grasping, insertion, cloth handling, palpation, and contact-rich control, with growing work on compact sensors and low-latency processing. A central challenge is reliable transfer across sensor designs and real-world conditions: calibration, sensor variation, wear, and limited labeled data can still reduce performance.

Latest papers

CardsList

71 papers6 papers in the last four weeks, down 40% on the four weeks before. 0.0% of all new papers.

  1. Where to Generate Touch: Do Image Latents Preserve Material Recognition?

    Nov 11, 2026Wanghao Ye, Aarosh Das, Sihan Chen +26Visual-to-Tactile PredictionVision-Based Tactile Sensing

  2. Mechanical Interaction Sensing for Robotic Kiwifruit Handling with an Optoelectronic Soft Suction Cup

    Nov 6, 2026Romina Adhami, Ebrahim Shahabi, Alessio Mondini +4Vision-Based Tactile SensingContact Force Estimation

  3. Which Physical Tactile Cues Matter for Contact-Rich Imitation Learning? A Controlled Real-Robot Study

    Nov 4, 2026Xuhao Qin, Xiyan Huang, Haoyu Dong +2Vision-Based Tactile SensingContact-Rich Robotic Manipulation

  4. LumiTac: Compact, High-Rate Six-Axis Optical Tactile Sensing for Human-Robot Interaction

    Nov 4, 2026Hao Wu, Haotian Guo, Yu Feng +2Vision-Based Tactile SensingTactile Sensing

  5. GelSlim 5.0: Unifying Vision and Touch with a Single Fingertip Camera

    Oct 22, 2026Xiangdong Wang, I-Hsuan Huang, Xiaohao Xu +3Tactile Sensing for Robotic ManipulationMultimodal Sensor Fusion

  6. GPT-6 Astra Is a Native Visuo-Tactile Policy for Contact-Rich Manipulation

    Oct 19, 2026Chen Yang, Linzhe Shi, Hang Zhang +3Robotic ManipulationContact-Rich Robotic Manipulation

  7. Ego2Contact: Predicting Touch from Egocentric Human Video for Contact-Rich Robot Manipulation

    Oct 16, 2026Qianqian Yang, Dayou Li, Bangya Liu +11Visual-to-Tactile PredictionVision-Based Tactile Sensing

  8. DeTac: Dual-branch Decoupling of Texture and Force Signals in Vision-Based Tactile Sensors

    Oct 12, 2026Zhirui Zhang, Yunkai Tang, Jiahang Li +6Vision-Based Tactile SensingRepresentation Disentanglement

  9. A Minimal Optical-Flow Representation for Vision-Based Tactile Rotation Classification in Robotic Manipulation Across Gravity Domains

    Oct 8, 2026Oscar Martinez-Bernal, Mario Cavero-Vidal, Francesco Grella +1Tactile Sensing for Robotic ManipulationVision-Based Tactile Sensing

  10. Tactile Reconstruction of Contact Task Frames and Forces for Hybrid Force/Motion Control

    Oct 7, 2026Antonio Rapuano, Simone Orelli, Barbara Bazzana +2Contact Force EstimationForce-Controlled Robotic Manipulation

  11. Fluorescence-enhanced Whisker Array with Vision-based Deformation Analysis for Underwater Source Localization

    Oct 5, 2026Xiaochi Xie, Hao Li, Shixuan Zhao +3Vision-Based Tactile Sensing

  12. GlowTact: Simple and Compact Vision-Based Tactile Sensing with High Sensitivity and Spatial Resolution

    Sep 26, 2026Yuxiang Ma, Megha Tippur, Pengfei Ye +4Vision-Based Tactile SensingTactile Sensing

  13. TACTIC: Understanding Tactile Encoders and Conditioning for Contact-rich Robot Manipulation Policies

    Sep 25, 2026Seongjin Bien, Débora Oliveira Makowski, Carlo Kneissl +6Visuo-Tactile Representation LearningVision-Based Tactile Sensing

  14. Calibration-Free Surface Normals Estimation in Vision-Based Tactile Sensing using Universal Photometric Stereo

    Sep 23, 2026Zdravko Dugonjic, Stefanie Speidel, Roberto CalandraSurface Normal EstimationVision-Based Tactile Sensing

  15. Norm2Tex: Augmenting Visuo-Tactile Simulations with Texture

    Sep 21, 2026Seongjin Bien, Débora Oliveira Makowski, Roberto Calandra +2Vision-Based Tactile SensingTactile Sensing

  16. LUMO: Designing Luminous Contact Morphology for Repeatable Whole-Finger Contact Observation

    Sep 16, 2026Dong Ho Kang, Youngsu Ko, Luis SentisVision-Based Tactile SensingTactile Sensing

  17. Language-Guided Representation Learning for Robust Cross-Sensor Material Recognition

    Sep 13, 2026Mashood M. Mohsan, Muhayy Ud Din, Binzhao Xu +2Vision-Based Tactile SensingTactile Sensing

  18. BIDETA: Brain-Inspired Data-Efficient Tactile Adaptation for Unseen Sensors

    Sep 8, 2026Boheng Liu, Lan Wei, Ziyu Li +4Vision-Based Tactile SensingFew-Shot Domain Adaptation

  19. Anomaly Detection on Small Industrial Components via Vision-Based Tactile Sensing

    Aug 31, 2026G. F. Preziosa, M. Casiglia, M. Faroni +2Vision-Based Tactile SensingIndustrial Anomaly Detection

  20. SpectraTac: A Compact Camera-Free Optical Tactile Sensor with Distributed Color Sensing

    Aug 31, 2026Hao Wu, Haotian Guo, Yu Feng +3Vision-Based Tactile SensingTactile Sensing

  21. VISTA: Visually Inferred Spatial ConTact Attention for Contact-Rich Manipulation

    Aug 26, 2026Jiayi Chen, Wenlong Dong, Yan Huang +5Contact-Rich Robotic ManipulationVisuomotor Policy Learning

  22. A Durable Vision-Based Tactile Fingertip for Robotic Manipulation

    Aug 25, 2026F. Richard Cottrell, Megha H. Tippur, Edward H. AdelsonTactile SensingRobotic Tactile Sensing

  23. Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor

    Aug 25, 2026Ziyang Ma, Yuhao Sun, Zichen Ai +2Tactile Image RecognitionTactile Sensing for Robotic Manipulation

  24. Zero-Shot Transfer of Force Map Estimation Across GelSight Mini Sensors

    Aug 18, 2026Julio Castaño Amoros, Pablo GilTactile SensingVision-Based Tactile Sensing

  25. Vision-Based Tactile Intelligence for Robotics: Sensing, Learning, and Embodied Manipulation

    Aug 16, 2026Peng Zhou, Jun Hu, Sihan Chen +12Tactile SimulationVision-Based Tactile Sensing

  26. MISTac: A Vision-Based Tactile Sensor for Minimally Invasive Surgery

    Aug 14, 2026Robin Koch, Annabella Mascot, Rayan Younis +5Tactile SensingVision-Based Tactile Sensing