Vision-Based Tactile Sensing

Overview

Vision-based tactile sensors image soft surfaces as they deform, letting robots estimate contact shape, force, slip, texture, and material properties. Methods include marker tracking and photometric reconstruction, learned models for tactile images and time sequences, and physics-based simulation or synthetic data generation. These signals support tasks such as grasping, insertion, cloth handling, palpation, and contact-rich control, with growing work on compact sensors and low-latency processing. A central challenge is reliable transfer across sensor designs and real-world conditions: calibration, sensor variation, wear, and limited labeled data can still reduce performance.

Latest papers

CardsList

71 papers6 papers in the last four weeks, down 40% on the four weeks before. 0.0% of all new papers.

  1. TactiVerse: Generalizing Multi-Point Tactile Sensing in Soft Robotics Using Single-Point Data

    Feb 23, 2026Junhui Lee, Hyosung Kim, Saekwang NamTactile SensingSoft Robotics

  2. MultiDiffSense: Diffusion-Based Multi-Modal Visuo-Tactile Image Generation Conditioned on Object Shape and Contact Pose

    Feb 22, 2026Sirine Bhouri, Lan Wei, Jian-Qing Zheng +1Synthetic Data Generation for RoboticsMultimodal Diffusion Models

  3. FruitTouch: A Perceptive Gripper for Gentle and Scalable Fruit Harvesting

    Feb 22, 2026Ruohan Zhang, Mohammad Amin Mirzaee, Wenzhen YuanRobotic GraspingRobotic Hand Design

  4. Soft Surfaced Vision-Based Tactile Sensing for Bipedal Robot Applications

    Feb 20, 2026Jaeeun Kim, Junhee Lim, Yu SheBipedal LocomotionRobotic Tactile Sensing

  5. Highly Deformable Proprioceptive Membrane for Real-Time 3D Shape Reconstruction

    Jan 20, 2026Guanyu Xu, Jiaqi Wang, Dezhong Tong +1Vision-Based Tactile SensingTactile Sensing

  6. External Photoreflective Tactile Sensing Based on Surface Deformation Measurement

    Nov 9, 2025Seiichi Yamamoto, Hiroki Ishizuka, Takumi Kawasetsu +6Vision-Based Tactile SensingTactile Sensing

  7. 3D Cal: An Open-Source Software Library for Depth Reconstruction on Vision-Based Tactile Sensors

    Nov 4, 2025Rohan Kota, Kaival Shah, J. Edward Colgate +1Vision-Based Tactile SensingTactile Sensing

  8. Vision-Based Tactile Sensing for the Perception of the Object's Compliance and Hardness

    Oct 14, 2025Muxing Huang, Zibin Chen, Weiliang Xu +5Vision-Based Tactile SensingTactile Sensing

  9. Tactile MNIST: Benchmarking Active Tactile Perception

    Jun 3, 2025Tim Schneider, Guillaume Duret, Cristiana de Farias +3Dynamic Tactile PerceptionTactile Sensing

  10. ControlTac: Scaling Tactile Data with Physically Controlled Tactile Image Generation

    May 26, 2025Dongyu Luo, Kelin Yu, Amir-Hossein Shahidzadeh +3Vision-Based Tactile SensingSynthetic Data Generation for Robotics

  11. Investigating Active Sampling for Hardness Classification with Vision-Based Tactile Sensors

    May 19, 2025Junyi Chen, Frederik Heller, Mario Gómez Andreu +7Active LearningRobotic Tactile Sensing