cs.RONov 18, 2026

TapTacTouch: Shape Completion from Sparse Tactile Contacts with Geometric Priors

Authors: Yoobin Shin, Jaeyoung Lee, Jieun Kang, Hyun Song, Woojin Kim, Andrew Jaeyong Choi

Organizations: School of Computing, iRASC Lab., Gachon University · Department of Electronic Engineering, Namseoul University

Abstract

3D object reconstruction is essential for robotic perception and manipulation, yet conventional approaches predominantly rely on visual observations that can be limited by occlusion or unavailable in visually constrained environments. In this work, we propose a vision-free, training-free, and category-agnostic framework for reconstructing 3D object meshes from sparse tactile contacts without relying on pretrained shape models. A 6-DoF robotic arm equipped with a 20-DoF multi-finger robotic hand collects tactile observations using 3x3 pressure sensor arrays mounted on the finger pads. The acquired tactile measurements are transformed into 3D contact constraints through robot kinematics and integrated into a multi-scale Gaussian Process Implicit Surface (GPIS). To address sparse and incomplete surface observations, the proposed method incorporates contact confidence weighting, weak pseudo-surface constraints, and an observation-driven geometric prior to preserve local surface geometry and provide structural guidance in unobserved regions. Real-world experiments on six objects achieve a Chamfer Distance (CD) of 1.610, an Earth Mover's Distance (EMD) of 7.738, and an F-Score of 95.00, with reconstruction completed in an average of 49.99 s per object. These results demonstrate that sparse tactile sensing can provide sufficient geometric information for continuous 3D object reconstruction without visual or semantic information.

Figures & tables

Explore similar work

CardsList
  1. TouchAnything: Diffusion-Guided 3D Reconstruction from Sparse Robot Touches

    Apr 10, 2026Langzhe Gu, Hung-Jui Huang, Mohamad Qadri +23D ReconstructionRobotic Tactile Sensing

  2. VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds

    Aug 21, 2026Shania Guo, Yeongsik Seo, Andrew Fu +73D Reconstruction Benchmarks3D Reconstruction