Sound of Touch: Active Acoustic Tactile Sensing via String Vibrations
Organizations: University of Michigan · MIT
Abstract
Distributed tactile sensing remains difficult to scale over large areas: dense sensor arrays increase wiring, cost, and fragility, while many alternatives provide limited coverage or miss fast interaction dynamics. We present Sound of Touch, an active acoustic tactile-sensing methodology that uses vibrating tensioned strings as sensing elements. The string is continuously excited electromagnetically, and a small number of pickups (contact microphones) observe spectral changes induced by contact. From short-duration audio signals, our system estimates contact location and normal force, and detects slip. To guide design and interpret the sensing mechanism, we derive a physics-based string-vibration simulator that predicts how contact position and force shift vibration modes. Experiments demonstrate millimeter-scale localization, reliable force estimation, and real-time slip detection. Our contributions are: (i) a lightweight, scalable string-based tactile sensing hardware concept for instrumenting extended robot surfaces; (ii) a physics-grounded simulation and analysis tool for contact-induced spectral shifts; and (iii) a real-time inference pipeline that maps vibration measurements to contact state.
Figures & tables
| Object | MAE (mm) | 5 mm (%) | Pearson | Condition |
|---|---|---|---|---|
| Plastic | 2.7 | 87.8 | 0.994 | Clean |
| 3.1 | 83.3 | 0.994 | Noise | |
| Wood | 8.8 | 51.4 | 0.863 | Clean |
| 8.6 | 55.7 | 0.857 | Noise | |
| Metal tube | 5.4 | 70.0 | 0.952 | Clean |
| 8.0 | 57.1 | 0.893 | Noise |
| Object | MAE (N) | 0.2 N (%) | Pearson | Condition |
|---|---|---|---|---|
| Plastic | 0.141 | 74.4 | 0.909 | Clean |
| 0.131 | 75.6 | 0.928 | Noise | |
| Wood | 0.111 | 84.3 | 0.903 | Clean |
| 0.115 | 82.9 | 0.927 | Noise | |
| Metal tube | 0.172 | 70.0 | 0.908 | Clean |
| 0.173 | 65.7 | 0.906 | Noise |
Tactile Sensing
Tactile sensing measures contact forces, deformation, texture, and motion to help robots perceive and act through physical interaction.
See all 138 papers