cs.RONov 9, 2026

PCTac: Mechanochromic Photonic-Crystal Tactile Sensor for Dexterous Manipulation

Authors: Ruilin Zhang, Xuanshuo Liu, Junzhe Dai, Kefei Wu, Xuhao Qin, Ziyuan Jiao, Wanlin Li, Yurui Qu, 

Organizations: School of Information Science and Technology, ShanghaiTech University, Shanghai, China. · State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI), Beijing, China.

Abstract

Modern visuotactile sensors primarily sense contact by imaging the deformation of a compliant interface. Using techniques such as photometric stereo, they can recover detailed contact geometry, often represented as surface normals or depth. However, force-related information typically still needs to be inferred indirectly through calibration, geometric reconstruction, or learned mappings. Mechanochromic photonic-crystal (PC) materials offer an alternative physical encoding mechanism: contact loading changes their periodic microstructure and spectral response, directly transforming local stress into a spatially resolved structural-color field. Despite this potential, PC materials have rarely been explored as visuotactile sensors for closed-loop robot learning. We present PCTac, an open-source mechanochromic PC fingertip that uses a dense hue field as its tactile observation. Loading characterization demonstrates a repeatable relationship between the applied normal load and the observed hue response. We further integrate this representation directly into a Diffusion Policy and evaluate it on three real-robot manipulation tasks. Across 90 physical rollouts, PCTac Hue achieves 68 successes (75.6%), compared with 60 (66.7%) for PCTac RGB, 57 (63.3%) for Wedge RGB, and 29 (32.2%) for vision-only. PCTac Hue also achieves the highest observed success rate on each evaluated task, including Perturbed Test-Tube Insertion, where it achieves 16/30 successes versus 13/30 for tactile RGB baselines and 1/30 for vision-only. These results demonstrate the potential of mechanochromic structural color as a compact, load-sensitive tactile representation for robot learning and closed-loop manipulation. Project page: https://bey0ndt1me.github.io/PCTac-page/.

Figures & tables

Explore similar work

CardsList
  1. PredTac: Learning Contact-Rich Manipulation with Predicted Touch

    Sep 14, 2026Weijia Fan, Daqiang GuoVisual-to-Tactile PredictionTactile Sensing

  2. TacO: Benchmarking Tactile Sensors for Object Manipulation

    May 21, 2026Anya Zorin, Zilin Si, Sachin Bhadang +11Tactile SensingContact-Rich Robotic Manipulation

  3. SpectraTac: A Compact Camera-Free Optical Tactile Sensor with Distributed Color Sensing

    Aug 31, 2026Hao Wu, Haotian Guo, Yu Feng +3Vision-Based Tactile SensingTactile Sensing