cs.ROSep 18, 2026

MicroHookACT: Monocular Microscopic Vision Guided Visuomotor Policy for Flexible Microelectrode Hooking

Authors: Yitong Chen, Fangbo Qin, Yang Wang, Ruihua Hu, Kui Zhang, Shan Yu

Organizations: Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China. · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China. · State Key Laboratory of Brain Cognition and Brain-Inspired Intelligence Technology, Shanghai 200031, China. · Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, China.

Abstract

Automated needle-loop hooking is a critical step in flexible microelectrode (FME) implantation. This paper presents MicroHookACT, an imitation learning-based visuomotor policy for automated 3D hooking under monocular microscopic vision. First, a unidirectional hooking strategy exploits defocus cues and optical-axis guidance to enable palpation-free precise alignment and contact-rich threading. Second, an action-supervised object attention module built on a frozen ViT backbone learns to focus on the micro-needle tip and micro-loop directly from human demonstrations, without requiring manual visual annotations for training. Third, attention-centered global coarse and local fine features are dynamically weighted according to predicted action progress, enabling a single ACT policy to adapt to changing defocus blur and visual requirements throughout the operation. In the experiments, visuomotor policies were trained on 60 human demonstrations and evaluated under five setups with varying difficulties. Our MicroHookACT framework achieved the highest overall success rate of 96.7% with an average execution time of 11.5 s. These results demonstrate the potential of visuomotor policy learning for micron-level control under varying operating conditions.

Figures & tables

Explore similar work

CardsList
  1. ReTac-ACT: A State-Gated Vision-Tactile Fusion Transformer for Precision Assembly

    Mar 10, 2026Minchi Ruan, LiangQing Zhou, Hongtong Li +4Contact-Rich Robotic ManipulationRobotic Assembly

  2. FingerViP: Learning Real-World Dexterous Manipulation with Fingertip Visual Perception

    Apr 23, 2026Zhen Zhang, Weinan Wang, Hejia Sun +4Dexterous ManipulationVisuomotor Policy Learning

  3. GuidedAttention: Interpretable and Correctable Visual Attention for OOD-Robust Robot Manipulation via Imitation Learning

    Jul 23, 2026Masaki Murooka, Ryoichi Nakajo, Keisuke Shirai +4Visual AttentionRobot Skill Learning