Overview

Gesture recognition studies how to detect and interpret movements, from hand signs and subtle social cues to commands for robots, XR systems, and assistive devices. Common approaches use CNNs, temporal models such as transformers and recurrent networks, pose or skeleton graphs, and fusion of video with inertial, EMG, radar, or Wi-Fi signals; benchmarks include Jester, NVGesture, and iMiGUE. Recent work also explores self-supervised learning, synthetic data, and compact models for real-time operation on phones, wearables, and robots. A central challenge is that strong results on familiar users or controlled data often do not transfer to new people and settings, while continuous, safety-critical use also demands low latency and reliable handling of uncertainty and false triggers.

Latest papers

CardsList

56 papers3 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. SurGPT: A Multi-Task Foundation Model for Robotic Surgical Skills Assessment and Gesture Recognition

    Oct 18, 2026Parham M. Kebria, Saeid Nahavandi, Mehrdad Saif +1Surgical Video UnderstandingSurgical Robotics

  2. Neural Networks for Temporal Pattern Recognition and Dynamic Arm Gesture Speed Estimation for Robot Control

    Oct 8, 2026Milán Zsolt Bagladi, László GulyásRecurrent Neural NetworksRobotic Perception

  3. Trajectory-Guided Tokenization of Complex CSI for Wi-Fi Sensing

    Oct 5, 2026Ziyi Wang, Kenuo Xu, Jichu Jiang +8Gesture RecognitionWi-Fi Sensing

  4. A Deployment Study of Identity-Gated Drone Gesture Control

    Sep 22, 2026Diyari Mohammed Salih, Ilyes Chaabeni, Naima Ait OufroukhGesture RecognitionQuadrotor Control

  5. Towards Reliable Underwater Diver-Robot Interaction: Gesture Design, Interaction Logic, and Real-World Evaluation

    Sep 20, 2026Yingqi Liu, Kanzhong Yao, Zimeng Peng +4Robotic ControlGesture Recognition

  6. Rescuing Performance from the Demo: Co-Designing Drum Gesture Mappings with a Percussionist

    Sep 8, 2026Jordie Shier, Teresa Pelinski, Charalampos Saitis +2Gesture Recognition

  7. Frame-Synchronous Hand Gesture Detection by Projected Winding Order

    Sep 7, 2026Amey ThakurGesture Recognition

  8. Why Personalization Matters: Cross-Subject Challenges in EMG-IMU-based HRI Activity Recognition

    Aug 21, 2026Ruan Rithelle Chagas de Faria Carminati, Giovanni Braglia, Luigi Biagiotti +4Human Activity RecognitionGesture Recognition

  9. One Residual with Three Reuses: A Wristband Front End for Gesture Sensing

    Aug 17, 2026Mouhssine RifakiWearable SensingMultimodal Sensor Fusion

  10. SafeGesture: Evaluating Fine-Grained Hand Gesture Understanding in Vision-Language Models through Scenario-Conditioned Safety Interpretation

    Aug 17, 2026Taegang Kim, Saleh Afroogh, Junfeng JiaoVLM EvaluationReasoning for VLA Models

  11. Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognition

    Aug 14, 2026Chengyan Wang, Hanliang Xie, Yueyi Yang +1Micro-Gesture RecognitionGesture Recognition

  12. UniCon-Former: Unified Convolution Transformer is All You Need for Hand Gesture Recognition

    Aug 13, 2026Mallika Garg, Debashis Ghosh, Pyari Mohan PradhanHybrid CNN-Transformer ArchitecturesEfficient ViTs

  13. DoRF++: Spherical Representation Learning over Doppler Radiance Fields for Robust Wi-Fi Sensing

    Aug 9, 2026Navid Hasanzadeh, Shahrokh ValaeeHuman Activity RecognitionGeometric Representation Learning

  14. MAUPITI: On-Device Prototype-Based Learning on a Smart Infrared Sensor

    Aug 7, 2026Beatrice Alessandra Motetti, Tanguy Dugas du Villard, Matteo Risso +7Prototype-Based ClassificationOn-Device Training

  15. RSC-GestureNet: Reliability-Aware Selective Causal Recognition of Chinese Traffic Police Gestures

    Aug 3, 2026Cheng Li, Renjun Gao, Boyi FuSelective PredictionAutonomous Driving Perception

  16. A Graph Neural Network Model for Real-Time Gesture Recognition Based on sEMG Signals

    Jul 8, 2026Pragatheeswaran Vipulanandan, Kamal Premaratne, Manohar MurthiEMG-Based Gesture RecognitionGraph Neural Networks

  17. SonoRank: Towards Calibration-Free Real-Time Finger Flexion Detection from Forearm Ultrasound Sequences

    Jul 8, 2026Dean Zadok, Alon Wolf, Alex M. Bronstein +1Gesture RecognitionAssistive Robotics

  18. Conservative Subject Invariant EMG-based Gesture Recognition

    Jul 4, 2026Hamed Rafiei, Ali MousaviEMG-Based Gesture RecognitionAdversarial Representation Learning

  19. PGUDA: Pressure-Guided Unsupervised Domain Adaptation with Cross-Modal Knowledge Distillation for sEMG-Based Gesture Recognition

    Jun 30, 2026Yurui Liu, Xiao-Cong Zhong, Qisong Wang +3EMG-Based Gesture RecognitionCross-Modal Knowledge Distillation

  20. FUTO Swipe: Layout-Agnostic Neural Swipe Decoding

    Jun 24, 2026David Lee Miller, Aleksandras KostarevasGesture Recognition

  21. Integrated Sensing and Communications for Real-time Avatar Control in XR over 5G

    Jun 22, 2026Nabeel Nisar Bhat, Javad Sameri, Rreze Halili +3Integrated Sensing and CommunicationSurface Electromyography

  22. A Multi-Modal Framework with Cross-Subject Pseudo-Labeling and Semantic Alignment for Micro-Gesture Recognition

    Jun 11, 2026Haoran Zhang, Haokun Zhang, Pengyu Liu +3Micro-Gesture RecognitionUnsupervised Domain Adaptation

  23. Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognition

    Jun 10, 2026Jialin Liu, Xinwen He, Pengyu Liu +3Micro-Gesture RecognitionGesture Recognition

  24. Real-time body pose non-verbal communication with a consistency-based reliability measure

    Jun 8, 2026Alina Marcu, Dragos Costea, Cristina Lazar +1Uncertainty QuantificationGesture Recognition

  25. Self-supervised Learning Matters: A Simple Ensemble Solution for Micro-Gesture Recognition

    Jun 8, 2026Tingyi Liu, Kun Li, Fei Wang +5Micro-Gesture RecognitionVideo Representation Learning

  26. Spatial-Temporal Decoupled Adapter for Micro-gesture Online Recognition

    Jun 5, 2026Xucheng Shen, Kun Li, Fei Wang +3Micro-Gesture RecognitionFine-Tuning