Overview

Gesture recognition studies how to detect and interpret movements, from hand signs and subtle social cues to commands for robots, XR systems, and assistive devices. Common approaches use CNNs, temporal models such as transformers and recurrent networks, pose or skeleton graphs, and fusion of video with inertial, EMG, radar, or Wi-Fi signals; benchmarks include Jester, NVGesture, and iMiGUE. Recent work also explores self-supervised learning, synthetic data, and compact models for real-time operation on phones, wearables, and robots. A central challenge is that strong results on familiar users or controlled data often do not transfer to new people and settings, while continuous, safety-critical use also demands low latency and reliable handling of uncertainty and false triggers.

Latest papers

CardsList

56 papers3 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. Recognizing Co-Speech Gestures in-the-Wild

    May 29, 2026Sindhu B Hegde, K R Prajwal, Andrew ZissermanMultimodal GroundingGesture Recognition

  2. MyoSem: Aligning Electromyography with Natural-Language Action Semantics

    May 29, 2026Chiyue Wang, Yang Gao, Zhanpeng JinEMG-Based Gesture RecognitionMultimodal Embedding

  3. NeuroEdge: Real-Time Hand Gesture Recognition with High-Density EMG Using Deep Learning at the Edge

    May 28, 2026Peter Chudinov, Zhenyu Lin, Jay Motamarry +3EMG-Based Gesture RecognitionEfficient Neural Network Inference

  4. Online Hand Gesture Recognition Using 3D Convolutional Neural Networks

    May 22, 2026Yinghao Qin, Tijana TimotijevicGesture Recognition3D CNNs

  5. Unsupervised clustering and classification of upper limb EMG signals during functional movements: a data-driven

    May 20, 2026L. F. Salazar Álvarez, D. Escobar-Saltarén, M. B. Salazar Sánchez +1EMG-Based Gesture RecognitionClustering

  6. iMiGUE-3K: A Large-Scale Benchmark for Micro-Gesture Analysis with Self-Supervised Learning

    May 16, 2026Chengyan Wang, Haoyu Chen, Hui Wei +3Micro-Gesture RecognitionGesture Recognition

  7. Efficient Sensor Fusion for Gesture Recognition on Resource-Constrained Devices

    May 13, 2026Pietro Bartoli, Christian Veronesi, Tommaso Bondini +2Human Activity RecognitionTiny ML

  8. EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras

    May 12, 2026Luming Wang, Hao Shi, Jiajun Zhai +2Event-Based Vision3D Hand Pose Estimation

  9. Practical Wi-Fi-based Motion Recognition Under Variable Traffic Patterns

    May 8, 2026Guolin Yin, Junqing Zhang, Guanxiong Shen +1Data AugmentationHuman Activity Recognition

  10. Elastic Spiking Transformers for Efficient Gesture Understanding

    May 4, 2026Alberto Ancilotto, Gianluca Amprimo, Stefano Di Carlo +1Efficient Neural Network InferenceSpiking Transformers

  11. Touchless Intraoperative Image Access System Based on Vision-Based Hand Tracking

    Apr 27, 2026Yin Lin, Domenico Aquino, Alberto Redaelli +3Medical ImagingGesture Recognition

  12. A Gesture-Based Visual Learning Model for Acoustophoretic Interactions using a Swarm of AcoustoBots

    Apr 21, 2026Alex Lin, Lei Gao, Narsimlu Kemsaram +1Multi-Robot SystemsRobotics

  13. Prompt-to-Gesture: Measuring the Capabilities of Image-to-Video Deictic Gesture Generation

    Apr 16, 2026Hassan Ali, Doreen Jirak, Luca Müller +1Synthetic Data AugmentationImage-to-Video Generation

  14. TinyGaze: Lightweight Gaze-Gesture Recognition on Commodity Mobile Devices

    Mar 30, 2026Yaxiong Lei, Hyochan Cho, Fergus Buchanan +4Gesture RecognitionOn-Device Inference

  15. SHANDS: A Multi-View Dataset and Benchmark for Surgical Hand-Gesture and Error Recognition Toward Medical Training

    Mar 27, 2026Le Ma, Thiago Freitas dos Santos, Nadia Magnenat-Thalmann +1Surgical Video UnderstandingGesture Recognition

  16. Dynamic LIBRAS Gesture Recognition via CNN over Spatiotemporal Matrix Representation

    Mar 26, 2026Jasmine MoreiraGesture RecognitionSign Language Recognition

  17. Development of ML model for triboelectric nanogenerator based sign language detection system

    Mar 26, 2026Meshv Patel, Bikash Baro, Sayan Bayan +1Sign Language RecognitionGesture Recognition

  18. mmFHE: mmWave Sensing with End-to-End Fully Homomorphic Encryption

    Mar 23, 2026Tanvir Ahmed, Yixuan Gao, Adnan Armouti +1mmWave Radar SensingRemote Sensing

  19. SurfaceXR: Fusing Smartwatch IMUs and Egocentric Hand Pose for Seamless Surface Interactions

    Mar 19, 2026Vasco Xu, Brian Chen, Eric J. Gonzalez +4Gesture RecognitionMultimodal Sensor Fusion

  20. FG-SGL: Fine-Grained Semantic Guidance Learning via Motion Process Decomposition for Micro-Gesture Recognition

    Mar 17, 2026Jinsheng Wei, Zhaodi Xu, Guanming Lu +2Micro-Gesture RecognitionGesture Recognition

  21. Scale-Gest: Scalable Model-Space Synthesis and Runtime Selection for On-Device Gesture Detection

    Mar 16, 2026Abdul Basit, Saim Rehman, Muhammad ShafiqueGesture RecognitionOn-Device Inference

  22. Active Inference for Micro-Gesture Recognition: EFE-Guided Temporal Sampling and Adaptive Learning

    Mar 8, 2026Weijia Feng, Jingyu Yang, Ruojia Zhang +7Micro-Gesture RecognitionGesture Recognition

  23. From Phase Grounding to Intelligent Surgical Narratives

    Mar 5, 2026Ethan Peterson, Huixin ZhanSurgical Video UnderstandingTemporal Action Segmentation

  24. Interpretable Multimodal Gesture Recognition for Drone and Mobile Robot Teleoperation via Log-Likelihood Ratio Fusion

    Feb 27, 2026Seungyeol Baek, Jaspreet Singh, Lala Shakti Swarup Ray +3Gesture RecognitionMultimodal Fusion

  25. FR-GESTURE: An RGBD Dataset For Gesture-based Human-Robot Interaction In First Responder Operations

    Feb 19, 2026Konstantinos Foteinos, Georgios Angelidis, Aggelos Psiris +3Human-Robot InteractionRobotic Data Collection