cs.LGSep 30, 2026

EFormer: Temporally Aligned Local Correction for Continuous sEMG-Based Hand Pose Tracking

Authors: JiaCheng Ge, SiYu Zhang

Abstract

Surface electromyography (sEMG) provides a wearable, camera-free signal for continuous hand-motion inference. Mapping muscle activity to joint kinematics remains challenging because the recorded waveforms are indirect measurements, their relationship with motion changes over time, and individual anatomy and sensor placement alter the signal distribution. This paper presents EFormer, a residual feature-correction network built on a frozen tracking backbone. EFormer combines a high-rate event branch, temporally aligned local cross-attention, two causal rotary position embedding (RoPE) temporal layers, and a bounded, dynamically gated residual. EFormer receives 16-channel sEMG sampled at 2 kHz and fuses a 64-channel tracking representation at 25 Hz with a 128-channel event representation at 200 Hz. Cross-attention uses a nominal delay of 100 ms, a 300 ms history parameter, and a 50 ms tolerance; its causal mask restricts each query to events occurring 50-400 ms earlier. The correction scale is 0.15. The evaluated continuation-training configuration contains 585,376 trainable parameters and 5,974,508 frozen parameters. On the test set, EFormer achieves an MAE of 0.1546634 rad, an RMSE of 0.24063 rad, and an R^2 of 0.74801, compared with 0.1745326 rad, 0.2715448 rad, and 0.6791103 for the official tracking baseline. EFormer reduces MAE by 11.38% relative to the baseline. The results show that temporally aligned event-feature correction can reduce continuous hand-pose tracking error.

Explore similar work

CardsList
  1. EMG-GPT: Predictive Pretraining on Residual-Quantized EMG Tokens for Hand Pose Estimation

    Oct 4, 2026Ettore Magni, Rolandos Alexandros Potamias, Stefanos Zafeiriou +1Surface ElectromyographyElectrocardiogram Foundation Models

  2. EgoEMG: A Multimodal Egocentric Dataset with Bilateral EMG and Vision for Hand Pose Estimation

    May 7, 2026Ziheng Xi, Jiayi Yu, Yitao Wang +33D HandSurface Electromyography

  3. Decoding High-Dimensional Finger Motion from EMG Using Riemannian Features and RNNs

    Apr 24, 2026Martin Colot, Cédric Simar, Guy Cheron +2Surface ElectromyographyRobotic Hands