cs.DCNov 6, 2026

EventHOI: Event-Driven Resource-Efficient Hand-Object Interaction Logging on Smartglasses

Authors: Le Zhang, Kailai Cui, Hao Chen, Vlad Roznyatovskiy, Jianzhong Zhang, Anhong Guo, Kang G. Shin, Ke Sun

Organizations: University of Michigan · Samsung Research America

Abstract

Hand-object interactions (HOIs) can be captured by smartglasses to learn how people manipulate objects in daily life. Automatic logging of these interactions from an egocentric perspective provides time-stamped evidence of daily actions for applications like memory assistance. However, continuous RGB capture and wireless transmission exceed the energy and bandwidth budgets of smartglasses. We present EventHOI, an event-driven sensing and compression system that couples selective RGB capture with HOI-aware encoding to enable egocentric logging over Bluetooth Low Energy (BLE) while preserving downstream HOI logging performance. Our key insight is to use low-power event sensing both to determine when RGB capture is needed and to identify where visual detail must be preserved. A lightweight IMU-based egomotion cancellation pipeline suppresses egomotion-induced events so that residual HOI motion can guide RGB triggering and spatial compression. We build a smartglasses prototype and conduct an end-to-end evaluation of EventHOI on a 50-hour egocentric benchmark with 97 subjects and a 20-hour real-world dataset we collect from 10 participants, together covering a broad range of daily-life scenarios and environments. Compared to RGB-only baselines, EventHOI reduces always-on backend power consumption by 5.8-10.4x and uplink bandwidth by 2.9x, with minimal HOI recognition accuracy loss. The resulting RGB uplink of less than 130 kbps fits within commodity BLE bandwidth budgets, making stable BLE video streaming feasible for egocentric HOI logging. Demo video and project website: https://eventhoi.github.io

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. OpenGlass: Ultra-Low-Power On-Device AI Eyewear with Event-based Vision

    Jun 5, 2026Pietro Bonazzi, Julian Moosmann, Ahmet Celik +2Event-Based VisionWearable Sensing

  2. ECHO: Ego-Centric modeling of Human-Object interactions

    Aug 29, 2025Ilya A. Petrov, Vladimir Guzov, Riccardo Marin +5HOI Generation3D Reconstruction

  3. A Multimodal RGB and Events Dataset for Hand Detection in First-Person View

    Jun 9, 2026Bharghav Kota, Yulia SandamirskayaEvent-Based VisionEvent Camera Simulation