cs.CVApr 16, 2026

High-Speed Full-Color HDR Imaging via Unwrapping Modulo-Encoded Spike Streams

Authors: Chu ZhouSiqi YangKailong ZhangHeng GuoZhaofei YuBoxin ShiImari Sato

Organizations: Digital Content and Media Sciences Research Division, National Institute of Informatics, Tokyo 101-8430, Japan · Institute for Artificial Intelligence, the State Key Laboratory of Multimedia Information Processing, School of Computer Science, and the National Engineering Research Center of Visual Technology, School of Computer Science, Peking University, Beijing 100080, China · Pattern Recognition and Intelligent System Laboratory, School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China · State Key Laboratory of Multimedia Information Processing, School of Computer Science, the National Engineering Research Center of Visual Technology, School of Computer Science, and the PKU-AI2 Robotics Joint Lab of Embodied AI, Peking University, Beijing 100080, China

Abstract

Conventional RGB-based high dynamic range (HDR) imaging faces a fundamental trade-off between motion artifacts in multi-exposure captures and irreversible information loss in single-shot techniques. Modulo sensors offer a promising alternative by encoding theoretically unbounded dynamic range into wrapped measurements. However, existing modulo solutions remain bottlenecked by iterative unwrapping overhead and hardware constraints limiting them to low-speed, grayscale capture. In this work, we present a complete modulo-based HDR imaging system that enables high-speed, full-color HDR acquisition by synergistically advancing both the sensing formulation and the unwrapping algorithm. At the core of our approach is an exposure-decoupled formulation of modulo imaging that allows multiple measurements to be interleaved in time, preserving a clean, observation-wise measurement model. Building upon this, we introduce an iteration-free unwrapping algorithm that integrates diffusion-based generative priors with the physical least absolute remainder property of modulo images, supporting highly efficient, physics-consistent HDR reconstruction. Finally, to validate the practical viability of our system, we demonstrate a proof-of-concept hardware implementation based on modulo-encoded spike streams. This setup preserves the native high temporal resolution of spike cameras, achieving 1000 FPS full-color imaging while reducing output data bandwidth from approximately 20 Gbps to 6 Gbps. Extensive evaluations indicate that our coordinated approach successfully overcomes key systemic bottlenecks, demonstrating the feasibility of deploying modulo imaging in dynamic scenarios.

Explore similar work

CardsList