cs.CVJul 2, 2025

Filter-Enhanced Smartphone Hyperspectral Imaging

Authors: Daniil Reutsky, Daniil Vladimirov, Yasin Mamedov, Georgy Perevozchikov, Nancy Mehta, Egor Ershov, Radu Timofte

Organizations: JMU, Würzburg · CRSI, Moscow · MIRIAI, Moscow · AXXX, Moscow

Abstract

Hyperspectral reconstruction from RGB imagery offers an affordable alternative to costly hyperspectral acquisition devices. However, its accuracy is fundamentally constrained by the limited spectral resolution of standard RGB cameras. In this paper, we propose a new approach that leverages the multi-camera systems integrated into most modern smartphones and enhances their capabilities by modulating their spectral response functions using carefully selected spectral filters, enabling a smartphone to capture richer spectral information. We propose a neural network able to exploit auxiliary RGB images with diverse spectral characteristics, enabling more accurate hyperspectral reconstruction compared to conventional single-image methods. Training is supported by a newly collected dataset, Doomer, which consists of multiple misaligned RGB images alongside corresponding hyperspectral data. We also propose a device-adaptation strategy that conditions the multi-image hyperspectral reconstruction network on camera color correction matrices available in standard DNG metadata, requiring no real images from the target device. We evaluate it on three physical smartphones, two of them unseen during training.

Figures & tables

Appendix figures & tables14 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Physics-Informed Untrained Learning for RGB-Guided Superresolution Single-Pixel Hyperspectral Imaging

    Apr 4, 2026Hao Zhang, Bilige Xu, Lichen Wei +2Hyperspectral Image ReconstructionHyperspectral Imaging

  2. Leveraging pretrained RGB denoisers for hyperspectral image restoration

    May 23, 2026Daniele Picone, Mohamad Jouni, Mauro Dalla-MuraHyperspectral ImagingTransfer Learning

  3. Correcting Spectra Outside the Backbone: A Model-Agnostic Rectifier for Hyperspectral Image Super-Resolution

    Jan 29, 2026Ji-Xuan He, Guohang Zhuang, Bo Junge +5Hyperspectral Image Super-ResolutionHyperspectral Imaging