cs.CVNov 17, 2026

TANGO: Real-World Unregistered RGB-Guided Hyperspectral Super-Resolution with Two-Camera Acquisitions

Authors: Matteo Kolyszko, Marco Buzzelli, Simone Bianco, Raimondo Schettini

Organizations: University of Milano-Bicocca

Abstract

Unregistered hyperspectral image super-resolution aims to recover a high-resolution HSI from a low-resolution hyperspectral observation and an unregistered high-resolution RGB reference. Although recent methods have begun to address the geometric misalignment between the two modalities, their evaluation is still constrained by the lack of a large-scale public benchmark based on real two-camera RGB--HSI acquisitions with a high-resolution HSI reference. To address this gap, we introduce DUET, the first large-scale public dataset for unregistered RGB-guided hyperspectral super-resolution, comprising 403 indoor and outdoor scenes captured with two separate RGB and hyperspectral cameras. We further propose TANGO (Two-camera AligNment with Gated Occlusions), which first compensates for the dominant cross-camera displacement through end-to-end global alignment and then refines the remaining inconsistencies with a coarse-to-fine local feature alignment. A learned gating mechanism further attenuates the RGB guidance where the two views cannot be consistently matched. Experimental results show that TANGO achieves state-of-the-art performance on both DUET and REAL across all evaluated scale factors, outperforming the strongest competitor on DUET by up to 2.29 dB in PSNR while requiring 2.5×\times fewer FLOPs. The code and dataset will be available at https://github.com/FagiolottoConSombrero/TANGO-DUET

Figures & tables

Explore similar work

CardsList
  1. Lightweight Interpretable RGB-Guided Hyperspectral Super-Resolution under Real Cross-resolution Misalignment

    Sep 1, 2026Mohamad Jouni, Aurélien Godet, Mauro Dalla MuraHyperspectral Image Super-ResolutionHyperspectral Imaging

  2. Enhancing Unregistered Hyperspectral Image Super-Resolution via Unmixing-based Abundance Fusion Learning

    Mar 9, 2026Yingkai Zhang, Tao Zhang, Jing Nie +1Hyperspectral UnmixingHyperspectral Image Super-Resolution

  3. Registration-Free Hyperspectral Reconstruction from RGB via a Permutation-Invariant Gram-Matrix Principle

    Aug 15, 2026Jiangsan Zhao, Masayuki Hirafuji, Seishi Ninomiya +2Hyperspectral Image ReconstructionHyperspectral Imaging