cs.CVNov 13, 2026

UnSPAD: Uncertainty-aware Single Photon Burst Photography

Authors: Sachin Shah, Kalyan Bhetwal, Levi Burner, Christopher A. Metzler

Organizations: University of Maryland, College Park

Abstract

We introduce UnSPAD, an uncertainty-aware burst photography framework capable of fusing and denoising arbitrarily long sequences of binary single photon avalanche diode (SPAD) measurements. Unlike prior methods that require fixed burst lengths or rely on powerful generative priors, UnSPAD combines learned motion estimation with uncertainty-informed measurement fusion and denoising to produce temporally consistent, hallucination-free reconstructions. UnSPAD first forms an initial scene estimate by averaging flow-aligned binary frames. UnSPAD then uses per-pixel uncertainty maps to perform uncertainty-aware denoising; the denoiser is informed about which regions accumulated the fewest observations (and thus contain the most relative shot noise) due to motion, occlusion, or alignment errors. This two-step reconstruction pipeline helps mitigate hallucinations---outside of the structure implicitly introduced by the flow estimates, the initial scenes estimates are entirely prior-free. Experiments on real and simulated SPAD and quantum image sensor (QIS) benchmarks demonstrate state-of-the-art reconstruction quality, improved temporal consistency, and superior color fidelity relative to the state of the art.

Figures & tables

Explore similar work

Oct 2, 2026

One Photon, Many Worlds: Posteriors and Predictions with Single-Photon Cameras

Single-photon avalanche diode (SPAD) cameras operate fundamentally differently from conventional cameras due to their photon-counting nature. Each frame produces a binary image: pixels report zero if no photons arrived during exposure, and one if one or more photons arrived. Reconstructing a scene or inferring its properties from a single binary frame is difficult because many different images could produce the same measurement; thus, the inverse problem is fundamentally one-to-many. As we gather more binary measurements, the inherent uncertainty associated with the inverse problem and any associated inference diminishes. With sufficient photon counts, photon noise becomes negligible relative to the signal mean, enabling near-deterministic scene recovery and inference. This work characterizes the transition from stochastic to near-deterministic scene understanding as photon budget increases, analyzing how the stochasticity in photon arrival affects downstream inference tasks. Technically, we develop a conditional generative framework based on a Hypergeometric frame-thinning process for accumulated binary SPAD measurements. Generative models capture the one-to-many nature of photon-starved inverse problems, enabling empirical characterization of how this ambiguity diminishes with increasing measurements and its impact on downstream tasks like character recognition, QR code decoding, and facial analysis.
Feb 23, 2026

gQIR: Generative Quanta Image Reconstruction

Capturing high-quality images from only a few detected photons is a fundamental challenge in computational imaging. Single-photon avalanche diode (SPAD) sensors promise high-quality imaging in regimes where conventional cameras fail, but raw quanta frames contain only sparse, noisy, binary photon detections. Recovering a coherent image from a burst of such frames requires handling alignment, denoising, and demosaicing (for color) under noise statistics far outside those assumed by standard restoration pipelines or modern generative models. We present an approach that adapts large text-to-image latent diffusion models to the photon-limited domain of quanta burst imaging. Our method leverages the structural and semantic priors of internet-scale diffusion models while introducing mechanisms to handle Bernoulli photon statistics. By integrating latent-space restoration with burst-level spatio-temporal reasoning, our approach produces reconstructions that are both photometrically faithful and perceptually pleasing, even under high-speed motion. We evaluate the method on synthetic benchmarks and new real-world datasets, including the first color SPAD burst dataset and a challenging Deforming (XD) video benchmark. Across all settings, the approach substantially improves perceptual quality over classical and modern learning-based baselines, demonstrating the promise of adapting large generative priors to extreme photon-limited sensing. Code at https://github.com/Aryan-Garg/gQIR.
Aug 1, 2026

Optical Flow from Photons

Optical flow remains challenging in high-speed and low-light scenes, where the limited frame rate and sensitivity of conventional cameras lead to motion blur and underexposure. Single-photon avalanche diode (SPAD) cameras offer single-photon sensitivity and extremely fine temporal sampling. However, individual slices in these high FPS binary photon streams are too sparse for dense correspondence. Temporal aggregation can provide the spatial cues required by optical flow, but accumulating photons at fixed coordinates blurs moving structures. Motion-aware aggregation can reduce this blur, yet it depends on the flow being estimated. To address this dependency, we propose QuantaFlow, the first method for dense optical flow directly from SPAD streams. Instead of constructing a fixed input representation, QuantaFlow embeds SPAD representation construction into iterative flow refinement. At each iteration, the current flow coarsely aligns the slices within the source and target sub-streams. A photon-flux transformation then constructs multi-scale representations containing intensity and structural cues, while adaptive multi-scale fusion balances photon noise and residual motion blur at each pixel. The fused representations drive a feature-warping flow update, and the refined flow guides representation construction in the next iteration. We further construct a synthetic dataset for SPAD optical-flow training and evaluation. Experiments on the synthetic dataset and real-world SPAD data demonstrate the effectiveness and generalization of QuantaFlow.