physics.opticsJun 19, 2026

Non-line-of-sight imaging with arbitrary relay surface geometries via 3D Gaussian Transient Rendering

Authors: Yi WangZiyu ZhanYuran WangHao WangQiang LiuZuoqiang ShiLingyun QiuXing Fu

Organizations: Department of Precise Instrument, Tsinghua University, China · Department of Electrical Engineering, City University of Hong Kong, China · Yau Mathematical Science Center, Tsinghua University, China

Abstract

Imaging objects hidden outside the direct line of sight expands the effective field of view and is critical for applications such as autonomous driving and robotic perception. Despite impressive progress in time-of-flight (ToF)-based non-line-of-sight (NLOS) imaging, real-world deployment remains challenging because practical measurements are often collected over spatially limited, arbitrarily shaped relay regions-conditions that violate the planar-wall and dense-sampling assumptions made by most existing methods. To address these limitations, we propose a LOS-guided NLOS imaging pipeline that imposes no geometric assumptions on the relay surface and naturally supports both confocal and non-confocal configurations. Our method represents the hidden scene using 3D Gaussian primitives and couples them with an efficient, differentiable transient rendering model, enabling end-to-end optimization directly from measured transients. We validate our approach on real-world measurements from both a public dataset and a custom-built capture system. Across settings, our method achieves state-of-the-art reconstruction fidelity under spatially limited, sparsely sampled conditions, and significantly outperforms existing methods on complex, arbitrary relay surface geometries.

Explore similar work

CardsList