Differentiable Inverse Rendering Recovers Intrinsic Properties from Intravascular Optical Coherence Tomography
Organizations: Institute of Medical Engineering and Science, MIT, 77 Massachusetts Ave, Cambridge, MA, 02139, USA. · Wellman Center for Photomedicine, Harvard Medical School and Massachusetts General Hospital, 399 Revolution Dr, Somerville, MA, 02145, USA. · Brigham and Women’s Hospital, Harvard Medical School, 75 Francis St, Boston, MA, 02115, USA. · Department of Computer Science, ETH Zurich, Rämistrasse 101, Zurich, 8092, Switzerland.
Abstract
Medical images encode intrinsic tissue properties that indicate disease progression, yet these properties remain entangled with the system-dependent physics of image formation. Differentiable inverse rendering asks whether they are recoverable by inverting the imaging system's forward physics rather than through post-hoc correction. We address this in optical coherence tomography (OCT), focusing on the optical attenuation coefficient, a per-pixel marker of pathology and cellular composition. Conventional recovery relies on closed-form inversions limited to simplified light-tissue models, or learned methods coupled to specific imaging configurations. We instead recover per-pixel attenuation from a single OCT image by gradient descent through a differentiable physics-based forward model. We verified the method against analytical solutions, validated it on five in vitro phantoms, and applied it without modification to 29{,}269 clinical intravascular OCT images from 128 patients. The inversion needs no training data or segmentations and is portable across platforms and retrospective archives. Replacing the forward model or recovering another optical parameter leaves the optimization procedure unchanged. We demonstrate per-pixel recovery is tractable because gradient information scales to this high-dimensional problem, where gradient-free methods become intractable. Our work supports quantitative tissue characterization from OCT images and provides a framework for extension across imaging modalities and organ systems.
Optical Coherence Tomography
Optical coherence tomography (OCT) creates depth-resolved tissue images and supports automated analysis of retinal structure, blood flow, and disease.
See all 50 papers