Overview

Inverse rendering works backward from images or other measurements to estimate the scene properties and physical processes that produced them, enabling reconstruction, relighting, and editing. Approaches include differentiable rasterization and ray tracing with meshes, neural fields, or Gaussian splats, as well as learned priors and feed-forward models that predict scene properties directly. Researchers evaluate these methods on synthetic and real captures using geometry and material accuracy, novel-view synthesis, and relighting under changed illumination. A central challenge is that different combinations of geometry, materials, and lighting can explain the same observations, especially with sparse views, so methods must balance physical consistency and generalization against speed and incomplete data.

Latest papers

CardsList

69 papers12 papers in the last four weeks, up 200% on the four weeks before. 0.1% of all new papers.

  1. RIDE-Splat: Reflection Removal for In-the-Wild Driving Environments

    Oct 25, 2026Kevin David Hayes, Alex Hanson, Allen Tu +33D Reconstruction3D Gaussian Splatting

  2. Directionally Factorized Illumination with Spherical Harmonic Rotation

    Oct 17, 2026Yimeng Dou, Adam M. Saunders, Andre T. S. Hucke +5Neural RenderingMulti-View Image Synthesis

  3. RoboCloth: A Large-Scale Real Cloth Material Dataset for Neural Reflectance Reconstruction

    Oct 15, 2026Zhen Li, Haoran Qin, Francesco Di Sario +2Neural RenderingInverse Rendering

  4. VisibilitySplat: Ray-Traced Occlusion for Relighting with 3D Gaussian Splatting

    Oct 14, 2026Sven Kluge, Oliver StaadtInverse Rendering3D Gaussian Splatting

  5. LAMP: 3D Source-Aware Lighting Estimation at Multiple Points

    Oct 13, 2026Yanqiao Wang, Jin SunInverse Rendering3D Scene Understanding

  6. IntrinSync: Joint Intrinsic Decomposition and Reciprocal Rendering

    Oct 8, 2026Zheng Gu, Rui Huang, Xilu Zhang +6Inverse RenderingIntrinsic Image Decomposition

  7. Casual Flash Lighting for Gaussian Splat Inverse Rendering

    Oct 5, 2026Jiamin Xu, Dongheng Wei, Jiarong Zhao +4Inverse Rendering3D Gaussian Splatting

  8. ImpactMat: Continuous Material Estimation for Inverse Impact Sound Rendering

    Oct 5, 2026Hyebin Cho, Bumsoo Kim, Joon Son ChungInverse RenderingMaterials Property Prediction

  9. 4DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes

    Oct 2, 2026Ruihong Shen, Žiga Kovačič, Peter Kulits +6Dynamic Scene ReconstructionAI Agent Benchmarks

  10. RoomLight: A 2.5D Illumination Prior for Indoor Environments

    Sep 23, 2026Andreea Ardelean, Bernhard EggerInverse Rendering

  11. GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

    Sep 17, 2026Jieting Xu, Rengan Xie, Zijian Huang +3Inverse Rendering3D Gaussian Splatting

  12. TBR: Transport-Based Rendering with Deposition Strokes for Inverse Graphics

    Sep 8, 2026Tianqi Liu, Yushan Han, Hang LiuInverse RenderingDifferentiable Rendering

  13. Inverse Rendering for Modeling with Line Primitives

    Sep 1, 2026Kenji Tojo, Ariel Shamir, Nobuyuki Umetani +1Inverse RenderingDifferentiable Rendering

  14. LightFuse: Relightable Interactive Gaussian Scene Reconstruction via Multi-Scan Fusion and 2D Gaussian Ray Tracing

    Aug 29, 2026Haonan Zhou, Gaoxiang Linghu, Youlin Jia +5Differentiable Ray Tracing3D Scene Relighting

  15. mmIR: Frequency-Space Inverse Rendering for 3D Millimeter-Wave Radar ADC Synthesis

    Aug 28, 2026Adnan Armouti, Yixuan Gao, Rajalakshmi NandakumarMillimeter-Wave RadarmmWave Radar Sensing

  16. ExMesh++: From Multi-View Images to Relightable UV-PBR Mesh Assets via Topology-Adaptive Reconstruction and Decomposition

    Aug 25, 2026Chuanjin Fan, Lifan Wu, Wenjie Chang +33D Mesh Reconstruction3D Reconstruction

  17. RGBX-Next: Towards Realistic Generative Rendering from G-Buffers

    Aug 14, 2026Zheng Zeng, Marco Salvi, Lifan Wu +9Inverse RenderingNeural Rendering

  18. SpotlessGS: Relightable 3D Gaussian Splatting under Dynamic Illumination for Robotic Perception

    Aug 11, 2026Liang Hong, Jiaxin Wei, Simon Schaefer +23D Gaussian Splatting3D Reconstruction

  19. Convolutional Neural Shading for High-Quality 3D Reconstruction from Multi-View Images

    Jul 30, 2026Juheon Hwang, Taewan Kim, Heeseok Oh +1Inverse RenderingNeural Rendering

  20. Hyperspectral Intrinsic Decomposition: Joint Recovery of Reflectance and Photometric Components for Non-Lambertian Scenes

    Jul 28, 2026Hao Ye, Zhan Shi, Chenglong Huang +4Inverse RenderingIntrinsic Image Decomposition

  21. PanoLess: Environment Reconstruction from Partial Reflective Views

    Jul 28, 2026Ahitagni Das, Ashok Veeraraghavan, Vivek BoominathanInverse Rendering3D Gaussian Splatting

  22. Inter-Reflective Gaussian Splatting for Robust and Efficient Inverse Rendering

    Jul 24, 2026Chun Gu, Xiaofei Wei, Zixuan Zeng +2Inverse Rendering3D Gaussian Splatting

  23. Feature-Guided Diffusion for Non-Differentiable Inverse Rendering

    Jul 19, 2026Andrei-Timotei Ardelean, Michael Fischer, Tim Weyrich +1Inverse RenderingBlack-Box Optimization

  24. Differentiable Polarized Path Tracing

    Jul 14, 2026Pramod Rao, Jérémy Riviere, Xilong Zhou +6Inverse RenderingDifferentiable Rendering

  25. Dynamic Inverse Rendering for Enhanced Material-Lighting Decomposition

    Jul 10, 2026Raza Yunus, Benjamin Ummenhofer, Jan Eric Lenssen +1Inverse RenderingIntrinsic Image Decomposition

  26. InvSplat: Inverse Feed-Forward Scene Splatting

    Jul 2, 2026Polina Karpikova, Wenjing Bian, Haofei Xu +2Inverse Rendering3D Gaussian Splatting