Overview

Inverse rendering works backward from images or other measurements to estimate the scene properties and physical processes that produced them, enabling reconstruction, relighting, and editing. Approaches include differentiable rasterization and ray tracing with meshes, neural fields, or Gaussian splats, as well as learned priors and feed-forward models that predict scene properties directly. Researchers evaluate these methods on synthetic and real captures using geometry and material accuracy, novel-view synthesis, and relighting under changed illumination. A central challenge is that different combinations of geometry, materials, and lighting can explain the same observations, especially with sparse views, so methods must balance physical consistency and generalization against speed and incomplete data.

Latest papers

CardsList

79 papers7 papers in the last four weeks, down 42% on the four weeks before. 0.1% of all new papers.

  1. Infer3D: Inverse Generative Modeling Enables Robust 3D Reconstruction

    Nov 18, 2026Amani Kiruga, Mark Hamilton, Joshua B. Tenenbaum +43D ReconstructionMonocular 3D Reconstruction

  2. UltraTex: Aligning Physical Knowledge for High-Fidelity PBR Texture Generation

    Nov 18, 2026Jingzhi Bao, Xiaohe Ma, Hong Li +23D Texture GenerationTexture Synthesis

  3. Neural Render Proxies for Interactive and Differentiable Lighting

    Nov 12, 2026Sergio Sancho, Alexander Rath, Marco Manzi +5Neural Rendering3D Scene Relighting

  4. A Lightweight Differentiable Method for Real-Time Skin Rendering and Digitization

    Nov 10, 2026Mario Marquez-Balduque, Carlos Rodriguez-Pardo, Jorge Lopez-MorenoInverse RenderingDifferentiable Rendering

  5. Differentiable Inverse Rendering Recovers Intrinsic Properties from Intravascular Optical Coherence Tomography

    Nov 9, 2026Ajay Manicka, Karim Kadry, Sebastian Ruiz-Lopera +7Optical Coherence TomographyInverse Rendering

  6. ClearForm: Shared-Surface Gaussian Splatting for Transparent and Opaque Scenes

    Nov 7, 2026Hajeong Lee, Jong-Il Park3D Reconstruction3D Gaussian Splatting

  7. Integrating Learned Priors through Prior-Space Reparameterization for Physically Based Inverse Rendering

    Nov 5, 2026Hun Hwangbo, Minjun Park, Yongsung Kim +4Inverse RenderingPhysically Based Rendering

  8. RIDE-Splat: Reflection Removal for In-the-Wild Driving Environments

    Oct 25, 2026Kevin David Hayes, Alex Hanson, Allen Tu +33D Reconstruction3D Gaussian Splatting

  9. Directionally Factorized Illumination with Spherical Harmonic Rotation

    Oct 17, 2026Yimeng Dou, Adam M. Saunders, Andre T. S. Hucke +5Neural RenderingMulti-View Image Synthesis

  10. RoboCloth: A Large-Scale Real Cloth Material Dataset for Neural Reflectance Reconstruction

    Oct 15, 2026Zhen Li, Haoran Qin, Francesco Di Sario +2Neural RenderingInverse Rendering

  11. VisibilitySplat: Ray-Traced Occlusion for Relighting with 3D Gaussian Splatting

    Oct 14, 2026Sven Kluge, Oliver StaadtInverse Rendering3D Gaussian Splatting

  12. LAMP: 3D Source-Aware Lighting Estimation at Multiple Points

    Oct 13, 2026Yanqiao Wang, Jin SunInverse Rendering3D Scene Understanding

  13. IntrinSync: Joint Intrinsic Decomposition and Reciprocal Rendering

    Oct 8, 2026Zheng Gu, Rui Huang, Xilu Zhang +6Inverse RenderingIntrinsic Image Decomposition

  14. Casual Flash Lighting for Gaussian Splat Inverse Rendering

    Oct 5, 2026Jiamin Xu, Dongheng Wei, Jiarong Zhao +4Inverse Rendering3D Gaussian Splatting

  15. ImpactMat: Continuous Material Estimation for Inverse Impact Sound Rendering

    Oct 5, 2026Hyebin Cho, Bumsoo Kim, Joon Son ChungInverse RenderingMaterials Property Prediction

  16. 4DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes

    Oct 2, 2026Ruihong Shen, Žiga Kovačič, Peter Kulits +6Dynamic Scene ReconstructionAI Agent Benchmarks

  17. RoomLight: A 2.5D Illumination Prior for Indoor Environments

    Sep 23, 2026Andreea Ardelean, Bernhard EggerInverse Rendering

  18. GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

    Sep 17, 2026Jieting Xu, Rengan Xie, Zijian Huang +3Inverse Rendering3D Gaussian Splatting

  19. TBR: Transport-Based Rendering with Deposition Strokes for Inverse Graphics

    Sep 8, 2026Tianqi Liu, Yushan Han, Hang LiuInverse RenderingDifferentiable Rendering

  20. Inverse Rendering for Modeling with Line Primitives

    Sep 1, 2026Kenji Tojo, Ariel Shamir, Nobuyuki Umetani +1Inverse RenderingDifferentiable Rendering

  21. LightFuse: Relightable Interactive Gaussian Scene Reconstruction via Multi-Scan Fusion and 2D Gaussian Ray Tracing

    Aug 29, 2026Haonan Zhou, Gaoxiang Linghu, Youlin Jia +5Differentiable Ray Tracing3D Scene Relighting

  22. mmIR: Frequency-Space Inverse Rendering for 3D Millimeter-Wave Radar ADC Synthesis

    Aug 28, 2026Adnan Armouti, Yixuan Gao, Rajalakshmi NandakumarMillimeter-Wave RadarmmWave Radar Sensing

  23. ExMesh++: From Multi-View Images to Relightable UV-PBR Mesh Assets via Topology-Adaptive Reconstruction and Decomposition

    Aug 25, 2026Chuanjin Fan, Lifan Wu, Wenjie Chang +33D Mesh Reconstruction3D Reconstruction

  24. RGBX-Next: Towards Realistic Generative Rendering from G-Buffers

    Aug 14, 2026Zheng Zeng, Marco Salvi, Lifan Wu +9Inverse RenderingNeural Rendering