Dynamic Scene Reconstruction

Ask about this topic

Overview

Dynamic scene reconstruction estimates how a scene’s geometry, appearance, and motion change over time, enabling novel-view rendering, mapping, and simulation. Methods use neural radiance fields, 3D and 4D Gaussian splatting, meshes, or point-based models, guided by cues such as depth, optical flow, camera motion, object identity, and physical constraints. Work spans monocular and multi-view video, from deformable objects and human interactions to driving scenes, and increasingly uses feed-forward models alongside slower per-scene optimization. A central challenge is that realistic-looking renderings do not always imply accurate geometry or motion; methods must balance fidelity, physical plausibility, speed, and robustness to sparse views, occlusion, and long sequences.

Latest papers

CardsList

290 papers35 papers in the last four weeks, up 30% on the four weeks before. 0.2% of all new papers.

  1. UFO: Unifying Feed-Forward and Optimization-based Methods for Large Driving Scene Modeling

    Feb 24, 2026Kaiyuan Tan, Yingying Shen, Mingfei Tu +5Dynamic Scene Reconstruction3D Reconstruction

    Xiaomi EV · UIUC

  2. RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstruction

    Feb 24, 2026Yangfan Zhao, Hanwei Zhang, Ke Huang +33DGS SLAMSimultaneous Localization and Mapping

    Capital Normal University · Saarland University · Xi’an Jiaotong-Liverpool University +1

  3. Flow3r: Factored Flow Prediction for Scalable Visual Geometry Learning

    Feb 23, 2026Zhongxiao Cong, Qitao Zhao, Minsik Jeon +13D ReconstructionFeed-Forward 3D Reconstruction

    Carnegie Mellon University

  4. PhysConvex: Physics-Informed 3D Dynamic Convex Radiance Fields for Reconstruction and Simulation

    Feb 21, 2026Dan Wang, Xinrui Cui, Serge Belongie +1Dynamic Scene ReconstructionNeural Radiance Fields

    University of California, San Diego · Univesity of North Texas · Copenhagen University

  5. Diff2DGS: Reliable Reconstruction of Occluded Surgical Scenes via 2D Gaussian Splatting

    Feb 20, 2026Tianyi Song, Danail Stoyanov, Evangelos Mazomenos +13D ReconstructionDynamic Scene Reconstruction

  6. 4D Monocular Surgical Reconstruction under Arbitrary Camera Motions

    Feb 19, 2026Jiwei Shan, Zeyu Cai, Cheng-Tai Hsieh +54D Reconstruction3D Reconstruction

    Department of Mechanical and Automation Engineering and T Stone Robotics Institute, The Chinese University of Hong Kong, Hong Kong. · Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China · State Key Laboratory of Robotics and Intelligent Systems, Shenyang, China +3

  7. NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting

    Feb 19, 2026Jiwei Shan, Zeyu Cai, Yirui Li +5Visual SLAM3DGS SLAM

    Department of Mechanical and Automation Engineering and T Stone Robotics Institute, The Chinese University of Hong Kong, Hong Kong. · School of Automation and Intelligent Sensing, the State Key Laboratory of Avionics Integration and Aviation System of-Systems Synthesis, and Shanghai Key Laboratory of Navigation and Location Based Services, Shanghai Jiao Tong University, Shanghai 200240, China

  8. NeRFscopy: Neural Radiance Fields for in-vivo Time-Varying Tissues from Endoscopy

    Feb 17, 2026Laura Salort-Benejam, Antonio AgudoEndoscopic 3D Reconstruction3D Reconstruction

    Institut de Rob`otica i Inform`atica Industrial, CSIC-UPC, Spain

  9. Time-Archival Camera Virtualization for Sports and Visual Performances

    Feb 16, 2026Yunxiao Zhang, William Stone, Suryansh KumarDynamic Novel View SynthesisNeural Rendering

  10. Constrained Dynamic Gaussian Splatting

    Feb 3, 2026Zihan Zheng, Zhenlong Wu, Xuanxuan Wang +53D Gaussian SplattingDynamic Scene Reconstruction

    Shanghai Jiao Tong University, Shanghai, 200240, China

  11. EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesis

    Jan 22, 2026Sheng Miao, Sijin Li, Pan Wang +53D Gaussian SplattingDynamic Scene Reconstruction

    Zhejiang University, China. · Huawei, China. · University of Tübingen, Germany.

  12. SUCCESS-GS: Survey of Compactness and Compression for Efficient Static and Dynamic Gaussian Splatting

    Dec 8, 2025Seokhyun Youn, Soohyun Lee, Geonho Kim +33DGS Compression3D Gaussian Splatting

    Kyung Hee University, South Korea · Kyung Hee University, Seoul, South Korea

  13. Gaussians on Fire: High-Frequency Reconstruction of Flames

    Nov 27, 2025Jakob Nazarenus, Dominik Michels, Wojtek Palubicki +43D Gaussian SplattingDynamic Scene Reconstruction

    Kiel University Germany · KAUST, CEMSE Saudi Arabia · Adam Mickiewicz University Poland +1

  14. Interaction-Aware 4D Gaussian Splatting for Dynamic Hand-Object Interaction Reconstruction

    Nov 18, 2025Hao Tian, Chenyangguang Zhang, Rui Liu +23D Gaussian Splatting3D Reconstruction

    Chengdu Institute of Computer Applications, Chinese Academy of Sciences, Chengdu, China · PetroChina (Beijing) Digital Intelligence Research Institute Co., Ltd., Beijing, China · University of Chinese Academy of Sciences, Beijing, China +2

  15. DIAL-GS: Dynamic Instance Aware Reconstruction for Label-free Street Scenes with 4D Gaussian Splatting

    Nov 10, 2025Chenpeng Su, Wenhua Wu, Chensheng Peng +33D Gaussian SplattingSelf-Supervised Learning

    Shanghai Jiao Tong University, Shanghai 200240, China. · University of California, Berkeley, Berkeley, CA 94720, USA.

  16. Dream4D: Lifting Camera-Controlled I2V towards Spatiotemporally Consistent 4D Generation

    Aug 11, 2025Xiaoyan Liu, Kangrui Li, Jiaxin Liu +2Camera-Controlled Video GenerationImage-to-Video Generation

    The Chinese University of Hong Kong · The Hong Kong Polytechnic University · The University of New South Wales +1

  17. Online camera-pose-free stereo endoscopic tissue deformation recovery with tissue-invariant vision-biomechanics consistency

    Jun 24, 2025Jiahe Chen, Naoki Tomii, Ichiro Sakuma +1Endoscopy3D Reconstruction

    School of Engineering, The University of Tokyo, Tokyo, 113-8656, Japan

  18. Joint Optimization for 4D Human-Scene Reconstruction in the Wild

    Jan 4, 2025Zhizheng Liu, Joe Lin, Wayne Wu +1Markerless Motion Capture4D Reconstruction

    Department of Computer Science, University of California, Los Angeles

  19. MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priors

    Jun 1, 2024Qingming Liu, Yuan Liu, Jiepeng Wang +43D Gaussian SplattingDynamic Gaussian Splatting

    City University of HongKong · CUHK(SZ) · HKUST +2

  20. 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learning

    May 17, 2024Zhentao Liu, Huangxuan Zhao, Wenhui Qin +7Medical ImagingNeural Rendering

    School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai, China · National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University, Wuhan, China · School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, China +1