Dynamic Scene Reconstruction

Follow this topic Ask about this topic

Momentum

24 papers in the last four weeks, up 200% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 181

All topics

Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video
May 25, 2026Tingxi Chen, Ke Hao, Yabo Chen +6Camera-Conditioned Video Generation 4D Reconstruction
Shanghai Jiao Tong University · Institute of Artificial Intelligence, China Telecom (TeleAI)
RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video
May 22, 2026Chenyu Wu, Wanhua Li, Zhu-Tian Chen +13D Gaussian Splatting Monocular 3D Reconstruction
Harvard University · Zhejiang University · Nanyang Technological University +1
No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videos
May 21, 2026Matteo Balice, Yanik Kunzi, Chenyangguang Zhang +33D Gaussian Splatting 4D Reconstruction
1Politecnico di Milano · 2ETH Zürich · 3ETH AI Center
Towards Physically Consistent 4D Scene Reconstruction for Closed-loop Autonomous Driving Simulation
May 20, 2026Bowyn Tan, Yutong Xie, Bai Huang +53D Gaussian Splatting Dynamic Scene Reconstruction
Tsinghua University · Meituan · Central University of Finance and Economics
PiG-Avatar: Hierarchical Neural-Field-Guided Gaussian Avatars
May 19, 2026Julian Kaltheuner, Jan Spindler, Sina Kitz +23D Gaussian Splatting Implicit Neural Representations
University of Bonn, Germany
Fast 4D Mesh Generation by Spatio-Temporal Attention Chains
May 19, 2026Dvir Samuel, Yuval Atzmon, Gal Chechik +13D Mesh Generation 4D Reconstruction
NVIDIA Research, Tel-Aviv, Israel · Bar-Ilan University, Ramat-Gan, Israel
MatPhys: Learning Material-Aware Physics Parameters for Deformable Object Simulation from Videos
May 19, 2026Yang Yang, Yiyan Wang, Zheming Liu +1Dynamic Scene Reconstruction Materials Property Prediction
1The University of Osaka · 3Huawei Technologies Japan K.K. · 2The University of Tokyo
Towards Ubiquitous Mapping and Localization for Dynamic Indoor Environments
May 18, 2026Halim Djerroud, Nico Steyn, Olivier Rabreau +2Simultaneous Localization and Mapping Dynamic Scene Reconstruction
Université Paris-Saclay, UVSQ, LISV, 78140, Vélizy-Villacoublay, France. · Tshwane University of Technology. Department of Electrical Engineering, Pretoria, South Africa
Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Driving
May 18, 2026Lijun Zhou, Hongcheng Luo, Zhenxin Zhu +34Dynamic Scene Reconstruction World Models for Autonomous Driving
Xiaomi Auto World Model Team
Motion-Uncertainty-Aware Next-Best-View Planning for Moving Object Reconstruction
May 17, 2026Karen Li, Mattia Mantovani, Robert J. Wood +2Next-Best-View Planning Dynamic Scene Reconstruction
Harvard University, Cambridge, MA 02134, USA. · University of Modena and Reggio Emilia, 42122 Reggio Emilia, Italy.
LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos
May 17, 2026Chenyi Xu, Yihao Wu, Liqi Yan +43D Point Tracking 4D Reconstruction
Hangzhou Dianzi University
RHINO: Reconstructing Human Interactions with Novel Objects from Monocular Videos
May 16, 2026Lixin Xue, Chengwei Zheng, Georgios Paschalidis +43D Reconstruction Monocular 3D Reconstruction
1ETH Zürich · 2The University of Tokyo · University of Amsterdam +1
ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics
May 15, 2026Sylvia Yuan, Dan Wang, Ravi Ramamoorthi +1Articulated Object Reconstruction 3D Reconstruction
University of California San Diego · University of North Texas
EndoGSim: Physics-Aware 4D Dynamic Endoscopic Scene Simulations via MLLM-Guided Gaussian Splatting
May 15, 2026Changjing Liu, Yiming Huang, Long Bai +23D Gaussian Splatting Robotics Simulation
Department of Electronic Engineering, The Chinese University of Hong Kong (CUHK), Hong Kong SAR, China
VGGT- $Ω$
May 14, 2026Jianyuan Wang, Minghao Chen, Shangzhan Zhang +7Multi-View 3D Reconstruction Dynamic Scene Reconstruction
1Visual Geometry Group, University of Oxford · 2Meta AI
Real2Sim in HOI: Toward Physically Plausible HOI Reconstruction from Monocular Videos
May 14, 2026Yubo Zhao, Yujin Chai, Yunao Dong +43D Reconstruction Monocular 3D Reconstruction
The Hong Kong University of Science and Technology · Tencent IEG
Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes
May 13, 2026Kaicong Huang, Talha Azfar, Weisong Shi +13D Gaussian Splatting Synthetic Data Generation
Department of Civil and Environmental Engineering, Rensselaer Polytechnic Institute, 110 Eighth Street, Troy, NY USA 12180. · Department of Computer and Information Sciences, University of Delaware, Newark, DE USA 19716.
4DVGGT-D: 4D Visual Geometry Transformer with Improved Dynamic Depth Estimation
May 12, 2026Ying Zang, Xuanyi Liu, Yidong Han +94D Reconstruction Depth Estimation
4Huzhou University · 2Peking University · 1KOKONI 3D, Moxin Technology +4
PointForward: Feedforward Driving Reconstruction through Point-Aligned Representations
May 12, 2026Cheng Chi, Xianqi Wang, Hongcheng Luo +93D Reconstruction Multi-View 3D Reconstruction
Xiaomi EV · Huazhong University of Science and Technology · Zhejiang University
CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representations
May 11, 2026Nengbo Lu, Minghua PanDynamic Scene Reconstruction Video Prediction
Guilin University of Electronic Technology · Guilin, China
VeloGauss: Learning Physically Consistent Gaussian Velocity Fields from Videos
May 11, 2026Nengbo Lu, Bin Zhao3D Gaussian Splatting Dynamic Scene Reconstruction
Guangxi Key Laboratory of Robot Intelligent Perception and Control, School of Artificial Intelligence, Guilin University of Electronic Technology, Guilin, 541004, China
DySurface: Consistent 4D Surface Reconstruction via Bridging Explicit Gaussians and Implicit Functions
May 11, 2026Minje Kim, Younghyun Noh, Jaesoon Kim +13D Gaussian Splatting Signed Distance Functions
KAIST · KT · Sungkyunkwan University
PaMoSplat: Part-Aware Motion-Guided Gaussian Splatting for Dynamic Scene Reconstruction
May 11, 2026Yinan Deng, Jianyu Dou, Jiahui Wang +33D Gaussian Splatting Dynamic Scene Reconstruction
School of Automation, Beijing Institute of Technology, Beijing 100081, China
SeasonScapes: Learning Large-scale Re-lightable 3D Landscapes with Seasonal Variation from Sparse Webcams
May 9, 2026Timo Kleger, Qi Ma, Deheng Zhang +2Dynamic Scene Reconstruction Sparse-View 3D Reconstruction
2ETH Zurich · 1INSAIT, Sofia University “St. Kliment Ohridski”
Kinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes
May 9, 2026Yeon-Ji Song, Kiyoung Kwon, Junoh Lee +23D Gaussian Splatting 3D Reconstruction
AI Institute, Seoul National University · Interdisciplinary Program in Neuroscience, Seoul National University · Gwangju Institute of Science and Technology +1
One World, Dual Timeline: Decoupled Spatio-Temporal Gaussian Scene Graph for 4D Cooperative Driving Reconstruction
May 8, 2026Yulong Chen, Xiaoyun Dong, Haoyu Zhang +6Multi-View 3D Reconstruction Dynamic Scene Reconstruction
City University of Hong Kong (Dongguan), Guangdong, China · City University of Hong Kong, Hong Kong, China · SLAI, Shenzhen, China
SoLAR: Error-Resilient Streamable Long-Horizon Free-Viewpoint Video Reconstruction with Anchor Activation and Latent Recalibration
May 8, 2026Haotian Zhang, Xu Mo, Yixin Yu +7Dynamic Scene Reconstruction
National Engineering Laboratory for Video Technology, School of Computer Science, Peking University, Beijing 100871, China · School of Computer Science, Jilin University, Changchun 130012, China · Institute for AI Industry Research (AIR), Tsinghua University, Beijing 100084, China
Syn4D: A Multiview Synthetic 4D Dataset
May 6, 2026Zeren Jiang, Yushi Lan, Yihang Luo +83D Point Tracking 4D Reconstruction
VGG, University of Oxford · Nanyang Technological University · Naver Labs Europe
Ground4D: Spatially-Grounded Feedforward 4D Reconstruction for Unstructured Off-Road Scenes
May 6, 2026Shuo Wang, Jilin Mei, Fuyang Liu +64D Reconstruction Autonomous Driving
Institute of Computing Technology, Chinese Academy of Sciences China · Xi’an Jiaotong University China · Beijing Institute of Technology China
FreeTimeGS++: Secrets of Dynamic Gaussian Splatting and Their Principles
May 5, 2026Lucas Yunkyu Lee, Soonho Kim, Youngwook Kim +23D Gaussian Splatting 4D Reconstruction
Seoul National University · POSTECH

May 25, 2026, cs.CVJ/K move · Enter open · S save

Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video

Tingxi Chen, Ke Hao, Yabo Chen, Zhengxue Cheng+5

Shanghai Jiao Tong University · Institute of Artificial Intelligence, China Telecom (TeleAI)

Camera-Conditioned Video Generation 4D Reconstruction Video Diffusion Models Multi-View Video Generation Dynamic Scene Reconstruction 4D Scene Generation

Open paper AskPDF arXiv

Generating 4D scenes from a single-view video is inherently ill-posed: a single viewpoint lacks the information needed to recover a complete, dynamic scene with full coverage. Existing methods are typically limited to monocular videos, simple 3D effects, or only small viewpoint perturbations around the original viewpoint, falling short of true 4D generation. Meanwhile, the lack of large-scale datasets capturing full-scope 4D scenes with synchronized multi-view videos further hinders progress in this direction. We propose a novel single-view video-to-4D framework that casts full-scope 4D generation as a multi-view video synthesis followed by optimization-based 4D reconstruction from the generated views. To instantiate this formulation end-to-end, we make three key contributions. First, we introduce Real-MV-4D, a large-scale dataset of synchronized multi-view videos captured in diverse real-world environments to provide the 4D supervision. Second, we train a multi-view video diffusion model driven by a novel fused time(T)-view(V) attention mechanism that directly embeds geometric reprojection priors and explicit camera conditioning into its view-time interactions. Unlike basic feature fusion, this direct binding strictly aligns the generation process with physical 3D priors to produce a dense, synchronized T

\times

V video grid. Third, rather than relying on non-interactive and inconsistent 2D video interpolations, we lift the synthesized multi-view videos into an explicit 4D representation (i.e. 4DGS), regularized by a Flow Matching Distillation loss that exploits the multi-view prior to improve novel-view rendering. Extensive experiments demonstrate that our method outperforms existing approaches in both visual fidelity and geometric consistency, enabling full-scope 4D scene generation from single-view videos.

Momentum

Related topics

Latest papers 181