3D Reconstruction

Follow this topic Ask about this topic

Momentum

112 papers in the last four weeks, up 62% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 672

All topics

CATSplat: Context-Aware Transformer with Spatial Guidance for Generalizable 3D Gaussian Splatting from A Single-View Image
Dec 17, 2024Wonseok Roh, Hwanhee Jung, Jong Wook Kim +63D Gaussian Splatting 3D ViTs
Korea University · Google · Purdue University
Sonicmesh: Enhancing 3D Human Mesh Reconstruction in Vision-Impaired Environments With Acoustic Signals
Dec 15, 2024Xiaoxuan Liang, Hong Zhou, Zhaolong Wei +33D Reconstruction Human Mesh Recovery
University of Massachusetts at Amherst, Location, Country · Trine University · University of Illinois at Chicago +1
SparseLGS: Sparse View Language Embedded Gaussian Splatting
Dec 3, 2024Jun Hu, Zhang Chen, Zhong Li +23D Gaussian Splatting Language-Embedded 3DGS
School of Mathematical Science, University of Science and Technology of China · Meta · Apple Inc. +1
NumGrad-Pull: Numerical Gradient Guided Tri-plane Representation for Surface Reconstruction from Point Clouds
Nov 26, 2024Ruikai Cui, Binzhu Xie, Shi Qiu +3Implicit Neural Representations 3D Reconstruction
School of Computing, The Australian National University, Australia · Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China · Department of Computer Science & Software Engineering, the University of Western Australia, Australia
GSurf: Learning Signed Distance Fields from Splatting Opaque Gaussians for High-quality 3D Reconstruction
Nov 24, 2024Baixin Xu, Jiangbei Hu, Jiaze Li +13D Gaussian Splatting Signed Distance Functions
College of Computing and Data Science, Nanyang Technological University · School of Software, Dalian University of Technology
PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshing
Sep 16, 2024Peng Li, Wangguandong Zheng, Yuan Liu +93D Reconstruction 3D Mesh Reconstruction
HKUST · Southeast University · Tsinghua University +1
2DGH: 2D Gaussian-Hermite Splatting for High-quality Rendering and Better Geometry Features
Aug 30, 2024Ruihan Yu, Tianyu Huang, Jingwang Ling +13D Gaussian Splatting 3D Reconstruction
Department of Physics, Tsinghua University · School of software and BNRist, Tsinghua University
Multi-view Hand Reconstruction with a Point-Embedded Transformer
Aug 20, 2024Lixin Yang, Licheng Zhong, Pengxiang Zhu +43D ViTs Markerless Motion Capture
School of Artificial Intelligence (SAI), Shanghai Jiao Tong University, Shanghai 200230, China · School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China · School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China +1
EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates
Date pendingWeikun Peng, Denys Iliash, Manolis SavvaArticulated Object Reconstruction 3D Part Segmentation
Simon Fraser University
Reconstruction of a 3D wireframe from a single line drawing via generative depth estimation
Date pendingElton Cao, Hod Lipson3D Reconstruction Depth Estimation
Creative Machines Lab, Columbia University New York, NY
Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning
Date pendingXuyang Wang, Zhenyu Li, Jian Ding +4Articulated Object Reconstruction 3D Reconstruction
Australian National University, Canberra, Australia · King Abdullah University of Science and Technology, Thuwal, Saudi Arabia
NSL-SLAM: High-Fidelity Neural Structured-Light Depth for Practical SLAM and Reconstruction
Date pendingJiaheng Li, Binsheng Zhang, Xinhai Chang +13D Reconstruction Depth Estimation
Wangxuan Institute of Computer Technology, Peking University Beijing Academy of Artificial Intelligence, Beijing, China · School of Computer Science and Technology, Beihang University · Yuanpei College, Peking University

Dec 17, 2024, cs.CVJ/K move · Enter open · S save

CATSplat: Context-Aware Transformer with Spatial Guidance for Generalizable 3D Gaussian Splatting from A Single-View Image

Wonseok Roh, Hwanhee Jung, Jong Wook Kim, Seunggwan Lee+5

Korea University · Google · Purdue University

3D Gaussian Splatting 3D ViTs 3D Reconstruction Single-View 3D Reconstruction Feed-Forward 3D Reconstruction

Open paper AskPDF arXiv

Recently, generalizable feed-forward methods based on 3D Gaussian Splatting have gained significant attention for their potential to reconstruct 3D scenes using finite resources. These approaches create a 3D radiance field, parameterized by per-pixel 3D Gaussian primitives, from just a few images in a single forward pass. However, unlike multi-view methods that benefit from cross-view correspondences, 3D scene reconstruction with a single-view image remains an underexplored area. In this work, we introduce CATSplat, a novel generalizable transformer-based framework designed to break through the inherent constraints in monocular settings. First, we propose leveraging textual guidance from a visual-language model to complement insufficient information from a single image. By incorporating scene-specific contextual details from text embeddings through cross-attention, we pave the way for context-aware 3D scene reconstruction beyond relying solely on visual cues. Moreover, we advocate utilizing spatial guidance from 3D point features toward comprehensive geometric understanding under single-view settings. With 3D priors, image features can capture rich structural insights for predicting 3D Gaussians without multi-view techniques. Extensive experiments on large-scale datasets demonstrate the state-of-the-art performance of CATSplat in single-view 3D scene reconstruction with high-quality novel view synthesis.

Momentum

Related topics

Latest papers 672