Multi View Diffusion
Multi-view diffusion models are revolutionizing 3D content generation by synthesizing multiple consistent views of an object from limited input (e.g., a single image or text prompt), enabling subsequent high-fidelity 3D reconstruction. Current research emphasizes improving the quality, consistency, and efficiency of these models, often employing architectures like transformers and diffusion models, sometimes coupled with Gaussian splatting for efficient 3D representation. This work has significant implications for various fields, including computer graphics, virtual and augmented reality, and digital asset creation, by offering faster and more realistic 3D content generation from diverse input sources.
Papers
Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Views
Songchun Zhang, Chunhui Zhao
DSplats: 3D Generation by Denoising Splats-Based Multiview Diffusion Models
Kevin Miao, Harsh Agrawal, Qihang Zhang, Federico Semeraro, Marco Cavallo, Jiatao Gu, Alexander Toshev
Multi-view Image Diffusion via Coordinate Noise and Fourier Attention
Justin Theiss, Norman Müller, Daeil Kim, Aayush Prakash
MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation
Zehuan Huang, Yuan-Chen Guo, Xingqiao An, Yunhan Yang, Yangguang Li, Zi-Xin Zou, Ding Liang, Xihui Liu, Yan-Pei Cao, Lu Sheng
Geometry-guided Cross-view Diffusion for One-to-many Cross-view Image Synthesis
Tao Jun Lin, Wenqing Wang, Yujiao Shi, Akhil Perincherry, Ankit Vora, Hongdong Li
Human Multi-View Synthesis from a Single-View Model:Transferred Body and Face Representations
Yu Feng, Shunsi Zhang, Jian Shu, Hanfeng Zhao, Guoliang Pang, Chi Zhang, Hao Wang
Fancy123: One Image to High-Quality 3D Mesh Generation via Plug-and-Play Deformation
Qiao Yu, Xianzhi Li, Yuan Tang, Xu Han, Long Hu, Yixue Hao, Min Chen
NovelGS: Consistent Novel-view Denoising via Large Gaussian Reconstruction Model
Jinpeng Liu, Jiale Xu, Weihao Cheng, Yiming Gao, Xintao Wang, Ying Shan, Yansong Tang
MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model
Chenjie Cao, Chaohui Yu, Shang Liu, Fan Wang, Xiangyang Xue, Yanwei Fu