3D Diffusion Models

Ask about this topic

Overview

3D diffusion models learn distributions over three-dimensional objects and environments, enabling new content generation, completion of partial observations, and editing of existing geometry. They diffuse over voxels, point clouds, meshes, Gaussian primitives, or compact latent tokens, using denoising networks, diffusion transformers, and flow-matching methods, often conditioned on text, images, sketches, measurements, or spatial layouts. Applications span object benchmarks such as ShapeNet and Objaverse, driving scenes and LiDAR, medical MRI and CT, CAD, and molecular structures. A central challenge is scaling to detailed, large scenes while preserving topology, physical plausibility, and consistency across views; compact latents and coarse-to-fine generation help, but trade-offs in fidelity, control, data, and inference cost remain.

Latest papers

CardsList

121 papers21 papers in the last four weeks, up 40% on the four weeks before. 0.1% of all new papers.

  1. Generative Structure from Motion with Native 3D Diffusion

    Oct 26, 2026Haobin Duan, Binbin Huang, Mochu Xiang +4Structure from MotionMulti-View 3D Reconstruction

    The University of Hong Kong · Transengram · Tencent

  2. Diffusion-Based Synthesis of Complete 3D Biparametric Prostate MRI

    Oct 22, 2026Claudia Giardina, Montse Pardàs, Verónica VilaplanaMedical Image SynthesisMagnetic Resonance Imaging

    Universitat Politècnica de Catalunya, Barcelona, Spain

  3. 3D Diffusion Models for Medical Imaging

    Oct 19, 2026Frank-Peter Schilling, Daniel Barco, Philipp Denzel +13D Diffusion ModelsMedical Image Synthesis

    Centre for AI (CAI), Zurich University of Applied Sciences (ZHAW), Technikumstrasse 9, Winterthur, 8400, Zurich, Switzerland

  4. Learning the Dose Manifold: A Latent Diffusion Framework for Volumetric Dose Prediction in Automated Radiotherapy Treatment Planning

    Oct 19, 2026J. Boyer-Chammard, R. Vauclin, M. C. Biston +7Radiotherapy Dose Prediction3D Diffusion Models

  5. NV-Generate-Body: 3D Latent Diffusion Model forControllable Anatomy, Tumor, and Demographic Body Mask Synthesis

    Oct 16, 2026Can Zhao, Pengfei Guo, Dong Yang +8Medical Image SynthesisConditional Generation

    NVIDIA · National Institutes of Health · University of Arkansas for Medical Sciences

  6. ADT: All-Atom Diffusion Tokenizer for 3D Molecular Structures

    Oct 16, 2026Xuantuo Huang, Encheng Su, Aoran Wang +6Protein Structure Generation3D Molecular Generation

    Peking University · University of Science and Technology of China · Shanghai AI Laboratory +1

  7. Seeing Both the Forest and the Trees: Reusing Holistic 3D Priors for Part-Decomposed Generation

    Oct 15, 2026Yiqun Zhao, Binbin Huang, Haobin Duan +23D Shape Generation3D Mesh Generation

    The University of Hong Kong · Transengram · Tencent +1

  8. WorldRecon: Generative Multi-View Mesh Reconstruction for Large-Scale 3D World

    Oct 13, 2026Mengchen Zhang, Yang Li, Chunshi Wang +23D Reconstruction3D Mesh Reconstruction

    Zhejiang University · Tencent Hunyuan · Fudan University

  9. HairFlow: Modeling 3D Hair Strands with Multi-Modal Conditioned Diffusion

    Oct 12, 2026Yating Wang, Kui Wu, Ran Yi +5Conditional Diffusion Models3D Diffusion Models

    Shanghai Jiao Tong University · LIGHTSPEED

  10. GHOST: Geometry-Constrained Hybrid Diffusion for Open-Vocabulary 3D Scene Graph Generation

    Oct 12, 2026Changqun Feng, Wangxiandi Yin, Xin Hu +43D SGG3D Scene Understanding

    University of Electronic Science and Technology of China Chengdu, Sichuan, China · Jilin University Changchun, Jilin, China

  11. Joint Discrete and SE(3) Diffusion for Protein Interface Design

    Oct 10, 2026Zhenqiao Song, Jianwen Xie, Lei LiProtein Binder DesignMolecular Generation

    Language Technologies Institute, Carnegie Mellon University · Lambda Inc.

  12. GenIA: Generative Reconstruction with Test-Time Input Alignment

    Oct 8, 2026Stefano Esposito, Naama Pearl, Polina Karpikova +53D ReconstructionObject-Centric 3D Reconstruction

    Tübingen AI Center, University of Tübingen · Meta Reality Labs

  13. HI3D 3.0 (Twinkle3D): Object-specific 3D Asset Generation with High Resolution

    Oct 8, 2026Ziying Li, Shengchu Zhao, Huiang He +223D Asset Generation3D Diffusion Models

  14. Position Forcing: Self-Conditioning 3D Generation

    Oct 7, 2026Ziheng Ouyang, Zeqiang Lai, Jiarui Chen +73D Shape Generation3D Diffusion Models

    VCIP, Nankai University · Tencent Hunyuan · MMLab, CUHK +3

  15. Unified Multi-plane Autoregressive Diffusion for 3D Multi-contrast MRI Synthesis

    Oct 7, 2026Yejee Shin, Geonhui Son, Jinglu Wang +3Medical Image Synthesis3D Diffusion Models

    Yonsei University · Microsoft Research Asia · Korea Institute of Science and Technology

  16. Inference-Time Projection for Physically Valid Biomolecular Diffusion Models

    Oct 4, 2026Qurat-ul-ain, Yee Whye Teh, Charlotte M. Deane +1Protein Structure Prediction3D Diffusion Models

    Department of Statistics, University of Oxford · Department of Biology, University of Copenhagen

  17. Verifier-Guided Synthetic Augmentation for 3D Human Shape Generation

    Oct 2, 2026Yuexuan Wu, Yang Xiang, Hamid Laga +33D Avatar GenerationSynthetic Data Augmentation

    Department of Statistics, University of South Carolina, Columbia, SC, USA · Department of Statistics and Operations Research, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA · School of Information Technology, Murdoch University, Perth, Australia +1

  18. T3lescope: Arbitrary-Resolution High-Fidelity Generative Surface Reconstruction from Images

    Oct 2, 2026Atsuhiro Noguchi, Tianhan Xu, Yiming Liang +5Large-Scale 3D Reconstruction3D Reconstruction

    Preferred Networks, Inc. · The University of Tokyo

  19. DecomVoxel: Harnessing 3D-Native Priors with Guided In-situ Denoising Optimization for Decompositional Scene Reconstruction

    Oct 1, 2026Junfeng Ni, Zirui Zhou, Yixin Chen +53D Reconstruction3D Mesh Reconstruction

    Tsinghua University, State Key Laboratory of General Artificial Intelligence, BIGAI, China · Peking University, China

  20. BTC3D: Blended Tile Conditioning for Detail-Enhancing Image-to-3D Generation

    Sep 30, 2026Junyu Li, Qiuyu Chen, Pengcheng Wang +5Diffusion Model Guidance3D Diffusion Models

    City University of Hong Kong (Dongguan) · SB Intuitions Corp. · Universitat Autònoma de Barcelona

  21. GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space

    Sep 28, 2026Kerui Ren, Tao Lu, Linning Xu +5Multi-View ConsistencyNovel View Synthesis

    Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · The Chinese University of Hong Kong +3

  22. Does Native 3D Texture Generation Necessarily Require 3D Assets for Training?

    Sep 28, 2026Jiangshan Wang, Zeqiang Lai, Jiayi Guo +63D Asset Generation3D Texture Generation

    MMLab, CUHK · Tencent Hunyuan · Tsinghua University +3

  23. EMERGE: Resolution-Agnostic Point Cloud Generation with Equivariant Graph-Based Diffusion

    Sep 22, 2026Ilias Mitsouras, Nikolaos Chaidos, Giorgos Stamou +1Graph Neural NetworksEquivariant Neural Networks

    National Technical University of Athens Athens, Greece

  24. Point Diffusion Mamba: Unified Diffusion-State-Space Modeling for Single-View 3D Reconstruction under Data Scarcity

    Sep 22, 2026Wei Zhou, Xinzhe Shi, Xingxing Hao +43D ReconstructionSingle-View 3D Reconstruction

    Northwest University, Xi’an, China · Nanyang Technological University, Singapore

  25. Uncertainty-Aware 3D Residual Wavelet Diffusion for Ultra Low-Field MRI Super-Resolution

    Sep 21, 2026Rui W. Yeow, Millie Beament, Fred Dick +6Medical Image Super-ResolutionMagnetic Resonance Imaging

    University College London, London, UK

  26. ZVeC: A Zero-Shot Framework for Instance-Level Vehicle Extraction and Generative Point Cloud Completion

    Sep 21, 2026Daisy Li, Kyle Gao, Quanyun Wu +3Point Cloud Completion3D Scene Completion

    University of Waterloo · Karlsruhe Institute of Technology

  27. Learning Foresight without Explicit Trajectories for 3D Diffusion Policies

    Sep 17, 2026Zhongbo Zhang, Zaibin Zhang, Yifan Wang +3Robot Policy LearningDiffusion Policy

    Dalian University of Technology

  28. GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

    Sep 17, 2026Jieting Xu, Rengan Xie, Zijian Huang +3Inverse Rendering3D Gaussian Splatting

    State Key Laboratory of CAD&CG, Zhejiang University, China

  29. LIFD: Anchored Diffusion for 3D-Aware Scene Memory in Robotic Manipulation

    Sep 17, 2026Wenbo Li, Yiteng Chen, Wenhao Li +1Robotic Manipulation3D Scene Representation

    School of Software Engineering, South China University of Technology

  30. Mind2Cloud: EEG-to-Point Cloud Generation with Two-Granularity Diffusion Decoding

    Sep 12, 2026Yongyi Lu, Xiongfeng Huang, Zhijing YangEEG-Based Visual DecodingPoint Cloud Generation

    Guangdong University of Technology, Guangzhou, China