Overview

3D foundation models aim to represent the shape, structure, and meaning of objects and scenes in forms that transfer across tasks such as reconstruction, segmentation, robotics, and generation. Common approaches pretrain on point clouds, multi-view images, meshes, or medical volumes using self-supervision, masked prediction, and alignment with images or language; models are then adapted with fine-tuning, lightweight prompts, or distillation. Generative models also use these representations to create or edit 3D assets and scenes. A central challenge is balancing broad transfer with reliable performance across different sensors, domains, and scales, while improving efficiency and evaluating geometric consistency and robustness.

Latest papers

CardsList

71 papers7 papers in the last four weeks, down 36% on the four weeks before. 0.0% of all new papers.

  1. Latent Riemannian Flow Matching for Geometry-Grounded 3D Foundation Models

    Jul 21, 2026Lisa Weijler, Irene Ballester, Guofeng Mei +23D Foundation ModelsFlow Matching

  2. ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space

    Jul 13, 2026Mingchao Sun, Luyang Tang, Yu Liu +343D Scene RepresentationPanoramic 3D Reconstruction

  3. DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generation

    Jul 8, 2026Weizhe Liu, Yunjie Wu, Xiangqian Shu +53D Foundation Models3D Asset Generation

  4. ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation

    Jul 7, 2026Tianjiao Yu, Xinzhuo Li, Yifan Shen +43D Foundation ModelsUnified Multimodal Models

  5. RayTun3R: Online Camera Adaptation in 3D Foundation Models

    Jul 2, 2026Daniil Sinitsyn, Nikita Araslanov, Daniel Cremers3D Foundation ModelsTest-Time Adaptation

  6. Geometric Foundation Model Distillation for Efficient Lunar 3D Reconstruction

    Jul 2, 2026Clémentine Grethen, Florient Chouteau, Géraldine Morin +13D Foundation Models3D Reconstruction

  7. The Turning Point of 3D Plant Phenotyping: 3D Foundation Models Enable Minute-to-Second Cross-Crop Reconstruction and Beyond

    Jul 2, 2026Hanyue Jia, Wei Zhou, Wenbo Zhou +33D Foundation ModelsPlant Phenotyping

  8. EPO: Boosting 3D Foundation Models with Edge-based Pose Optimization

    Jul 1, 2026Mattia D'Urso, Christian Sormann, Mattia Rossi +13D Foundation Models3D Reconstruction

  9. Arko-T: A Foundation Model for Text-to-Structured 3D Generation

    Jun 29, 2026Liang Wang, Zhaoyang Xi, Zekai Xiang +53D Foundation ModelsParametric CAD Modeling

  10. One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models

    Jun 28, 2026Xiaohao Xu, Feng Xue, Xiang Li +53D Foundation ModelsDepth Estimation

  11. Jolia: Concept-Level Vision-Language Alignment for 3D CT Contrastive Learning

    Jun 23, 2026Julien Khlaut, Charles Corbière, Baptiste Callard +93D VLMsMedical Imaging Foundation Models

  12. PAIWorld: A 3D-Consistent World Foundation Model for Robotic Manipulation

    Jun 16, 2026Yuhang Huang, Xuan Lv, Junyan Xu +253D Foundation ModelsMulti-View Consistency

  13. Honey, I Shrunk the Arc de Triomphe!

    Jun 1, 2026Yuanbo Xiangli, Hanyu Chen, Xueqing Tsang +13D Foundation ModelsMetric Depth Estimation

  14. Unified Panoramic Geometry Estimation via Multi-View Foundation Models

    May 25, 2026Vukasin Bozic, Isidora Slavkovic, Dominik Narnhofer +43D Foundation Models3D ViTs

  15. FOUND-IT: Foundation-model-first Task-driven 3D Scene Graphs with Granularity on Demand

    May 25, 2026Dominic Maggio, Nicolas Gorlo, Kris Hauser +13D Foundation ModelsScene Graph Generation

  16. Tango3D: Towards Alignment for Global and Local 2D-3D Correspondence

    May 19, 2026Zebin He, Mingxin Yang, Shuhui Yang +43D Foundation ModelsCross-Modal Alignment

  17. Tadpole: Autoencoders as Foundation Models for 3D PDEs with Online Learning

    May 14, 2026Qiang Liu, Felix Koehler, Benjamin Holzschuh +13D Foundation ModelsPDE Surrogate Modeling

  18. Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models

    May 5, 2026Zihao Guo, Yiding Sun, Jihua Zhu +33D Foundation ModelsMamba

  19. Long-tail Internet photo reconstruction

    Apr 24, 2026Yuan Li, Yuanbo Xiangli, Hadar Averbuch-Elor +23D Foundation Models3D Reconstruction

  20. Mining Attribute Subspaces for Efficient Fine-tuning of 3D Foundation Models

    Apr 11, 2026Yu Jiang, Hanwen Jiang, Ahmed Abdelkader +4Parameter-Efficient Fine-TuningLow-Rank Adaptation

  21. Online3R: Online Learning for Consistent Sequential Reconstruction Based on Geometry Foundation Model

    Apr 10, 2026Shunkai Zhou, Zike Yan, Fei Xue +3Streaming 3D ReconstructionTest-Time Adaptation

  22. RGB-Pointmap Pretraining for Unified 3D Scene Understanding

    Apr 2, 2026Ye Mao, Weixun Luo, Ranran Huang +23D Foundation ModelsMulti-View Learning

  23. Towards Foundation Models for 3D Scene Understanding: Instance-Aware Self-Supervised Learning for Point Clouds

    Mar 26, 2026Bin Yang, Mohamed Abdelsamad, Miao Zhang +1Self-Supervised Point Cloud LearningPoint Cloud Learning

  24. An Adapter-free Fine-tuning Approach for Tuning 3D Foundation Models

    Mar 24, 2026Sneha Paul, Zachary Patterson, Nizar BouguilaFine-Tuning3D Foundation Models

  25. S-VGGT: Structure-Aware Subscene Decomposition for Scalable 3D Foundation Models

    Mar 18, 2026Xinze Li, Pengxu Chen, Yiyuan Wang +23D Foundation ModelsEfficient Attention