3D Representation Learning

Overview

3D representation learning studies how to encode point clouds, meshes, voxel grids, implicit fields, Gaussian splats, and multi-view images into features that preserve shape, spatial relations, and meaning. Methods include masked and contrastive self-supervised learning, rotation-equivariant networks, neural fields, generative latent models, and alignment with image, text, or action features. Systems are tested on tasks such as ShapeNet object recognition and reconstruction, ScanNet scene understanding, and robotic manipulation benchmarks. A central challenge is balancing compact, efficient features with the geometric detail, topology, and robustness needed for sparse views, occlusion, and transfer across datasets or tasks.

Latest papers

CardsList

191 papers21 papers in the last four weeks, up 24% on the four weeks before. 0.1% of all new papers.

  1. PhysCreator: Creating Physically-Attributed 3D Assets at Will

    Oct 25, 2026Shiyan Zheng, Ming Li, Lei Han +13D Asset Generation3D Representation Learning

  2. RangeNav: Task-Aligned LiDAR Range-Image Pretraining for Robot Navigation

    Oct 21, 2026Samuel Foo Enze, Manthan Patel, Fan Yang +4Robot Navigation3D Representation Learning

  3. Noise-Invariant Spatial Encoding for 3D Manipulation Policies under Depth Corruption

    Oct 17, 2026Zhiyuan Yang, Jiaju He, Ruiteng Zhao +3Robotic ManipulationNoise Robustness

  4. TriFold: Folding irregular 3D Gaussians into structured latents for 3D Scene Generation

    Oct 16, 2026Yun Wang, Chiyu Wang, Fan Jiang +53D Scene Generation3D Representation Learning

  5. Teaching DINOv3 About Partial 3D Geometry: A Self-Supervised Geometry-Aware Approach

    Oct 15, 2026Viktoria Ehm, Dongliang Cao, Riccardo Marin +43D Representation LearningSelf-Supervised Visual Representation Learning

  6. Learning Topology-Aware Representations for Mechanics-Relevant TPMS Metamaterials

    Oct 14, 2026Songlin Duan, Shuo Yang, Yujia Zheng +1Topological Representation Learning3D Representation Learning

  7. Q-MAGIC: Quad-only Mesh Autoregressive Generation via Singularity-Aware Circular Relative Offset Tokenization

    Oct 14, 2026Yuming Zhao, Zezeng Li, Weimin Wang +23D Mesh Generation3D Representation Learning

  8. Revisiting Triplet Contrastive Learning for 3D Shape Understanding

    Oct 14, 2026Chaoyang Zhu, Zhe Liao, Jiayi Zhang +33D Representation LearningCross-Modal Alignment

  9. Align-VAE: Aligning Attention and Geometry in VecSet VAEs for 3D Reconstruction

    Oct 10, 2026Huaizhi Qu, Mingxin Yang, Xintong Han +2Variational Autoencoders3D Reconstruction

  10. Point-Focused Attention Meets Context-Scan State Space: Robust Biological Visual Perception for Point Cloud Representation

    Oct 8, 2026Kanglin Qu, Pan Gao, Qun Dai +1Point Cloud Learning3D Representation Learning

  11. ActiveLang: Active Open-Vocabulary 3D Mapping with Semantic-Uncertainty-Guided Exploration

    Oct 7, 2026Liyan Chen, Hairong Yin, Huangying Zhan +33D Semantic Mapping3D Mapping

  12. Atom-JEPA: Joint-Embedding Predictive Architecture for 3D Atomistic Systems

    Oct 6, 2026Kasper Helverskov Petersen, Rasmus Hannibal Tirsgaard, François R J Cornet +2Joint-Embedding Predictive ArchitectureMaterials Property Prediction

  13. SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation

    Oct 1, 2026Tianjiao Yu, Xinzhuo Li, Yifan Shen +43D Shape Generation3D Representation Learning

  14. PAGER: Partial-to-global Alignment via Geometric and Relational Distillation

    Oct 1, 2026Akira-Miranda Adeyomi Adeniran-Lowe, Binod Singh, Lars Arnold Dethlefsen +23D Semantic Segmentation3D Representation Learning

  15. Planning Oriented 3D Scene Completion via Coupled TUDF Occupancy Representation Learning from Partial Observations

    Sep 29, 2026Tianyou Yu, Pengfei Zhao, Chao Xu3D Occupancy Prediction3D Representation Learning

  16. From Surfaces to Volumes: Registered Geometry for Protein Representation Learning

    Sep 28, 2026Siyuan Chen, Cai Zhou, Jinrui Zhang +8Protein-Protein Interaction Prediction3D Representation Learning

  17. Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding

    Sep 28, 2026Xinming Dai, Qihang Jin, Tianshu Tan +8Representation LearningSparse-View 3D Reconstruction

  18. LEGAU: Learning Semantic Gaussian Priors for Scalable Category-level Pose Estimation

    Sep 28, 2026Hongli Xu, Zhaowei Lu, Junwen Huang +5Object Pose Estimation3D Representation Learning

  19. PGL-3D: Towards Progressive Geometric Learning for 3D Visual Query Localization

    Sep 27, 2026Liang Peng, Shizhuo Mu, Bohan Tan +6Geometric Representation Learning3D Representation Learning

  20. Atelier: Learning Local Self-Supervised Features for CryoEM Volumes via Hypernetworks

    Sep 24, 2026Phillip Lo, Sudarshan Babu, Dari Kimanius +13D Representation LearningCryo-Electron Microscopy

  21. KeyGen: Unsupervised Keypoint based Object-Centric Representations for Category-Level Policy Generalization

    Sep 23, 2026Shuxin Cao, Liquan Wang, Masoud Moghani +2Point Cloud LearningGeneralization in Robotic Manipulation

  22. From Alignment to Fusion in 3D Vision-Language

    Sep 23, 2026Xueqi Qiu, Xingyu Miao, Jingjing Deng +33D Representation LearningVision-Language Alignment

  23. GAE: Learning a Geometry-Native Latent Space for 3D-Consistent World Generation

    Sep 21, 2026Jiahao Lu, Minghao Yin, Wenbo Hu +53D Scene GenerationGeometric Consistency in Video Generation

  24. GALA: Geometry-Aware Latent Action Modeling for Vision-Language-Action Model Pretraining across Embodiments

    Sep 18, 2026Yichen Liu, Puzhen Yuan, Xiang Zhu +2Latent Action LearningVision-Language-Action Models

  25. ParticleSplat: Self-supervised Object-centric Latent Particle Splatting

    Sep 16, 2026Lyuxing He, Daniel Guo, Elizabeth Terveen +33D Gaussian SplattingObject-Centric Representation Learning

  26. PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics

    Sep 16, 2026Bardienus P. Duisterhof, Kaifeng Zhang, Adam Hung +53D Point Tracking3D Representation Learning