cs.ROMar 5, 2026

Hyperbolic Multiview Pretraining for Robotic Manipulation

Authors: Jin Yang, Ping Wei, Yixin Chen, Nanning Zheng

Organizations: National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University

Abstract

3D-aware visual pretraining has proven effective in improving the performance of downstream robotic manipulation tasks. However, existing methods are constrained to Euclidean embedding spaces, whose flat geometry limits their ability to model structural relations among embeddings. As a result, they struggle to learn structured embeddings that are essential for robust spatial perception in robotic applications. To this end, we propose HyperMVP, a self-supervised framework for Hyperbolic MultiView Pretraining. Hyperbolic space offers geometric properties well suited for capturing structural relations. Methodologically, we extend the masked autoencoder paradigm and design a GeoLink encoder to learn multiview hyperbolic representations. The pretrained encoder is then finetuned with visuomotor policies on manipulation tasks. In addition, we introduce 3D-MOV, a large-scale dataset comprising multiple types of 3D point clouds to support pretraining. We evaluate HyperMVP on COLOSSEUM, RLBench, and real-world scenarios, where it consistently outperforms strong baselines across diverse tasks and perturbation settings. Our results highlight the potential of 3D-aware pretraining in a non-Euclidean space for learning robust and generalizable robotic manipulation policies.

Figures & tables

Explore similar work

CardsList
  1. Learning Structural Latent Points for Efficient Visual Representations in Robotic Manipulation

    May 20, 2026Yicheng Jiang, Jiaxu Wang, Junhao He +8Point Cloud LearningRobotic Manipulation

  2. 3DWay: Generalizing Robot Manipulation via 3D Consistent Waypoints

    Sep 8, 2026Ziqin Huang, Yingyue Li, Chenyangguang Zhang +6Generalization in Robotic ManipulationTrajectory Representation Learning

  3. SpatialVAM:Spatial-Aware Multi-View Video Diffusion as a Data-Efficient Robot Policy

    Apr 3, 2026Peiyan Li, Yixiang Chen, Yuan Xu +13Multi-Task Robotic ManipulationData-Efficient Robot Learning