Zero-Shot Robotic Manipulation

Overview

Zero-shot robotic manipulation studies how robots can carry out new tasks and interact with unfamiliar objects or environments without task-specific demonstrations or fine-tuning. Approaches combine vision-language models and language-guided planning with geometric grounding, affordance representations, object-centric policies, and closed-loop feedback; other work learns transferable skills from human videos or scales synthetic data and simulation for sim-to-real transfer. Evaluation spans tabletop and long-horizon tasks, dexterous and contact-rich manipulation, and transfer across objects, viewpoints, robots, and real-world settings. A central challenge is turning broad semantic generalization into precise, reliable physical control, especially under occlusion, changing contact dynamics, and compounding errors during long tasks.

Latest papers

CardsList

103 papers26 papers in the last four weeks, up 117% on the four weeks before. 0.2% of all new papers.

  1. World Pilot: Steering Vision-Language-Action Models with World-Action Priors

    Jun 10, 2026Zefu Lin, Rongxu Cui, Junjia Xu +4Zero-Shot Robotic ManipulationWorld Models for Robotics

  2. Wall-OSS-0.5 Technical Report

    May 29, 2026Ryan Yu, Pushi Zhang, Starrick Liu +24Zero-Shot Robotic ManipulationCross-Embodiment Robot Learning

  3. Decompose and Recompose: Reasoning New Skills from Existing Abilities for Cross-Task Robotic Manipulation

    May 2, 2026Xitie Zhang, Aming Wu, Yahong HanICL for RoboticsZero-Shot Robotic Manipulation

  4. AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation

    Apr 13, 2026Mingyang Li, Haofan Xu, Haowen Sun +10Affordance-Based Robotic ManipulationRobot Manipulation Datasets

  5. AffordGen: Generating Diverse Demonstrations for Generalizable Object Manipulation with Afford Correspondence

    Apr 12, 2026Jiawei Zhang, Kaizhe Hu, Yingqian Huang +3Affordance-Based Robotic ManipulationRobotic Manipulation

  6. AnySlot: Goal-Conditioned Vision-Language-Action Policies for Zero-Shot Slot-Level Placement

    Apr 12, 2026Zhaofeng Hu, Sifan Zhou, Qinbo Zhang +4Goal-Conditioned Robotic ManipulationRobotic Manipulation

  7. SIM1: Physics-Aligned Simulator as Zero-Shot Data Scaler in Deformable Worlds

    Apr 9, 2026Yunsong Zhou, Hangxu Liu, Xuekun Jiang +12Sim-to-Real TransferSynthetic Data Generation for Robotics

  8. ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstration

    Apr 9, 2026Yanwen Zou, Chenyang Shi, Wenye Yu +5Active Vision for Robot ManipulationRobot Imitation Learning

  9. LAMP: Lift Image-Editing as General 3D Priors for Open-world Manipulation

    Apr 9, 2026Jingjing Wang, Zhengdong Hong, Chong Bao +3Generalization in Robotic ManipulationRobotic Manipulation

  10. BLaDA: Bridging Language to Functional Dexterous Actions within 3DGS Fields

    Apr 9, 2026Fan Yang, Wenrui Chen, Guorun Yan +7Robotic ManipulationRobotic Grasping

  11. Grasp as You Dream: Imitating Functional Grasping from Generated Human Demonstrations

    Apr 8, 2026Chao Tang, Jiacheng Xu, Haofei Lu +4Robotic GraspingZero-Shot Robotic Manipulation

  12. Functional Force-Aware Retargeting from Virtual Human Demos to Soft Robot Policies

    Apr 1, 2026Uksang Yoo, Mengjia Zhu, Evan Pezent +8Motion RetargetingRobot Imitation Learning

  13. RAAP: Retrieval-Augmented Affordance Prediction with Cross-Image Action Alignment

    Mar 31, 2026Qiyuan Zhuang, He-Yang Xu, Yijun Wang +3Robotic Affordance InferenceAffordance-Based Robotic Manipulation

  14. Tac2Real: Reliable and GPU Visuotactile Simulation for Online Reinforcement Learning and Zero-Shot Real-World Deployment

    Mar 30, 2026Ningyu Yan, Shuai Wang, Xing Shen +4Robotics SimulationSim-to-Real Transfer

  15. UMI-Underwater: Learning Underwater Manipulation without Underwater Teleoperation

    Mar 27, 2026Hao Li, Long Yin Chung, Jack Goler +5Affordance-Based Robotic ManipulationRobotic Grasping

  16. DiffusionAnything: End-to-End In-context Diffusion Learning for Unified Navigation and Pre-Grasp Motion

    Mar 27, 2026Iana Zhura, Yara Mahmoud, Jeffrin Sam +4Visual Robot NavigationDiffusion-Based Planning

  17. Morphology-Consistent Humanoid Interaction through Robot-Centric Video Synthesis

    Mar 20, 2026Weisheng Xu, Jian Li, Yi Gu +12Robot Motion GenerationHumanoid Robotics

  18. MolmoB0T: Large-Scale Simulation Enables Zero-Shot Manipulation

    Mar 17, 2026Abhay Deshpande, Maya Guru, Rose Hendrix +23Sim-to-Real TransferZero-Shot Robotic Manipulation

  19. DexGrasp-Zero: A Morphology-Aligned Policy for Zero-Shot Cross-Embodiment Dexterous Grasping

    Mar 17, 2026Yuliang Wu, Yanhan Lin, WengKit Lao +4Robotic GraspingZero-Shot Robotic Manipulation

  20. Emergent Dexterity via Diverse Resets and Large-Scale Reinforcement Learning

    Mar 16, 2026Patrick Yin, Tyler Westenbroek, Zhengyu Zhang +9Robotic RLRobotic Manipulation

  21. Building Explicit World Model for Zero-Shot Open-World Object Manipulation

    Mar 14, 2026Xiaotong Li, Gang Chen, Javier Alonso-MoraZero-Shot Robotic ManipulationRobotic Manipulation

  22. ST-VLA: Enabling 4D-Aware Spatiotemporal Understanding for General Robot Manipulation

    Mar 14, 2026You Wu, Zixuan Chen, Cunxu Ou +9Robotic ManipulationVLMs for Robotics

  23. AdaClearGrasp: Learning Adaptive Clearing for Zero-Shot Robust Dexterous Grasping in Densely Cluttered Environments

    Mar 11, 2026Zixuan Chen, Wenquan Zhang, Jing Fang +7Robotic GraspingRobotics

  24. TiPToP: A Modular Open-Vocabulary Robot Manipulation System That Plans

    Mar 10, 2026William Shen, Nishanth Kumar, Sahit Chintalapudi +8Robotic ManipulationRobot Task Planning

  25. Robotic Scene Cloning:Advancing Zero-Shot Robotic Scene Adaptation in Manipulation via Visual Prompt Editing

    Mar 10, 2026Binyuan Huang, Yuqing Wen, Yucheng Zhao +5Robot Policy AdaptationZero-Shot Robotic Manipulation

  26. UltraDexGrasp: Learning Universal Dexterous Grasping for Bimanual Robots with Synthetic Data

    Mar 5, 2026Sizhe Yang, Yiman Xie, Zhixuan Liang +4Robotic GraspingBimanual Robotic Manipulation

  27. Touch2Insert: Zero-Shot Peg Insertion by Touching Intersections of Peg and Hole

    Mar 4, 2026Masaru Yajima, Yuma Shin, Rei Kawakami +2Robotic InsertionTactile Sensing for Robotic Manipulation