Zero-Shot Robotic Manipulation

Overview

Zero-shot robotic manipulation studies how robots can carry out new tasks and interact with unfamiliar objects or environments without task-specific demonstrations or fine-tuning. Approaches combine vision-language models and language-guided planning with geometric grounding, affordance representations, object-centric policies, and closed-loop feedback; other work learns transferable skills from human videos or scales synthetic data and simulation for sim-to-real transfer. Evaluation spans tabletop and long-horizon tasks, dexterous and contact-rich manipulation, and transfer across objects, viewpoints, robots, and real-world settings. A central challenge is turning broad semantic generalization into precise, reliable physical control, especially under occlusion, changing contact dynamics, and compounding errors during long tasks.

Latest papers

CardsList

117 papers20 papers in the last four weeks, down 26% on the four weeks before. 0.2% of all new papers.

  1. ForceHarness: Turning Force into Action and Physics for Frozen Frontier Models

    Nov 16, 2026Ke Sun, Kevin Yuchen Ma, Yike Zhang +2Robotic ManipulationForce-Controlled Robotic Manipulation

  2. Self-Calibrating Vision-Agent-Action: Deploying Pick-and-Place to New Robot Cells without Demonstrations or Fine-Tuning

    Nov 14, 2026Jae Hun Hwang, Yechan Seo, Hong-In WonVision-Based Robot ControlZero-Shot Robotic Manipulation

  3. Bridging Task Planning and Execution for Language-Conditioned Bimanual Manipulation

    Nov 9, 2026Emanuele Cuzzocrea, Giuseppina Iannotti, Luca Rossini +2Language-Conditioned Robot ManipulationRobot Task Planning

  4. Zero-Shot VLA Adaptation with Retrieved Guidance

    Nov 7, 2026Subin Kim, Anh-Quan Pham, Dinesh JayaramanVLA Model AdaptationVision-Language-Action Models

  5. On Agentic Manipulation Policies

    Nov 6, 2026Chen Chen, Omid Bagherieh, Naveen Nikamanth Appiah Balaji +10Agentic AI for RoboticsGeneralization in Robotic Manipulation

  6. UniLatent: Cross-Embodiment Transfer via Latent Observation Alignment

    Nov 6, 2026Yufei Ding, Yi Du, Weiduo Yuan +5Cross-Embodiment TransferLatent Space Alignment

  7. Perceptive Humanoid Motion from Simulation

    Nov 4, 2026Siyuan Hu, Abulikemu Abuduweili, Yue Meng +5Humanoid RoboticsSim-to-Real Transfer

  8. PointPilot: Unified Robotic Manipulation via Object-Centric 3D Point Flow Prediction

    Nov 2, 2026Yihan Fang, Yuxin Tian, Ruixiang Wang +7Robotic ManipulationGeneralization in Robotic Manipulation

  9. MolmoSpaces-CommonSense: Evaluating Commonsense in Robotic Manipulation Policies

    Oct 30, 2026Arjun Guru, Max Argus, Jae Sung Park +3Robotic ManipulationRobot Manipulation Benchmarks

  10. Force-Driven Hook Disassembly via Constraint-Aware Object-Centric Reinforcement Learning

    Oct 28, 2026Nadeen Elhadad, Takuya Kiyokawa, Kensuke HaradaObject-Centric RLRobotic Manipulation

  11. RoboSTD: Zero-Shot Single-to-Dual Transfer via Sagittal Mirroring for Bimanual Learning

    Oct 27, 2026Hongyu Wu, Chong Liu, Shaoxuan Xie +4Bimanual Robotic ManipulationRobot Imitation Learning

  12. Zero-HLM: Generalizable Humanoid Loco-Manipulation without Real Robot Data

    Oct 26, 2026Dianyi Yang, Mengya Liu, Zhumei Wang +9Humanoid Loco-ManipulationSim-to-Real Transfer

  13. LLM4Robot-Bench: How Far Can GPT-6 Astra Go in Robotic Manipulation? A Hierarchical, Paired Sim-Real Benchmark

    Oct 25, 2026Haibao Yu, Jiaqi Meng, Zijian Zhang +16Contact-Rich Robotic ManipulationRobot Manipulation Benchmarks

  14. From Reasoning to Action: Benchmarking Frontier AI Models on LIBERO-10 Robot Manipulation Tasks

    Oct 21, 2026May Espinola, Qifan Zhang, Yu XiangRobotic ManipulationZero-Shot Robotic Manipulation

  15. Large Multimodal Models for Direct Robot Control: GPT-6 as a Beginning

    Oct 20, 2026Youwei Zhou, Bohan Hou, Yankai Fu +10Robotic ManipulationZero-Shot Robotic Manipulation

  16. Learning to Compose: Recursive Self-Improvement of Shared Executable Stacks for Zero-Shot Long-Horizon Robot Manipulation

    Oct 17, 2026Yangzhi Chen, Feiran Liu, Zishuo Wang +4Robotic ManipulationRecursive Self-Improvement

  17. No Eyes, No Problem: What Does Touch Contribute to Blind Baoding Ball Manipulation?

    Oct 16, 2026Ayush Deshmukh, Nalin Agarwal, Elle Miller +1In-Hand ManipulationZero-Shot Robotic Manipulation

  18. MoCaP: Mobile Code-as-Policies for Zero-Shot Mobile Manipulation from Passive Human Videos

    Oct 14, 2026Yiyang Cai, Tatsuya Kamijo, Ninghao Lu +2Zero-Shot Robotic ManipulationMobile Manipulation

  19. TGrasp6D: Task-Informed Vision-Language Priors and Pose Refinement enable Zero-Shot Task-Oriented 6DoF Grasping

    Oct 14, 2026Manav Kulshrestha, Apoorva Vashisth, Damon Conover +1Robotic GraspingZero-Shot Robotic Manipulation

  20. Collective Learning for Unified Robotic Manipulation via Predictive Dynamics Adaptation

    Oct 13, 2026Shaocheng Liu, Yuan Meng, Zhenshan Bing +1Robotic ManipulationCross-Embodiment Robot Learning

  21. VLMs are Native Action Models: Unleashing the Manipulation Capabilities of VLMs with Explicit Action-Space Grounding

    Oct 9, 2026Jingkun Yi, Shujie Zhang, Zirui Zhou +8VLMs for RoboticsZero-Shot Robotic Manipulation

  22. Embodied Zero-Shot Task Planning via Hardware-Aware LLM-VLM Integration for Grounded Robotic Manipulation

    Oct 8, 2026Lonnie Tankersley, Noorbakhsh Amiri Golilarz, Soroush KorivandRobotic ManipulationRobot Task Planning

  23. CASTER: Formalizing Zero-Shot Manipulation from Synthetic Videos as Constrained Optimization

    Oct 8, 2026Yinlong Dai, Homanga Bharadhwaj, Dylan P. LoseyZero-Shot Robotic ManipulationRobotic Manipulation

  24. Dex-One2Many: Learning Dexterous Manipulation from a Single Human Demonstration

    Oct 8, 2026Jusuk Lee, Sungha Kim, Yeonsoo Park +8Robotic ManipulationLearning from Demonstration