Active Vision for Robot Manipulation

Overview

Active vision for robot manipulation studies how a robot can change its viewpoint or interact with objects to see what it needs for grasping and task execution, especially under occlusion or uncertainty. Methods include next-best-view planning, gaze control, and information-seeking actions, learned through reinforcement learning, imitation, or vision-language-action policies. Researchers evaluate these approaches in cluttered scenes, occluded-object tasks, and settings where viewpoints or environments change, often using simulation and real-robot trials. A central tension is that active sensing can improve robustness, but its benefits vary by task and must be balanced against extra movements, latency, data needs, and hardware complexity.

Latest papers

CardsList

42 papers8 papers in the last four weeks, down 47% on the four weeks before. 0.1% of all new papers.

  1. Visibility-Aware Task and Motion Planning with Task-Centric Perception

    Nov 12, 2026Sahit Chintalapudi, Xiaoyan Wang, Aryan Zoroufi +4Robot Task PlanningLong-Horizon Robotic Manipulation

  2. Curie's Jarvis: Autonomous Robotic Chemistry Experiments from Printed Protocols

    Nov 9, 2026Rumi Loghmani, Bozhang Song, Victor Alvarado +2Robotic Laboratory AutomationRobot Learning

  3. Seeing What Execution Needs: Benchmarking Task-Conditioned Actionable Spatial Belief for Manipulation

    Nov 6, 2026Yina Jian, Mingkun XuRobot Manipulation BenchmarksActive Vision for Robot Manipulation

  4. ActiveAlign: Aligning Egocentric Manipulation via Active Perception

    Oct 27, 2026Ri-Zhao Qiu, Bowen Wen, Yifeng Jiang +6Real-to-Sim TransferRobotic Manipulation

  5. LogLook: Execution-Grounded Memory for Frontier-Model Robot Planners

    Oct 23, 2026Tianyi Jiang, Tianyao Tong, Zhenshan BingMemory-Augmented VLMsLarge Language Model-Based Robot Planning

  6. AWAM: Active Trajectory-Conditioned View Imagination for Robust Robot Manipulation

    Oct 16, 2026Jiawei Geng, Zhenyang Liu, Yuzheng Wu +1occlusion-aware robotic manipulationRobotic Manipulation

  7. FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAs

    Oct 14, 2026Bingao Chen, Lihan Zha, C. Karen Liu +1Foveated VisionVision-Language-Action Models

  8. Receding-Horizon Next-Best-View Planning for Highly Occluded Target Perception

    Oct 13, 2026Ayse Gul Yildiz, Rekha RajaNext-Best-View PlanningRobotic Perception

  9. Look Before You Move: Agent-Interface-Aligned Supervision for Open-World Mobile Manipulation

    Oct 11, 2026Ronghe Qiu, Teli Ma, Jiaming Zhou +4Mobile ManipulationLanguage-Conditioned Robot Manipulation

  10. Learning to See through Action: Predictive Curiosity for Robots

    Oct 9, 2026Stelios Zarifis, Panagiotis Filntisis, George Retsinas +1Self-Supervised Visual Representation LearningActive Vision for Robot Manipulation

  11. EgoReveal: Learning Active Vision and Object Manipulation under Partial Occlusions from Egocentric Demonstrations

    Oct 9, 2026Hiromu Kurihara, Kazutoshi Tanaka, Masashi Hatano +3occlusion-aware robotic manipulationActive Vision for Robot Manipulation

  12. Fly-by-Code: Embodied Coding Agents for Aerial Manipulation with Active Visual and Physical Feedback

    Oct 8, 2026Jaewoo Lee, Jeongyeon Seo, Sihyun Cho +10Robotic Program SynthesisError Feedback

  13. Reactive Exploration of Unknown Environments for Redundant Robots using Virtual Model Control

    Oct 6, 2026Alessio Canzolino, Omar Faris, Alessandro De Blasi +1Active Vision for Robot ManipulationRobotics

  14. EyeRobot 2.0: Active Gaze for Precise Manipulation without Wrist Cameras

    Oct 2, 2026Kush Hari, Justin Kerr, Nidhya Shivakumar +7Active Vision for Robot ManipulationActive Vision

  15. ActiveWAM: Evidence-Aware Active Vision for World-Action Models

    Oct 1, 2026Renjun Wu, Luzhou Ge, Xuesong LiWorld Action ModelsMulti-Task Robotic Manipulation

  16. Beyond the Current Scene: Event-Referential Grasping with Active View Selection

    Sep 30, 2026Hyunjoon Lee, Haebeom Jung, Eunsung Cha +4Robotic GraspingLanguage-Conditioned Robot Manipulation

  17. Recovering the View: Benchmarking Physical Active Vision for Occlusion Recovery in Robotic Manipulation

    Sep 29, 2026Kaijun Luo, Yudi Huang, Qijun Zhong +3Active Visual PerceptionActive Vision for Robot Manipulation

  18. Learning to Explore Hidden Kinematics for Articulated Object Manipulation

    Sep 29, 2026Ruiyao Liu, Boshu Lei, Zhuoyang Pan +1RL for RoboticsActive Perception

  19. From Passive Execution to Active Exploration: Agentic Embodied Manipulation in Realistic Environments

    Sep 24, 2026Shilin Ma, Chubin Zhang, Xulong Bai +3Long-Horizon Robotic ManipulationActive Vision for Robot Manipulation

  20. Imagine then Verify: Affordance-Targeted Active Perception for Task-Oriented Grasping in Cluttered Scenes

    Sep 20, 2026Jingzhi Cui, Xuefeng Liu, Feng Han +3Robotic GraspingNext-Best-View Planning

  21. Selective Commitment for Language-Guided Object Retrieval under Partial Observability

    Sep 19, 2026Wonhee Koh, Sushil Samuel Dinesh, Hansol Ko +2Vision-Language RetrievalActive Vision for Robot Manipulation

  22. MAAP: Multi-Agent Active Perception for Collaborative Manipulation

    Sep 18, 2026Bruno N. Y. Chen, Li Kang, Heng Zhou +4Active Vision for Robot ManipulationRobotic Manipulation

  23. ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware

    Sep 16, 2026Shuai Zhou, Kaisheng Pang, Wenxuan Song +3Active Vision for Robot ManipulationRobotic Manipulation

  24. Autonomous Precision Milling of Biological Structures via Generic Anatomical Priors and Active Boundary Perception

    Sep 11, 2026Enduo Zhao, Xiaofeng Lin, Yifan Wang +4Active Vision for Robot ManipulationRobotic Manipulation

  25. PhysCaP: Grounding Code-as-Policy Agent with Physics-Informed Exploration

    Aug 21, 2026Chen-Yu Lin, Jing-Wen Chen, Hsueh-En Chang +8Physical ReasoningActive Vision for Robot Manipulation

  26. Evidence-Gated Task and Motion Planning with Vision-Language Models

    Aug 20, 2026Tsunehiko Tanaka, Matthew Stephenson, Alistair Macvicar +1Long-Horizon Robotic ManipulationMotion Planning