Active Vision for Robot Manipulation

Overview

Active vision for robot manipulation studies how a robot can change its viewpoint or interact with objects to see what it needs for grasping and task execution, especially under occlusion or uncertainty. Methods include next-best-view planning, gaze control, and information-seeking actions, learned through reinforcement learning, imitation, or vision-language-action policies. Researchers evaluate these approaches in cluttered scenes, occluded-object tasks, and settings where viewpoints or environments change, often using simulation and real-robot trials. A central tension is that active sensing can improve robustness, but its benefits vary by task and must be balanced against extra movements, latency, data needs, and hardware complexity.

Latest papers

CardsList

37 papers16 papers in the last four weeks, up 167% on the four weeks before. 0.1% of all new papers.

  1. ActiveAlign: Aligning Egocentric Manipulation via Active Perception

    Oct 27, 2026Ri-Zhao Qiu, Bowen Wen, Yifeng Jiang +6Real-to-Sim TransferRobotic Manipulation

  2. LogLook: Execution-Grounded Memory for Frontier-Model Robot Planners

    Oct 23, 2026Tianyi Jiang, Tianyao Tong, Zhenshan BingMemory-Augmented VLMsLarge Language Model-Based Robot Planning

  3. AWAM: Active Trajectory-Conditioned View Imagination for Robust Robot Manipulation

    Oct 16, 2026Jiawei Geng, Zhenyang Liu, Yuzheng Wu +1Robotic ManipulationActive Vision for Robot Manipulation

  4. FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAs

    Oct 14, 2026Bingao Chen, Lihan Zha, C. Karen Liu +1Foveated VisionVision-Language-Action Models

  5. Receding-Horizon Next-Best-View Planning for Highly Occluded Target Perception

    Oct 13, 2026Ayse Gul Yildiz, Rekha RajaNext-Best-View PlanningRobotic Perception

  6. Look Before You Move: Agent-Interface-Aligned Supervision for Open-World Mobile Manipulation

    Oct 11, 2026Ronghe Qiu, Teli Ma, Jiaming Zhou +4Mobile ManipulationLanguage-Conditioned Robot Manipulation

  7. Learning to See through Action: Predictive Curiosity for Robots

    Oct 9, 2026Stelios Zarifis, Panagiotis Filntisis, George Retsinas +1Self-Supervised Visual Representation LearningActive Vision for Robot Manipulation

  8. EgoReveal: Learning Active Vision and Object Manipulation under Partial Occlusions from Egocentric Demonstrations

    Oct 9, 2026Hiromu Kurihara, Kazutoshi Tanaka, Masashi Hatano +3Active Vision for Robot ManipulationRobotic Manipulation

  9. Fly-by-Code: Embodied Coding Agents for Aerial Manipulation with Active Visual and Physical Feedback

    Oct 8, 2026Jaewoo Lee, Jeongyeon Seo, Sihyun Cho +10Error FeedbackAerial Manipulation

  10. Reactive Exploration of Unknown Environments for Redundant Robots using Virtual Model Control

    Oct 6, 2026Alessio Canzolino, Omar Faris, Alessandro De Blasi +1Active Vision for Robot ManipulationRobotics

  11. EyeRobot 2.0: Active Gaze for Precise Manipulation without Wrist Cameras

    Oct 2, 2026Kush Hari, Justin Kerr, Nidhya Shivakumar +7Active Vision for Robot ManipulationActive Vision

  12. ActiveWAM: Evidence-Aware Active Vision for World-Action Models

    Oct 1, 2026Renjun Wu, Luzhou Ge, Xuesong LiWorld Action ModelsMulti-Task Robotic Manipulation

  13. Beyond the Current Scene: Event-Referential Grasping with Active View Selection

    Sep 30, 2026Hyunjoon Lee, Haebeom Jung, Eunsung Cha +4Robotic GraspingLanguage-Conditioned Robot Manipulation

  14. Recovering the View: Benchmarking Physical Active Vision for Occlusion Recovery in Robotic Manipulation

    Sep 29, 2026Kaijun Luo, Yudi Huang, Qijun Zhong +3Robot Manipulation BenchmarksActive Vision for Robot Manipulation

  15. Learning to Explore Hidden Kinematics for Articulated Object Manipulation

    Sep 29, 2026Ruiyao Liu, Boshu Lei, Zhuoyang Pan +1RL for RoboticsActive Perception

  16. From Passive Execution to Active Exploration: Agentic Embodied Manipulation in Realistic Environments

    Sep 24, 2026Shilin Ma, Chubin Zhang, Xulong Bai +3Long-Horizon Robotic ManipulationActive Vision for Robot Manipulation

  17. Imagine then Verify: Affordance-Targeted Active Perception for Task-Oriented Grasping in Cluttered Scenes

    Sep 20, 2026Jingzhi Cui, Xuefeng Liu, Feng Han +3Robotic GraspingNext-Best-View Planning

  18. Selective Commitment for Language-Guided Object Retrieval under Partial Observability

    Sep 19, 2026Wonhee Koh, Sushil Samuel Dinesh, Hansol Ko +2Vision-Language RetrievalActive Vision for Robot Manipulation

  19. MAAP: Multi-Agent Active Perception for Collaborative Manipulation

    Sep 18, 2026Bruno N. Y. Chen, Li Kang, Heng Zhou +4Active Vision for Robot ManipulationRobotic Manipulation

  20. ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware

    Sep 16, 2026Shuai Zhou, Kaisheng Pang, Wenxuan Song +3Active Vision for Robot ManipulationRobotic Manipulation

  21. Autonomous Precision Milling of Biological Structures via Generic Anatomical Priors and Active Boundary Perception

    Sep 11, 2026Enduo Zhao, Xiaofeng Lin, Yifan Wang +4Active Vision for Robot ManipulationRobotic Manipulation

  22. PhysCaP: Grounding Code-as-Policy Agent with Physics-Informed Exploration

    Aug 21, 2026Chen-Yu Lin, Jing-Wen Chen, Hsueh-En Chang +8Physical ReasoningActive Vision for Robot Manipulation

  23. Evidence-Gated Task and Motion Planning with Vision-Language Models

    Aug 20, 2026Tsunehiko Tanaka, Matthew Stephenson, Alistair Macvicar +1Long-Horizon Robotic ManipulationMotion Planning

  24. ActiveMimic: Egocentric Video Pretraining with Active Perception

    Jun 4, 2026Xingyao Lin, Guojin Zhong, Tianyi Lu +4Active PerceptionActive Vision for Robot Manipulation

  25. Behavior Cloning for Active Perception with Low-Resolution Egocentric Vision

    May 13, 2026Anthony Bilic, Chen Chen, Ladislau BölöniActive Vision for Robot ManipulationActive Sensing

  26. TAVIS: A Benchmark for Egocentric Active Vision and Anticipatory Gaze in Imitation Learning

    May 8, 2026Giacomo SpiglerActive Visual PerceptionActive Sensing

  27. ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstration

    Apr 9, 2026Yanwen Zou, Chenyang Shi, Wenye Yu +5Active Vision for Robot ManipulationRobot Imitation Learning

  28. Occlusion Handling by Pushing for Enhanced Fruit Detection

    Apr 7, 2026Ege Gursoy, Dana Kulić, Andrea CherubiniAgricultural RoboticsActive Vision for Robot Manipulation