Overview

Active visual perception studies how an agent’s actions—such as shifting gaze, zooming into a crop, moving a camera, or changing illumination—can improve what it sees for a task. Methods include biologically inspired foveation and scanpaths, adaptive image and token selection, and learned camera or robot policies; multimodal language models increasingly use these tools to gather evidence for video, document, remote-sensing, and 3D reasoning. Evaluation compares active observation with fixed or full-image input, using measures such as task accuracy, manipulation success, scanpath similarity, and sensing cost. Results show that selective viewing can save computation and improve performance, but benefits depend on the task, and a key challenge is choosing observations that are both informative and feasible while evaluating them without misleading shortcuts such as center bias.

Latest papers

CardsList

53 papers3 papers in the last four weeks, down 75% on the four weeks before. 0.0% of all new papers.

  1. Choosing What to Observe: Budget-Paired Counterfactual Audits for Credible Evaluation of Visual Agents

    Nov 18, 2026Ruiqi Liu, Jinming Li, Mo Wang +2Process-Based Agent EvaluationAI Agent Auditing

  2. Check Your Blind Spots: Decision-Guided Perception by Probing the Planner with Hypothetical Objects

    Nov 17, 2026Hoang Pham Cong, Long D. Nguyen, Ho Viet Duc Luong +2Active Visual PerceptionAutonomous Driving Perception

  3. FoAViS: Analyzing Learned Fixation Strategies in a Foveated Active Vision System

    Oct 30, 2026Valentin Hassler, Jonathan Henrich, Yohaï-Eliel Berreby +2Active Visual PerceptionVisual Attention

  4. Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding

    Oct 27, 2026Ruilin Yao, Xinyu Qiu, Tianyu Zou +4Active Visual PerceptionTransfer Learning

  5. Think-Capture: Active 3D Geometry Acquisition for Spatial Reasoning in Vision-Language Models

    Oct 21, 2026Junjie Wang, Zhihao Yuan, Yunhan Tang +7Visual Spatial Reasoning3D VLMs

  6. Illumination-Aware Active Perception for Spacecraft Inspection

    Oct 15, 2026Sagarika Rao Valluri, Benjamin RiviereRobotic InspectionActive Visual Perception

  7. Learning to Think and Explore in 3D World

    Oct 15, 2026Yijiang Li, Bingyang Wang, Nuno VasconcelosVLM Reasoning3D Visual Question Answering

  8. FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAs

    Oct 14, 2026Bingao Chen, Lihan Zha, C. Karen Liu +1Foveated VisionVision-Language-Action Models

  9. Adaptive Observation Control for Active Visual Recognition

    Oct 14, 2026Dikai Li, Weijia Wang, Yuan-Gen WangActive Visual PerceptionAdaptive Computation

  10. Semantic Saliency from Multi-Modal Large Language Model Scene Understanding Maps

    Oct 11, 2026Ziqi Wen, Shravan Murlidaran, Jonathan Skaza +2Visual SaliencyActive Visual Perception

  11. Harnessing Multimodal Large Language Models for Training-Free Human-Object Interaction Detection

    Oct 5, 2026Zhaolin Cai, Huiyu Duan, Liu Yang +5Multimodal Large Language ModelsMLLM Reasoning

  12. EviRover: Reinforcing Agentic Perception Beyond a Glance

    Sep 30, 2026Kaixuan Fan, Kaituo Feng, Tianshuo Peng +4Tool-Using Vision-Language AgentsActive Visual Perception

  13. Recovering the View: Benchmarking Physical Active Vision for Occlusion Recovery in Robotic Manipulation

    Sep 29, 2026Kaijun Luo, Yudi Huang, Qijun Zhong +3Active Visual PerceptionActive Vision for Robot Manipulation

  14. DeltaSeek: Toward Active Perception in Evolving Construction Environments

    Sep 27, 2026Sanjay Acharjee, Md Nazmus SakibRobotic ConstructionActive Visual Perception

  15. Fisheye-VLA: Decoupling Coverage and Acuity for Manipulation with a Single Fisheye Camera

    Sep 22, 2026Ziang Ren, Zike Yan, Raymond Zhang +2Robotic ManipulationVision-Based Robot Control

  16. FlipToSee: A Probabilistic Stable Placement Prior for Active Visual Exploration via Regrasping

    Sep 17, 2026Chang Shu, Sushil Samuel Dinesh, Shinkyu ParkMixture Density NetworksActive Visual Perception

  17. LEAP: Learning Emergent Active Perception for Quadruped Navigation

    Sep 15, 2026Ü. Bora Gökbakan, Stéphane Caron, Philippe SouèresRobot NavigationQuadruped Robot Navigation

  18. Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understanding

    Sep 6, 2026Xiao Zhang, Wang Zeng, Sheng Jin +3Video SurveillanceActive Visual Perception

  19. Efficient Semantic Understanding from Digital Foveation

    Sep 3, 2026Caterina Caccavella, Vittorio Fra, Andreas Ziegler +2Active Visual PerceptionSemantic Segmentation

  20. SG-AMP: Scene-Graph-Guided Active Perception and Semantics-Aware Motion Planning for Pepper Plants

    Sep 1, 2026Rohit Menon, Shiva Rudra Lolla, Niklas Mueller-Goldingen +3Depth CompletionAgricultural Robotics

  21. Active Perception for Embodied Disambiguation

    Aug 11, 2026Yiwei Liu, Luwei YangActive Visual PerceptionHuman-Robot Interaction

  22. InSight-doc: Agentic Visual Perception for Long-Document Understanding

    Aug 11, 2026Kaican Li, Weiyan Xie, Lewei Yao +4Document UnderstandingVisual Question Answering

  23. GUI-Lens: Enabling Precise GUI Grounding for Off-the-Shelf VLMs via Coarse-to-Fine Cropping

    Aug 4, 2026Zichuan Fu, Shirong Wang, Wenlin Zhang +10GUI GroundingVisual Grounding

  24. HiResNets: Native Full-HD Video Recognition with Foveal Residual Streams

    Aug 3, 2026Shivani Mall, Swarnim Jain, Joao F. HenriquesResidual LearningActive Visual Perception

  25. An Exam for Active Observers

    Jul 17, 2026Jiarui Zhang, Muzi Tao, Shangshang Wang +3VLM EvaluationMultimodal Large Language Models

  26. AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents

    Jul 16, 2026Susan Liang, Chao Huang, Filippos Bellos +3Test-Time ScalingTool-Using Vision-Language Agents