Active Visual Perception

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 32

All topics

Harnessing Multimodal Large Language Models for Training-Free Human-Object Interaction Detection
Oct 5, 2026Zhaolin Cai, Huiyu Duan, Liu Yang +5Multimodal Large Language Models Active Visual Perception
Shanghai Jiao Tong University · Xinjiang University · Beijing Jiaotong University +1
EviRover: Reinforcing Agentic Perception Beyond a Glance
Sep 30, 2026Kaixuan Fan, Kaituo Feng, Tianshuo Peng +4Tool-Using Vision-Language Agents Active Visual Perception
MMLab, The Chinese University of Hong Kong · Fudan University
Recovering the View: Benchmarking Physical Active Vision for Occlusion Recovery in Robotic Manipulation
Sep 29, 2026Kaijun Luo, Yudi Huang, Qijun Zhong +3Bimanual Robotic Manipulation Active Vision for Robot Manipulation
Sun Yat-sen University · University of Electronic Science and Technology of China · X-Era AI Lab +1
DeltaSeek: Toward Active Perception in Evolving Construction Environments
Sep 27, 2026Sanjay Acharjee, Md Nazmus SakibRobotic Construction Active Visual Perception
Department of Civil Engineering, University of Texas at Arlington, TX 76019, USA.
Fisheye-VLA: Decoupling Coverage and Acuity for Manipulation with a Single Fisheye Camera
Sep 22, 2026Ziang Ren, Zike Yan, Raymond Zhang +2Robotic Manipulation Vision-Based Robot Control
Hong Kong Embodied AI Lab · The Chinese University of Hong Kong, Hong Kong SAR, China · DeepCybo +1
What Survives on Real Drawings: Active Sampling, Connectome Wiring, and Matched Baselines in Architectural Document Vision
Sep 21, 2026Dmitry KuklevVisual Representation Learning Image Matching
Independent Researcher
FlipToSee: A Probabilistic Stable Placement Prior for Active Visual Exploration via Regrasping
Sep 17, 2026Chang Shu, Sushil Samuel Dinesh, Shinkyu ParkActive Visual Perception
Electrical and Computer Engineering, King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Saudi Arabia
LEAP: Learning Emergent Active Perception for Quadruped Navigation
Sep 15, 2026Ü. Bora Gökbakan, Stéphane Caron, Philippe SouèresRobot Navigation Active View Selection
WILLOW · Inria and DI ENS, PSL, Paris, France · ISIR +3
Efficient Semantic Understanding from Digital Foveation
Sep 3, 2026Caterina Caccavella, Vittorio Fra, Andreas Ziegler +2Active Visual Perception Semantic Segmentation
Zurich University of Applied Sciences (ZHAW), Wädenswil, Switzerland · ETH Zürich, Zürich, Switzerland · Politecnico di Torino, Turin, Italy +2
SG-AMP: Scene-Graph-Guided Active Perception and Semantics-Aware Motion Planning for Pepper Plants
Sep 1, 2026Rohit Menon, Shiva Rudra Lolla, Niklas Mueller-Goldingen +3Depth Completion Agricultural Robotics
Humanoid Robots Lab, University of Bonn, Germany · Center for Robotics, Bonn, Germany · Institute of Geodesy and Geoinformation, University of Bonn +1
Conditional Visual Evidence Utility: State-Dependent Rank Reversals in Frozen Vision-Language Encoders
Aug 28, 2026Yunxuan Fang, Xinhe WangVision-Language Models Visual Search
Beihang University
InSight-doc: Agentic Visual Perception for Long-Document Understanding
Aug 11, 2026Kaican Li, Weiyan Xie, Lewei Yao +4Document Understanding Visual Question Answering
1The Hong Kong University of Science and Technology · 2Huawei
GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMs
Aug 4, 2026Zichuan Fu, Shirong Wang, Wenlin Zhang +10GUI Grounding Visual Grounding
City University of Hong Kong · Westlake University · Tencent Jarvis Lab
HiResNets: Native Full-HD Video Recognition with Foveal Residual Streams
Aug 3, 2026Shivani Mall, Swarnim Jain, Joao F. HenriquesResidual Learning Active Visual Perception
Visual Geometry Group, University of Oxford
An Exam for Active Observers
Jul 17, 2026Jiarui Zhang, Muzi Tao, Shangshang Wang +3VLM Evaluation Multimodal Large Language Models
University of Southern California
AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents
Jul 16, 2026Susan Liang, Chao Huang, Filippos Bellos +3Test-Time Scaling Tool-Using Vision-Language Agents
University of Rochester · Univeristy of Michigan
Detector Confidence Signals Presence Rather Than Occlusion in Cluttered Manipulation
Jul 15, 2026Yuanzhi HeOpen-Vocabulary Object Detection Occlusion Reasoning
School of Computer Science & Informatics, Cardiff University
Foveation-Guided Dynamic Token Selection for Robust and Efficient Vision Transformers
Jul 10, 2026Ibrahim Batuhan Akkaya, Kishaan Jeeveswaran, Bahram Zonooz +1Image Corruption Robustness Efficient ViTs
Advanced Research Lab, NavInfo Europe, Eindhoven, 5657 DB, Netherlands · Department of Mathematics and Computer Science, Eindhoven University of Technology, Eindhoven, 5612 AZ, Netherlands
Look-Before-Move: Narrative-Grounded World Visual Attention in Dynamic 3D Story Worlds
Jun 25, 2026Jiaming Bian, Bingliang Li, Yuehao Wu +5Camera-Controlled Video Generation Next-Best-View Planning
Policy-based Foveated Imaging and Perception
Jun 1, 2026Howard Xiao, Jan Ackermann, Boyang Deng +1Active Perception Policy Learning
Stanford University, USA
Look on Demand: A Cognitive Scheduling Framework for Visual Evidence Acquisition in Multimodal Reasoning
May 27, 2026Yang Zhang, Xiaoshuai Sun, Rui Zhao +5Active Perception Multimodal Reasoning
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China. · Sino-Russian ResearchCenter for Digital Economy. · School of Informatics, Xiamen University, China. +2
Why We Look Where We Look: Emergent Human-like Fixations of a Foveated Visual Language Model Maximizing Scene Understanding
May 18, 2026Shravan Murlidaran, Ziqi Wen, Sana Shehabi +1Visual Attention Large Vision-Language Models
Psychological & Brain Sciences, University of California, Santa Barbara & 93106, USA. · Computer Science, University of California, Santa Barbara & 93106, USA. · Electrical and Computer Engineering, University of California, Santa Barbara & 93106, USA.
Behavior Cloning for Active Perception with Low-Resolution Egocentric Vision
May 13, 2026Anthony Bilic, Chen Chen, Ladislau BölöniActive Vision for Robot Manipulation Active Sensing
Department of Computer Science, University of Central Florida, Orlando, FL, USA
TAVIS: A Benchmark for Egocentric Active Vision and Anticipatory Gaze in Imitation Learning
May 8, 2026Giacomo SpiglerActive Vision for Robot Manipulation Active Sensing
Department of Intelligent Systems Tilburg University Netherlands
Act2See: Emergent Active Visual Perception for Video Reasoning
May 3, 2026Martin Q. Ma, Yuxiao Qu, Aditya Agrawal +4Tool Use in VLMs Video Reasoning
1Carnegie Mellon University · 2MIT
The Perceptual Bandwidth Bottleneck in Vision-Language Models: Active Visual Reasoning via Sequential Experimental Design
May 2, 2026Anjie Liu, Ziqin Gong, Yan Song +6VLM Reasoning Visually Grounded Reasoning
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · University College London, London, United Kingdom · ShanghaiTech University, Shanghai, China +2
Autonomous Search for Sparsely Distributed Visual Phenomena through Environmental Context Modeling
Mar 10, 2026Eric Chen, Travis Manderson, Nare Karapetyan +3Underwater Robotics Active Visual Perception
Massachusetts Institute of Technology and Woods Hole Oceanographic Institution · Massachusetts Institute of Technology · Woods Hole Oceanographic Institution +1
Debiasing Central Fixation Confounds Reveals a Peripheral "Sweet Spot" for Human-like Scanpaths in Hard-Attention Vision
Feb 16, 2026Pengcheng Pan, Yonekura Shogo, Yasuo KuniyoshVisual Attention Eye Tracking
Department of Mechano-Informatics, The University of Tokyo
LiDAS: Lighting-driven Dynamic Active Sensing for Nighttime Perception
Dec 9, 2025Simon de Moreau, Andrei Bursuc, Hafid El-Idrissi +1Autonomous Driving Perception Active Sensing
Valeo - Mines Paris PSL · Valeo · Mines Paris PSL
Predicting upcoming visual features during eye movements yields scene representations aligned with human visual cortex
Nov 16, 2025Sushrut Thorat, Adrien Doerig, Alexander Kroner +2Predictive Coding Visual Neuroscience
Institute of Cognitive Science, Osnabrück University, Osnabrück 49069, Germany. · Lossfunk, Bengaluru 560038, India. · Department of Education and Psychology, Freie Universität, Berlin 14195, Germany. +1
Position: Reasoning After Perception Means Reasoning Without Vision
Jul 21, 2025Hongcheng Gao, Zihao Huang, Jingyi Tang +12Visual Reasoning VLM Reasoning
Tsinghua University · BIT · Peking University +6
Look, Focus, Act: Efficient and Robust Robot Learning via Human Gaze and Foveated Vision Transformers
Jul 21, 2025Ian Chuang, Jinyu Zou, Andrew Lee +2Visuomotor Policy Learning Efficient ViTs
University of California, Berkeley · 2Tongji University · University of California, Davis

Oct 5, 2026, cs.CVJ/K move · Enter open · S save

Harnessing Multimodal Large Language Models for Training-Free Human-Object Interaction Detection

Zhaolin Cai, Huiyu Duan, Liu Yang, Yanjun Qin+4

Shanghai Jiao Tong University · Xinjiang University · Beijing Jiaotong University+1

Multimodal Large Language Models Active Visual Perception Human-Object Interaction

Open paper AskPDF arXiv

Human-object interaction (HOI) detection aims to localize human-object pairs and recognize their interactions. Traditional supervised methods perform strongly but rely on task-specific training. Recent multimodal large language models (MLLMs) offer a promising route to training-free HOI detection through their broad visual-semantic knowledge and versatile perceptual and reasoning capabilities. However, existing approaches largely invoke these capabilities through loosely coordinated inference stages. This fragmented execution restricts the role of interaction hypotheses in guiding visual exploration, leaving key participants overlooked and local ambiguities unresolved. Furthermore, propagating early semantic assumptions through subsequent visual grounding and relation prediction induces self-reinforcing semantic circularity. To resolve these challenges, we propose HarnessHOI, a training-free framework that transforms passive MLLM inference into an active interaction-centric harness. Specifically, we introduce an interaction-guided perception mechanism that projects emerging interaction hypotheses back into the visual space to discover missing participants and refine ambiguous evidence through targeted observation. Furthermore, a relation-agnostic geometric adjudication module reconciles multi-source evidence to establish a unified spatial basis for grounded interaction reasoning across multiple actions and semantic roles. Extensive experiments on HICO-DET and V-COCO demonstrate that HarnessHOI achieves state-of-the-art performance among training-free methods, confirming the effectiveness of the proposed harness for complex interaction understanding. Code will be released upon publication.

Momentum

Related topics

Latest papers 32