Vision-Language Agents

Follow this topic Ask about this topic

Momentum

2 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 30

All topics

Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arena
Oct 1, 2026Haojian Huang, Pukun Zhao, Zexi Li +7VLM Evaluation Visual Reasoning
HKUST (Guangzhou) · Knowin AI · The Chinese University of Hong Kong
Show-Harness: Just a VLM Agent Can Play Robots
Sep 9, 2026Yanzhe Chen, Zechen Bai, Zhijun Cao +7Cross-Embodiment Robot Learning Language-Conditioned Robot Control
Show Lab, National University of Singapore
Lies We Can See: Joint Verbal and Non-Verbal Deception by VLM Agents in Embodied Social Interactions
Aug 31, 2026Jaewoo Ahn, Junseo Kim, Hyunseo Kim +4Social Deduction Games AI Agent Safety Benchmarks
Seoul National University · Inha University · KAIST +1
SkillLens: Visual Skill Cards for Retrieval-Augmented GUI Action Prediction and On-Policy Distillation
Aug 11, 2026Zhou Liu, Ligang Huang, Zeli Su +5GUI Agents LLM Agent Skill Retrieval
Peking University · ByteDance · Shanghai Jiao Tong University
ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning
Jul 14, 2026Jiahang Wang, Yirong Yang, Yanqing Zhu +4Hierarchical Planning Vision-Language Navigation
Amap, Alibaba Group, China · Beihang University
Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing
Jul 9, 2026Feng Wang, Canmiao Fu, Zhipeng Huang +3Multimodal Memory Episodic Memory
Peking University · WeChat Vision, Tencent Inc.
Dynamo: Dynamic Skill-Tool Evolution for Vision-Language Agents
Jun 29, 2026Yutao Sun, Yanting Miao, Hao-Xuan Ma +8Tool Use in VLMs VLM Adaptation
1Qwen Large Model Application Team, Alibaba · 2Zhejiang University · University of Waterloo +3
The Latent Bridge: A Continuous Slow-Fast Channel for Real-Time Game Agents
Jun 23, 2026Bojie Li, Noah ShiGame-Playing Agents VLM Reasoning
Pine AI · University of Washington
LandslideAgent with Multimodal LandslideBench: A Domain-Rule-Augmented Agent for Autonomous Landslide Identification and Analysis
Jun 17, 2026Chengfu Liu, Dongyang Hou, Junwu Xiang +5Semantic Segmentation Vision-Language Agents
School of Geosciences and Info-Physics, Central South University, 932 South Lushan Road, Changsha, 410083, Hunan, China.
GUITrans2Act: Understanding User Operational Behaviors from Mobile GUI Interactions with Vision-Language Models
Jun 11, 2026Yudong Zhang, Lei Hu, Daoyang Liu +4Mobile GUI Automation Vision-Language Agents
Honor Device Co., Ltd · The Chinese University of Hong Kong, Hong Kong, China
JoyAI-VL-Interaction: Real-Time Vision-Language Interaction Intelligence
Jun 10, 2026Dingyu Yao, Junhao Zhou, Chenxu Yang +17Human-AI Interaction Vision-Language Agents
Guide Me Out: A Framework to Benchmark VLM Operators Communication in Crisis Scenarios
Jun 8, 2026Giacomo Gonella, Stefano Menini, Marco GueriniVLM Evaluation Disaster Response
Fondazione Bruno Kessler, Italy · University of Trento, Italy
MIRAGE: Mobile Agents with Implicit Reasoning and Generative World Models
Jun 3, 2026Zhichao Yang, Yuanze Hu, Haojie Hao +7Mobile GUI Automation Latent Visual Reasoning
Beihang University · Northwestern Polytechnical University · Institute of Software, Chinese Academy of Sciences +2
Multi-Turn Multi-Agent Dialogue for Collaborative Reconstruction Improves VLM Performance on Spatial Reasoning, But Only Barely
May 29, 2026Chalamalasetti Kranti, Sherzod Hakimov, David SchlangenVisual Spatial Reasoning Multi-Agent Collaboration
Computational Linguistics, Department of Linguistics University of Potsdam, Germany · German Research Center for Artificial Intelligence (DFKI), Berlin, Germany
SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes
May 29, 2026Tianhui Liu, Jie Feng, Zhiheng Zheng +6Spatial Reasoning Benchmarks Visual Spatial Reasoning
1The Hong Kong University of Science and Technology (Guangzhou) · 2Zhongguancun Academy · 3Tsinghua University +1
DiTTo: Scalable Order-aware All-in-One Image Restoration Agent
May 29, 2026Seungho Choi, Jihyong OhAll-in-One Image Restoration Image Restoration
CMLab, Chung-Ang University
Completion at the Boundary (CaB): Deployable Switching with Completion-Aware Control under Limited Calibration
May 29, 2026Yusuke Sano, Takeshi ItogaVision-Language-Action Models Embodied AI
Intelligent Systems Laboratory, SECOM Co., Ltd.
DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selection
May 22, 2026Jie Zhu, Girish Chandar Ganesan, Xiaoming LiuMetric Depth Estimation Monocular Depth Estimation
Michigan State University · University of North Carolina at Chapel Hill
GROW: Aligning GRPO with State-Action Modeling for Open-World VLM Agents
May 18, 2026Xiongbin Wu, Zhihao Luo, Shanzhe Lei +7Reinforcement Learning Group Relative Policy Optimization
Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · East China Normal University +2
ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models
May 11, 2026Tingshu Mou, Jiabo He, Renying Wang +5Visual Spatial Reasoning 3D Spatial Reasoning
Fudan University · BCAI · Bosch Center for Artificial Intelligence (BCAI) +1
Mirror, Mirror on the Wall: Can VLM Agents Tell Who They Are at All?
May 9, 2026Filippo Ziliotto, Ciro Beneduce, Bruno Lepri +3AI Agent Evaluation Vision-Language Grounding
University of Padova · FondazioneLucianoBrunoSerafiniKessler · Fondazione Bruno Kessler
PRISM: Perception Reasoning Interleaved for Sequential Decision Making
May 6, 2026Mohamed Salim Aissi, Clemence Grislain, Clement Romac +4Active Perception VLM Reasoning
Sorbonne Universite, CNRS, ISIR, F-75005 Paris, France · Hugging Face · Inria (Flowers), University of Bordeaux, France +2
What You Think is What You See: Driving Exploration in VLM Agents via Visual-Linguistic Curiosity
May 5, 2026Haoxi Li, Qinglin Hou, Jianfei Ma +6Intrinsic Motivation RL Exploration
Department of Computer Science and Engineering, Hong Kong University of Science and Technology (HKUST), Hong Kong, China. · Department of Computer Science, University of Southern California, Los Angeles, USA · School of Computing, National University of Singapore, Singapore. +1
AI-Gram: When Visual Agents Interact in a Social Network
Apr 23, 2026Andrew ShinMulti-Agent LLM Systems Multi-Agent Systems
Faculty of Science and Technology Keio University Yokohama, Kanagawa Prefecture, Japan
If you're waiting for a sign... that might not be it! Mitigating Trust Boundary Confusion from Visual Injections on Vision-Language Agentic Systems
Apr 21, 2026Jiamin Chang, Minhui Xue, Ruoxi Sun +3VLM Robustness Adversarial Attacks on VLMs
University of New South Wales, Sydney, NSW 2052, Australia · CSIRO’s Data61, Marsfield, NSW 2122, Australia · Macquarie University, NSW 2109, Australia
Environmental Understanding Vision-Language Model for Embodied Agent
Apr 21, 2026Jinsik Bang, Jaeyeon Bae, Donggyu Lee +2Embodied AI VLMs for Robotics
UNIST
AgentRVOS for MeViS-Text Track of 5th PVUW Challenge: 3rd Method
Apr 20, 2026Deshui Miao, Chao Yang, Chao Tian +4Image Segmentation Video Object Segmentation
1Pengcheng Laboratory · 2Wuhan Textile University · 3Yixiang Innovation Technology (Shenzhen)
SlowBA: An efficiency backdoor attack towards VLM-based GUI agents
Mar 9, 2026Junxian Li, Tu Lan, Haozhen Tan +2Backdoor Attacks GUI Agents
School of Computer Science, Shanghai Jiao Tong University
Vision Wormhole: Latent-Space Communication in Heterogeneous Multi-Agent Systems
Feb 17, 2026Xiaoze Liu, Ruowang Zhang, Weichen Yu +7Multi-Agent Systems Multimodal Agents
Purdue University · Contextual AI · Carnegie Mellon University +1
EMemBench: Interactive Benchmarking of Episodic Memory for VLM Agents
Jan 23, 2026Xinze Li, Ziyue Zhu, Siyuan Liu +4Episodic Memory Long-Horizon Agent Evaluation
Nanyang Technological University · Shanghai AI Laboratory · Fudan University

Oct 1, 2026, cs.ROJ/K move · Enter open · S save

Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arena

Haojian Huang, Pukun Zhao, Zexi Li, Yehang Zhang+6

HKUST (Guangzhou) · Knowin AI · The Chinese University of Hong Kong

VLM Evaluation Visual Reasoning AI Agent Benchmarks Embodied AI VLMs for Robotics Vision-Language Agents

Open paper AskPDF arXiv

Frontier vision-language models (VLMs) increasingly estimate scenes, ground interactions, and generate executable actions. How far these native capabilities support embodied generalism across diverse tasks remains unclear. We introduce Embodied Agent Arena to assess seven VLM agents across Geometry, Spatial Reasoning, Affordance, Task Planning, and Manipulation. The arena contains 1,000 cases drawn from 32 established sources and GeoProbe, our new benchmark for geometric estimation on Blender renders and real-scene images. A minimal harness preserves source observations and operations while leaving perception, reasoning, and action selection to the model. Separate measures of metric precision, functional grounding, and native goal completion connect local competence to complete task outcomes. Astra's strengths in precise estimation and usable-contact localization coexist with endpoint errors in tracing and low household-task completion. Supplementary comparisons of richer observations and multi-round review show model- and task-dependent effects. Current VLM agents thus fall short of embodied generalism: they often make partial progress without satisfying all task goals within allotted time and interaction budgets.

Momentum

Related topics

Latest papers 30