Tool-Using Vision-Language Agents

Ask about this topic

Momentum

15 papers in the last four weeks, up 200% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 101

All topics
CardsList

  1. Adversarial Images Hijack Web Agents from Visual Grounding to Browser Execution

    Oct 7, 2026Wanjing Han, Levi Taiji Li, Mu Zhang +2AI Agent SecurityTool-Using Vision-Language Agents

    University of Utah

  2. Visual Orchestration Tax in Agentic VLM Pipelines: Auditing and Certifying Visual Evidence Reuse

    Oct 6, 2026Lingteng ZengVLM EvaluationAI Agent Auditing

    Faculty of Engineering, The Chinese University of Hong Kong Hong Kong, China

  3. IRSTD-Agent: Agentic Infrared Small Target Detection via Zoom-Guided Interaction Learning

    Oct 4, 2026Jiawen Xi, Yu Zhang, Tianyi Zhao +3Tool Use in VLMsInfrared Small Target Detection

    Beihang University · Dalian University of Technology

  4. WebFovea: When the Model Is Right but the Click Is Wrong -- Reliable Round Trips for Vision-Based Web Agents on Live Websites

    Oct 2, 2026Jiangang HanWeb AgentsTool-Using Vision-Language Agents

    Independent Researcher

  5. Fewer Tokens, Better Action: GPT-6 Astra Robot Agents with 14% Higher Success Rate but 65% Fewer Tokens

    Oct 1, 2026Ruiyang Si, Jianxin Bi, Shunyu Yang +9Robotic ControlTool-Augmented Language Model Agents

    Peking University · National University of Singapore · NVIDIA +1

  6. EviRover: Reinforcing Agentic Perception Beyond a Glance

    Sep 30, 2026Kaixuan Fan, Kaituo Feng, Tianshuo Peng +4Tool-Using Vision-Language AgentsActive Visual Perception

    MMLab, The Chinese University of Hong Kong · Fudan University

  7. A.D.A.M.O. (Agent for language-Driven Actions with Multimodal Observations): A Visual-Symbolic Framework for Virtual Humans

    Sep 28, 2026Alessandro Emmanuel Pecora, Stefano Calzolari, Francesco Strada +1Language Model-Based ControlWorld Models

    DAUIN, Politecnico di Torino, Torino, Italy

  8. PainterBench: A Figural Divergent-Thinking Benchmark for Tool-Using Language Models

    Sep 28, 2026Shane K. A. Dalumura Hettige, Jonas OppenlaenderCreativity AssessmentAgentic Image Generation

    Computer Science and Engineering University of Oulu Oulu, Finland · Centre for Applied Computing University of Oulu Oulu, Finland

  9. WeaveAgent: A Two-Stage Tool-Routing Agent for Ultra-High-Resolution Remote Sensing Imagery

    Sep 25, 2026Zhongyu PangRemote Sensing Image UnderstandingTool Use in VLMs

    Department of Electronics, National University of Defense Technology, Changsha, China

  10. World Action Agent: Harnessing VLMs for Robot Manipulation via World Action Rehearsal

    Sep 24, 2026Yehang Zhang, Haojian Huang, Yifan Chang +13Tool-Using Vision-Language AgentsRobotic Manipulation

    HKUST(GZ) · Knowin AI · CUHK

  11. SkinAgent AI: A Safety-Grounded Multimodal Agentic Framework for Non-Diagnostic Skincare Support

    Sep 24, 2026Muhammad Muhtasim Shahriar, Abdullah Mohammad Sayem, Tze Hui Liew +2LLM Agent OrchestrationLLM Agent Evaluation

    Department of Computer Science, International Islamic University Chittagong, Chittagong, Bangladesh · Centre for Intelligent Cloud Computing, Centre of Excellence for Advanced Cloud, Faculty of Information Science and Technology, Multimedia University, Melaka, Malaysia · Multimedia University, Jalan Ayer Keroh Lama, 75450 Bukit Beruang, Melaka, Malaysia +1

  12. VideoResearcher: Self-Improving Tool Design for Long-Video Understanding

    Sep 17, 2026Dingqiang Ye, Dongdi Zhao, Kaishen Wang +11Tool-Using Vision-Language AgentsLong-Video Understanding

    Johns Hopkins University

  13. NoteVQA: Benchmarking VLMs on Real-Life Questions from Human Communities

    Sep 14, 2026Haonan Jiang, Guojian Zhan, Jiancong Xie +6VLM EvaluationVisual Question Answering

    AllSpark Team

  14. AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation

    Sep 14, 2026Long Giang Vu, Chengkai Yao, Yuxin Liu +2Vision-Language NavigationVision-Language Grounding

    *These authors contributed equally.

  15. Online Video Agent Harness for Long Video Understanding

    Sep 14, 2026Sen Yang, Boqiang Duan, Jing Yang +7Tool-Using Vision-Language AgentsLong-Video Understanding

    Baidu Inc. · Baidu

  16. MedVA: An End-to-End Neuro-Symbolic Agentic System for Medical Volume Visualization

    Sep 14, 2026Haill An, Suhyeon Kim, Minjun Kang +4Medical Image AnalysisTool-Using Vision-Language Agents

    Institute of Translational Medicine, National Center for Translational Medicine, Shanghai Jiao Tong University, Minhang, Shanghai, China

  17. Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method

    Sep 8, 2026Boao Yu, Zimo Chen, Junreng Rao +4Aerial RoboticsAI Agent Benchmarks

    National University of Defense Technology National Key Laboratory of Digital Intelligent Modeling and Simulation

  18. Making Every Tool Call Count: Necessary Tool-Evidence Path Rewards for Agentic Vision-Language Models

    Sep 3, 2026Xingming Long, Yu Liu, Zhiwei Yang +7Tool Use in VLMsTool-Using Vision-Language Agents

    MiLM Plus, Xiaomi Inc.3 · Institute of Information Engineering, Chinese Academy of Sciences1 · Department of Machine Learning, Carnegie Mellon University2

  19. FoldingAgent: Inferring Parametric Origami Procedures from Demonstration Videos

    Aug 31, 2026Maya Moriya, Sigal Raab, Yael Vinker +1Tool-Using Vision-Language AgentsVideo Reasoning

    Weizmann Institute of Science, Rehovot, Israel · MIT, Boston, USA

  20. Evolve Vision-Language-Action Model into an Agent with On-the-fly Tool-use

    Aug 14, 2026Ding Yi, Yanzhao Yu, Xili Dai +5Robotic Tool UseTool-Using Vision-Language Agents

    Astribot · Tsinghua University · Juxi Tech +2

  21. MIRA: Medical Image Reflection for Agentic Diagnosis

    Aug 11, 2026Shengzhi Wang, Jun Yang, Kai Wu +11Medical Image AnalysisLLM Agent Verification

    Tongji University · École Normale Supérieure – PSL · Nanjing University +2

  22. InSight-doc: Agentic Visual Perception for Long-Document Understanding

    Aug 11, 2026Kaican Li, Weiyan Xie, Lewei Yao +4Document UnderstandingVisual Question Answering

    1The Hong Kong University of Science and Technology · 2Huawei

  23. ToolVision: Learning When and How to Use Visual Tools with Capability-Aligned Supervision

    Aug 9, 2026Delin Mao, Chenghao Sun, Jingwei Song +2Tool Use in VLMsTool-Using Vision-Language Agents

    Shanghai Jiao Tong University · University of Chinese Academy of Sciences · Fudan University

  24. An Agentic AI Framework Overcomes Fundamental Limitations of Large Language Models for Glaucoma Detection from Fundus Photography

    Aug 7, 2026Jalil Jalili, Hossein Taghizad, Anuwat Jiravarnsirikul +8Medical ImagingMedical Image Classification

    Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, La Jolla, CA, USA. · Hamilton Glaucoma Center, Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, La Jolla, CA, USA · Department of Electrical and Computer Engineering, University of Quebec at Trois-Rivières, Trois-Rivières, QC, Canada +2

  25. LAVE: Latent Visual Evidence-Enhanced Planning for Video Tool-use Agents

    Aug 5, 2026Zijian Wang, Junnan Zhu, Rongzhen Li +7Latent Visual ReasoningTool-Using Vision-Language Agents

    College of Computer Science, Chongqing University, Chongqing, China · MAIS, Institute of Automation, Chinese Academy of Sciences · Chongqing National Data AI Research Institute, AI Research Lab +1

  26. ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generation

    Aug 5, 2026Jiahao Zhao, Xiaomin Yu, Zhongxiang Sun +5Unified Multimodal ModelsAgentic Image Generation

    1RUC · 2HKUST(GZ) · 3NUS +1

  27. Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent

    Aug 4, 2026Zhen Fang, Yu Zeng, Wenxuan Huang +17Deep Research AgentsVideo QA

  28. VC-Tooler: Learning Compositional and Adaptive Visual Tool Use

    Aug 3, 2026Yizheng Wu, Jiashen Hua, Bing Deng +1Tool Use in VLMsTool-Using Vision-Language Agents

    Alibaba Group

  29. DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoning

    Aug 1, 2026An Lanji, Dawei Liu, Jin Li +3AI Agent ReliabilityVLM Interpretability

    University of Electronic Science and Technology of China, Chengdu, China.

  30. VetClaw: An Edge-Cloud Multimodal Agentic System for Veterinary Disease Screening

    Jul 28, 2026Syed Mhamudul Hasan, Anas AlSobeh, Hussein Zangoti +1Multimodal ClassificationTool-Using Vision-Language Agents

    School of Computing, Southern Illinois University, Carbondale, 62901, IL, USA. · 2Information Systems and Technology, Utah Valley University, Orem, Orem, 84058, UT, USA. · College of Engineering and Computer Science, Jazan University, Saudi Arabia.