Tool-Using Vision-Language Agents

Ask about this topic

Momentum

15 papers in the last four weeks, up 200% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 101

All topics
CardsList

  1. SceneActBench: Can Agents Act on the 3D Scenes They See?

    Jul 24, 2026Yifei Zhao, Xiangxin Zhou, Wenhao Yang +11AI Agent BenchmarksTool-Using Vision-Language Agents

    1Tencent Hunyuan · 2THU · 3NJU +3

  2. Searching Videos as Trees: Self-Correcting Agents for Grounded Long Video QA

    Jul 17, 2026Ce Zhang, Ziyang Wang, Yulu Pan +6Temporal Video GroundingTool-Using Vision-Language Agents

    University of North Carolina at Chapel Hill · Sony

  3. AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents

    Jul 16, 2026Susan Liang, Chao Huang, Filippos Bellos +3Test-Time ScalingTool-Using Vision-Language Agents

    University of Rochester · Univeristy of Michigan

  4. MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents

    Jul 13, 2026Kaixin Ma, Di Feng, Alexander Metz +3Tool-Use EvaluationTool-Using Vision-Language Agents

    Apple

  5. Memory-Conditioned Tool Calling for Camera-First Visual Agents

    Jul 10, 2026Xiaofan Wu, Xi Zeng, Miaoxia Chen +5Memory-Augmented VLMsTool-Using Vision-Language Agents

    Chance AI

  6. Self-Specializing Vision-Language Transmon Chip Calibration in a Physics-Grounded Environment

    Jul 3, 2026Animesh Tripathy, Aswanth KrishnanVLM AdaptationTool-Using Vision-Language Agents

    QpiAI India Pvt. Ltd.

  7. VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning

    Jul 3, 2026Zhenkun Gao, Yicheng Bao, Jinlong Peng +13Multimodal RAGVideo QA

    East China Normal University · Tencent Youtu Lab · HFIPS, Chinese Academy of Sciences +3

  8. GMO-E2^2DIT: Grounded Multi-Operation Editing for E-Commerce Images

    Jul 1, 2026Zipeng Guo, Xiaoan Liu, Lichen Ma +9Image Editing EvaluationText-Guided Image Editing

    Wuhan University · Xi’an Jiaotong University · Sun Yat-sen University

  9. PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking

    Jun 30, 2026Dengxian Gong, Yuanzheng Wu, Haobo Yuan +11Vision-Language GroundingTool-Using Vision-Language Agents

    Wuhan University · UC Merced · UTS +3

  10. SimpleSearch-VL: A Simple Recipe for Multimodal Agentic Deep Search

    Jun 30, 2026Ming Dai, Zhihong Lu, Jinjie Gu +5Tool-Augmented Language Model AgentsAgentic Search

    Southeast University · Ant Group

  11. ReGRPO: Reflection-Augmented Policy Optimization for Tool-Using Agents

    Jun 30, 2026Binjie Zhang, Mike Zheng ShouReinforcement LearningGroup Relative Policy Optimization

    Show Lab, National University of Singapore

  12. TACO: Tool-Augmented Credit Optimization for Agentic Tool Use

    Jun 29, 2026Mingkuan Feng, Jinyang Wu, Hao Gu +5Tool Use in VLMsMultimodal QA

    Department of Automation, BNRist, Tsinghua University · Institute of Automation, Chinese Academy of Sciences

  13. Dynamo: Dynamic Skill-Tool Evolution for Vision-Language Agents

    Jun 29, 2026Yutao Sun, Yanting Miao, Hao-Xuan Ma +8Tool Use in VLMsVLM Adaptation

    1Qwen Large Model Application Team, Alibaba · 2Zhejiang University · University of Waterloo +3

  14. ProMSA:Progressive Multimodal Search Agents for Knowledge-Based Visual Question Answering

    Jun 26, 2026ZhengXian Wu, Hangrui Xu, Kai Shi +8Multimodal RAGMultimodal Search Agents

    OPPO AI Center, OPPO Inc. China · The Shenzhen International Graduate School, Tsinghua University · Nanyang Technological University, Singapore

  15. VideoAgent: All-in-One Framework for Video Understanding and Editing

    Jun 22, 2026Hengji Zhou, Lingxuan Huang, Jian Wang +4Video Editing BenchmarksLLM Agent Orchestration

    1Harbin Institute of Technology, Shenzhen · 2South China University of Technology · 3The University of Hong Kong +1

  16. S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligence

    Jun 18, 2026Yalun Dai, Hao Li, Shulin Tian +10Visual Spatial Reasoning3D Spatial Reasoning

    1NTU · ★Ropedia · 2THU +2

  17. CaVe-VLM-CoT: An Interpretable Vision-Language Model Framework

    Jun 16, 2026Sneha Rao, Shaina Raza, Dhanesh RamachandramVLM EvaluationVision-Language Grounding

    Vector Institute, Toronto, ON M5G 0C6, Canada

  18. Guava: Distilling Frontier VLMs into a Compact Agent through a Robotic Manipulation Harness

    Jun 16, 2026Haowen Liu, Xirui Li, Shaoxiong Yao +5Long-Horizon Robotic ManipulationVLM Distillation

    University of Maryland College Park · University of Illinois Urbana-Champaign · University of Waterloo +3

  19. GeoDisaster: Benchmarking Orchestrated Agents for Operational Disaster Geo-Intelligence

    Jun 15, 2026Maram Hasan, Aman Verma, Savitra Roy +5Disaster Damage AssessmentRL for Language Model Reasoning

    Indian Institute of Technology Bombay · Mohamed bin Zayed University of Artificial Intelligence

  20. VisualClaw: A Real-Time, Personalized Agent for the Physical World

    Jun 15, 2026Haoqin Tu, Jianwen Chen, Zijun Wang +14Continual Learning for LLM AgentsAI Agent Benchmarks

    1UC Santa Cruz · 2UNC-Chapel Hill · 3Google +1

  21. Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning

    Jun 13, 2026Zhengbo Zhang, Changtao Miao, Jinbo Su +10Multimodal IRMultimodal Grounding

    School of Artificial Intelligence, UCAS · Institute of Automation, CAS · Ant Digital Technologies, Ant Group +2

  22. SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning

    Jun 11, 2026Seokju Cho, Ryo Hachiuma, Abhishek Badki +8Tool Use in VLMs3D Spatial Reasoning

    KAIST · NVIDIA

  23. SkillChain: Closing the Loop on Skill Evolution for Image-Based E-Commerce AI Assistants

    Jun 11, 2026Yimin Hu, Mengtao Xu, Hao Guo +3LLM Agent Self-ImprovementLLM Agent Skill Learning

    Alibaba Group

  24. Perceive, Interact, Reason: Building Tool-Augmented Visual Agents for Spatial Reasoning

    Jun 11, 2026Changye Li, Meng Lu, Yi Wu +1Tool Use in VLMsVisual Spatial Reasoning

    Tsinghua University · Virginia Tech · NVIDIA

  25. AgenticNav: Zero-Shot Vision-and-Language Navigation as a Tool-Calling Harness

    Jun 9, 2026Yijian Li, Changze Li, Hantian Shi +4Vision-Language NavigationTool-Using Vision-Language Agents

    Shanghai Jiao Tong University · Huawei Technologies Ltd.

  26. IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment

    Jun 6, 2026Zichen Zhu, Yuheng Sun, Mingxuan Zhu +11Text-Guided Image EditingTool-Using Vision-Language Agents

    X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University · Huawei Technologies Ltd. · Shanghai Innovation Institution +1

  27. Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning

    Jun 5, 2026Haoyuan Li, Zhengdong Hu, Jun Wang +23D Spatial ReasoningTool-Using Vision-Language Agents

    Zhejiang University, Hangzhou, China · University of Technology Sydney, Sydney, Australia · OPPO Research Institute, Shenzhen, China

  28. VoLo: A Physical Orchestrator for Open-Vocabulary Long-Horizon Manipulation

    Jun 5, 2026Siyi Chen, Hugo Hadfield, Alex Zook +9Long-Horizon Robotic ManipulationTool-Using Vision-Language Agents

    1NVIDIA · University of Michigan

  29. Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators

    Jun 4, 2026Chenming Zhu, Jingli Lin, Yilin Long +4Visual Spatial ReasoningWorld Model Learning

    1The University of Hong Kong · 2Shanghai AI Laboratory · 3Shanghai Jiao Tong University +2

  30. MapAgent: An Industrial-Grade Agentic Framework for City-scale Lane-level Map Generation

    Jun 3, 2026Deguo Xia, Zihan Li, Haochen Zhao +6HD Map ConstructionAutonomous Driving

    Tsinghua University Baidu Beijing, China · University of Macau Macao, China · Institute of Information Engineering, Chinese Academy of Sciences Beijing, China +2