Multimodal Agents

Ask about this topic

Latest papers 364

49 papers in the last four weeks, up 20% on the four weeks before. 0.3% of all new papers.

All topics
CardsList

  1. MedMASLab: A Unified Orchestration Framework for Benchmarking Multimodal Medical Multi-Agent Systems

    Mar 10, 2026Yunhang Qian, Xiaobin Hu, Jiaquan Yu +6Multi-Agent SystemsMultimodal Agents

    National University of Singapore · University of Science and Technology of China · Fudan University +3

  2. MM-tau-p2^2: Persona-Adaptive Prompting for Robust Multi-Modal Agent Evaluation in Dual-Control Settings

    Mar 10, 2026Anupam Purwar, Aditya ChoudharyAgent EvaluationAI Agent Benchmarks

    Sprinklr AI, Gurugram, India

  3. Meissa: Multi-modal Medical Agentic Intelligence

    Mar 9, 2026Yixiong Chen, Xinyi Bai, Yue Pan +2Medical LLMsMultimodal Agents

    Johns Hopkins University, Baltimore, MD, USA · Cornell University, Ithaca, NY, USA

  4. ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning

    Mar 9, 2026Yiran Zhao, Yaoqi Ye, Xiang Liu +2Image EditingRL for Image Editing

    National University of Singapore · Adobe Research

  5. PIRA-Bench: A Transition from Reactive GUI Agents to GUI-based Proactive Intent Recommendation Agents

    Mar 9, 2026Yuxiang Chai, Shunye Tang, Han Xiao +2GUI AgentsAI Agent Benchmarks

    Nankai University · Huawei Research

  6. DERM-3R: A Resource-Efficient Multimodal Agents Framework for Dermatologic Diagnosis and Treatment in Real-World Clinical Settings

    Mar 6, 2026Jirui Dai, Zhendong Wang, Chongjing Wang +7Multimodal AgentsClinical Decision-Making

  7. Towards Multimodal Lifelong Understanding: A Dataset and Agentic Baseline

    Mar 5, 2026Guo Chen, Lidong Lu, Yicheng Liu +17Temporal Video UnderstandingVideo Understanding

    1Nanjing University · 2NVIDIA · 3Zhejiang University +2

  8. Dual-Modality Multi-Stage Adversarial Safety Training: Robustifying Multimodal Web Agents Against Cross-Modal Attacks

    Mar 4, 2026Haoyu Liu, Dingcheng Li, Lukas Rutishauser +1Adversarial TrainingMultimodal Robustness

    UC Berkeley, IEOR & BAIR · Google · Google Deepmind

  9. Proact-VL: A Proactive VideoLLM for Real-Time AI Companions

    Mar 3, 2026Weicai Yan, Yuhong Dai, Qi Ran +6AI CompanionsVision-Language Agents

    Zhejiang University · Shenzhen University · South China University of Technology +2

  10. PlayWrite: A Multimodal System for AI Supported Narrative Co-Authoring Through Play in XR

    Mar 2, 2026Esen K. Tütüncü, Qian Zhou, Frederik Brudy +2Interactive StorytellingHuman-AI Co-Creation

    Institute of Neurosciences of the University of Barcelona, Barcelona, Spain · Autodesk Research, San Francisco, USA · Autodesk Research, Toronto, Canada

  11. CARE: Towards Clinical Accountability in Multi-Modal Medical Reasoning with an Evidence-Grounded Agentic Framework

    Mar 2, 2026Yuexi Du, Jinglu Wang, Shujie Liu +2Medical VLMsMedical Reasoning

    Microsoft Research Asia · Department of Biomedical Engineering, Yale University · Department of Radiology & Biomedical Imaging, Yale University

  12. SciDER: Scientific Data-centric End-to-end Researcher

    Mar 2, 2026Ke Lin, Owais Aijaz, Yilin Lu +3AI Agents for Scientific DiscoveryScientific Workflow Automation

    Data Science, College of William & Mary, Williamsburg, USA · Natural Language Processing, MBZUAI, Abu Dhabi, UAE · Computer Science, University of Minnesota, Minneapolis, USA +1

  13. U-Mind: A Unified Framework for Real-Time Multimodal Interaction with Audiovisual Generation

    Feb 27, 2026Xiang Deng, Feng Gao, Yong Zhang +5Multimodal AgentsUnified Multimodal Models

    Tsinghua University · Meituan

  14. AgentVista: Evaluating Multimodal Agents in Ultra-Challenging Realistic Visual Scenarios

    Feb 26, 2026Zhaochen Su, Jincheng Gao, Hangyu Guo +10AI Agent BenchmarksTool-Using Vision-Language Agents

    Hong Kong University of Science and Technology · University of North Carolina at Chapel Hill · Zhejiang University +1

  15. Can Agents Distinguish Visually Hard-to-Separate Diseases in a Zero-Shot Setting? A Pilot Study

    Feb 26, 2026Zihao Zhao, Frederik Hauke, Juliana De Castilhos +2Medical Image ClassificationMultimodal Agents

    Department of Diagnostic and Interventional Radiology, University Hospital Aachen, 52074 Aachen, Germany

  16. WaterVideoQA: ASV-Centric Perception and Rule-Compliant Reasoning via Multi-Modal Agents

    Feb 26, 2026Runwei Guan, Shaofeng Liang, Ningwei Ouyang +9Video QAVideo Reasoning

    Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China. · Hubei Key Laboratory of Inland Shipping Technology (Wuhan University of Technology), Wuhan, China · School of Advanced Technology, Xi’an Jiaotong-Liverpool University, Suzhou, China. +5

  17. OmniGAIA: Towards Native Omni-Modal AI Agents

    Feb 26, 2026Xiaoxi Li, Wenxiang Jiao, Jiarui Jin +10Multimodal ReasoningAI Agent Benchmarks

    1Renmin University of China · 2Xiaohongshu Inc. · 3Peking University +2

  18. ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile Devices

    Feb 25, 2026Dezhi Kong, Zhengzhao Feng, Qiliang Liang +12AI Agent BenchmarksAgentic AI

    HyperAI Team, Xiaomi Corporation · Zhejiang University · Peking University +1

  19. Adversarial Intent is a Latent Variable: Stateful Trust Inference for Securing Multimodal Agentic RAG

    Feb 24, 2026Inderjeet Singh, Vikas Pahuja, Aishvariya Priya Rathina Sabapathy +8AI Agent SecurityRAG Security

    Fujitsu Research of Europe, UK · Fujitsu Limited, Japan

  20. PyVision-RL: Forging Open Agentic Vision Models via RL

    Feb 24, 2026Shitian Zhao, Shaoheng Lin, Ming Li +4Multimodal AgentsRL for VLMs

    Shanghai AI Lab · UMD · CUHK +3

  21. MERRY: Semantically Decoupled Evaluation of Multimodal Emotional and Role Consistencies of Role-Playing Agents

    Feb 24, 2026Zhenyu Wang, Xiaofen Xing, Yirong Chen +1Agent EvaluationMultimodal Agents

    South China University of Technology, Guangzhou 510641, China · Foshan University, Foshan 528225, China

  22. MMA: Multimodal Memory Agent

    Feb 18, 2026Yihao Lu, Wanru Cheng, Zeyu Zhang +1Multimodal AgentsMemory-Augmented Agents

    School of Computer Science, Peking University

  23. Proactive Conversational Assistant for a Procedural Manual Task based on Audio and IMU

    Feb 17, 2026Rehana Mahfuz, Yinyi Guo, Erik Visser +1Conversational AgentsTask-Oriented Dialogue Systems

    Qualcomm Technologies, Inc.

  24. Multi-Modal Multi-Agent Reinforcement Learning for Radiology Report Generation

    Feb 17, 2026Kaito Baba, Risa Kishikawa, Satoshi KoderaRadiology Report GenerationMultimodal Agents

    Department of Cardiovascular Medicine The University of Tokyo Hospital, Tokyo, Japan

  25. Vision Wormhole: Latent-Space Communication in Heterogeneous Multi-Agent Systems

    Feb 17, 2026Xiaoze Liu, Ruowang Zhang, Weichen Yu +7Multi-Agent SystemsMultimodal Agents

    Purdue University · Contextual AI · Carnegie Mellon University +1

  26. EventMemAgent: Hierarchical Event-Centric Memory for Online Video Understanding with Adaptive Tool Use

    Feb 17, 2026Siwei Wen, Zhangcheng Wang, Xingjian Zhang +2Streaming Video UnderstandingMultimodal Agents

    Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, School of Artificial Intelligence, Beihang University, Beijing, China · 4Paradigm Inc., Beijing, China · Hangzhou International Innovation Institute, Beihang University, Hangzhou, China

  27. ProAct: Harnessing Streaming Motion Generation and Agentic Reasoning for Real-Time Embodied Social Interaction

    Feb 15, 2026Zeyi Zhang, Zixi Kang, Ruijie Zhao +4Human Motion GenerationHuman-Robot Interaction

    Peking University, China

  28. ProAct: A Benchmark and Multimodal Framework for Structure-Aware Proactive Response

    Feb 3, 2026Xiaomeng Zhu, Fengming Zhu, Weijie Zhou +8AI Agent BenchmarksProactive Assistance

    Department of Computer Science and Engineering, The Hong Kong University of Science and Technology (HKUST), Hong Kong SAR, China · Tencent, Shenzhen, China · Futian Laboratory, Shenzhen, China +1

  29. A Vision Toward Energy-Efficient Domain-Specific Artificial Intelligence Models and Agents

    Oct 24, 2025Abhijit Chatterjee, Niraj K. Jha, Jonathan D. Cohen +6Energy-Efficient MLLifelong Learning Agents

    School of Electrical and Computer Engineering, Georgia Institute of Technology · Department of Electrical and Computer Engineering, Princeton University · Department of Psychology & Neuroscience Institute, Princeton University +4

  30. MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents

    Aug 14, 2025Shilong Li, Xingyuan Bu, Wenjie Wang +22Multimodal IRMultimodal Reasoning

    1ByteDance · 2Nanjing University · 5Zhejiang University +2