Multimodal Agent Evaluation

Latest papers

CardsList

42 papers26 papers in the last four weeks, with none the four weeks before. 0.2% of all new papers.

  1. Paint What You See: Benchmarking Dexterous Visual Tool Use in Multimodal Agents

    Aug 26, 2026Shudong Liu, Dongyang Chen, Enci Zhang +3AI Agent BenchmarksTool Use

  2. M3^3Exam: Benchmarking Multimodal Memory for Realistic User-Agent Interactions

    Jun 5, 2026Zhengjun Huang, Wenxuan Liu, Zhoujin Tian +6Multimodal UnderstandingMultimodal Grounding

  3. WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction

    May 28, 2026Chengzhi Liu, Yuzhe Yang, Sophia Xiao Pu +14Multimodal Agent EvaluationMultimodal Memory

  4. TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents

    May 16, 2026Zhiqiang Liu, Wenhui Dong, Yilang Tan +3Tool-Use EvaluationAI Agent Benchmarks

  5. MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory

    May 14, 2026Minghao Guo, Qingyue Jiao, Zeru Shi +14Multimodal Agent EvaluationMultimodal Memory

  6. Do Joint Audio-Video Generation Models Understand Physics?

    May 8, 2026Zijun Cui, Xiulong Liu, Hao Fang +8Multimodal Agent EvaluationPhysical Consistency in Video Generation

  7. AgentVista: Evaluating Multimodal Agents in Ultra-Challenging Realistic Visual Scenarios

    Feb 26, 2026Zhaochen Su, Jincheng Gao, Hangyu Guo +10Multimodal Agent EvaluationAI Agent Benchmarks

  8. MERRY: Semantically Decoupled Evaluation of Multimodal Emotional and Role Consistencies of Role-Playing Agents

    Feb 24, 2026Zhenyu Wang, Xiaofen Xing, Yirong Chen +1Role-Playing Agent EvaluationMultimodal Agent Evaluation

  9. GameDevBench: Evaluating Agentic Capabilities Through Game Development

    Feb 11, 2026Wayne Chi, Yixiong Fang, Arnav Yayavaram +8Multimodal Agent EvaluationSoftware Engineering Agents

  10. DSAEval: Evaluating Data Science Agents on a Wide Range of Real-World Data Science Problems

    Jan 20, 2026Maojun Sun, Yifei Xie, Yue Wu +5Multimodal Agent EvaluationLLM Agent Evaluation