Multimodal Agent Evaluation

Latest papers

CardsList

42 papers24 papers in the last four weeks, against 1 the four weeks before. 0.2% of all new papers.

  1. TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents

    May 16, 2026Zhiqiang Liu, Wenhui Dong, Yilang Tan +3Tool-Use EvaluationAI Agent Benchmarks

  2. MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory

    May 14, 2026Minghao Guo, Qingyue Jiao, Zeru Shi +14Multimodal Agent EvaluationMultimodal Memory

  3. Do Joint Audio-Video Generation Models Understand Physics?

    May 8, 2026Zijun Cui, Xiulong Liu, Hao Fang +8Multimodal Agent EvaluationPhysical Consistency in Video Generation

  4. AgentVista: Evaluating Multimodal Agents in Ultra-Challenging Realistic Visual Scenarios

    Feb 26, 2026Zhaochen Su, Jincheng Gao, Hangyu Guo +10Multimodal Agent EvaluationAI Agent Benchmarks

  5. MERRY: Semantically Decoupled Evaluation of Multimodal Emotional and Role Consistencies of Role-Playing Agents

    Feb 24, 2026Zhenyu Wang, Xiaofen Xing, Yirong Chen +1Role-Playing Agent EvaluationMultimodal Agent Evaluation

  6. GameDevBench: Evaluating Agentic Capabilities Through Game Development

    Feb 11, 2026Wayne Chi, Yixiong Fang, Arnav Yayavaram +8Multimodal Agent EvaluationSoftware Engineering Agents

  7. DSAEval: Evaluating Data Science Agents on a Wide Range of Real-World Data Science Problems

    Jan 20, 2026Maojun Sun, Yifei Xie, Yue Wu +5Multimodal Agent EvaluationLLM Agent Evaluation