Computer-Use Agent Evaluation

Latest papers

CardsList

30 papers7 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. Beyond Next-Screen Prediction: The Decision Value of GUI World Models

    Oct 17, 2026Sizhe Tang, Hanhan Zhou, Jeffrey Svajlenko +1World Model EvaluationComputer-Use Agent Evaluation

  2. PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas

    Oct 16, 2026Haoming Li, Defu Cao, Xu Hu +23Computer-Use Agent EvaluationComputer-Use Agent Benchmarks

  3. Talk2Agent: Benchmarking Voice Interfaces for Text Agents

    Sep 30, 2026Terumi Chiba, Guangzhi Sun, Zheqi Yuan +1ASR EvaluationVoice Agent Evaluation

  4. OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models

    Jul 30, 2026Qiushi Sun, Kanzhi Cheng, Yian Wang +20VLM EvaluationComputer-Use Agent Benchmarks

  5. How Benchmarks Mis-Score Computer-Use Agents

    Jul 30, 2026Zihan Dong, Zhiyuan Ma, Zekun Wang +5Agent Failure AnalysisComputer-Use Agent Benchmarks

  6. SeekJudge: A Practical Reward Framework for Reinforcement Learning in Computer-Use Agents

    Jul 25, 2026Yang Wan, Zhenhao Zhang, Jierui Wang +1Reward ModelingLLM-as-a-Judge

  7. PPT-Eval: A Benchmark for Computer-Use Agents on PowerPoint Tasks

    Jun 30, 2026Apurva Gandhi, Vishwas Suryanarayanan, Raja Hasnain Anwar +6Computer-Use AgentsRubric-Based Evaluation

  8. MacAgentBench: Benchmarking AI Agents on Real-World macOS Desktop

    Jun 21, 2026Yikun Fu, Bowen Fu, Zhenyu Wu +10AI Agent BenchmarksComputer-Use Agents

  9. MyPCBench: A Benchmark for Personally Intelligent Computer-Use Agents

    Jun 15, 2026Lawrence Keunho Jang, Andrew Keunwoo Jang, Jing Yu Koh +1Personal AI AgentsTool-Augmented Language Model Agents

  10. iOSWorld: A Benchmark for Personally Intelligent Phone Agents

    Jun 8, 2026Lawrence Keunho Jang, Mareks Woodside, Geronimo Carom +3Personal AI AgentsMobile GUI Agents

  11. WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces

    Jun 8, 2026Wanli Li, Bowen Zhou, Yunyao Yu +4Agent BenchmarksComputer-Use Agents

  12. RealClawBench: Live OpenClaw Benchmarks from Real Developer-Agent Sessions

    Jun 2, 2026Zongwei Lv, Zhewen Tan, Yaoming Li +7Computer-Use Agent BenchmarksAI Coding Agents

  13. TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks

    May 21, 2026Zhaoyang Chu, Jiarui Hu, Xingyu Jiang +8Computer-Use Agent BenchmarksTerminal Agents

  14. Computer Use at the Edge of the Statistical Precipice

    May 7, 2026Pierluca D'Oro, Sneha Silwal, William Wong +6Computer-Use Agent BenchmarksComputer-Use Agents

  15. IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agents

    Apr 6, 2026Rongqian Chen, Yu Li, Zeyu Fang +3Computer-Use Agent EvaluationReward Modeling

  16. Video-Based Reward Modeling for Computer-Use Agents

    Mar 10, 2026Linxin Song, Jieyu Zhang, Huanxin Sheng +6Computer-Use Agent EvaluationReward Modeling

  17. General Agent Evaluation

    Feb 26, 2026Elron Bandel, Asaf Yehudai, Lilach Eden +12Agent EvaluationAutomated Agent Evaluation