GUI Agent Benchmarks

GUI: Graphical User Interface

Ask about this topic

Latest papers

CardsList

21 papers5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. ECHOES: Seeing Beyond the Current Image via Recursive History Compression and Privileged On-Policy Distillation

    Oct 14, 2026Tengda Guo, Jiawang Hu, Yifei Tao +4Long-Horizon Agent TasksMemory-Augmented Agents

    Tsinghua University · StepFun · Nanyang Technological University +2

  2. Learn from Move: the Next Step for GUI Agents

    Oct 12, 2026Jiahao Lu, Yize Shen, Chuanyuan Tan +6GUI Agent BenchmarksGUI Agents

    Fudan University · Shanghai Innovation Institute · Soochow University

  3. A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution

    Oct 11, 2026Alan Wu, Wei Tao, Yiwen GuoComputer-Use AgentsComputer-Use Agent Benchmarks

    Independent Researcher · LIGHTSPEED

  4. Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?

    Sep 28, 2026Tien Tran, Namho Koh, Daiki E. Matsunaga +2Computer-Use Agent BenchmarksGUI Agents

    KAIST · CMU

  5. DashAct: A Progressive Diagnostic Benchmark for GUI Agents in Interactive Dashboard Analysis

    Sep 26, 2026Chuhan Zhang, Qi Xie, Ziyue Wang +4GUI Agent BenchmarksGUI Agents

    State Key Laboratory of CAD&CG, Zhejiang University · College of Computer Science and Technology, Zhejiang University

  6. JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition

    Sep 9, 2026Zixiang Chen, Yuheng Lu, Zihao Cheng +8Computer-Use Agent BenchmarksGUI Agents

    School of Computer Science and Engineering, Beihang University, Beijing, China · Beijing Institute of Technology, Beijing, China · Baidu Inc., Beijing, China

  7. Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents

    Sep 3, 2026Zhaoyuan Huang, Tianjie Ju, Pengzhou Cheng +7GUI AgentsAI Agent Safety

    School of Computer Science, Shanghai Jiao Tong University · Ant Group

  8. EvoGUI: An Evolution-Aware Benchmark for GUI State-Transition Understanding

    Jul 19, 2026Yaohan Yang, Minglei Shi, Borui Zhang +2Computer-Use Agent BenchmarksGUI Agents

    Department of Automation, Tsinghua University

  9. Beyond Sequential Interaction: Benchmarking Parallel Execution and Coordination for GUI Agents

    Jul 17, 2026Zedong Yu, Qianxing Li, Zhi Gao +8Computer-Use Agent BenchmarksGUI Agents

    Beijing University of Posts and Telecommunications, Beijing, China · State Key Laboratory for General Artificial Intelligence, BIGAI, Beijing, China · China University of Geosciences (Beijing), Beijing, China +1

  10. GUI vs. CLI: Execution Bottlenecks in Screen-Only and Skill-Mediated Computer-Use Agents

    Jun 22, 2026Xiao Zhou, Siyue Zhang, Yilun Zhao +4Computer-Use Agent BenchmarksComputer-Use Agents

    NNYU Shanghai · Y Yale NLP Lab

  11. MacAgentBench: Benchmarking AI Agents on Real-World macOS Desktop

    Jun 21, 2026Yikun Fu, Bowen Fu, Zhenyu Wu +10AI Agent BenchmarksComputer-Use Agents

    1Shanghai Jiao Tong University · 2Shanghai AI Laboratory · 3Xi’an Jiaotong University +5

  12. iOSWorld: A Benchmark for Personally Intelligent Phone Agents

    Jun 8, 2026Lawrence Keunho Jang, Mareks Woodside, Geronimo Carom +3Personal AI AgentsMobile GUI Agents

    Carnegie Mellon University

  13. WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces

    Jun 8, 2026Wanli Li, Bowen Zhou, Yunyao Yu +4Agent BenchmarksComputer-Use Agents

    Microsoft Research Asia · Tsinghua University

  14. MacArena: Benchmarking Computer Use Agents on an Online macOS Environment

    Jun 4, 2026Victor Muryn, Maksym Shamrai, Sofiia Mazepa +1Computer-Use Agent BenchmarksComputer-Use Agents

    1MacPaw Research, Kyiv, Ukraine

  15. MedCUA-Bench: A Screenshot-Only Benchmark for Clinical Computer-Use Agents

    Jun 2, 2026Jia Yu, Zilong Wang, Xinyang Jiang +2LLM Agent EvaluationAI Agent Benchmarks

    Microsoft Research Asia, Shanghai, China · Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China · Shanghai Key Laboratory of MICCAI, Shanghai, China

  16. Recovering Policy-Induced Errors: Benchmarking and Trajectory Synthesis for Robust GUI Agents

    May 28, 2026Tianpeng Bu, Xin Liu, Qihua Chen +7GUI AgentsLong-Horizon Agent Evaluation

    Alibaba Cloud Computing.

  17. Beyond Binary: Reframing GUI Critique as Continuous Semantic Alignment

    May 14, 2026Yuchen Sun, Pei Fu, Shaojie Zhang +6GUI AgentsAI Agent Evaluation

    1Shanghai Jiao Tong University · 2Xiaomi Inc.

  18. WinDeskGround: A Benchmark for Robust GUI Grounding in Complex Multi-Window Desktop Environments

    May 13, 2026Haoren Zhao, Tianyi Chen, Zhen WangMultimodal RobustnessGUI Agents

    School of Cyberspace, Hangzhou Dianzi University, Hangzhou, China · 2Microsoft

  19. FineState-Bench: Benchmarking State-Conditioned Grounding for Fine-grained GUI State Setting

    Apr 30, 2026Fengxian Ji, Jingpu Yang, Zirui Song +5GUI AgentsVision-Language Grounding

    MBZUAI · Northeastern University, China

  20. Benchmarking and Improving GUI Agents in High-Dynamic Environments

    Apr 28, 2026Enqi Liu, Liyuan Pan, Zhi Gao +5GUI AgentsGUI Agent Benchmarks

    Beijing Institute of Technology, Beijing, China · Beijing Institute for General Artificial Intelligence, Beijing, China · Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing, China +1

  21. RiskWebWorld: A Realistic Interactive Benchmark for GUI Agents in E-commerce Risk Management

    Apr 15, 2026Renqi Chen, Zeyin Tao, Jianming Guo +6GUI Agent BenchmarksWeb Agent Benchmarks

    Ant International, Ant Group