Overview

Web agent benchmarks measure whether AI systems can find information and complete tasks through browser interfaces, from web research and form filling to shopping and website development. They use simulated websites for repeatable tests, live sites for realistic workflows, and controlled changes to interfaces or instructions to probe robustness. Evaluation combines task success with measures such as evidence quality, interaction traces, efficiency, and human or automated judgments. A central challenge is balancing realistic, varied settings with reproducible scoring; agents still often struggle with long tasks, changing interfaces, and verifying that their actions produced the intended result.

Latest papers

CardsList

72 papers14 papers in the last four weeks, up 40% on the four weeks before. 0.1% of all new papers.

  1. WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents

    Nov 13, 2026Imene Kerboua, Fatemeh Pesaran Zadeh, Xing Han Lù +19Web Agent BenchmarksWeb Agents

  2. Harness Matters: Measuring and Dissecting Security Resilience in Web Agents

    Nov 9, 2026Xinyi Wu, Jiagui Chen, JiaYi Dong +5LLM Agent SecurityLLM Agent Harnesses

  3. ScamWorld: An Interactive Environment for Evaluating Web Agents Against Online Fraud

    Nov 3, 2026Yutao Wu, Xiao Liu, Ming Wen +3Web AgentsLLM Agent Evaluation

  4. ANGLER: Verifier-Grounded Benchmarking with an Adaptive Attacker for Web Agents

    Oct 30, 2026Yini Huang, Aiwen LU, Zhen Sun +3AI Agent Security BenchmarksAutomated Red Teaming

  5. DynaRev: Benchmarking Web Agents under Dynamic Goal Revision

    Oct 29, 2026Shiqi Zhang, Guochen Zhou, Zesheng Wei +2Web Agent BenchmarksWeb Agents

  6. AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access Barriers

    Oct 29, 2026Zhiyi Liu, Haohua Du, Haoqi Sun +1Web AgentsLLM Agent Reliability

  7. WebAnything: From the Wild Web to Scalable Agent Environments

    Oct 27, 2026Tianci Xie, Zikun Cai, Chaoyun Zhang +4Web AgentsWeb Agent Benchmarks

  8. Back to Basics: A Skill-Centric Approach to Generalist Web Agents

    Oct 26, 2026Minh Pham-Dinh, Md Farhan Ishmam, Hernan Yupanqui +2Web AgentsLLM Agent Skill Learning

  9. The Agent in the Middle: How AI-Mediated Access Reshapes Web Vulnerability Exploitation

    Oct 26, 2026Ruozhao Yang, Jiongchi Yu, Ming Hu +1AI Agent SecurityAI Agent Security Benchmarks

  10. SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web Agents

    Oct 24, 2026Bo-Yu Chen, Zhi Zhou, Yu-Feng LiAgent Skill LearningWeb Agent Benchmarks

  11. WebUniverse: Scaling Verified Training Data for Agentic Web Development

    Oct 23, 2026Yaorui Ding, Fengqing Jiang, Yichen Feng +8Web AgentsWeb Application Generation

  12. LoWAgent: A Low-Resource Multilingual Benchmark for Web Agents

    Oct 19, 2026Ocean Monjur, Daud Ahmad Nisar, Shahriar Kabir Nahin +4Web Agent BenchmarksWeb Agents

  13. Get In, Decide, Prove: A Merchant-Side Readiness Benchmark for Agentic Commerce

    Oct 12, 2026Adrian de Valois-Franklin, Alex Bogdan, Anas Ibrahim +2Agentic CommerceWeb Agent Benchmarks

  14. HyWe: Unifying Search and Operation for Real-World Hybrid Web Tasks

    Oct 12, 2026Zijian Cai, Haowei Liu, Kailai Chen +7Web AgentsWeb Search Agents

  15. A Baseline Assessment for the Agentic Web Technology Stack

    Oct 9, 2026Vagner Figueredo de Santana, Diogo CortizWeb AgentsMulti-Agent LLM Systems

  16. When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded Tasks

    Oct 9, 2026Yisheng Li, Dongming Han, Hongkun Pan +5Web AgentsAI Agent Reliability

  17. HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents

    Oct 2, 2026Alham Fikri Aji, Faiz Rizki Ramadhan, Zayd M. K. Zuhri +14Web Agent BenchmarksAgent Benchmarks

  18. Auditing Web Agent Evaluation on WebArena-Lite: Human Review of Outcomes and Trajectories

    Oct 1, 2026Chengguang Gan, Zimeng He, Yoshihiro Tsujii +3AI Agent AuditingWeb Agent Benchmarks

  19. WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents

    Sep 28, 2026Anton Emelyanov, Maria Tikhonova, Zaven Martirosian +2Web Agent BenchmarksGUI Agents

  20. Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions

    Sep 20, 2026Xunjian Yin, Tianchen Guan, Jinao Wang +8Web AgentsWeb Agent Benchmarks

  21. CAP: A Scalable Benchmark for Evaluating Cross-Site Browser Agents with Complex Actions and Perception

    Aug 9, 2026Zejun Xu, Taiyi Chen, Jin Li +13Computer-Use AgentsWeb Agent Benchmarks

  22. Routing Is Least Learnable Where It Is Most Valuable: Bounds on Representation Routing for Web Agents

    Aug 6, 2026Jiaming Wei, Zekun Wu, Adriano Koshiyama +1Web Agent BenchmarksWeb Agents