Mobile Agent Benchmarks

Ask about this topic

Latest papers

CardsList

19 papers2 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools

    Oct 9, 2026Chenyang Yan, Yingying Zhang, Kanzhi Cheng +21Mobile Agent BenchmarksMobile GUI Agents

    Nanjing University · SenseTime · The University of Hong Kong +3

  2. Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?

    Sep 28, 2026Tien Tran, Namho Koh, Daiki E. Matsunaga +2Computer-Use Agent BenchmarksGUI Agents

    KAIST · CMU

  3. APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents

    Sep 7, 2026Jintian Feng, Long Chen, Xiao Yu +7Mobile GUI AutomationGUI Agents

    Laboratory for Artificial Intelligence and New Forms of Education, Central China Normal University · Faculty of Artificial Intelligence in Education, Central China Normal University · Agentic Labs, Acrab AI

  4. MobilePA-Bench: Benchmarking Mobile Planner Agents on Complex Real-World Tasks

    Aug 24, 2026Yi Zhu, Xiongwei Wu, Qiyi Wang +8Mobile Agent BenchmarksLLM Agent Evaluation

    MAI Team, Alibaba Token Hub, Alibaba Group

  5. Benchmarking General Mobile Assistants in Challenging Real-World Scenarios

    Aug 21, 2026Yiqi Zhu, Feiyu Gao, Jiaxing Fan +7Mobile Agent BenchmarksAI Agent Evaluation

    Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China · Alibaba Token Hub, Alibaba Group · Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China

  6. Benchmarking LLM Judges for Mobile Agent Evaluation

    Aug 11, 2026Ziqiang Wang, Li Gu, Zhixiang Chi +4LLM-as-a-JudgeMobile Agent Benchmarks

    Mila – Québec AI Institute · Concordia University · University of Toronto +2

  7. MobileMem: Learning from a Year of Mobile Experiences

    Aug 11, 2026Xinle Deng, Yida Xue, Xiangyuan Ru +16Agent MemoryMemory Agent Benchmarks

    OPPO, OpenKG

  8. AndroidReality: How Far Are Mobile Agents from the Real World?

    Aug 7, 2026Xiaoou Liu, Longchao Da, Hanyang Chen +2Agent ReliabilityMobile Agent Benchmarks

    Arizona State University · Independent Researcher

  9. Beyond the GUI Paradigm: Do Mobile Agents Need the Phone Screen?

    Jun 16, 2026Li Gu, Zihuan Jiang, Linqiang Guo +6Mobile GUI AutomationAI Coding Agents

    1Mila – Québec AI Institute · 2Concordia University · University of Toronto +1

  10. PhoneHarness: Harnessing Phone-Use Agents through Mixed GUI, CLI, and Tool Actions

    Jun 12, 2026Chenxin Li, Zhengyao Fang, Zhengyang Tang +18Mobile GUI AutomationMobile Agent Benchmarks

    Tencent Hunyuan · The Chinese University of Hong Kong · The Chinese University of Hong Kong, Shenzhen +1

  11. iOSWorld: A Benchmark for Personally Intelligent Phone Agents

    Jun 8, 2026Lawrence Keunho Jang, Mareks Woodside, Geronimo Carom +3Personal AI AgentsMobile GUI Agents

    Carnegie Mellon University

  12. PhoneWorld: From Real-App Trajectories to Dynamic and Verifiable Environments for Phone-Use Agents

    May 28, 2026Yuxuan Liu, Xin Lai, Junyi Li +21Mobile GUI AutomationMobile Agent Benchmarks

    Tencent Hunyuan · Gaoling School of Artificial Intelligence, Renmin University of China · The Chinese University of Hong Kong, Shenzhen +1

  13. AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications

    May 26, 2026Yifan Sui, Xin Huang, Hongbing Li +14Automated EvaluationComputer-Use Agent Benchmarks

    1Beijing University of Posts and Telecommunications · 2StepFun · 3Waseda University

  14. MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research

    May 25, 2026Dingbang Wu, Rui Hao, Haiyang Wang +8Mobile GUI AutomationGUI Agents

    Institute of Automation, Chinese Academy of Sciences · Peking University · The Chinese University of Hong Kong

  15. Safe, or Simply Incapable? Rethinking Safety Evaluation for Phone-Use Agents

    May 8, 2026Zhengyang Tang, Yi Zhang, Chenxin Li +18Mobile GUI AgentsComputer-Use Agents

    1Tencent Hunyuan · 2The Chinese University of Hong Kong, Shenzhen · 3Tsinghua University

  16. KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation

    Apr 9, 2026Tongbo Chen, Zhengxi Lu, Zhan Xu +13Mobile Agent BenchmarksAI Agent Benchmarks

    Zhejiang University · Apple · Tencent

  17. Do Phone-Use Agents Respect Your Privacy?

    Apr 1, 2026Zhengyang Tang, Ke Ji, Xidong Wang +19Mobile GUI AgentsMobile Agent Benchmarks

    The Chinese University of Hong Kong, Shenzhen · Hunyuan Team, Tencent · The University of Hong Kong +3

  18. MobiFlow: Real-World Mobile Agent Benchmarking through Trajectory Fusion

    Feb 28, 2026Yunfei Feng, Xi Zhao, Cheng Zhang +5Computer-Use Agent BenchmarksMobile Agent Benchmarks

    Institute of Parallel and Distributed Systems (IPADS), Shanghai Jiao Tong University · Department of Precision Instrument, Tsinghua University · National Innovation Institute of High-end Smart Appliances

  19. ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile Devices

    Feb 25, 2026Dezhi Kong, Zhengzhao Feng, Qiliang Liang +12Mobile Agent BenchmarksAI Agent Benchmarks

    HyperAI Team, Xiaomi Corporation · Zhejiang University · Peking University +1