Mobile GUI Agents

GUI: Graphical User Interface

Overview

Mobile GUI agents interpret screenshots and accessibility trees, then tap, type, and navigate apps to complete user goals, often across multiple steps and applications. Common approaches combine vision-language models with structured planning, memory and reusable skills, reinforcement learning, or tools that speed up routine actions; simulation and real-device training provide interaction data and feedback. Benchmarks increasingly test long workflows, unseen apps, personalization, robustness, and real-world execution, not just task completion in familiar interfaces. Agents are becoming more capable, but generalization and reliability remain uneven, while prompt injection, privacy, and consequential actions make safe behavior a central open challenge.

Latest papers

CardsList

91 papers8 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. How Complete Must an Environment Be to Train a Capable GUI Agent?

    Nov 18, 2026Jingxing Wang, Teng Wang, Xingyu Lou +5GUI AgentsMobile GUI Agents

  2. MobileWeave: Program-First Synthesis of Dependency-Linked Tasks for Training Mobile GUI Agents

    Nov 18, 2026Ziyi He, Xian Wu, Qiyuan Chen +7Mobile GUI AgentsLLM Agent Training

  3. MobileProbe: Adaptive Security Evaluation of Mobile Agents via Trajectory-Aware Injection

    Nov 12, 2026Yingbin Jin, Ji'an Wang, HaoYang Chai +7AI Agent AuditingMobile GUI Agents

  4. Coati: Host-Grounded Execution for Installable Mobile GUI Agents

    Nov 2, 2026Yudou Ying, Pu Shi, Hanlei Shi +1Mobile GUI AgentsLLM Agent Reliability

  5. MAPLE: A Multimodal Mobile Agent with Playbook-Learned Experience

    Oct 31, 2026Jun Wang, Aurora Wei, Lucas Spangher +3Mobile GUI AgentsMultimodal Agents

  6. MemU-Bench: Benchmarking GUI Agents on Long-Horizon User Interactions

    Oct 30, 2026Yizhou Liu, Zhengxi Lu, Fei Tang +12Computer-Use Agent BenchmarksGUI Agents

  7. GUI-JEPA: Candidate-Conditioned JEPA Latents as a Fast Action Policy for Mobile GUI Agents

    Oct 27, 2026Bingchao Wang, Yongcheng Jing, Shunyu Liu +5Mobile GUI AgentsMobile GUI Automation

  8. Reuse, Rewrite, or Reject: Evidence-Constrained Trace Reuse for Repeated Mobile GUI Control

    Oct 22, 2026Bingyu Bai, Cheng Zhang, Erhu FengMobile GUI AgentsLLM Agent Efficiency

  9. Diagnosing Personalization Failures in Mobile GUI Agents

    Oct 22, 2026Zhixin Lin, Dongliang Xu, Jungang Li +6GUI AgentsMobile GUI Agents

  10. Tandem: Serving Hybrid Linear-Attention GUI Agents on Mobile NPUs

    Oct 19, 2026Zhuomin Chen, Jingchao Ni, Xu Zheng +4On-Device Language Model InferenceMobile GUI Agents

  11. How GUI Agents Fail: GraceBench for Execution Stability Diagnosis

    Oct 14, 2026Ridong Zhang, Shuxian Liang, Chaoqun Wan +2Computer-Use Agent BenchmarksGUI Agents

  12. OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools

    Oct 9, 2026Chenyang Yan, Yingying Zhang, Kanzhi Cheng +21Mobile Agent BenchmarksMobile GUI Agents

  13. DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents

    Oct 8, 2026Yudong Bai, Yihong Chen, Quanming Yao +1Mobile GUI AgentsAgent Memory Management

  14. DIBench: Benchmarking Decision Integrity of GUI-based Mobile Agents Under Deceptive Injections

    Sep 29, 2026Li Hu, Kanghua Mo, Yingbin Jin +2AI Agent EvaluationAI Agent Safety Benchmarks

  15. PhoneCLI: From App Interfaces to Callable Commands for Mobile Agents

    Sep 28, 2026Yangqin Jiang, Lingrui Xu, Chao HuangMobile GUI AutomationMobile GUI Agents

  16. PastForward: Faster On-Device GUI Agents via Computational Experience Reuse

    Sep 26, 2026Taehwan Park, Changmin Lee, Hayeon Lee +1Mobile GUI AgentsOn-Device Inference

  17. From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinks

    Sep 25, 2026Yuchen Sun, Chenglin Cai, Gongjie Zhang +8Mobile GUI Agents

  18. Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents

    Sep 15, 2026Bofan Chen, Boxuan Zhang, Fei Tang +7Mobile GUI AutomationGUI Agents

  19. APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents

    Sep 7, 2026Jintian Feng, Long Chen, Xiao Yu +7Mobile GUI AutomationGUI Agents

  20. ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults

    Sep 4, 2026Weide Zhan, Qumu Shaqu, Yuanqing Liu +6Mobile GUI AutomationComputer-Use Agent Benchmarks

  21. UI-Venus-2 Technical Report

    Aug 27, 2026Venus Team, Zhuohan Cai, Haoxing Chen +28GUI AgentsMultimodal Agents

  22. Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments

    Aug 25, 2026Guo Gan, Yilun Zhao, Cong Chen +5Mobile GUI AgentsAdversarial Robustness

  23. CausalCache: Conditional High-Fidelity Restoration for Long-Horizon GUI Agents

    Aug 23, 2026Jiaxuan Luo, Zhanfeng Liao, Jiayao Teng +1Computer-Use AgentsAgent Memory Management