GUI Agents

GUI: Graphical User Interface

Ask about this topic

Momentum

23 papers in the last four weeks, up 283% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 124

All topics
CardsList

  1. Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields

    Jun 9, 2026Liya Zhu, Jingzhe Ding, Jian Zhang +63Computer-Use Agent BenchmarksGUI Agents

  2. GUI-AC: Enhancing Continual Learning in GUI Agents

    Jun 9, 2026Can Lin, Tao Feng, Hangjie Yuan +3Non-Stationary RLRL for GUI Agents

    Beijing University of Posts and Telecommunications · Tsinghua University · Zhejiang University +1

  3. DragOn: A Benchmark and Dataset for Drag-Based GUI Interactions

    Jun 4, 2026Nathan Bout, Maxime Langevin, Ronan RiochetGUI AgentsGUI Grounding

    1H

  4. MacArena: Benchmarking Computer Use Agents on an Online macOS Environment

    Jun 4, 2026Victor Muryn, Maksym Shamrai, Sofiia Mazepa +1Computer-Use Agent BenchmarksComputer-Use Agents

    1MacPaw Research, Kyiv, Ukraine

  5. Benchmarking Living-Screen-Native GUI Agents on Short-Video Platforms

    Jun 3, 2026Jiashu Yao, Heyan Huang, Daiqing Wu +5GUI AgentsAI Agent Benchmarks

    Beijing Institute of Technology · Tsinghua University · Beihang University

  6. DeskCraft: Benchmarking Desktop Agents on Professional Workflows and Human-in-the-Loop Collaboration

    Jun 2, 2026Wenkai Wang, Tao Xiong, Jingchen Ni +6Computer-Use Agent BenchmarksGUI Agents

    1Zhejiang University · 2Tsinghua University · 3Tencent +1

  7. HLL: Can Agents Cross Humanity's Last Line of Verification?

    Jun 1, 2026Xinhao Song, Su Su, Sirui Song +6GUI AgentsAI Agent Evaluation

    1Shanghai Jiao Tong University · 2Shandong University · 3Tongji University

  8. UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents

    May 28, 2026Yuxiang Chai, Han Xiao, Xinyu Fu +3Mobile GUI AutomationGUI Agents

    1CUHK MMLab · 2Huawei Research · 3Shenzhen Loop Area Institute +1

  9. GUITestScape: Towards Open-set Evaluation on Exploratory GUI Testing

    May 28, 2026Xiaoyi Chen, Yifei Gao, Yang Xu +3GUI AgentsAI Agent Benchmarks

    Beijing Jiaotong University · Independent Researcher

  10. Recovering Policy-Induced Errors: Benchmarking and Trajectory Synthesis for Robust GUI Agents

    May 28, 2026Tianpeng Bu, Xin Liu, Qihua Chen +7GUI AgentsLong-Horizon Agent Evaluation

    Alibaba Cloud Computing.

  11. STAMP: Training Explicit Memory for Mobile GUI Agents in Controllable and Scalable Virtual Environments

    May 28, 2026Junyang Wang, Haiyang Xu, Xi Zhang +4GUI AgentsAI Agent Benchmarks

    Beijing Jiaotong University · Tongyi AI Lab, Alibaba Group

  12. MaskClaw: Edge-Side Personalized Privacy Arbitration for GUI Agents with Behavior-Driven Skill Evolution

    May 27, 2026Yanqiu Zhao, Dongying Zheng, Kaibo Huang +3GUI Agents

    Beijing University of Posts and Telecommunications

  13. Mobile-Aptus: Confidence-Driven Proactive and Robust Interaction in MLLM-based Mobile-Using Agents

    May 27, 2026Zheng Wu, Pengzhou Cheng, Zongru Wu +5Probability CalibrationGUI Agents

    School of Computer Science, Shanghai Jiao Tong University · GenAI, Meta

  14. GUI-CIDER: Mid-training GUI Agents via Causal Internalization and Density-aware Exemplar Reselection

    May 27, 2026Zheng Wu, Chengcheng Han, Zhengxi Lu +5GUI AgentsTraining Data Selection

    School of Computer Science, Shanghai Jiao Tong University · Meituan · Zhejiang University +1

  15. GUI Agents for Continual Game Generation

    May 27, 2026Yixu Huang, Bo Li, Na Li +8GUI AgentsCode Generation

    αFudan University · βXiaohongshu Inc. · γTongji University +2

  16. MIRAGE: Context-Aware Prompt Injection against Mobile GUI Agents via User-Generated Content

    May 27, 2026Ruoqi Guo, Yi Liu, Gelei Deng +7Mobile GUI AutomationGUI Agents

    1Griffith University · 2Quantstamp · 3Nanyang Technological University +4

  17. AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications

    May 26, 2026Yifan Sui, Xin Huang, Hongbing Li +14Mobile GUI AutomationComputer-Use Agent Benchmarks

    1Beijing University of Posts and Telecommunications · 2StepFun · 3Waseda University

  18. Darwin Mobile Agent: A Roadmap for Self-Evolution

    May 26, 2026Daniel Beechey, Derek Yuen, Jianheng Liu +5Reinforcement LearningRL for GUI Agents

    1Huawei Noah’s Ark Lab · University College London

  19. MobileExplorer: Accelerating On-Device Inference for Mobile GUI Agents via Online Exploration

    May 26, 2026Runxi Huang, Liyu Zhang, Shengzhong Liu +1Mobile GUI AutomationEfficient VLM Inference

    Hong Kong University of Science and Technology · Shanghai Jiao Tong University

  20. MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research

    May 25, 2026Dingbang Wu, Rui Hao, Haiyang Wang +8Mobile GUI AutomationGUI Agents

    Institute of Automation, Chinese Academy of Sciences · Peking University · The Chinese University of Hong Kong

  21. ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis

    May 24, 2026Guohong Liu, Jialei Ye, Pengzhi Gao +4Mobile GUI AutomationGUI Agents

    Institute for AI Industry Research (AIR), Tsinghua University · University of Electronic Science and Technology of China · MiLM Plus, Xiaomi Inc.

  22. AutoRPA: Efficient GUI Automation through LLM-Driven Code Synthesis from Interactions

    May 20, 2026Minghao Chen, Xinyi Hu, Zhou Yu +1GUI AgentsLLM-Based Program Synthesis

    Zhejiang Key Laboratory of Space Information Sensing and Transmission, School of Computer Science, Hangzhou Dianzi University, China.

  23. CutVerse: A Compositional GUI Agents Benchmark for Media Post-Production Editing

    May 19, 2026Haobo Hu, Xiangwu Guo, Zhiheng Chen +4GUI AgentsVideo Editing

    MIPG, Communication University of China · National University of Singapore · USEIT AI

  24. AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtrees

    May 19, 2026Yuankai Li, Tinghui Zhu, Ha Min Son +3Efficient Multimodal InferenceGUI Agents

    UC Davis

  25. MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents

    May 18, 2026Ziyun Zeng, Hang Hua, Bocheng Zou +3Multimodal MemoryGUI Agents

    University of Rochester · MIT-IBM Watson AI Lab · University of Wisconsin-Madison

  26. DocOS: Towards Proactive Document-Guided Actions in GUI Agents

    May 18, 2026Jingjing Liu, Ziye Huang, Zihao Cheng +6GUI AgentsWeb Search Agents

    School of Computer Science and Engineering, Beihang University, Beijing, China · School of Computer Science, Peking University, Beijing, China · School of Computer Science and Technology, Beijing Institute of Technology, Beijing +2

  27. DiagEval: Trajectory-Conditioned Diagnosis for Reliable Software Evaluation with GUI Agents

    May 17, 2026Sirui Hong, Zhijie Liu, Tengfei Li +3Agent Failure AnalysisGUI Agents

    1DeepWisdom · 2Independent Researcher · 3The Hong Kong University of Science and Technology (Guangzhou)

  28. SE-GA: Memory-Augmented Self-Evolution for GUI Agents

    May 16, 2026Shilong Jin, Lanjun Wang, Zhuosheng ZhangGUI AgentsMobile GUI Agents

    College of Intelligence and Computing, Tianjin University, Tianjin, China · School of New Media and Communication, Tianjin University, Tianjin, China · School of Computer Science, Shanghai Jiao Tong University, Shanghai, China

  29. PAGER: Bridging the Semantic-Execution Gap in Point-Precise Geometric GUI Control

    May 15, 2026Jingxuan Wei, Xi Bai, Shan Liu +8Visual Spatial ReasoningGUI Agents

    University of Chinese Academy of Sciences · China University of Petroleum-Beijing · Shanghai Artificial Intelligence Laboratory

  30. DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding

    May 15, 2026Yichao Liu, Huawen Shen, Liu Yu +3GUI AgentsGUI Grounding

    1Nankai University · Institute of Information Engineering, Chinese Academy of Sciences