GUI Agents

GUI: Graphical User Interface

Ask about this topic

Momentum

23 papers in the last four weeks, up 283% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 124

All topics
CardsList

  1. AndroidReality: How Far Are Mobile Agents from the Real World?

    Aug 7, 2026Xiaoou Liu, Longchao Da, Hanyang Chen +2Agent ReliabilityGUI Agents

    Arizona State University · Independent Researcher

  2. The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents

    Aug 6, 2026Weiwei Li, Junzhuo Liu, Tong Chu +2GUI AgentsImitation Learning

    University of Electronic Science and Technology of China

  3. AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents

    Aug 6, 2026Weikai Xu, Yunren Feng, Haoxiang Lei +6Mobile GUI AutomationWorld Model Learning

    1Nanyang Technological University, Singapore · University of Electronic Science and Technology of China · 3Independent Researchers +2

  4. StepReflect: Structured UI Transition Reflection for Mobile GUI Agents

    Aug 6, 2026Linqiang Guo, Wei Liu, Li Gu +3Mobile GUI AutomationGUI Agents

    Peter · Concordia University Montreal, Quebec, Canada

  5. FocusMem: Factorizing Content, Readout, and Trust in Latent GUI Memory

    Aug 5, 2026Zhuoran Zhang, Bowen Li, Jingcheng Ju +5GUI AgentsEpisodic Memory

    School of Computer Science, Peking University · 2Key Lab of High Confidence Software Technologies, Peking University · Institute of Information Engineering, Chinese Academy of Sciences +1

  6. Why Are GUI Agents Correct but Late? Decode on the Decision-Time Critical Path, Tested with Pre-Compiled Policy Trees

    Jul 30, 2026Zihan Dong, Rui Qian, Qishi Zhan +3Computer-Use AgentsGUI Agents

    Georgia Institute of Technology · Fudan University · Marquette University +3

  7. Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents

    Jul 30, 2026Hanzhang Zhou, Panrong Tong, Xu Zhang +13Mobile GUI AutomationComputer-Use Agents

    MAI-UI Team Alibaba Token Hub, Alibaba Group

  8. AgentGUI: An Interface for Observing and Steering Long-Running AI Agents

    Jul 28, 2026Xuan Zhao, Jiwoong Sohn, Qinyue Zheng +1GUI AgentsHuman-in-the-Loop AI

    ETH Zürich · ETH AI Center

  9. Scaling GUI Agents with Visual State Transitions

    Jul 27, 2026Xiangyan Liu, Kaixin Li, Haonan Wang +6World ModelsGUI Agents

    NUS · UTS · University of Liverpool +1

  10. SEE: Structure-aware Exploring & Exploiting for Long-horizon GUI Agent Trajectory Synthesis

    Jul 20, 2026Zhuohang Fan, Beichen Zhang, Yuanfa Li +4Trajectory GenerationSynthetic Data Generation

    Harbin Institute of Technology, Weihai, China · Harbin Institute of Technology (Weihai) Qingdao Research Institute, Qingdao, China

  11. EvoGUI: An Evolution-Aware Benchmark for GUI State-Transition Understanding

    Jul 19, 2026Yaohan Yang, Minglei Shi, Borui Zhang +2Computer-Use Agent BenchmarksGUI Agents

    Department of Automation, Tsinghua University

  12. Beyond Sequential Interaction: Benchmarking Parallel Execution and Coordination for GUI Agents

    Jul 17, 2026Zedong Yu, Qianxing Li, Zhi Gao +8Computer-Use Agent BenchmarksGUI Agents

    Beijing University of Posts and Telecommunications, Beijing, China · State Key Laboratory for General Artificial Intelligence, BIGAI, Beijing, China · China University of Geosciences (Beijing), Beijing, China +1

  13. SeerGuard: A Safety Framework for Mobile GUI Agents via World Model Prediction

    Jul 17, 2026Xue Yu, Bo Yuan, Kailin Zhao +3GUI AgentsAI Agent Safety

    JIUTIAN Research

  14. Plover: Steering GUI Agents through Plan-Centric Interaction

    Jul 16, 2026Madhumitha Venkatesan, Shicheng Wen, Jiajing Guo +3GUI AgentsLLM Agent Planning

    University of California, Davis · Davis, California, USA · Bosch Research North America +1

  15. HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents

    Jul 16, 2026Hy Vision Team, Huawen Shen, Zhengyang Tang +20GUI AgentsMobile GUI Agents

    Hy Vision Team

  16. Tactile: Giving Computer-Using Agents Hands and Feet

    Jul 16, 2026Yong Liu, Zhenyi Zhong, Zhanpeng ShiComputer-Use AgentsGUI Agents

    Shanghai Jiao Tong University

  17. KnowAct-GUIClaw: Know Deeply, Act Perfectly, Personal GUI Assistant with Self-Evolving Memory and Skill

    Jul 14, 2026Yunxin Li, Jinchao Li, Shibo Su +7Mobile GUI AutomationGUI Agents

    Lychee Team∗, Harbin Institute of Technology, Shenzhen

  18. UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning

    Jul 5, 2026Niu Lian, Alan Chen, Zhehao Yu +8Continual Learning for LLM AgentsGUI Agents

    Tsinghua Shenzhen International Graduate School, Tsinghua University · Harbin Institute of Technology, Shenzhen · Zhejiang University +2

  19. Do GUI Agents Believe Their Eyes? Diagnosing State-Belief Reliance on Pixels versus Structure

    Jul 5, 2026Guijia Zhang, Harry YangGUI AgentsAI Agent Evaluation

    1Shenzhen University · 2The Hong Kong University of Science and Technology

  20. What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States

    Jun 30, 2026Chen Liu, Ling Chen, Hanzhang Zhou +7RL for GUI AgentsGUI Agents

    University of Technology Sydney · Tongyi Lab, Alibaba Group · Adelaide University

  21. Xiaomi-GUI-0 Technical Report

    Jun 30, 2026Wanxia Cao, Chengzhen Duan, Pei Fu +29Mobile GUI AutomationRL for GUI Agents

  22. GUICrafter: Weakly-Supervised GUI Agent Leveraging Massive Unannotated Screenshots

    Jun 29, 2026Sunqi Fan, Lingshan Chen, Runqi Yin +4RL for GUI AgentsGUI Agents

    Tsinghua University · Tencent Hunyuan

  23. Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction

    Jun 28, 2026Sunqi Fan, Qingle Liu, Runqi Yin +2GUI AgentsVideo QA

    Tsinghua University, Beijing, China

  24. Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning

    Jun 25, 2026Tianyi Men, Zhuoran Jin, Pengfei Cao +3GUI AgentsLLM Agent Training

    The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China

  25. GUI agent: Guided Exploration of User-Sensitive Screens

    Jun 24, 2026Aradhana Nayak, Mussadiq Nazeer, Wang Peng +1GUI AgentsHuman-in-the-Loop AI

    1Huawei Heisenberg Research Center (Munich) · 2Huawei Technologies Co., Ltd

  26. VisCritic: Visual State Comparison as Process Reward for GUI Agents

    Jun 23, 2026Jiachen QianProcess Reward ModelsGUI Agents

    City University of Hong Kong

  27. GUI vs. CLI: Execution Bottlenecks in Screen-Only and Skill-Mediated Computer-Use Agents

    Jun 22, 2026Xiao Zhou, Siyue Zhang, Yilun Zhao +4Computer-Use Agent BenchmarksComputer-Use Agents

    NNYU Shanghai · Y Yale NLP Lab

  28. ENVS: Environment-Native Verified Search for Long-Horizon GUI Agents

    Jun 22, 2026Yincheng Zhou, Athena Zhuoming Zhong, Shijie Zhang +3Distribution Shift RobustnessComputer-Use Agent Benchmarks

    University of Pennsylvania · 2Peking University

  29. Running the Gauntlet: Hard Agentic Tasks

    Jun 12, 2026Mykola Vysotskyi, Runqi Lin, Grzegorz Biziel +203D Spatial ReasoningWeb Agent Benchmarks

    SoftServe · Ukrainian Catholic University · University of Oxford +3

  30. Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents

    Jun 12, 2026Seoyoung Choi, Minseok Ko, Hyunseok Lee +4Agent Failure AnalysisGUI Agents

    1Seoul National University · 2POSTECH · 3KAIST +1