GUI Agents

GUI: Graphical User Interface

Momentum

23 papers in the last four weeks, up 283% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 123

All topics
CardsList
  1. Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training

    Oct 5, 2026Yongxin Ning, Runliang Niu, Qianli Xing +4World ModelsSynthetic Data Generation

  2. Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents

    Oct 1, 2026Beining Wu, Zihao Ding, Jun HuangContinual Learning for LLM AgentsGUI Agents

  3. GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution

    Oct 1, 2026Geyi Yang, Zikun Qu, Xiang Li +4GUI AgentsAgent Harness Optimization

  4. Learning Reliable GUI Agents under Imperfect Priors

    Sep 30, 2026Bo Han, Qianyi Wang, Shuai Liu +9GUI AgentsLLM Agent Training

  5. Action Conditioned Bisimulation For GUI Agent Memory

    Sep 30, 2026Hongbo Zhang, Liuyang Song, Quanquan Li +3Agent MemoryGUI Agents

  6. HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents

    Sep 29, 2026Tongbo Chen, Junbo Niu, Zhengxi Lu +8Computer-Use AgentsGUI Agents

  7. MatToolBench: Benchmarking Multimodal Agents in Real-World Materials Science Workflows

    Sep 29, 2026Mei Wu, Rui Xie, Runyu Zhang +6GUI AgentsAI Agent Benchmarks

  8. PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience Retrieval

    Sep 29, 2026Bin Kang, Jiarui Ouyang, Li Jiang +2GUI AgentsLong-Horizon Agent Evaluation

  9. WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents

    Sep 28, 2026Anton Emelyanov, Maria Tikhonova, Zaven Martirosian +2Web Agent BenchmarksGUI Agents

  10. LongPuzzleBench: Evaluating GUI Agents on Long-Horizon Visual Puzzles

    Sep 28, 2026Bingo Zhang, Haochuan Lu, Zongjie Li +3GUI AgentsLong-Horizon Agent Evaluation

  11. One Rollout Is All You Get: Fully Test-Time Adaptation for GUI Agents

    Sep 28, 2026Ziqiang Wang, Li Gu, Zhixiang Chi +6Test-Time AdaptationContinual Test-Time Adaptation

  12. GUITAR: Structured Failure Diagnosis of GUI Agents via State Transitions

    Sep 28, 2026Shaoqing Zhang, Kehai Chen, Xuefeng Bai +4Agent Failure AnalysisGUI Agents

  13. Invisible in Space, Visible in Time: Motion Vision CAPTCHA against GUI Agents

    Sep 23, 2026Zeyu Zhang, Dingyi Rong, Zijian Chen +3GUI Agents

  14. Towards Omni-dimensional GUI Agent Navigation with Masked Trajectory Prediction

    Sep 22, 2026Yan Zhang, Pei Fu, Daiqing Wu +8GUI AgentsMulti-Task Learning

  15. A Dual-Process Perspective on Nudge Susceptibility in LLM-Based GUI Agents

    Sep 17, 2026Haya Halimeh, Sascha Kaltenpoth, Kevin Bösch +1GUI AgentsAgentic Reasoning

  16. Affora: A Design System for Agent-Friendly Interfaces

    Sep 16, 2026Jin GaoComputer-Use AgentsGUI Agents

  17. Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents

    Sep 15, 2026Bofan Chen, Boxuan Zhang, Fei Tang +7Mobile GUI AutomationGUI Agents

  18. JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition

    Sep 9, 2026Zixiang Chen, Yuheng Lu, Zihao Cheng +8Computer-Use Agent BenchmarksGUI Agents

  19. APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents

    Sep 7, 2026Jintian Feng, Long Chen, Xiao Yu +7Mobile GUI AutomationGUI Agents

  20. ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults

    Sep 7, 2026Weide Zhan, Qumu Shaqu, Yuanqing Liu +6Mobile GUI AutomationComputer-Use Agent Benchmarks

  21. Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents

    Sep 3, 2026Zhaoyuan Huang, Tianjie Ju, Pengzhou Cheng +7GUI AgentsAI Agent Safety

  22. Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization

    Sep 2, 2026Bizhe Bai, Jiakang Yuan, Hongming Wu +8GUI AgentsGUI Automation

  23. CoAdapt-GUI: Joint Workflow Context and Policy Adaptation for Unseen GUI Applications

    Aug 12, 2026Linqiang Guo, Li Gu, Zihuan Jiang +8Reinforcement LearningRL for GUI Agents

  24. Test-Time Self-Evolving GUI Visual Grounding via Reflection-Guided On-Policy Self-Distillation

    Aug 11, 2026Shiyu Xuan, Zechao LiTest-Time AdaptationOn-Policy Self-Distillation

  25. SkillLens: Visual Skill Cards for Retrieval-Augmented GUI Action Prediction and On-Policy Distillation

    Aug 11, 2026Zhou Liu, Ligang Huang, Zeli Su +5GUI AgentsLLM Agent Skill Retrieval

  26. Software Engineering for and with GUI Agent

    Aug 10, 2026Shengcheng Yu, Yuchen Ling, Junyang Xing +3AI Agent ReliabilityGUI Agents

  27. AndroidReality: How Far Are Mobile Agents from the Real World?

    Aug 7, 2026Xiaoou Liu, Longchao Da, Hanyang Chen +2Agent ReliabilityGUI Agents

  28. The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents

    Aug 6, 2026Weiwei Li, Junzhuo Liu, Tong Chu +2GUI AgentsImitation Learning

  29. AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents

    Aug 6, 2026Weikai Xu, Yunren Feng, Haoxiang Lei +6Mobile GUI AutomationWorld Model Learning

  30. StepReflect: Structured UI Transition Reflection for Mobile GUI Agents

    Aug 6, 2026Linqiang Guo, Wei Liu, Li Gu +3Mobile GUI AutomationGUI Agents

  31. FocusMem: Factorizing Content, Readout, and Trust in Latent GUI Memory

    Aug 5, 2026Zhuoran Zhang, Bowen Li, Jingcheng Ju +5GUI AgentsEpisodic Memory

  32. Why Are GUI Agents Correct but Late? Decode on the Decision-Time Critical Path, Tested with Pre-Compiled Policy Trees

    Jul 30, 2026Zihan Dong, Rui Qian, Qishi Zhan +3Computer-Use AgentsGUI Agents

  33. Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents

    Jul 30, 2026Hanzhang Zhou, Panrong Tong, Xu Zhang +13Mobile GUI AutomationComputer-Use Agents

  34. AgentGUI: An Interface for Observing and Steering Long-Running AI Agents

    Jul 28, 2026Xuan Zhao, Jiwoong Sohn, Qinyue Zheng +1GUI AgentsHuman-in-the-Loop AI

  35. Scaling GUI Agents with Visual State Transitions

    Jul 27, 2026Xiangyan Liu, Kaixin Li, Haonan Wang +6World ModelsGUI Agents

  36. SEE: Structure-aware Exploring & Exploiting for Long-horizon GUI Agent Trajectory Synthesis

    Jul 20, 2026Zhuohang Fan, Beichen Zhang, Yuanfa Li +4Trajectory GenerationSynthetic Data Generation

  37. EvoGUI: An Evolution-Aware Benchmark for GUI State-Transition Understanding

    Jul 19, 2026Yaohan Yang, Minglei Shi, Borui Zhang +2Computer-Use Agent BenchmarksGUI Agents

  38. Beyond Sequential Interaction: Benchmarking Parallel Execution and Coordination for GUI Agents

    Jul 17, 2026Zedong Yu, Qianxing Li, Zhi Gao +8Computer-Use Agent BenchmarksGUI Agents

  39. Plover: Steering GUI Agents through Plan-Centric Interaction

    Jul 16, 2026Madhumitha Venkatesan, Shicheng Wen, Jiajing Guo +3GUI AgentsLLM Agent Planning

  40. HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents

    Jul 16, 2026Hy Vision Team, Huawen Shen, Zhengyang Tang +20GUI AgentsMobile GUI Agents

  41. Tactile: Giving Computer-Using Agents Hands and Feet

    Jul 16, 2026Yong Liu, Zhenyi Zhong, Zhanpeng ShiComputer-Use AgentsGUI Agents

  42. KnowAct-GUIClaw: Know Deeply, Act Perfectly, Personal GUI Assistant with Self-Evolving Memory and Skill

    Jul 14, 2026Yunxin Li, Jinchao Li, Shibo Su +7Mobile GUI AutomationGUI Agents

  43. UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning

    Jul 5, 2026Niu Lian, Alan Chen, Zhehao Yu +8Continual Learning for LLM AgentsGUI Agents

  44. Do GUI Agents Believe Their Eyes? Diagnosing State-Belief Reliance on Pixels versus Structure

    Jul 5, 2026Guijia Zhang, Harry YangGUI AgentsAI Agent Evaluation

  45. What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States

    Jun 30, 2026Chen Liu, Ling Chen, Hanzhang Zhou +7RL for GUI AgentsGUI Agents

  46. Xiaomi-GUI-0 Technical Report

    Jun 30, 2026Wanxia Cao, Chengzhen Duan, Pei Fu +29Mobile GUI AutomationRL for GUI Agents

  47. GUICrafter: Weakly-Supervised GUI Agent Leveraging Massive Unannotated Screenshots

    Jun 29, 2026Sunqi Fan, Lingshan Chen, Runqi Yin +4RL for GUI AgentsGUI Agents

  48. Bridging VideoQA and Video-Guided Agentic Tasks via Generalized Keyframe Extraction

    Jun 28, 2026Sunqi Fan, Qingle Liu, Runqi Yin +2GUI AgentsVideo QA

  49. Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning

    Jun 25, 2026Tianyi Men, Zhuoran Jin, Pengfei Cao +3GUI AgentsLLM Agent Training

  50. GUI agent: Guided Exploration of User-Sensitive Screens

    Jun 24, 2026Aradhana Nayak, Mussadiq Nazeer, Wang Peng +1GUI AgentsHuman-in-the-Loop AI

  51. ENVS: Environment-Native Verified Search for Long-Horizon GUI Agents

    Jun 22, 2026Yincheng Zhou, Athena Zhuoming Zhong, Shijie Zhang +3Distribution Shift RobustnessComputer-Use Agent Benchmarks

  52. Running the Gauntlet: Hard Agentic Tasks

    Jun 12, 2026Mykola Vysotskyi, Runqi Lin, Grzegorz Biziel +203D Spatial ReasoningWeb Agent Benchmarks

  53. Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents

    Jun 12, 2026Seoyoung Choi, Minseok Ko, Hyunseok Lee +4Agent Failure AnalysisGUI Agents