Graphical User Interface Agents

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

6 new papers

A weekly snapshot of new work published in Graphical User Interface Agents.

Period ending 2026-09-14

5 new papers

A weekly snapshot of new work published in Graphical User Interface Agents.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Graphical User Interface Agents.

Inside this field

Focused directions

151 papers

Latest in Graphical User Interface Agents

Browse all topics →
CardsList

  1. Faithful Mobile GUI Agents with Guided Advantage Estimator

    May 2, 2026Haowen Hu, Pengzhou Cheng, Zheng Wu +3Graphical User Interface AgentsGraphical User Interface

  2. Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Grounding

    May 1, 2026Yan Zhang, Daiqing Wu, Huawen Shen +2Graphical User InterfaceGraphical User Interface Agents

  3. A11y-Compressor: A Framework for Enhancing the Efficiency of GUI Agent Observations through Visual Context Reconstruction and Redundancy Reduction

    May 1, 2026Michito Takeshita, Takuro Kawada, Takumi Ohashi +2Graphical User Interface AgentsGraphical User Interface

  4. FineState-Bench: Benchmarking State-Conditioned Grounding for Fine-grained GUI State Setting

    Apr 30, 2026Fengxian Ji, Jingpu Yang, Zirui Song +5Graphical User InterfaceExplicit Visual Grounding

  5. GUI Agents with Reinforcement Learning: Toward Digital Inhabitants

    Apr 30, 2026Junan Hu, Jian Liu, Jingxiang Lai +6Graphical User Interface AgentsGraphical User Interface

  6. WindowsWorld: A Process-Centric Benchmark of Autonomous GUI Agents in Professional Cross-Application Environments

    Apr 30, 2026Jinchao Li, Yunxin Li, Chenrui Zhao +3Graphical User Interface AgentsMulti-Agent Workflows

  7. Beyond Screenshots: Evaluating VLMs' Understanding of UI Animations

    Apr 28, 2026Chen Liang, Xirui Jiang, Naihao Deng +2Ava-VlmUser Interface

  8. Training Computer Use Agents to Assess the Usability of Graphical User Interfaces

    Apr 28, 2026Alice Gao, Weixi Tong, Rishab Vempati +4Computer-Use AgentsUsability

  9. Benchmarking and Improving GUI Agents in High-Dynamic Environments

    Apr 28, 2026Enqi Liu, Liyuan Pan, Zhi Gao +5Graphical User Interface AgentsGraphical User Interface

  10. AutoGUI-v2: A Comprehensive Multi-Modal GUI Functionality Understanding Benchmark

    Apr 27, 2026Hongxin Li, Xiping Wang, Jingran Su +4Graphical User InterfaceMultimodal Agents

  11. GoClick: Lightweight Element Grounding Model for Autonomous GUI Interaction

    Apr 27, 2026Hongxin Li, Yuntao Chen, Zhaoxiang ZhangGraphical User InterfaceVision-Language Model Grounding

  12. VLAA-GUI: Knowing When to Stop, Recover, and Search, A Modular Framework for GUI Automation

    Apr 23, 2026Qijun Han, Haoqin Tu, Zijun Wang +11Graphical User Interface AgentsLoop

  13. Measure Twice, Click Once: Co-evolving Proposer and Visual Critic via Reinforcement Learning for GUI Grounding

    Apr 23, 2026Wenkai Wang, Xiyun Li, Hongcan Guo +5Graphical User InterfaceCritic Learning

  14. AgentLens: Adaptive Visual Modalities for Human-Agent Interaction in Mobile GUI Agents

    Apr 22, 2026Jeonghyeon Kim, Byeongjun Joung, Junwon Lee +3Graphical User Interface AgentsMultimodal Agents

  15. Temporal UI State Inconsistency in Desktop GUI Agents: Formalizing and Defending Against TOCTOU Attacks on Computer-Use Agents

    Apr 20, 2026Wenpeng XuGraphical User Interface AgentsUser Interface

  16. HalluClear: Diagnosing, Evaluating and Mitigating Hallucinations in GUI Agents

    Apr 19, 2026Chao Jin, Wenkui Yang, Hao Sun +6Graphical User Interface AgentsHallucination Mitigation

  17. MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generation

    Apr 16, 2026Yan Li, Zezi Zeng, Yifan Yang +12Web AgentsWeb

  18. FedGUI: Benchmarking Federated GUI Agents across Heterogeneous Platforms, Devices, and Operating Systems

    Apr 16, 2026Wenhao Wang, Haoting Shi, Mengying Yuan +7Graphical User Interface AgentsFederated Learning

  19. GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Models

    Apr 15, 2026Yangyue Wang, Harshvardhan Sikka, Yash Mathur +3Graphical User InterfaceSpatial Reasoning

  20. Efficient Personalization of Generative User Interfaces

    Apr 10, 2026Yi-Hao Peng, Jeffrey P. Bigham, Jason WuPersonalizationUser Interface

  21. GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation

    Mar 27, 2026Rui Xie, Zhi Gao, Chenrui Shi +3Graphical User Interface AgentsAgentic Video Generation

  22. CAPTCHA Solving for Native GUI Agents: Automated Reasoning-Action Data Generation and Self-Corrective Training

    Mar 23, 2026Yuxi Chen, Haoyu Zhai, Chenkai Wang +4Captcha-Capable Native Graphical User Interface AgentGraphical User Interface Agents

  23. SlowBA: An efficiency backdoor attack towards VLM-based GUI agents

    Mar 9, 2026Junxian Li, Tu Lan, Haozhen Tan +2Graphical User Interface AgentsBackdoor Attacks

  24. Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making

    Jan 30, 2026Ruoyu Chen, Shangquan Sun, Xiaoqing Guo +8Prior KnowledgeStep-Level Supervision

  25. GAIA: A Data Flywheel System for Training GUI Test-Time Scaling Critic Models

    Jan 26, 2026Shaokang Wang, Pei Fu, Ruoceng Zhang +7Critic LearningGraphical User Interface

  26. Mind the Gap: Action Rebinding Attacks against Android GUI Agents

    Jan 18, 2026Yi Qian, Kunwei Qian, Xingbang He +7Graphical User Interface AgentsMalicious Code

  27. InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Training

    Jan 7, 2026Ziyun Zhang, Zezhou Wang, Xiaoyi Zhang +4Graphical User Interface AgentsArtificial Intelligence Assistants

  28. MobileDreamer: Generative Sketch World Model for GUI Agent

    Jan 7, 2026Yilin Cao, Yufeng Zhong, Zhixiong Zeng +6Graphical User Interface AgentsWorld Models

  29. GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding

    Nov 2, 2025Shijie Zhou, Viet Dac Lai, Hao Tan +4Graphical User InterfaceCross-Modal Attention

  30. GUI-PRA: Process Reward Agent for GUI Tasks

    Sep 27, 2025Tao Xiong, Xavier Hu, Yurun Chen +6Graphical User InterfaceReliable Medical Process-Level Reward Model Evaluation Framework

  31. Toward Metaphor-Fluid Conversation Design for Voice User Interfaces

    Feb 17, 2025Smit Desai, Jessie Chin, Dakuo Wang +2MetaphorsUser Interface