cs.AIOct 22, 2026

Subgoal-aware Memory Graph for GUI Agent

Authors: Dezhao Luo, Daniel Beechey, Derek Yuen, Weilin Luo

Organizations: Huawei Noah’s Ark Lab

Abstract

GUI agents aim to automate complex user tasks by interacting with mobile interfaces, but ef- fective decision-making in long-horizon set- tings requires reusing prior experience rather than relying solely on the environment ob- servations. Existing memory-based methods typically store experience either at the single- action level or as entire trajectories. Single- step actions are often too fine-grained to carry meaningful semantics, since the success of an individual action does not necessarily imply progress towards the overall goal. In contrast, whole trajectories are often too coarse-grained and difficult to reuse across different tasks. We propose a subgoal-aware memory graph that distils past trajectories into structured, reusable evidence at the level of subgoals. We define a subgoal as consecutive actions shar- ing a single intent, the granularity at which progress toward the task becomes meaning- ful. To reduce redundancy and support cross- task reuse, we organise subgoal experiences as nodes in a graph, where related memories can be merged, extended, and retrieved based on the environment observation. On SPA-Bench, our method improves success rate by 11.11% over the baseline.

Figures & tables

Explore similar work

CardsList
  1. What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States

    Jun 30, 2026Chen Liu, Ling Chen, Hanzhang Zhou +7RL for GUI AgentsGUI Agents

  2. DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents

    Oct 8, 2026Yudong Bai, Yihong Chen, Quanming Yao +1Mobile GUI AgentsAgent Memory Management

  3. AndroTMem: From Interaction Trajectories to Anchored Memory in Long-Horizon GUI Agents

    Mar 19, 2026Yibo Shi, Jungang Li, Linghao Zhang +25Agent MemoryMemory-Augmented Agents