cs.AISep 15, 2026

EchoPath: Execution-Level Replayable Memory for GUI Agents

Authors: Yao Zhao, Aditya Shanmugham, Swastik Roy, Yanxun Xu

Organizations: Department of Applied Mathematics and Statistics, Johns Hopkins University · Amazon AGI · Division of Quantitative Sciences, Department of Oncology, Johns Hopkins University School of Medicine

Abstract

Computer-use agents increasingly operate browsers, software, and desktop applications via CLI or API portals, but graphical user interface (GUI) still plays an important role in common industrial production scenarios. GUI agents commonly employ fresh observe-plan-ground-act loops, which is inefficient for enterprise tasks that repeatedly update records, process forms, configure tools, and export reports. We introduce EchoPath, a model-agnostic harness that converts artifact-validated GUI trajectories into standardized, parameter-controlled callable memories, analogous to Model Context Protocol (MCP)-style tool calls rather than unstructured experience records. Each memory stores task-intent keys, application and state preconditions, flexible input parameters, GUI evidence, validation provenance, and lifecycle state, so the host agent invokes a targeted procedure only when it can be deterministically replayed in the current runtime. The core mechanism enabling replay is an image-based target-reaiming algorithm that treats stored coordinates as visual evidence, matches the remembered GUI target against the current screen, and emits corrected operation coordinates before execution. During replay, EchoPath rebinds only declared modifiable inputs and rejects ambiguous or incompatible steps to bounded grounding repair or fresh planning. In experiments with real computer-use tasks, EchoPath reduced median token cost by more than 90% and median execution time by about 60%. These results support a bounded form of enterprise GUI memory: validated execution experience can become a controllable callable asset for recurrent work rather than only context for another reasoning pass.

Figures & tables

Explore similar work

CardsList
  1. Executable Agentic Memory for GUI Agent

    May 12, 2026Zerui Qin, Sheng Yue, Xingyuan Hua +2GUI AgentsLLM Agent Memory

  2. DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents

    Oct 8, 2026Yudong Bai, Yihong Chen, Quanming Yao +1Mobile GUI AgentsAgent Memory Management

  3. MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents

    May 18, 2026Ziyun Zeng, Hang Hua, Bocheng Zou +3Multimodal MemoryGUI Agents