cs.HCOct 22, 2026

ABRA: Agent-Bound UI for Human-Agent Communication beyond Chat with Reusable Views

Authors: Seon Gyeom Kim, Hannah Kim

Organizations: Megagon Labs

Abstract

Agents can create rich representations, yet these representations are rarely used as a medium for expressing user intent. We present Agent-Bound UI, an interaction model that separates reusable interaction structures from task-specific meanings. Agents bind task-specific meanings to interactions in reusable views and publish the resulting bindings as shared state, enabling humans and agents to understand and act on shared surfaces whose meanings vary across tasks. We implement ABRA, a framework-agnostic prototype of Agent-Bound UI, in which users and agents collaborate through chat and shared interactive canvases. We demonstrate ABRA through a representative use case and evaluate four LLM-backed agents on canvas authoring, owner-side consequence resolution, and cross-agent invocation. The code and demo video are available at https://github.com/megagonlabs/abra.

Figures & tables

Explore similar work

CardsList
  1. Agent+P: Guiding UI Agents via Symbolic Planning

    Oct 7, 2025Shang Ma, Xusheng Xiao, Yanfang YeGUI AgentsMobile GUI Agents

  2. EmbeWebAgent: Embedding Web Agents into Any Customized UI

    Feb 16, 2026Chenyang Ma, Clyde Fare, Matthew Wilson +1Web AgentsTool-Using Agents

  3. When Interfaces Speak: Data-Aware Generative UI Harness for Active Interaction

    Oct 8, 2026Xiaolong Li, Xiaohan Xu, Jinyang Li +5Human-AI InteractionLLM Agent Harnesses