cs.AIJul 3, 2026

Object-Centric Environment Modeling for Agentic Tasks

Authors: Yiyang LiTianyi MaZehong WangYijun MaYanfang Ye

Organizations: University of Notre Dame · †Corresponding Author

Abstract

Large language model (LLM) agents can improve through accumulated experience, but free-form textual memories become difficult to maintain, validate, and reuse as interactions grow. Recent symbolic approaches learn executable skills or programmatic world models, yet often store local procedures or assume simplified dynamics. We propose Object-Centric Environment Modeling (OCM), which organizes experience into an executable object-centric environment model. OCM maintains two connected code bases: object knowledge, which defines environment entities and mechanisms as Python classes, and procedure knowledge, which records reusable interaction patterns that must import and use the object model. OCM works in an online setting: after each episode, OCM reflects on the trajectory, updates both knowledge bases, and verifies that all procedures execute against the updated object model. During future interaction, the agent uses progressive knowledge disclosure to inspect compact code signatures first and read source code only when needed. Experiments show that OCM achieves the best average rank across benchmarks and reduces invalid actions, demonstrating that agents can benefit from building object-centric environment models.

Explore similar work

CardsList
  1. Agent-Editing World Model: Rethinking World Modeling for LLM Agents

    Sep 23, 2026Shuang Sun, Guoxin Chen, Fanzhe Meng +6