cs.CLNov 16, 2026

Experience Rot: Experienced Agents Fail Where Novices Succeed

Authors: Zhen Xu, Hang Yin, Zitao Zhang, Kevin Zhao, Xuefeng Liu

Organizations: University of Chicago · eBay · University of Florida

Abstract

Agents are increasingly built to learn from experience: they keep conversation histories, memory files, retrieved notes and skills, and reuse what worked before. We show that this experience turns against them when their tools change silently. We test a range of models with tools defined as in the Model Context Protocol (MCP). After a silent change, experienced agents fail on most tasks, while agents new to the task mostly succeed. We call this failure Experience Rot. Experienced agents copy their earlier call instead of checking the current interface, even when the tool definition shows the change. Then they report success. When the documentation is incomplete, experience is what makes agents succeed. After a change, the same experience leaves them worse off than no experience at all. The failure appears in every form of memory we test and grows with the amount of experience. Simple remedies fall short: announcing the update barely helps, and pointing the agent to the documentation fails whenever the documentation does not spell out the answer.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. When History Fails to Become Experience: Action Calibration in Language Agents

    Oct 2, 2026Jingyu Liu, Zhiwen Wang, Yuxin Jing +2Memory-Augmented Language Model AgentsIn-Context Learning

  2. Sentry: Learning to Recover from LLM Agent Failures at Test Time

    Oct 2, 2026Changxiu Ji, Amy Lu, Qizheng Zhang +1LLM Agent ReliabilityMemory-Augmented Language Model Agents