cs.AINov 8, 2026

Separation of Skilling Context for Standard Operating Procedure-based Agents

Authors: Mitsuhiro Nakayama, Toshiaki Sota, Takehiko Yamaguchi, Michiaki Tatsubori

Organizations: IBM Japan

Abstract

Standard Operating Procedures (SOPs) are kept concise for human readability, so LLM agents that generate executable skills from them lack the tacit knowledge and implementation details needed for automation. Human intervention fills these gaps, but must be repeated as SOPs evolve---a problem we call SOP-skill drift. We propose managing SOPs and Contextual Knowledge (CK) separately, together with a contract-aware evaluation that distinguishes genuine violations from CK-resolved differences. On eight Indeed-derived workflows (single LLM), it raises the functional-equivalence rate from 12% to 58%. Under three SOP-revision perturbations, previously extracted CK already covers 79.5% of newly introduced automation gaps.

Figures & tables

Explore similar work

CardsList
  1. Skill Drift Is Contract Violation: Proactive Maintenance for LLM Agent Skill Libraries

    May 9, 2026Linfeng Fan, Yuan Tian, Ziwei Li +1AI Agent Monitoring

  2. Compile, Then Page: Executable SOP Programs and a Capability-Gated Runtime for Procedural LLM Agents

    Jul 13, 2026Chenglin Yu, Li Yin, Ying Yu +4Instruction FollowingRuntime Enforcement for AI Agents

  3. Demystifying Agent Skills: Why They Work-Until They Don't

    Aug 14, 2026Zhiyuan Jiang, Fangrui Huang, Hanwen Xing +6LLM Agent Skill EvaluationLLM Agents