cs.AIMar 21, 2026

Context Cartography: Toward Structured Governance of Contextual Space in Large Language Model Systems

Authors: Zihua Wu, Georg Gartner

Organizations: NVIDIA · Research Division Cartography, TU Wien

Abstract

The prevailing approach to improving large language model (LLM) reasoning has centered on expanding context windows, implicitly assuming that more tokens yield better performance. However, empirical evidence - including the "lost in the middle" effect and long-distance relational degradation - demonstrates that contextual space exhibits structural gradients, salience asymmetries, and entropy accumulation under transformer architectures. We introduce Context Cartography, a formal framework for the deliberate governance of contextual space. We define a tripartite zonal model partitioning the informational universe into black fog (unobserved), gray fog (stored memory), and the visible field (active reasoning surface), and formalize seven cartographic operators - reconnaissance, selection, simplification, aggregation, projection, displacement, and layering - as transformations governing information transitions between and within zones. The operators are derived from a systematic coverage analysis of all non-trivial zone transformations and are organized by transformation type (what the operator does) and zone scope (where it applies). We ground the framework in the salience geometry of transformer attention, characterizing cartographic operators as necessary compensations for linear prefix memory, append-only state, and entropy accumulation under expanding context. An analysis of four contemporary systems (Claude Code, Letta, MemOS, and OpenViking) provides interpretive evidence that these operators are converging independently across the industry. We derive testable predictions from the framework - including operator-specific ablation hypotheses - and propose a diagnostic benchmark for empirical validation.

Figures & tables

Explore similar work

CardsList
  1. ContextGuard: Structured Self-Auditing for Context Learning in Language Models

    May 26, 2026Hongbo Jin, Chi Wang, Haoran Tang +5LLM AuditingInstruction Following

  2. LLM-Microscope: Uncovering the Hidden Role of Punctuation in Context Memory of Transformers

    Feb 20, 2025Anton Razzhigaev, Matvey Mikhalchuk, Temurbek Rahmatullaev +4Transformer InterpretabilityLong-Context Language Modeling

  3. CoCoSI: Collaborative Cognitive Map Construction for Spatial Intelligence

    Jun 9, 2026Yiming Zhang, Ruoxuan Cao, Zhihang ZhongMultimodal UnderstandingMultimodal Large Language Models