The Cost of Conservation: Coordination-Memory Laws for Exact-Support Generation
Organizations: School of Computation, Information and Technology Technical University of Munich, Germany
Abstract
Many AI systems make decisions locally, even when every realized output must obey an additive conservation law, such as selecting exactly a fixed number of items. This constraint can be statistically invisible: small subsets of a balanced fixed-budget output look increasingly independent, yet communication-free coordinate-parallel generation needs exponentially many pre-shared plans, while a sequential exact sampler needs only logarithmic memory. We study product measures conditioned on additive conservation laws in the intermediate regime where one plan is selected before a fixed-order pass, every plan is a bounded-state stochastic executor whose support is entirely legal, and the mixture of plan laws approximates the target distribution in total variation. Our main result identifies the optimal asymptotic selector rate, up to constant factors, with the killed spectral profile of the conservation-difference walk. The resulting coordination cost decreases as an inverse power of live-state width, with an exponent determined by intrinsic conservation rank rather than alphabet size; the law extends to noncentral budgets and heterogeneous local scores. The converse is driven by a state-versus-resource-sum obstruction, while a rate-matching construction compiles discrepancy control into exact-support finite-state plans. Complementary results characterize block-parallel plan complexity and the benefit of programmable output order. Together, these results show precisely how online memory substitutes for front-loaded coordination in exact-support generation.
Figures & tables
| Interface | Coordination | Online state |
|---|---|---|
| Fixed-order width- library (priced here) | selector rate | bits |
| Order-programmable library | ; needs addressable output | bits |
| Coordinate-parallel product | positive rate | constant |
| Remaining-count program | one plan | bits |
| Dropping, batchwise assignment, adaptive order, repair | not priced | unrestricted |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Object | Prior result used | Increment carried by this paper |
|---|---|---|
| One bounded-memory component | KRVZ small-space source ( 25 ) ; KRVZ/ROBP simulation ( 6 , Def. 12, Thm. 13) | no novelty claim for the component model |
| Legal support | truthful implementation as support inclusion ( 16 , Def. 2.8) | require truthfulness after conditioning on every selected plan |
| Selector-state frontier | flattening gives width at most | minimize at fixed truthful component width ; prove the killed-profile upper and lower rates |
| System | Architectural relaxation purchased | Frontier cost thereby avoided |
|---|---|---|
| Switch Transformer ( 11 ) | Overflow tokens bypass the sparse layer through the residual path. | Relaxes exact no-drop quotas, so overflow mass need not be represented by exact-support plans. |
| Expert Choice ( 40 ) | Experts select batchwise top- tokens, and a token may reach a variable number of experts. | Replaces fixed-order streaming by global batchwise assignment, moving coordination into the scheduler. |
| MegaBlocks ( 13 ) | Dynamic block-sparse dispatch accommodates realized, generally imbalanced expert loads without token dropping. | Replaces bounded-state equal-quota streaming by dynamic dispatch, spending runtime scheduling and storage instead. |