What Must Survive? Exact Task-Information--State Frontiers Under Partial Task Revelation
Abstract
A state may need to be compressed before its exact downstream task is known. For a finite family of linear task operators , we characterize exactly how much state must survive when only one of coarse task messages is available at compression time: where stacks the tasks that remain unresolved within cell . Thus task information reduces retained state precisely by separating tasks whose joint task-visible subspace is expensive. We derive the dual bit frontier, an irreducible common-core floor, and a sharp singular-value characterization for nonzero tolerance. For overlapping task families, a cumulative overlap deficit places the exact frontier within an additive of weighted load balancing. Optimal partitioning is strongly NP-hard, yet direct-sum families admit classical approximation guarantees and a PTAS. We stress-test the theory on learned task operators from CIFAR-10, Fashion-MNIST, SVHN, and Burgers observables. For Burgers with and , a constructive partition attains , while balanced random partitions require median , with held-out worst standardized RMSE . The results distinguish uniform task sufficiency from distributional and decision-level performance.
Figures & tables
| dataset | theorem interval | worst test RMSE | top-1 drop | |
|---|---|---|---|---|
| CIFAR-10 | 4 | 0.0107 | 1.69 | |
| Fashion-MNIST | 4 | 0.0333 | 11.00 | |
| SVHN | 4 | 0.00376 | 2.55 |
Information-Theoretic Lower Bounds
Information-theoretic lower bounds quantify the data, queries, communication, or computation no algorithm can avoid in learning and decision tasks.
See all 82 papers