Does Scaling Toward AGI Depend on What System-1 Lets System-2 Execute?
Organizations: Department of Automation, Tsinghua University, Beijing, China · Department of Computer Science, Tsinghua University, Beijing, China
Abstract
Progress toward artificial general intelligence (AGI) has largely relied on scaling a resource-intensive executive, System-2, through larger models, more data and compute, longer reasoning, and more agents. We ask whether the next stage may come instead from co-designing it with System-1, a lightweight, semantically aware predictor that evaluates candidate interactions before execution, so that System-2 acts only on those worth their cost. Our answer is a qualified yes. We study conditional interaction, a predict--gate--execute--update loop: System-1 estimates each candidate's utility, System-2 executes those admitted by an adaptive threshold, and the outcomes update System-1. The loop spans training, test-time reasoning, adaptive decision-making, and agentic tool use, with utility and cost defined by the application. Under ideal screening and equal execution costs, execution compute falls by a factor approaching , where is the density of utility-relevant interactions (cost-weighted when costs differ); prediction errors, exploration, and distribution shift reduce the saving. We bound selection regret by predictor error and the utility margin. These results motivate our central hypothesis: is a measurable coordinate of scaling efficiency and makes informative compute a better description of scaling than total compute.
Figures & tables
| Schema element | Digital (training) | Physical (training) | Test time | Agentic |
| Interaction (and execution) | prompt CoT generation | task config. env. rollout | reasoning step / sample | tool / think / ask action |
| Executive state | policy parameters | policy parameters | answer belief state | answer / plan belief state |
| Verifier / feedback | reward checker / scorer | adaptation loss | consistency / halting signal | tool result / task outcome |
| Utility | mixed-outcome proxy | predicted adaptation risk | accuracy gain (or belief change) | value of information |
| System-1 output | predicted value of continuing | predicted VoI net of cost | ||
| Cost | training compute ( ) | physics fidelity / actuation | inference compute | latency + $ + tokens + risk |