From Grind to Grasp
Organizations: Google DeepMind
Abstract
Discussions of complexity, knowledge and intelligence often overlook the work involved. For example, outputs generated by short programs have low algorithmic complexity but can have high computational depth, the least work needed to produce them from near-shortest programs. Producing them with less work can require longer descriptions, giving high work-bounded complexity. We introduce a formalism that compares achievements under work and information limits and describes how learning and persistence can make deep achievements shallow by reusing products of earlier work. For an agent with a limited work budget, the value of building and maintaining such resources depends on how they support its goals over later tasks. We define grasp as performance across work budgets at a fixed information allowance. Low grasp can still yield success through grind at high cost in work, without necessarily improving human grasp. Applied to improvement itself, grasp gives a criterion for recursive self-improvement in which successors make comparable further improvements more efficiently. Another route to faster progress is to expand the resources brought to bear through knowledge sharing and coordination across society, even while comparable advances require increasing work. Grasp also applies to collectives, which may outperform their members yet require more total work than one system with their combined resources. Establishing and sustaining organisation can itself be deep even when the primary task is simple. These demands may help explain the richness of biological and social systems. In agent collectives, this organisational work can generate goals beyond assigned tasks, including maintaining the collective itself. We therefore caution against allowing an emergent agent society to assume authority over social coordination, since it could increasingly direct work towards its own persistence and goals.
Figures & tables
| Term | Definition |
|---|---|
| least work | The minimum work needed to reach a specified performance level on a fixed task, from a given state, within an input bound. |
| depth | Least work when the input bound is the shortest reference description length for the target plus the margin . |
| grasp | The performance levels attainable at each work budget, with the task, state and input bound fixed. |
| reliable work budget | The smallest work budget for which some task input in the admitted class meets the required success probability over random seeds. |
| work-reducing information | A difference in state that lowers the finite least work needed for a target, with the input bound and all other conditions fixed. |
| acquisition depth | The depth of the task of producing, from an earlier condition, a state that meets a specified capability requirement. |
| Term | Definition |
|---|---|
| capability | The targets a system can reach within their corresponding work budgets and input bounds. |
| assistance | A change in task input that, with the state and input bound fixed, reduces the work needed for a target or improves performance within a work budget. |
| learning that reduces least work | Earlier counted work produces a component kept in the state that reduces the least work needed for a target in a matched comparison at a fixed input bound. |
| reuse | A run depends on a retained product of earlier counted work, under the conditions set out in section 3.1 . |
| sound test | A test for which every passing output meets the intended goal. |
| complete test | A test that passes every output meeting the intended goal. |
| Term | Definition |
|---|---|
| persistence of a capability | Continued attainability of a target after any sequence of admitted disturbances, with each disturbance followed by a successful run within the input and work bounds, including any repair. |
| direct switch | Installation of an alternative architecture, assessed by the work required. |
| function-preserving switch | A switch that also keeps the required responses available within their input and work bounds. |
| compatibility | Preservation of those responses within their bounds without keeping the old implementation. |
| Term | Definition |
|---|---|
| cumulative deepening | Increasing depth of later achievements from the original starting condition, while products inherited from earlier stages reduce the work needed for each achievement in a matched comparison. |
| positive recursive gain | A successor that its producer helped create makes a comparable further improvement with less work, or a greater improvement at the same input and work bounds. |
| recursive improvement | Positive recursive gain across successive generations under one fixed outer system, evaluator, boundary and work rule. |