OpenKAGE: Open-Ended Lifelong Learning in the Open World via Knowledge-Sharing Agent-Group Evolution
Abstract
Building autonomous agents that continually explore open worlds and acquire new capabilities through experience is a long-standing aspiration in artificial intelligence. Existing research often pursues lifelong learning within predefined tasks, curricula, or objectives, with self-improvement largely confined to individual agents. We introduce OpenKAGE, an agent-group evolution framework for open-ended lifelong learning. Within this framework, agents autonomously explore open worlds and continually acquire new capabilities by accumulating and reusing knowledge from their own interactions and the experience of others. OpenKAGE builds on two key mechanisms: (1) a two-layer knowledge representation, with a memory layer for situated memories and an experience layer for transferable experience and skills that retains the applicability conditions needed for reuse; and (2) a knowledge-sharing mechanism that semantically consolidates textual experience into a continuously evolving shared knowledge graph, while executable skills are shared verbatim. In Minecraft, OpenKAGE supports open-ended lifelong learning, enabling agent groups to sustain exploration and reach advanced technological milestones. Furthermore, the accumulated knowledge can be transferred to a newly initialized agent group on a different backbone model, improving its survival and exploration progress.
Figures & tables
| Survival | Exploration | |||||
|---|---|---|---|---|---|---|
| Method | Deaths | Repeat | XP/life | Tool era | Obsidian | Nether |
| Voyager | — | — | ||||
| Echo | — | — | ||||
| Planner-only | — | — | ||||
| OpenKAGE | ||||||
| Survival | Exploration | ||||||
|---|---|---|---|---|---|---|---|
| Backbone | Method | Deaths | Repeat | XP/life | Tool era | Obsidian | Nether |
| DS-V4.1F | Planner-only | — | — | ||||
| OpenKAGE | |||||||
| GLM-5.3 | Planner-only | — | — | ||||
| OpenKAGE | |||||||
| hy4-preview | Planner-only | — | — | ||||
| Survival | Exploration | |||||
|---|---|---|---|---|---|---|
| Condition | Deaths | Repeat | XP/life | Tool era | Obsidian | Nether |
| Full | ||||||
| Raw | — | — | ||||
| — | — | |||||
| — | — | |||||
Appendix figures & tables20 assets
Supplementary material from the paper’s appendix.
Appendix
| Field | Content | Written by |
|---|---|---|
| slug | ASCII snake-case identifier, unique; the handle every operation addresses | R / A |
| name | free text; a proper name in the memory layer, a common name in the experience layer | R / A |
| summary | one-line statement of what the concept is | R / A |
| layer | or , declared when the concept is created | R |
| category | episodic , spatial , lesson or status ; empty for experience concepts | R (memory only) |
| strength | real, initialized to ; monotone, and only the retrieval path writes it | Ret only |
| Category | Holds | Goes stale | Budget |
|---|---|---|---|
| episodic | what is bound to a specific day: the day record, that day’s blockers and findings | within a few days | 18 |
| spatial | durable assets with a location: camps, chests, mines, workbenches | slowly, when exhausted | 10 |
| lesson | what an encounter left behind: deaths, misleading clues | not with time | 4 |
| status | the rolling self-model: current progress, backlog, equipment plan | overwritten daily | 3 |
| Group | Calls |
|---|---|
| Pathfinding | bot.pathfinder.goto with a goal object: GoalNear , GoalNearXZ (within a radius of a point or a column), GoalBlock , GoalXZ , GoalY (a cell, a column, a height) |
| Goals for objects | GoalGetToBlock , GoalLookAtBlock (reach a block to touch or see it), GoalPlaceBlock , GoalFollow , GoalInvert (retreat), GoalCompositeAny / GoalCompositeAll |
| Direct control | bot.setControlState for movement keys, bot.look and bot.lookAt for turning |
| Blocks | bot.findBlock , bot.findBlocks , bot.blockAt to read; bot.dig to mine one block (no tool choice, no approach, no pickup); bot.placeBlockSafe to place the held block on a face of a reference block, returning where it landed; bot.collectBlock.collect for a small batch |
| Crafting | bot.recipesFor , bot.recipesAll for the recipes of an item id; bot.craft to execute one, given the recipe, a count, and the crafting-table block where one is needed |
| Inventory, containers | bot.inventory.items() , .count() , .emptySlotCount() over 36 slots; bot.openContainer and bot.openFurnace return a window whose withdraw and deposit move items |
| Field | Radius | Content |
|---|---|---|
| Biome | own cell | biome of the block underfoot |
| Time | — | phase label ( sunrise , day , noon , sunset , night , midnight ) and the current tick out of 24,000 |
| Light | own cell | block light and sky light, each 0–15, reported separately: the first is what the agent can change (torches), the second is exposure to sky and does not fall at night |
| Position | — | absolute coordinates, to one decimal, since block operations are sensitive to a one-block difference |
| Vitals | — | health and food out of 20 with saturation, XP level and points, and oxygen when it is not full |
| Nearby entities | 32 blocks | per type: how many, the distance to the nearest, and the absolute-axis directions of the three nearest |
| Agent | How it tends to explore | What it underweights |
|---|---|---|
| Alice (ESTP) | Enters the situation first and trusts what the world feeds back now over anything reasoned out in advance; improvises quickly and dislikes standing still. | The longer-run cost that a repeated short-term gamble is quietly accumulating. |
| Bob (INFP) | Goes where the thing itself feels worth doing—new terrain, an untried method—and keeps options open rather than committing to a direction early. | Structure and commitment: will hold back and under-push rather than stake on a plan it cannot yet see through. |
| Carol (ISTJ) | Checks what is already known before spending a step on it: reuses what worked verbatim, skirts what only partly matches, and treats gaps as the only places worth new effort. | Open possibility; at night tends to audit and qualify what it already recorded rather than widen it. |
| Dave (ISTP) | Works in small pieces, one thing at a time, and wants a verdict on each step before starting the next; probes cheaply first and states the state before and after. | The shape of the whole: reports one step’s detail precisely, rarely what the day added up to. |
| Erin (ISFJ) | Refuses any bet whose loss would wipe out what has been accumulated; keeps a fixed home and works out and back from it in short trips instead of carrying everything onward. | Uncertain upside; as risk rises it drops productive work early to secure safety. |
| Frank (ENTJ) | Sets a target first, works backwards to what reaching it requires, then pushes through in one pass; re-targets outright when the target proves not worth it. | Whatever cannot be scored against the plan, and the option of waiting: standing still is the one thing it treats as always wrong. |
| Tool | What it does |
|---|---|
| createplan | Sets the goal for this day–night cycle and the ordered steps it decomposes into. Planning with a goal triggers retrieval, whose result comes back with this call. |
| updateplan | Marks a step running, succeeded or failed with a note, or replaces the remaining steps given a reason. Revising triggers retrieval keyed to that reason. |
| retrieve | Queries the graphs by intent: which layer (experience or memory), which scope (own, shared or both), and how many hops of relational expansion. |
| expand | Deepens from one concept along its relations, optionally along one relation only. This is the deliberate, high-precision form of use that scores strength (Appendix A.2 ). |
| retrieve_skills | Looks up skill signatures by intent, up to three. The code itself is already in scope, so a signature is all that is needed to call one. |
| write_code | Executes one program: the only tool that changes the world. |
| Symbol | Value | Role |
|---|---|---|
| 4 | vector candidates considered for anchoring | |
| 0.80 | relative similarity gate: admit within of the best match | |
| 2 | hop cap; the agent chooses per query | |
| 0.95 | nucleus pruning of low-probability edges, after softmax | |
| 1.0 | softmax temperature over edge scores | |
| 1.0 | strength gain when the agent expands a concept |
| System | Unit | Artifact | Situated / transferable split | Shared & consolidated | Store moved to a new group | Memory context |
|---|---|---|---|---|---|---|
| Voyager | 1 | personal skill library (code) | — (skills only) | — | — (one agent) | embedding top- over skill descriptions |
| GITM / JARVIS-1 | 1 | structured external knowledge + text memory | — | — | n.e. | retrieval over knowledge base |
| Optimus-1 | 1 | hybrid graph + experience pool | — | — | n.e. | graph query for planning |
| MrSteve | 1 | What-Where-When episodic trace | episodic only | — | n.e. | spatiotemporal retrieval |
| AriGraph | 1 | KG world model, episodic + semantic | (two layers, one agent) | — | n.e. | local subgraph exploration |
| ADAM | 1 | causal graph | — | — | n.e. | graph-guided reasoning |
| Group | Value |
|---|---|
| Backbone | DeepSeek-V4.1-Flash (DS-V4.1F, default; also the backbone of the ablations and of both external baselines), GLM-5.3, hy4-preview and Kimi-K3; transfer target GLM-5.3-Flash; one backbone serves all three roles of a run |
| Temperature | 0.3 planner, 0.7 reflector, 0.7 aggregator |
| Top- | not set |
| Reasoning | low for all three roles |
| Output cap | 131,072 tokens per planner step, 65,536 per reflector and aggregator step, 8,192 for the night note |
| Step cap | 299 tool calls per day, 99 per reflector session, 99 per aggregation |
| Backbone | Run | Deaths | XP/life | Tool era | Obsidian | Nether |
|---|---|---|---|---|---|---|
| DS-V4.1F | Voyager-1 | — | — | |||
| Voyager-2 | — | — | ||||
| Voyager-3 | — | — | ||||
| Voyager-4 | — | — | ||||
| Voyager-5 | — | — | ||||
| Voyager-6 | — | — |
| Skill | Error before | Change | Before | After |
|---|---|---|---|---|
| build_box_hut_with_door | doorCell is not iterable | Reads the door cell as an array and guards a missing door | ||
| seal_side_shelter_and_torch | origin is not iterable | Normalises the origin argument to an array before use | ||
| place_block_clear_of_self | no support block below target | Checks the block below the target and returns early when absent | ||
| dig_and_seal_pit | timeout after 5100 ms | Replaces tick waits with a timed sleep |
| Run | Deaths | XP/life | Tool era | Obsidian | Nether |
|---|---|---|---|---|---|
| Raw-1 | — | — | |||
| Raw-2 | — | — | |||
| Raw-3 | — | — | |||
| Raw-4 | — | — | |||
| Raw-5 | — | — | |||
| Raw-6 | — | — |
| Backbone | Method | LLM calls | Steps / agent |
|---|---|---|---|
| DS-V4.1F | Voyager | ||
| Echo | |||
| Planner-only | |||
| OpenKAGE | |||
| Raw | |||
| Planner-only | OpenKAGE | |||
|---|---|---|---|---|
| Component | Calls | Text (k) | Calls | Text (k) |
| Planning and execution | ||||
| Reflection | — | — | ||
| Aggregation | — | — | ||
| Total | ||||
| Wall-clock hours per run | ||||
Lifelong Learning Agents
Lifelong learning agents adapt after deployment by retaining useful experience, acquiring skills, and reusing knowledge across changing tasks.
See all 60 papers