EMBER: Autonomous Cognitive Behaviour from Learned Spiking Neural Network Dynamics in a Hybrid LLM Architecture
Organizations: Independent Researcher
Abstract
We present (Experience-Modulated Biologically-inspired Emergent Reasoning), a hybrid cognitive architecture that reorganises the relationship between large language models (LLMs) and memory: rather than augmenting an LLM with retrieval tools, we place the LLM as a replaceable reasoning engine within a persistent, biologically-grounded associative substrate. The architecture centres on a 220,000-neuron spiking neural network (SNN) with spike-timing-dependent plasticity (STDP), four-layer hierarchical organisation (sensory/concept/category/meta-pattern), inhibitory E/I balance, and reward-modulated learning. Text embeddings are encoded into the SNN via a novel z-score standardised top-k population code that is dimension-independent by construction, achieving 82.2% discrimination retention across embedding dimensionalities. We show that STDP lateral propagation during idle operation can trigger and shape LLM actions without external prompting or scripted triggers: the SNN determines when to act and what associations to surface, while the LLM selects the action type and generates content. In one instance, the system autonomously initiated contact with a user after learned person-topic associations fired laterally during an 8-hour idle period. From a clean start with zero learned weights, the first SNN-triggered action occurred after only 7 conversational exchanges (14 messages).
Figures & tables
| Embedding model | Dim | Retention | Close/Dist | Sparsity |
|---|---|---|---|---|
| bge-large-en-v1.5 | 1024 | 82.2% | 1.57 | 14.0% |
| bge-small-en-v1.5 | 384 | 83.8% | 1.32 | 14.0% |
| # | Milestone | Messages | Time | Evidence |
|---|---|---|---|---|
| 1 | First lateral weight | 2 (1 exch.) | 1 min | Max weight 0.062 |
| 2 | First lateral impulse | 10 (5 exch.) | +3 min idle | 24 in 15 min |
| 3 | First KG edge | 10 (5 exch.) | +30 min | Consolidation edges |
| 4 | L3/L4 categories | 10 (5 exch.) | +30 min | First consol. cycle |
| — 8-hour designed idle period (STDP lateral propagation, no input) — | ||||
| 5 | Significance threshold | 14 (7 exch.) | +9.3 hours | 3+ concept firings |
| Metric | SNN-enabled | SNN-disabled |
| Reach-out actions | 1 | 0 |
| SNN-driven continuations | 1 | 0 |
| LLM-driven continuations | 0 | 1 |
| Cross-domain refs (cooking, per resp.) | 2.2 | 1.2 |
| Prior-domain refs as arguments | Yes | No (name-drops) |
| Journal entries with tags | 75% | 33% |
Cognitive Architectures for AI Agents
Cognitive architectures for AI agents organize perception, memory, goals, reasoning, and action into systems for persistent, adaptive behavior.
See all 85 papers