cs.CLOct 11, 2026

The Mathematical Collective Unconscious: Jungian Archetypes within the Latent Space

Authors: Andrew Breen

Read PDF
Ask AI
Cite

Copy citation

DOINot available for this paper

Abstract

Carl Jung theorised that the human psyche contains an inherited framework, the collective unconscious, populated by universal archetypes. As large language models (LLMs) are trained on vast corpora of textual data, this paper investigates whether they spontaneously construct distinct archetype-like regions within their high-dimensional latent spaces. The paper proposes that these regions function as spatial constraints that naturally organise semantically related narratives. To evaluate this, we applied cosine similarity and angular distance metrics across thirteen experiments utilising OpenAIs text-embedding-3-small model. The paper contains two experimental sections the first section explores these ideas using synthetically constructed narratives, the results of which act as a baselines for experiments conducted in the second section where the synthetic data is replaced by human-authored literature (Shmoop corpus), unedited dream reports (DreamBank corpus), and culturally distilled folklore (Andrew Langs Fairy Books). The results show that archetypal roles occupy distinct, measurable regions in the latent space. Crucially, these regions remain compact and consistent because of narrative structure rather than simple word overlap. Additionally, text category dictates spatial distribution: dream reports concentrate within Trickster and Shadow regions, while traditional folklore distributes evenly across all tested archetypes. We conclude that transformer latent spaces encode stable regions which appear to correspond to recognised Jungian archetypes.

More in this topic

Representation Geometry in Language Models

Representation geometry in language models studies how embeddings and hidden states organize concepts, computation, and behavior.

See all 421 papers

Explore similar work

CardsList
Mar 18, 2026

Text-to-Stage: Spatial Layouts from Long-form Narratives

In this work, we probe the ability of a language model to demonstrate spatial reasoning from unstructured text, mimicking human capabilities and automating a process that benefits many downstream media applications. Concretely, we study the narrative-to-play task: inferring stage-play layouts (scenes, speaker positions, movements, and room types) from text that lacks explicit spatial, positional, or relational cues. We then introduce a dramaturgy-inspired deterministic evaluation suite and, finally, a training and inference recipe that combines rejection SFT using Best-of-N sampling with RL from verifiable rewards via GRPO. Experiments on a text-only corpus of classical English literature demonstrate improvements over vanilla models across multiple metrics (character attribution, spatial plausibility, and movement economy), as well as alignment with an LLM-as-a-judge and subjective human preferences.

Jefferson Hernandez, Swarnadeep Saha, Chenxi Whitehouse +6

Rice University · Meta FAIR · Meta Reality Labs Research

Spatial Reasoning in Language ModelsSpatial ReasoningLanguage Model Generation Evaluation
AskPDF
Aug 27, 2026

Planting a Latent Variable in Natural-Looking Text: a More Realistic Test of Belief States in LLMs and Their Link to Concept Geometry

LLMs are thought to track "belief states," i.e., running probability distributions over the latent variables that govern language (Shai et al., 2024; Sarfati et al., 2026), but so far this has only been comprehensively demonstrated on toy synthetic data and in a few isolated case studies. It has also never been empirically connected to the geometry of LLM features (the concepts interpretability finds in model activations). In this work, we plant a controllable latent variable inside natural-looking text. An LLM teacher writes ordinary text while we "subliminally" steer it along one of K = 8 unrelated sparse autoencoder directions at each token, with the active directions following a ring-shaped Markov chain. A small transformer model trained on this corpus does indeed track the Bayesian posterior belief about our planted latent variable. Moreover, it also arranges the 8 states themselves on a ring, in the exact order of the Markov chain, which is supporting evidence that a concept's geometry can be formed by the statistical dynamics of the latent variable behind it.

Alexandru-Iulius Jerpelea

Columbia University

Belief Updating in LLMsRepresentation Geometry in Language ModelsLatent Variable ModelsBayesian Inference
AskPDF
Apr 16, 2026

Learning to Draw ASCII Improves Spatial Reasoning in Language Models

When faced with complex spatial problems, humans naturally sketch layouts to organize their thinking, and the act of drawing further sharpens their understanding. In this work, we ask whether a similar principle holds for Large Language Models (LLMs): can learning to construct explicit visual layouts from spatial descriptions instill genuine spatial understanding? We introduce Text2Space, a dataset that pairs natural language descriptions with ground-truth ASCII grid layouts and spatial QA pairs, enabling us to separate failures in constructing spatial representations from failures in reasoning over them. We adopt ASCII because it is human-readable, operates entirely within the token space of language models, and encodes spatial relations in a structurally verifiable form. Our evaluation reveals a pronounced "Read-Write Asymmetry": LLMs interpret ASCII representations effectively but struggle to produce them from text, and these construction errors propagate to incorrect answers downstream. To address this limitation, we train models on layout construction (Text→\rightarrowASCII) and find that it significantly improves spatial reasoning from text alone, even without producing any ASCII at inference time. Combining construction with comprehension training further amplifies these gains. Crucially, these improvements transfer to three external spatial reasoning benchmarks, demonstrating that, much as sketching sharpens human spatial thinking, learning to construct explicit layouts instills spatial understanding that generalizes beyond the training format.

Shiyuan Huang, Li Liu, Jincheng He +1

University of California, Santa Cruz

Representation LearningSpatial ReasoningSpatial Reasoning in Language Models
AskPDF