cs.CLNov 9, 2026

What drives the emergence of symbolic mechanisms in large language models?

Authors: Melody Zixuan Li, Taylor Webb

Organizations: Princeton Neuroscience Institute, Princeton University · Princeton Neuroscience Institute, Department of Psychology, Princeton University

Abstract

Recent work has identified a set of emergent symbolic mechanisms that support abstract reasoning in large language models, but it remains unclear what factors drive the emergence of these mechanisms. To address this question, we trained neural networks from scratch on abstract sequence tasks, varying both architectural and data distributional factors, and investigated the effects of these factors on the emergence of symbolic mechanisms. Using representational, attentional, and causal mediation analyses, we first confirmed that transformer-based language models trained from scratch on our task developed symbolic mechanisms. We then found that, across multiple axes of data diversity, greater diversity produced stronger symbolic signatures. Surprisingly, the same signatures emerged in modified transformer architectures and even multilayer perceptrons, indicating that architectural inductive biases are not necessary for the development of symbolic mechanisms. We also observed consistent patterns in an entity-attribute binding task. Together, these findings identify data diversity, not architecture, as the primary driver of emergent symbolic computation in neural networks.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Unveiling the Reasoning Process of Large Language Models

    Mar 31, 2026Junjie Zhang, Zhen Shen, Xisong Dong +1Symbolic Reasoning in Language ModelsLLM Interpretability

  2. Compositional Neuro-Symbolic Reasoning

    Apr 2, 2026Anugyan Das, Omkar Ghugarkar, Vishvesh Bhat +1Neuro-Symbolic ReasoningVisual Reasoning