cs.LGApr 9, 2026

Loom: A Scalable Analytical Neural Computer Architecture

Authors: Mehmet Kerem Turkcan

Organizations: Columbia University

Abstract

We present Loom, a computer architecture that executes programs compiled from C inside a looped transformer whose weights are derived analytically. The architecture implements a 22-opcode instruction set in 8 transformer layers. Each forward pass executes one instruction; the model is applied iteratively until the program counter reaches zero. The full machine state resides in a single tensor X∈Rd×nX \in \mathbb{R}^{d \times n} of fixed size, and every step has fixed cost for fixed dd and nn, independent of program length or execution history. The default configuration uses d=155d = 155 and n=1024n = 1024, yielding 4.7 million parameters and 928 instruction slots. A compact configuration at d=146d = 146 and n=512n = 512 suffices for a 9×\times9 Sudoku solver (284 instructions). The weights are program-independent: programs live in the state tensor, and the same fixed-weight model executes any compiled program. We make Loom source code publicly available at https://github.com/mkturkcan/Loom.

Figures & tables

Explore similar work

CardsList
  1. Planning with Transformers: Chain of Computation and Structured Context Windows

    Jul 20, 2026Ehsan Futuhi, Nathan R. SturtevantLLM PlanningModel-Based Planning

  2. Internalizing Chain-of-thought into Looped Transformers

    Oct 19, 2026Kehang Zhou, Pinyan LuRecurrent TransformersLatent Reasoning

  3. Efficiently Representing Algorithms With Chain-of-Thought Transformers

    Jun 18, 2026Yanhong Li, Anej Svete, Ashish Sabharwal +1TransformerCoT Reasoning