cs.LGMay 9, 2026

Lattice Deduction Transformers

Authors: Liam DavisLeopold HallerAlberto AlfaranoMark Santolucito

Organizations: Amherst College · Axiom · Barnard College, Columbia University

Abstract

We introduce the Lattice Deduction Transformer (LDT), a recurrent transformer that approximates logically sound deduction by projecting its latent state through a lattice between forward passes. We train on-policy in a process that mirrors deduction in a search-based constraint solver and supervise training via a domain-agnostic, abstract-interpretation-based approximation of the set of solution candidates. An 800800K-parameter LDT achieves 100%100\% accuracy on Sudoku-Extreme and Snowflake Sudoku, at a fraction of the training cost of prior small recurrent reasoners, while remaining empirically sound: the model returns a correct answer or abstains. A 1.81.8M-parameter variant reaches 99.9%99.9\% accuracy on Maze-Hard. Frontier LLMs score 0%0\% on all three benchmarks.

Explore similar work

CardsList