cs.CLMay 12, 2026

Do Language Models Encode Knowledge of Linguistic Constraint Violations?

Authors: HardySebastian Padó

Abstract

Large Language Models (LLMs) achieve strong linguistic performance, yet their internal mechanisms for producing these predictions remain unclear. We investigate the hypothesis that LLMs encode representations of linguistic constraint violations within their parameters, which are selectively activated when processing ungrammatical sentences. To test this, we use sparse autoencoders to decompose polysemantic activations into sparse, monosemantic features and recover candidates for violation-related features. We introduce a sensitivity score for identifying features that are preferentially activated on constraint-violated versus well-formed inputs, enabling unsupervised detection of potential violation-specific features. We further propose a conjunctive falsification framework with three criteria evaluated jointly. Overall, the results are negative in two respects: (1) the falsification criteria are not jointly satisfied across linguistic phenomena, and (2) no features are consistently shared across all categories. While some phenomena show partial evidence of selective causal structure, the overall pattern provides limited support for a unified set of grammatical violation detectors in current LMs.

Explore similar work

CardsList
  1. Implicit Representations of Grammaticality in Language Models

    May 6, 2026Yingshan Susan Wang, Linlu Qiu, Zhaofeng Wu +2GrammaticalityText Corpora

  2. Linguistic Productivity in Large Language Models: Models Coerce, but do not Preempt

    Jun 1, 2026Claire Bonial, Claire Benet Post, Laura Michaelis +1Linguistics