cs.CLJul 7, 2026

LLMs Silently Correct African American English: Auditing and Mitigating Dialect Bias via Activation Steering

Authors: Huan WuAli EmamiMuhammad Furquan HassanOsaretin IgbinobaOsakpolor IdusuyiOsamede IgbinobaFaiza Khan KhattakLaleh Seyyed-Kalantari

Organizations: 1York University · 2Vector Institute · Connected Minds · 4Emory University · 5Wilfrid Laurier University · University of Toronto · University of Guelph · 8Monark Health · 9CIFAR Solution Network Member

Abstract

African American English (AAE), a rule-governed dialect spoken by over 30 million people, is routinely misinterpreted and "corrected" by large language models (LLMs). Across six instruction-tuned LLMs (14B to 70B), we show that state-of-the-art models systematically prefer Standard American English (SAE) continuations even when the preceding context is in AAE, effectively rewriting AAE into SAE. We present an end-to-end framework to audit and mitigate this bias. For auditing, we introduce conditional Dialect Group Invariance (cDGI), which isolates true model bias from translator-induced artifacts, and a feature-level localization analysis that identifies which AAE markers most strongly trigger bias; we find that syntactic constructions, especially negative concord (e.g., "ain't nobody"), are universal triggers across all models. For mitigation, we introduce, to our knowledge, the first application of activation steering to dialect bias: a training-free, test-time method that extracts dialect directions via causal tracing and injects them into bias-relevant layers. Activation steering reduces bias 5 to 20 times more than prompting while preserving SAE fluency. To enable this work, we release REAL-AAE , the largest real-AAE parallel corpus to date: 17,479 AAE/SAE/ AAE_back triplets from natural tweets (2 to 6 times larger than prior real-AAE resources), validated automatically (BERTScore F1 = 0.95) and by three native AAE speakers (83.0% semantic agreement).

Explore similar work

CardsList
  1. Side-by-side Comparison Amplifies Dialect Bias in Language Models

    May 23, 2026Kritee Kondapally, Claire J. Smerdon, Pooja C. Patel +5Large Language Model BiasDialects