cs.CLJan 2, 2026

Embedding Consistency Regulation for Persistent Semantic Routing in Compact Language Models

Authors: Chung-Wei Victor Yuan

Organizations: YVIC Research Lab

Abstract

Language models are increasingly deployed under tight memory and compute constraints, where semantic routes (e.g., language, tone, or intent) may be assigned before decoding. However, these routes may not remain reflected in generated responses. We study this phenomenon as persistent semantic routing. We investigate this property using Embedding Consistency Regulation (ECR) as a minimal probe. ECR derives a short discrete prefix for each input using a frozen embedding model and applies the same prefix construction during both training and inference. In controlled prefix-assignment experiments, ECR achieves 99.93% ±\pm 0.12% language routing accuracy, while random, shuffled, and dummy controls remain near chance (34--36%). This gap is not reliably captured by likelihood: some controls achieve competitive NLL despite losing routing consistency. We introduce Response Routing Recoverability (RRR), an encoder-independent diagnostic that tests whether assigned routes remain observable after generation. Routing recoverability persists across multilingual settings, unsupervised partitions, reduced precision, and transfer tasks. These findings establish routing persistence as a distinct and measurable property of language models, complementary to task performance and likelihood.

Figures & tables

Appendix figures & tables9 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Test, then Route: How Language Models Execute In-Context Conditional Rules Across Models and Languages

    Aug 4, 2026Luxshan Thavarasa, Sivasuthan SukumarIn-Context LearningCircuits in Language Models

  2. SeLMRoute: Probabilistic Semantic Evidence for Large Language Model Routing

    Sep 28, 2026Vasilis Perifanis, Nikolaos Pavlidis, Symeon SymeonidisLLM Routing