Cross-Lingual Consistency in Language Models

Follow this topic Ask about this topic

Momentum

12 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 40

All topics

Do Multilingual Encoders Produce Language-Consistent Semantic IDs?
Oct 1, 2026Abhinav Bohra, Anuj BohraMultilingual Language Model Evaluation Semantic ID Recommendation
Rutgers University
Where's Waldo? Query-language Preference under Cross-lingual Knowledge Disparities
Sep 30, 2026Dayeon Ki, Ruochen Zhang, Silviu Cucerzan +2Multilingual Language Model Evaluation Knowledge Conflicts in Language Models
University of Maryland · Microsoft
ACTR: Aligning Thoughts and Responses for Multilingual Safety in Reasoning LLMs
Sep 29, 2026Xianhui Zhang, Jian Yu, Chengyu Xie +6Adversarial Attacks on LLMs LLM Safety Alignment
Nanjing University of Science and Technology, Nanjing, China · National University of Singapore, Singapore · Beihang University, Beijing, China
CineSubBench: Evaluating LLMs on Long-Form Narrative and Cultural Understanding from Multilingual Movie Subtitles
Sep 28, 2026Mir Tafseer Nayeem, Susmoy Chakraborty, Davood RafieiMultilingual Language Model Evaluation Long-Context Language Model Evaluation
University of Alberta · Independent Researcher
Fair Fact-Checking: Closing the Cross-Lingual Gap in LLM Factual Judgement with RoSh
Sep 28, 2026Muhammad Ahmad, Fatemeh Seyedin, Adrian Weller +2Multilingual Language Model Evaluation Automated Fact-Checking
Department of Computer Science, Shifa Tameer-e-Millat University, Islamabad, Pakistan · BRAINS, Brandenburg Research Center for Applied Intelligent Systems, Potsdam, Germany · Max Planck Institute for Security and Privacy, Bochum, Germany +3
Do Audio Language Models Hear and Read Distinctive Features Alike?
Sep 24, 2026Yuanhao Chen, Peter ChinAudio-Language Models Self-Supervised Speech Representation Learning
Thayer School of Engineering, Dartmouth College, Hanover, NH, USA
BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents
Sep 20, 2026Peng Kuang, Yuchun Fan, Jiangnan Li +7Multilingual Language Model Evaluation LLM Agent Evaluation
Alibaba Token Hub, Alibaba Group · University of Illinois Urbana-Champaign · Northeastern University +2
Semantic Fibers and Cross-Gram Interference: A Calculus of Safety Drift in Overcomplete Representations
Sep 14, 2026Mohammed Ahnouch, Lotfi ElaachackLanguage Model Safety Evaluation LLM Safety
Université Paris 1 Paris, France · Faculty of Science and Technology of Tangier Abdelmalek Essaadi University Tangier, Morocco
SWORD: Wikidata-based Distortions Reveal Hidden Cross-Lingual Inconsistencies in LLM Factual Error Rejection
Sep 8, 2026Sanghyeok Park, Minji Kang, Hosung Kwak +1Multilingual Language Model Evaluation Factual Knowledge in Language Models
Soongsil University, Seoul, Republic of Korea · KAIST, Daejeon, Republic of Korea
Same Values, Different Languages? From Multilingual Probing to Steering LLMs Toward Chinese Social Values
Sep 8, 2026Yuemei Xu, Kexin Xu, Jian Zhou +3Multilingual Language Model Evaluation Cultural Alignment
School of Information Science and Technology, Beijing Foreign Studies University · Beijing Academy of Artificial Intelligence · The State Key Lab of Software Development Environment, Beihang University
Tracing Stereotypes from Representation to Output in Multilingual LLMs
Sep 8, 2026Ariun-Erdene Tumurchuluun, Yusser Al Ghussin, Pinzhen Chen +2Multilingual Language Models Social Bias in Language Models
Saarland University, Saarland Informatics Campus · German Research Center for Artificial Intelligence (DFKI) · Queen’s University Belfast +1
Perspectives on Cross-Lingual Consistency in LLMs for Medical Questions
Sep 7, 2026Minh Duc Bui, Mario Sanz-Guerrero, Abteen Ebrahimi +4Multilingual QA Cross-Lingual Consistency in Language Models
Johannes Gutenberg University Mainz, Germany · University of Colorado Boulder, USA · University of Marburg, Germany +1
A Systematic Evaluation of Cross-Lingual Consistency Enhancement Methods in Multilingual Language Models
Sep 3, 2026Jirui Qi, Mingyang Wang, Hinrich Schütze +2Multilingual Language Model Evaluation Multilingual QA
University of Groningen · LMU Munich · University of Amsterdam
Personas Differ from Native-Language Generation: Language Pathways Shape LLM Interpersonal Advice
Aug 31, 2026Jinhee Won, Xinlan Emily HuMultilingual Language Models LLM Prompting
Massachusetts Institute of Technology
More Capable, Less Faithful: A Multilingual Analysis of Mathematical (Un)Solvability Detection in LLMs
Aug 31, 2026Maria-Eleni Zoumpoulidi, Nikolaos Xiros, Georgios ParaskevopoulosMultilingual Language Model Evaluation LLM Reliability
Institute for Language and Speech Processing, Athena Research Center, Greece
When the API Speaks the Wrong Language: Revisiting Post-Training for Multilingual Tool Use
Aug 12, 2026Siddharth Chauhan, Thomas Butler, Abhishek Singhania +2Supervised Fine-Tuning Multilingual Language Model Evaluation
Amazon.
Actions Speak Louder than Words: Measuring Cross-Lingual Policy Retention in Tool-Using Agents
Aug 11, 2026Sourabrata Mukherjee, Kalika Bali, Sunayana SitaramMultilingual Language Model Evaluation Tool-Augmented Language Model Agents
Microsoft Research India
Is This Your Final Answer? Cross-Contextual Consistency as a Measure of LLM Credibility
Aug 10, 2026Siyang Wu, Yibo Jiang, Bryon AragamPrompt Sensitivity LLM Evaluation
Data Science Institute University of Chicago Chicago, USA · Department of Computer Science University of Chicago Chicago, USA · Booth School of Business University of Chicago Chicago, USA
Hidden Language Consistency Phenomena in Reasoning LLMs
Aug 9, 2026Muhammad Ali Shafique, Kelly MarchisioMultilingual Language Models Multilingual Language Model Evaluation
Kansas State University · Cohere
Decided Upstream, Written Late: Locating and Pricing the Cross-Lingual Refusal Circuit of a Multilingual MoE
Aug 8, 2026Ramakrishna P. Kompella, Aadit MahajanMultilingual Language Models Mixture-of-Experts Language Models
Gödel Machines · IIT Madras
Measuring the Cross-Lingual Comprehension Gap: How the language of the evidence shapes what language models understand
Aug 6, 2026Rafael da Silva, Jeff EicherMultilingual Language Model Evaluation Multilingual QA
Eastern University
Language Equality has a Price: A Systematic Investigation of Multi-turn LLM Performance for EU-24+
Aug 2, 2026Sherzod Hakimov, Karl Osswald, Jelle Psurek +3Multilingual Language Model Evaluation LLM Evaluation
Computational Linguistics, Department of Linguistics University of Potsdam, Germany · 1German Research Center for Artificial Intelligence (DFKI), Berlin, Germany
Inference-Time Steering for Cross-Lingual Factual Consistency in LLMs
Jul 21, 2026Alexander ManevMultilingual Language Model Evaluation LLM Alignment
Technical University of Munich
Distill Where the Student Goes: Teacher-Regularized RL for English-Evidence Cross-Lingual RAG
Jul 3, 2026Haotian Zhou, Weiran Huang, Siqi Liu +3RL for Language Models Retrieval-Augmented Generation
School of Computer Science, Shanghai Jiao Tong University · Ant International, Ant Group · Shanghai Innovation Institute +1
SPLIT: Cross-Lingual Empathy and Cultural Grounding in English and Ukrainian LLM Responses
Jul 2, 2026Anna ChornaMultilingual Language Model Evaluation LLM-as-a-Judge
Soft Token Alignment for Cross-Lingual Reasoning
Jun 25, 2026Jiayi He, Jungsoo Park, Wei Xu +1Multilingual Language Models Cross-Lingual Reasoning in Language Models
Georgia Institute of Technology
The Language Blind Spot: How Query Language and Brand Recognition Tier Shape AI-Constructed Brand Reputation Across Twelve European Languages
Jun 22, 2026Dmitrij ŻatuchinCultural Bias in Language Models Linguistic Bias in Language Models
Estonian Entrepreneurship University of Applied Sciences · Department of Information Technologies, Estonian Entrepreneurship University of Applied Sciences (EUAS), Tallinn, Estonia. · Rankfor.AI, Tallinn, Estonia.
Cross-LLM Consistency in Inference: Evidence from Shared Interactions
Jun 6, 2026Siyu Lou, Yao Yan, Yuntian Chen +1LLM Inference LLM Interpretability
School of Computer Science Shanghai Jiao Tong University Ningbo Key Laboratory of Advanced Manufacturing Simulation Eastern Institute of Technology, Ningbo · College of Computer and Information Science Chongqing Normal University · Ningbo Key Laboratory of Advanced Manufacturing Simulation Eastern Institute of Technology, Ningbo
When Languages Disagree: Self-Evolving Multilingual LLM Judges
Jun 6, 2026Xiyan Fu, Wei LuMultilingual Language Model Evaluation LLM-as-a-Judge
Nanyang Technological University
Improving Cross-Lingual Factual Recall via Consistency-Driven Reinforcement Learning
Jun 4, 2026Jonathan von Rad, Louis Arts, George Burgess +6Multilingual Language Model Evaluation RL for Language Models
University College London, Centre for Artificial Intelligence

Oct 1, 2026, cs.IRJ/K move · Enter open · S save

Do Multilingual Encoders Produce Language-Consistent Semantic IDs?

Abhinav Bohra, Anuj Bohra

Rutgers University

Multilingual Language Model Evaluation Semantic ID Recommendation Residual VQ Cross-Lingual Representation Alignment Cross-Lingual Consistency in Language Models

Open paper AskPDF arXiv

Semantic IDs (SIDs) compress item embeddings into discrete code sequences used in generative retrieval. We ask whether a multilingual encoder is sufficient for different-language renderings of the same product to receive language-consistent SIDs. Using Amazon ESCI listings rendered in English, Spanish, and Japanese, we test whether translations remain close to their English source, whether residual quantization is unusually sensitive to translation-induced movement, and whether multilingual or language-balanced quantizer fitting improves SID agreement. Multilingual E5 places translations measurably apart: under an English-heavy fit, a Japanese translation preserves the first SID code of its English counterpart in only 7.7% of cases, compared with 89.0% for an English rewording. Distance-matched product-directed controls produce nearly the same full-SID mismatch as translation, providing no evidence that the quantizer selectively amplifies language directions. Balancing the fitting mixture makes codebook use more uniform but further reduces cross-lingual prefix agreement: Spanish first-code consistency falls from 28.3% to 6.6%, while an English-only fit preserves it for 67.6% of Spanish translations. These results show that multilingual exposure and balanced codebook use alone do not guarantee language-consistent SIDs.

Momentum

Related topics

Latest papers 40