Cross-Lingual Consistency in Language Models

Overview

This field asks whether language models preserve answers, reasoning, and safety behavior when the same meaning is expressed in different languages, scripts, or dialects. Researchers use parallel question-answering, factual-recall, reasoning, and safety benchmarks, measuring both accuracy and agreement across language versions. Methods include multilingual fine-tuning and reinforcement learning, representation alignment, preference optimization, and inference-time steering. Results show persistent gaps, especially for lower-resource languages, while leaving an important tension: models should be consistent on shared facts and safety rules without erasing culturally appropriate differences.

Latest papers

CardsList

72 papers14 papers in the last four weeks, level with the four weeks before. 0.1% of all new papers.

  1. Red-Teaming Large Language Models in Low-Resource African Languages: A Case Study of Yoruba and Nigerian Pidgin

    Oct 29, 2026Paula Chikaodinaka Anyanwu, Valdini Douglace Lemofouet, Blessing Ngozi Uzor +7Language Model Safety EvaluationLLM Red Teaming

  2. "Not" is Not Lost in Translation: A Causal Analysis of Negation Representations in Multilingual LLMs

    Oct 23, 2026Giang Son Nguyen, Wray Buntine, Dung D. Le +1Cross-Lingual Consistency in Language ModelsMultilingual Language Models

  3. Same Answer, Different Reasons: Trace-Level Divergence in Multilingual Large Language Models

    Oct 21, 2026Rui Sun, Peizhao Mei, Xiewei Cheng +4Multilingual Language Model EvaluationReasoning Consistency in Language Models

  4. Same Judgment, Different Yes: Measuring Multilingual Judgment Profiles in Language Models

    Oct 20, 2026Haonan Huang, Yuwei Lu, Chengkun CaiMultilingual Language Model EvaluationCross-Lingual Consistency in Language Models

  5. Evaluating Semantic Relation Knowledge through Bidirectional Relation Prediction from Gloss Pairs

    Oct 10, 2026Zhihan Cao, Adam Nohejl, Hitomi YanakaRelation ExtractionFactual Knowledge in Language Models

  6. ACTR: Aligning Thoughts and Responses for Multilingual Safety in Reasoning LLMs

    Sep 29, 2026Xianhui Zhang, Jian Yu, Chengyu Xie +6Adversarial Attacks on LLMsLLM Safety Alignment

  7. Concept Direction Reliability Across Languages with Different Tokenizer Fertility

    Sep 28, 2026Muhammad Abdullahi Said, Abass Oguntade, Elisha Komolafe +3Multilingual Sentiment AnalysisCross-Lingual Consistency in Language Models

  8. Fair Fact-Checking: Closing the Cross-Lingual Gap in LLM Factual Judgement with RoSh

    Sep 28, 2026Muhammad Ahmad, Fatemeh Seyedin, Adrian Weller +2Multilingual Language Model EvaluationAutomated Fact-Checking

  9. Do Audio Language Models Hear and Read Distinctive Features Alike?

    Sep 24, 2026Yuanhao Chen, Peter ChinAudio-Text AlignmentAudio-Language Models

  10. BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents

    Sep 20, 2026Peng Kuang, Yuchun Fan, Jiangnan Li +7Multilingual Language Model EvaluationLLM Agent Evaluation

  11. Measuring Behavioural Signatures of Large Language Models through Psychometric Profiling

    Sep 19, 2026Yu Sha, Junqi Tao, Dixin Zhou +10Personality Modeling in Language ModelsMultilingual Language Model Evaluation

  12. Semantic Fibers and Cross-Gram Interference: A Calculus of Safety Drift in Overcomplete Representations

    Sep 14, 2026Mohammed Ahnouch, Lotfi ElaachackLanguage Model Safety EvaluationLLM Safety

  13. SWORD: Wikidata-based Distortions Reveal Hidden Cross-Lingual Inconsistencies in LLM Factual Error Rejection

    Sep 8, 2026Sanghyeok Park, Minji Kang, Hosung Kwak +1Multilingual Language Model EvaluationFactual Knowledge in Language Models

  14. Same Values, Different Languages? From Multilingual Probing to Steering LLMs Toward Chinese Social Values

    Sep 8, 2026Yuemei Xu, Kexin Xu, Jian Zhou +3Multilingual Language Model EvaluationCultural Alignment

  15. Tracing Stereotypes from Representation to Output in Multilingual LLMs

    Sep 8, 2026Ariun-Erdene Tumurchuluun, Yusser Al Ghussin, Pinzhen Chen +2Multilingual Language ModelsSocial Bias in Language Models

  16. Perspectives on Cross-Lingual Consistency in LLMs for Medical Questions

    Sep 7, 2026Minh Duc Bui, Mario Sanz-Guerrero, Abteen Ebrahimi +4Multilingual QACross-Lingual Consistency in Language Models

  17. Cross-Lingual Representation Alignment by Token-Level Optimal Transport in a Language-Agnostic Space

    Sep 6, 2026Taisei Yamamoto, Ryoma Kumon, Danushka Bollegala +1Cross-Lingual Representation AlignmentCross-Lingual Consistency in Language Models

  18. UniRRM: Unified Reasoning Reward Models Across Languages and Evaluation Paradigms

    Sep 5, 2026Peng Lai, Yichao Du, Junchao Wu +6Reward ModelingReward Model Evaluation

  19. Recurrence Is Not Enough: Causally Validating Multilingual SAE Translation Features in Gemma 2 and 3

    Sep 4, 2026Giang Son Nguyen, Nhi Ngoc-Yen Nguyen, Wray Buntine +1Cross-Lingual Consistency in Language ModelsCross-Lingual Transfer

  20. A Systematic Evaluation of Cross-Lingual Consistency Enhancement Methods in Multilingual Language Models

    Sep 3, 2026Jirui Qi, Mingyang Wang, Hinrich Schütze +2Multilingual Language Model EvaluationMultilingual QA

  21. More Capable, Less Faithful: A Multilingual Analysis of Mathematical (Un)Solvability Detection in LLMs

    Aug 31, 2026Maria-Eleni Zoumpoulidi, Nikolaos Xiros, Georgios ParaskevopoulosMultilingual Language Model EvaluationLLM Reliability

  22. Latent-Space Intervention for Cross-Lingual Factual Consistency: Consistency Improvements without Accuracy Drops

    Aug 28, 2026Faeze Ghorbanpour, Constanza Fierro, Alexander Fraser +1Cross-Lingual Consistency in Language ModelsMultilingual QA