Cross-Lingual Reasoning in Language Models

Follow this topic Ask about this topic

Momentum

4 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 45

All topics

Bridge Routing Heads: Where Multilingual Multi-hop Reasoning Lives in LLMs
Oct 7, 2026Seunghan Kim, Minyeong Choe, Hyunil Kim +1Cross-Lingual Reasoning in Language Models Multilingual Language Models
Chosun University · Soongsil University
Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning
Oct 7, 2026HyeonSeok Lim, SeungWoo Song, Inho Won +3LLM Reasoning Cross-Lingual Reasoning in Language Models
ETRI · KAIST · Department of Artificial Intelligence, Dankook University
Multilingual GSM-Symbolic: What determines capability transfer across languages?
Oct 2, 2026Kenneth Enevoldsen, Riley Herchert, Sofie Mosegaard +22Mathematical Reasoning Benchmarks Multilingual Language Model Evaluation
Aarhus University · Danish Foundation Models · University of Alabama +13
What Does Post-Training Change in Multilingual Reasoning?
Sep 29, 2026Hongyang Li, Xiao Li, Caesar Wu +2Multilingual Language Model Evaluation Cross-Lingual Reasoning in Language Models
University of Luxembourg · Seafill Open-Source Community
Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning
Sep 9, 2026Mehrnaz Mofakhami, Ananya Sahu, Alejandro R. Salamanca +5Multilingual Language Models Cross-Lingual Reasoning in Language Models
We're Cooked! - Probing LLM Political Alignment Via Conflict-Framed Recipe Translation
Sep 7, 2026Svetlana Gorovaia, Angelica Henestrosa, Ivan P. YamshchikovCross-Lingual Reasoning in Language Models LLM Prompting
CAIRO, Technical University of Applied Sciences Würzburg-Schweinfurt Würzburg, Germany
Enhancing Low-Resource Language Reasoning via High-Resource Language Feature Transfer
Aug 31, 2026Minju Song, Hyeon Hwang, Junhyun Lee +1Cross-Lingual Reasoning in Language Models Low-Resource Language Processing
Korea University · Hankuk University of Foreign Studies · Noah’s Farm +1
XHotpotQA: A Benchmark for Cross-Lingual Knowledge Composition in Multi-Hop Question Answering
Aug 23, 2026Iman Barati, Arash Ghafouri, Behrouz Minaei-BidgoliMulti-Hop QA Cross-Lingual Reasoning in Language Models
School of Computer Engineering, Iran University of Science and Technology, Tehran 16846-13114, Iran
Hidden Language Consistency Phenomena in Reasoning LLMs
Aug 9, 2026Muhammad Ali Shafique, Kelly MarchisioMultilingual Language Models Multilingual Language Model Evaluation
Kansas State University · Cohere
RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer
Aug 6, 2026Xinye Wang, Junxiao Liu, Shujian HuangNumerical Reasoning in Language Models Multilingual Language Models
National Key Laboratory for Novel Software Technology, Nanjing University
On-Policy Delta Distillation for Multilingual Math Reasoning
Aug 6, 2026Byeongho Heo, Jaehui Hwang, Sangdoo Yun +1Numerical Reasoning in Language Models Multilingual Language Models
NAVER AI Lab
Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages
Aug 1, 2026Sean Gip Lim, William Chandra Tjhi, Hai Leong ChieuNumerical Reasoning in Language Models Multilingual Language Models
1Nanyang Technological University · 2AI Singapore · 3DSO National Laboratories
ADAGE: A Language-Agnostic Pipeline for Analogical Reasoning Evaluation
Jul 25, 2026Ahmed Haj Ahmed, Alvin GrissomMultilingual Language Model Evaluation Reasoning Evaluation
Haverford College
Similarity All The Way Up: Multilingual Generalization in LLMs Relies on Language-Level Similarity Structures
Jul 18, 2026Supantho Rakshit, Adele Goldberg, Henry ConklinMultilingual Language Model Evaluation Cross-Lingual Reasoning in Language Models
Department of Electrical and Computer Engineering Princeton University · Department of Psychology Princeton University · Laboratory for Artificial Intelligence Princeton University
Cost of Reasoning in non-English Languages: A Case Study on Japanese
Jul 11, 2026Yuu JinnaiMultilingual Language Models Multilingual Language Model Evaluation
CyberAgent / Tokyo, Japan
Efficient Multilingual Reasoning Transfer via Progressive Code-Switching
Jul 1, 2026Zhijun Wang, Junxiao Liu, Hao Zhou +3Code-Switching Cross-Lingual Reasoning in Language Models
National Key Laboratory for Novel Software Technology, Nanjing University, China · Tongyi Lab, Alibaba Group
Multilingual Reasoning Cascades Need More Context
Jun 25, 2026Arnav Mazumder, Dengjia Zhang, Shuyue Stella Li +2Cross-Lingual Reasoning in Language Models Machine Translation
University of Washington · Johns Hopkins University
Soft Token Alignment for Cross-Lingual Reasoning
Jun 25, 2026Jiayi He, Jungsoo Park, Wei Xu +1Multilingual Language Models Cross-Lingual Reasoning in Language Models
Georgia Institute of Technology
LLM Parameters for Math Across Languages: Shared or Separate?
Jun 16, 2026Behzad Shomali, Luisa Victor, Tim Selbach +5Multilingual Language Models Cross-Lingual Reasoning in Language Models
Lamarr Institute · University of Bonn · Fraunhofer IAIS
ChLogic: Evaluating Robustness of Logical Reasoning in Chinese Expressions
Jun 16, 2026Peixian Zhou, Yuxu Chen, Chaorui Zhang +3Multilingual Language Model Evaluation Cross-Lingual Reasoning in Language Models
College of Mathematics, Sichuan University, China · Theory Lab, 2012 Labs, Huawei Technologies Co., Ltd.
AdaMame: A Training Recipe for Adaptive Multilingual Reasoning
Jun 13, 2026Dayeon Ki, Kevin Duh, Marine CarpuatMultilingual Language Models Cross-Lingual Reasoning in Language Models
mmPISA-bench: Do LLMs Reason Equally Well Across 43 Languages?
Jun 5, 2026Yerzhan Sapenov, Jaromir SavelkaMultilingual Language Models Multilingual Language Model Evaluation
School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA
Learning When to Translate for Multilingual Reasoning
Jun 1, 2026Deokhyung Kang, Hyounghun Kim, Gary Geunbae LeeMultilingual Language Models Cross-Lingual Reasoning in Language Models
1Graduate School of Artificial Intelligence · POSTECH, South Korea · Department of Computer Science & Engineering
Cross-lingual Self-Consistency for Multilingual Reasoning with Language Models
May 31, 2026Ahmed Elhady, Eneko Agirre, Mikel ArtetxeMultilingual Language Models Cross-Lingual Reasoning in Language Models
HiTZ Center, University of the Basque Country (UPV/EHU) · Reka AI
XLGoBench: Detecting cross-lingual skill gaps with algorithmic tasks
May 29, 2026Purvam Jain, Preethi Jyothi, Vihari Piratla +1Multilingual Language Model Evaluation Cross-Lingual Reasoning in Language Models
Google DeepMind · Indian Institute of Technology Bombay · International Centre for Theoretical Sciences, Tata Institute of Fundamental Research
When English Rewrites Local Knowledge: Global Narrative Dominance in Large Language Models
May 28, 2026Md Arid Hasan, Ruwad Naswan, Farhan Samir +2Multilingual Language Model Evaluation LLM Grounding
University of Toronto · BUET · University of Illinois Urbana-Champaign
Evaluating Cross-lingual Knowledge Consistency in Code-Mixed vis-a-vis Indian Languages using IndicKLAR
May 28, 2026Debajyoti Mazumder, Divyansh Pathak, Prashant Kodali +3Multilingual Language Model Evaluation Cross-Lingual Reasoning in Language Models
Indian Institute of Science Education and Research, Bhopal, India · Microsoft Corporation · UNSW Sydney, Australia
Do LLMs Build World Models From Text? A Multilingual Diagnostic of Spatial Reasoning
May 27, 2026Zhikai Pan, Chih-Ting Liao, Chunrui Liu +5LLM World Models Multilingual Language Model Evaluation
University of New South Wales · Essential Energy · University of Alabama at Birmingham +3
DEPART: DEcomposing PARiTy across Multilingual LLMs
May 27, 2026Manan Uppadhyay, Prashant Kodali, Pranjal Chitale +3Multilingual Language Model Evaluation Cross-Lingual Reasoning in Language Models
Microsoft Research India · IIT Gandhinagar
Simorgh at SemEval-2026 task 7: Region-Aware Hybrid Retrieval for Low-Resource Cultural Reasoning in Multilingual Question Answering
May 26, 2026Hadi Bayrami Asl Tekanlou, Mahdi Bakhtiyarzadeh, Jafar RazmaraRetrieval-Augmented Generation Cross-Lingual Reasoning in Language Models
University of Tabriz, Tabriz, Iran

Oct 7, 2026, cs.CLJ/K move · Enter open · S save

Bridge Routing Heads: Where Multilingual Multi-hop Reasoning Lives in LLMs

Seunghan Kim, Minyeong Choe, Hyunil Kim, Haehyun Cho

Chosun University · Soongsil University

Cross-Lingual Reasoning in Language Models Multilingual Language Models Circuits in Language Models Causal Interventions in Language Models Multi-Hop Reasoning

Open paper AskPDF arXiv

Multilingual LLMs answer the same multi-hop reasoning question across languages, but we lack a mechanistic account of whether they share an internal circuit. We identify Bridge Routing Heads (BRH) in two large multilingual LLMs through a three-stage pipeline. The resulting language-specific head sets exhibit near-complete mutual exclusivity across the five languages, with a mean Jaccard similarity of only 0.017 for Llama 3.1 70B and 0.057 for Qwen 2.5 72B, revealing language-idiosyncratic circuits. Ablating general BRH increases two-hop Negative Log-Likelihood (NLL) by 39-89x the random-head baseline, providing direct causal evidence of their role. Amplifying these heads in a failing target-language pass rescues up to 51.7% of cross-lingual failures, with no training. The two models share this dual-circuit pattern but allocate heads differently: Llama concentrates chaining in a large general pool, while Qwen leans on larger language-specific pools. Together these results show that activation-level intervention alone can recover correct answers from cross-lingual reasoning failures.

Momentum

Related topics

Latest papers 45