Multilingual Large Language Models

Follow this topic Ask about this topic

Recent momentum

+22%

11 papers in the last 28 days · 0.3% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

1 new paper

A weekly snapshot of new work published in Multilingual Large Language Models.

68 papers

Latest in Multilingual Large Language Models

Open your feed →

To Each Language Its Tokenizer: Modular Tokenizers for Efficient Multilingual LLMs
Sep 14, 2026Franck Signe, Hippolyte Pilchen, François Yvon +1Multilingual Language Models Multilingual Large Language Models
Multilingual in Name Only? Cultural and Linguistic Weaknesses of LLMs in Urdu
Sep 12, 2026Farah Adeeba, Abdul Rafae Khan, Rajesh Bhatt +1Multilingual Large Language Models Low-Resource Languages
Distribution-aware Language Neuron Identification in Multilingual Large Language Models
Sep 11, 2026Minjun Kim, Inho Won, Junghun Yuk +3Multilingual Large Language Models
5-Dialects-BN: Unmasking the Impact of Transliteration on Bangla Dialectal LLMs
Sep 9, 2026Md Mahir Jawad, Galib Mahmud Jim, Rafid Ahmed +3Dialects Bangla
Tracing Stereotypes from Representation to Output in Multilingual LLMs
Sep 8, 2026Ariun-Erdene Tumurchuluun, Yusser Al Ghussin, Pinzhen Chen +2Multilingual Large Language Models Stereotype Mitigation
Lost in Reordering: Structural Sensitivity of Multilingual LLMs under Semantics-Preserving Perturbations
Sep 3, 2026Karthika Nhayakkat, Rajat Verma, Maharaj Brahma +4Multilingual Large Language Models Multilingual Reasoning
To What Extent Do Large Language Models Understand Bangla Idioms?
Sep 3, 2026Mousumi Akter, Md. Faiyaz Abdullah Sayeedi, Nurul Labib Sayeedi +1Multilingual Idioms Multilingual Large Language Models
VakyArth: Evaluating Pragmatic Competence in LLMs across Indic Languages
Sep 1, 2026Usneek Singh, Poorvaja Veera Balaji Kumar, Parth Nanda +4Multilingual Large Language Models English
GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions
Sep 1, 2026Elias Stengel-Eskin, Newton Sander, Carlos Bonetti +4Multilingual Large Language Models Evolution
Separating Syntax from Language: A Mechanistic Account of Translation in Multilingual LLMs
Sep 1, 2026Mikhail Sonkin, Tanja Baeumel, Daniil Gurgurov +2Multilingual Large Language Models Machine Translation
Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
Sep 1, 2026Jingshen Zhang, Shaoyang Xu, Wenxuan ZhangLarge Language Model Alignment Large Language Model Bias
When Safety Speaks a Language: A Mechanistic Analysis of Safety-Language Identity Entanglement in LLMs
Aug 30, 2026Apoorva Upadhyaya, Sandipan SikdarMultilingual Safety Large Language Model Safety
When the API Speaks the Wrong Language: Revisiting Post-Training for Multilingual Tool Use
Aug 12, 2026Siddharth Chauhan, Thomas Butler, Abhishek Singhania +2Multilingual Large Language Models Multilingual
SurakshaEval: An Indic Safety Benchmark for Multilingual LLMs
Aug 8, 2026Debopriyo Banerjee, Kapil Rajesh Kavitha, Angana Borah +11Multilingual Safety Large Language Model Safety
Grammar Engineering Meets LLMs: Development of Cantonese and Irish ParGram Treebanks
Aug 7, 2026Chit-Fung Lam, Elaine Uí DhonnchadhaMultilingual Large Language Models
Strengthening Target-Language Features: SAE-Based Steering for Multilingual Inference
Aug 5, 2026Hongsheng Wang, Philipp KoehnMultilingual Large Language Models Multilingual Reasoning
Predicting Multilingual Classification and Translation Performance of LLMs with Cross-Lingual Alignment $\unicode{x2013}$ Is English Enough?Predicting Multilingual Classification and Translation Performance of LLMs with Cross-Lingual Alignment \unicode{x2013} Is English Enough?
Aug 4, 2026Adnan Al Ali, Kathy Hämmerl, Jindřich Libovický +1Cross-Lingual Alignment Multilingual Large Language Models
Language Equality has a Price: A Systematic Investigation of Multi-turn LLM Performance for EU-24+
Aug 2, 2026Sherzod Hakimov, Karl Osswald, Jelle Psurek +3Multilingual Large Language Models English
Language Shapes Instruction Hierarchy Compliance in Multilingual LLMs
Jul 26, 2026Jiwon Moon, Yerin Hwang, Kyomin JungMultilingual Large Language Models English
When Trivia Is Not Trivial: Everyday Knowledge Failures in Multilingual LLMs
Jul 23, 2026Anna Mosolova, Djamé SeddahMultilingual Benchmark Multilingual Large Language Models
LKValues: Aligning Large Language Models with Sri Lankan Societal Values
Jul 22, 2026Nethmi Muthugala, Supryadi, Surangika Ranathunga +7Large Language Model Alignment Multilingual Large Language Models
Similarity All The Way Up: Multilingual Generalization in LLMs Relies on Language-Level Similarity Structures
Jul 18, 2026Supantho Rakshit, Adele Goldberg, Henry ConklinMultilingual Large Language Models Structural Generalization
Beyond Heuristic Tuning: Power-Calibrated LLM Watermarking
Jul 6, 2026Xiaopu Wang, Zelin He, Chengyuan Liu +1Large Language Model Watermarks Watermarking
CrossHallu: Do Hallucination Signals Generalize Across Languages and Domains in Large Language Model's Internals?
Jul 4, 2026Aisha Alansari, Malak Alkhorasani, Hamzah LuqmanMultilingual Large Language Models Hallucinations
MultiSynt/MT: Trillion-Token Multi-Parallel Pre-Training Data Translated Across 36 Languages
Jul 1, 2026Maximilian Idahl, Jörg Tiedemann, Sampo Pyysalo +19Multilingual Large Language Models Multilingual Language Models
Soft Token Alignment for Cross-Lingual Reasoning
Jun 25, 2026Jiayi He, Jungsoo Park, Wei Xu +1Cross-Lingual Alignment Multilingual Large Language Models
Evaluating Japanese Dialect Robustness Across Speech and Text-based Large Language Models
Jun 24, 2026Tomoya Mizumoto, Yusuke Fujita, Hao Shi +3Dialects Multilingual Large Language Models
A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Models
Jun 24, 2026Soham Dan, Himanshu Beniwal, Thomas HartvigsenMultilingual Safety Large Language Model Safety
IndicGuard: A Multilingual Safety Guard Model and Dataset for Indic Languages
Jun 22, 2026Parth Bramhecha, Smit Deshmukh, Sairaj Bodhale +2Multilingual Safety Large Language Model Safety
The Language-Energy Divide: Measuring Energy Costs of Multilingual LLM Inference
Jun 20, 2026Naihao Deng, Alissa Shen, Yiming Feng +5Multilingual Large Language Models LLM Inference Efficiency
Code-Switching Reveals Language Anchoring in Multilingual LLMs
Jun 18, 2026Jeonghyun Park, Seunghyun Yoon, Yonghyun Jun +1Multilingual Large Language Models Code-Switching
Equity with Efficiency: An Empirical Study of Tokenizers for Multilingual Large Language Models
Jun 13, 2026Kieron Seven Jun Wei Lee, Muhammad Reza Qorib, Andrew Ivan Soegeng +1Multilingual Large Language Models Multilingual Language Models
SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptation
Jun 11, 2026Marek Šuppa, Andrej Ridzik, Daniel Hládek +2Domain-Invariant Text Embeddings Multilingual Large Language Models
Lius: Translation Model Based Instructional Lingustic Using Continual Instruction Tuning In Kupang Malay
Jun 10, 2026Joanito Agili Lopo, Yunita Sari, Guntur Budi HerwantoMultilingual Large Language Models Translation Quality
The Masked Advantage: Uncovering Local-Language Access to Cultural Knowledge in LLMs
Jun 5, 2026Yang Zhang, Xiao Fei, Amr Mohamed +6Multilingual Large Language Models Cultural Knowledge
From Script to Semantics: Prompting Strategies for African NLI
Jun 2, 2026Anuj Tiwari, Terry Oko-odion, Hannah NwokochaMultilingual Large Language Models Natural Language Inference
Multilinguality of Large Language Models From a Structural Perspective
Jun 1, 2026Haruki Sakajo, Yusuke Sakai, Hidetaka Kamigaito +1Multilingual Large Language Models Multilingual
Toward Responsible and Epistemically Grounded Multilingual LLMs for Computational Social Science and Humanities
May 30, 2026Wajdi ZaghouaniMultilingual Reasoning Multilingual Large Language Models
Model-Based Quality Assessment for Massively Multilingual Parallel Data
May 29, 2026Abdelaziz M. A. Ibrahim, Zihao Li, Jörg Tiedemann +1Multilingual Benchmark Multilingual Large Language Models
Shared Doubt: Zero-Shot Cross-Lingual Confidence Estimation for Language Models
May 29, 2026Athina Kyriakou, Dennis Ulmer, Ivan TitovMultilingual Large Language Models Confidence Estimation
Cross-Lingual Steering for Figurative Language Generation
May 28, 2026Linfeng Liu, Tiffany Zhan, Louie Hong Yao +2Figurative Language Multilingual Large Language Models
Comparative Evaluation of Machine Translation Systems on Images with Text
May 28, 2026Blai Puchol, Sergio Gómez González, Miguel Domingo +1Image-To-Image Translation Image-Text Pairs
VLMs May Not Globally Enhance Human Alignment over LLMs During Natural Reading
May 27, 2026Jinzhou Wu, Zhengwu Ma, Jixing Li +2Vision-Language Multilingual Large Language Models
DEPART: DEcomposing PARiTy across Multilingual LLMs
May 27, 2026Manan Uppadhyay, Prashant Kodali, Pranjal Chitale +3Multilingual Large Language Models English
Disentangling Language Roles in Multilingual LLM Task Execution
May 26, 2026Qishi Zhan, Minxuan Hu, Seoyeon Jang +7Multilingual Large Language Models Multilingual
MultiHaluDet: Multilingual Hallucination Detection via LLM Hidden State Probing
May 24, 2026Riasad Alvi, Nurul Labib Sayeedi, Md. Faiyaz Abdullah SayeediRobust Hallucination Detection Multilingual Large Language Models
Discovering Lexical Gaps Using Embeddings from Multilingual LLMs
May 23, 2026Yoonwon Jung, Aaron S. Cohen, Benjamin K. BergenMultilingual Large Language Models Korean
Same Model, Different Weakness: How Language and Modality Reshape the Jailbreak Attack Surface in Frontier MLLMs
May 22, 2026Casey Ford, Madison Van Doren, Sicheng Jin +1Large Language Model Jailbreaks Multilingual Safety
Do LLMs Know What Luxembourgish Borrows? Probing Lexical Neology in Low-Resource Multilingual Models
May 20, 2026Nina Hosseini-KivananiMultilingual Large Language Models Multilingual Language Models
Multilingual jailbreaking of LLMs using low-resource languages
May 18, 2026Dylan Marx, Marcel DunaiskiLarge Language Model Jailbreaks Multilingual Safety
A Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAM $Δ$ Integration into Upcycled MoEA Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAMΔ Integration into Upcycled MoE
May 18, 2026Hao Zhou, Tianhao Li, Zhijun Wang +6Multilingual Large Language Models Mixture-Of-Expert Language Models
Toward LLMs Beyond English-Centric Development
May 15, 2026Sho Takase, Ukyo HondaMultilingual Large Language Models Large Language Model Bias
Maistros: A Greek Large Language Model Adapted Through Knowledge Distillation From Large Reasoning Models
May 3, 2026Nikolaos Giarelis, Charalampos Mastrokostas, Nikos KaracapilidisMultilingual Large Language Models Large Language
Language Ideologies in a Multilingual Society: An LLM-based Analysis of Luxembourgish News Comments
Apr 30, 2026Emilia Milano, Alistair Plum, Yves Scherrer +1Multilingual Large Language Models Linguistics
TLPO: Token-Level Policy Optimization for Mitigating Language Confusion in Large Language Models
Apr 29, 2026Jinho Choo, JunSeung Lee, Jimyeong Kim +3Multilingual Large Language Models Linguistics
An Investigation of Linguistic Biases in LLM-Based Recommendations
Apr 28, 2026Nitin Venkateswaran, Jason Ang, Deep Adhikari +1Large Language Model Bias Multilingual Large Language Models
Large Language Models for Multilingual Code Intelligence: A Survey
Apr 27, 2026Chao Jiang, Dugang Liu, Cheng Wen +6Multilingual Large Language Models Multilingual
Multilingual Refusal Alignment for Safer Large Language Models
Apr 24, 2026Aleksandra Krasnodębska, Wojciech Kusa, Aldo LipaniMultilingual Safety Cross-Lingual Alignment
Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Framework
Apr 22, 2026Chenyuan Zhang, Qiguang Chen, Xie Chen +6Multilingual Reasoning Multilingual Large Language Models
Location Not Found: Exposing Implicit Local and Global Biases in Multilingual LLMs
Apr 21, 2026Guy Mor-Lan, Omer Goldman, Matan Eyal +6Large Language Model Bias Multilingual Large Language Models

Sep 14, 2026 · cs.CLJ/K move · Enter open · S save

To Each Language Its Tokenizer: Modular Tokenizers for Efficient Multilingual LLMs

Franck Signe, Hippolyte Pilchen, François Yvon, Édouard Grave

Kyutai, Paris · Univ. Grenoble Alpes, CNRS, Grenoble INP, LIG, Grenoble · Sorbonne Université, CNRS, Institute of Intelligent Systems and Robotics, Paris

Multilingual Large Language Models (LLMs) traditionally rely on a single vocabulary shared by all supported languages, which can lead to uneven compression across them. Moreover, their large embedding and output matrices increase memory usage and slow inference, notably for small-scale models. It is also wasteful as models are often used for only a subset of languages. To address these issues, we introduce a modular framework for multilingual model training. First, we propose methods to learn large modular BPE and Unigram tokenizers that enable extraction of subtokenizers tailored to any language subset. These subtokenizers achieve compression on par with monolingual tokenizers and improve cross-lingual fairness. Second, we design a pretraining strategy that samples subtokenizers to form batches, restricting predictions to the relevant vocabulary subset and allowing efficient training despite a large vocabulary. This supports efficient inference with any combination of language-specific vocabularies. Therefore, it reduces memory usage and speeds up inference in models without sacrificing performance.

Multilingual Language Models Multilingual Large Language Models Tokenization Byte-Pair Encoding

Open paper Ask about it PDF

Recent momentum

Neighbouring directions

Recent digests

1 new paper

Latest in Multilingual Large Language Models