Multilingual Language Models

Overview

Multilingual language models study how systems can understand, reason, translate, and generate text across languages, including those with limited training data or distinct scripts. Common approaches include multilingual pretraining and data balancing, continued pretraining and instruction tuning, language-aware tokenization, and transfer methods such as shared representations, adapters, and mixture-of-experts models. Researchers evaluate performance with translation, comprehension, reasoning, and safety benchmarks, while probing internal representations and using inference-time steering to improve language control. A central tension is how to expand language coverage and transfer shared knowledge without degrading performance, reinforcing English or high-resource-language biases, or overlooking differences between languages and scripts.

Latest papers

CardsList

278 papers19 papers in the last four weeks, down 44% on the four weeks before. 0.1% of all new papers.

  1. Beyond Bilingual: Studying Quadrilingual Code-Switching with Conversational AI

    Nov 16, 2026Annika Bush, Melika Minnaar, Salys Sultan +3Code-SwitchingMultilingual Language Models

  2. When does text encoding matter for language modeling?

    Nov 10, 2026Eugene Jang, Catherine Arnett, Terra BlevinsTokenization in Language ModelsByte-Level Language Model

  3. MoTo: Mixture of Tokenizers Towards Fair Multilingual Language Modeling

    Nov 8, 2026Gül Sena Altıntaş, Colin RaffelTokenization in Language ModelsMultilingual Language Models

  4. I play of the cello: Evaluating Constructional Bleeding in Multilingual LLMs with CALQUE

    Nov 6, 2026Toshiki Nakai, Yu-Yin Hsu, Marie-Catherine de Marneffe +6Multilingual Language ModelsMultilingual Language Model Evaluation

  5. Language Defaults Before Content: A Causal Layer Map of Multilingual Generation

    Nov 5, 2026Shenbin Qian, Yves ScherrerMultilingual Language ModelsLLM Interpretability

  6. CardioLM: A multilingual suite of small language models for the cardiology domain

    Nov 5, 2026Manuela-Daniela Danu, Miguel Rodríguez-Ortega, Alberto Becerra-Tome +37Clinical NLPClinical Information Extraction

  7. Familiar letters, not related languages, let unseen languages into a shared space of meaning

    Nov 4, 2026Yuliang Liu, Xinyu Wang, Xiang BaiMultilingual Language ModelsCross-Lingual Transfer

  8. Leaving the Cave by Breaking the Symmetry: Identifiable Structure Can Enable Cross-Lingual Generalization

    Oct 28, 2026Frederick Riemenschneider, Anette FrankCross-Lingual Representation AlignmentMultilingual Language Models

  9. Quality over Quantity: Rethinking Data and Model Assumptions for Bengali Coreference Resolution

    Oct 26, 2026Zenith Biswas, Andrew Thomas DyerCoreference ResolutionLow-Resource Language Processing

  10. When the Weakest Language Keeps Moving: ARMOR-DP for Multilingual BabyLM

    Oct 24, 2026Hanyu Liao, Yijing Chen, Tao JiMultilingual Language ModelsAdaptive Sampling

  11. "Not" is Not Lost in Translation: A Causal Analysis of Negation Representations in Multilingual LLMs

    Oct 23, 2026Giang Son Nguyen, Wray Buntine, Dung D. Le +1Cross-Lingual Consistency in Language ModelsMultilingual Language Models

  12. CrisiLangs: A Multilingual Resource for Crisis Warning Generation

    Oct 22, 2026Giacomo Gonella, Stefano Menini, Marco GueriniMultilingual Language ModelsEarly Warning Detection

  13. Scaling Multilingual Pretraining of Pixel Language Models

    Oct 21, 2026Ilker Kesen, Jenny Kunz, Kasra Malihi +1Multilingual Language ModelsLanguage Model Scaling

  14. Same Answer, Different Reasons: Trace-Level Divergence in Multilingual Large Language Models

    Oct 21, 2026Rui Sun, Peizhao Mei, Xiewei Cheng +4Multilingual Language Model EvaluationReasoning Consistency in Language Models

  15. How to Use Parallel Data for Multilingual Pretraining

    Oct 20, 2026Zhihong Huang, Yao Lu, Derek F. Wong +2Language Model PretrainingMultilingual Language Models

  16. Where Are Language-Specific Features Represented in Multilingual LLMs? Everywhere

    Oct 18, 2026Mikaela Martins, Jonathan DunnMultilingual Language ModelsConcept Localization in Language Models

  17. One Head Away from Language Confusion: Single Attention Heads Across Model Families

    Oct 18, 2026Jiwon Jeong, Anjelo Jann Laroza, Chaewoon Yoon +4Multilingual Language ModelsAttention Head Analysis

  18. Unfragmenting Nawatl NMT: Single-Variant Specialization for Masewalkopa

    Oct 15, 2026Luis A. Mercado-Campos, Alexis PalmerBack-TranslationMachine Translation

  19. Multi-SFT: Permissively-Licensed Multilingual Instruction-Following

    Oct 15, 2026Daniela Baiamonte, Kamyar Zeinalipour, Elena Fano +2Instruction TuningMultilingual Language Models

  20. Translation Circuit Discovery and Targeted Optimization for Low-Resource Multilingual Translation

    Oct 15, 2026Atai Waris Khan, Abdullah Mazhar, Raghu Kumar +1Multilingual Language ModelsLow-Resource MT

  21. Wolof-Adapted Industry-Ready Open-Weight Language Models

    Oct 14, 2026Gwénolé Lecorvé, Delphine Charlet, Pierre Adam +15Language ModelingOpen-Weight Language Models

  22. Scaling Multilingual Mixture-of-Experts: How Language Coverage Changes Capacity and Compute Allocation

    Oct 14, 2026Joel Dag, Nikit Srivastava, Hamada M. Zahera +1Multilingual Language ModelsMixture-of-Experts Language Models