Overview

Language identification studies how to infer a text’s or speech segment’s language, from whole documents and recordings down to individual words in code-switched conversations. Common approaches include character and word-based classifiers, contextual multilingual models, tokenizer likelihoods, and speech systems built on pretrained encoders; some methods also adjust representations to reduce accent-related errors. Evaluation spans multilingual benchmarks, regional varieties, noisy or transliterated text, mixed-language social media, and speech recorded across different acoustic conditions. Systems can perform well on familiar data, but low-resource languages, closely related varieties, code-switch boundaries, and shifts in speaker or recording conditions remain difficult, and benchmark results do not always predict real-world reliability.

Latest papers

CardsList

27 papers1 paper in the last four weeks, down 83% on the four weeks before. 0.0% of all new papers.

  1. Acoustic and Lexical Signals for Native Language Identification of Language Learners

    Oct 23, 2026Ahmet Yavuz Uluslu, Mengjie Qian, Kate Knill +1Language IdentificationSpeech Processing

  2. Where Are Language-Specific Features Represented in Multilingual LLMs? Everywhere

    Oct 18, 2026Mikaela Martins, Jonathan DunnMultilingual Language ModelsConcept Localization in Language Models

  3. Anuvani-LID: Robust and Calibrated Spoken Language Identification for Indian Languages

    Oct 14, 2026Stephen Fernandes, Narayan ChoudharyLanguage Identification

  4. MixLID: Token-Level Language Identification in Mixed-Language Text

    Oct 12, 2026Seongtae Hong, Youngjoon Jang, Seungyoon Lee +2Language Identification

  5. Mitigating Accent-Language Confusion in Self-Supervised Speech Representations for Language Identification

    Oct 7, 2026Minu Kim, Jihwan Lee, David R. Mortensen +1Language IdentificationAlgorithmic Bias

  6. Code-Switching Spoken Language Identification as Multi-Label Set Prediction

    Oct 1, 2026Shunsuke Mitsumori, Matthew Wiesner, Shigeo Morishima +1Multi-Label ClassificationLanguage Identification

  7. Acoustic domain shift in spoken language identification from systematic domain generalization evaluation to real-world application

    Sep 23, 2026Francois Derrida, Raphaël Duroselle, Thomas Courtat +1Distribution ShiftDomain Generalization

  8. IndicTriMix: Developing Language Identification Datasets and Models for Tri-Language Code-Mixing

    Sep 10, 2026Pruthwik Mishra, Rudra Trivedi, Avi Patel +2Language Identification

  9. Fine PT-PT Web: A High-Quality 41 Billion Tokens Data Collection of the European Portuguese Web

    Sep 7, 2026Gonçalo Vinagre, Rui Pedro Guerra, Pedro Gomes +7Language Model PretrainingLanguage Identification

  10. Improving Language Identification for Code-Switched Utterances with Integer Linear Programming

    Sep 4, 2026Joanna Radoła, Josep Maria Crego, François YvonLanguage Identification

  11. Vocal Music under Phoneme-Conditional Analysis

    Aug 31, 2026Hayoon Kim, Kyogu LeeLanguage Identification

  12. Language Identification with Succinct Machine-Independent Traces

    Jul 14, 2026Moses Charikar, Jon Kleinberg, Chirag PabbarajuInductive InferenceLanguage Identification

  13. Improving low-resource ASR using bilingual fine-tuning with language identification: a cross-linguistic evaluation

    Jun 16, 2026Reihaneh Amooie, Yun Hao, Wietse de Vries +3Fine-TuningLanguage Identification

  14. CHALIS: A Challenge Dataset for Language Identification in Difficult Scenarios

    Jun 4, 2026Michal Tichý, Jindřich LibovickýDistribution Shift RobustnessLanguage Identification

  15. Spoken Language Identification with Pre-trained Models and Margin Loss

    May 3, 2026Zhihua Fang, Liang He, Weiwu JiangLanguage IdentificationMargin-Based Learning

  16. On the Price of Privacy for Language Identification and Generation

    Apr 8, 2026Xiaoyu Li, Andi Han, Jiaojiao Jiang +1Privacy-Preserving Language ModelsLanguage Identification

  17. Robust Language Identification for Romansh Varieties

    Mar 16, 2026Charlotte Model, Sina Ahmadi, Jannis VamvasDialect IdentificationLanguage Identification

  18. Scaling Self-Supervised Speech Models Uncovers Deep Linguistic Relationships: Evidence from the Pacific Cluster

    Mar 7, 2026Minu Kim, Hoirin Kim, David R. MortensenSelf-Supervised Speech Representation LearningLanguage Identification

  19. What Language is This? Ask Your Tokenizer

    Feb 19, 2026Clara Meister, Ahmetcan Yavuz, Pietro Lesci +1Dialect IdentificationLanguage Identification

  20. KazakhOCR: A Synthetic Benchmark for Evaluating Multimodal Models in Low-Resource Kazakh Script OCR

    Feb 17, 2026Henry Gagnier, Sophie Gagnier, Ashwin KirubakaranOptical Character RecognitionLow-Resource Language Processing

  21. Agnostic Language Identification and Generation

    Jan 30, 2026Mikael Møller Høgsgaard, Chirag PabbarajuLanguage IdentificationText Generation

  22. Safe Language Generation in the Limit

    Jan 13, 2026Antonios Anastasopoulos, Giuseppe Ateniese, Evgenios M. KornaropoulosLanguage IdentificationText Generation

  23. Sparse Autoencoders Can Capture Language-Specific Concepts Across Diverse Languages

    Jul 15, 2025Lyzander Marciano Andrylie, Inaya Rahmanisa, Mahardika Krisna Ihsani +3Multilingual Language ModelsRepresentation Learning