Speech Large Language Models

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

17 new papers

A weekly snapshot of new work published in Speech Large Language Models.

Period ending 2026-09-14

21 new papers

A weekly snapshot of new work published in Speech Large Language Models.

Period ending 2026-09-07

36 new papers

A weekly snapshot of new work published in Speech Large Language Models.

Inside this field

Focused directions

327 papers

Latest in Speech Large Language Models

Browse all topics →
CardsList

  1. DuplexChat: Constructing Speaker-Separated Full-Duplex Dialogue Speech at Scale for Spoken Dialogue Language Modeling

    Jul 6, 2026Wataru Nakata, Yuki Saito, Hiroshi SaruwatariFull-Duplex Speech ModelsFull-Duplex Dialogue

  2. Evaluating the Effect of Linguistic Relatedness on Cross-Lingual Transfer in Large Multilingual Automatic Speech Recognition

    Jul 6, 2026Andrei Florian, Cynthia Jayne Amol, Hope Kerubo Ombaba +6Cross-Lingual TransferMultilingual Automatic Speech Recognition

  3. S-DiverSe: Spanish Diverse Speech

    Jul 3, 2026Fernando López, Fernando Ibañez, Ana Martínez +4Librispeech

  4. Deriving Benchmarking Datasets from Long-Form Recordings: Challenges and Opportunities

    Jul 3, 2026Kaveri K. Sheth, Lawrence Borst, Tarek Kunze +6LibrispeechMultilingual Benchmark

  5. Unlocking Speech-Text Compositional Powers: Instruction-Following Speech Language Models without Instruction Tuning

    Jul 2, 2026Congrui Du, Yang Zhang, Kaizhi Qian +1Speech Large Language ModelsMultimodal Instruction Tuning

  6. Towards a Phonology-Informed Evaluation of Multilingual TTS

    Jul 2, 2026Sneha Ray Barman, Neeraj Kumar Sharma, Shakuntala MahantaMultilingual Automatic Speech RecognitionZero-Shot Text-To-Speech

  7. Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleaving

    Jul 2, 2026Ruchao Fan, Yiming Wang, Rui Zhao +10Speech-Llms

  8. H-SAGE: Holistic Speaker-Aware Guided Experts for MoE-based Multi-Talker ASR

    Jul 2, 2026Yujie Guo, Jiaming Zhou, Yuhang Jia +2Automatic Speech Recognition SystemsSpeech Encoder

  9. From Monolingual to Multilingual: Evaluating Mamba for ASR in South African Languages

    Jul 1, 2026Jesujoba O. Alabi, Julian Herreilers, Badr M. Abdullah +1Multilingual Automatic Speech RecognitionAfrican Languages

  10. Disentangling Speaker and Language Effects in Cross-Lingual Speaker Verification for Iberian Languages

    Jul 1, 2026Pol Buitrago, Javier HernandoSpeaker Verification PerformanceCross-Lingual Transfer

  11. LuxEmo: Expressive Text-to-Speech Corpus for Luxembourgish

    Jun 30, 2026Nina Hosseini-Kivanani, Sandipana DowerahLibrispeechCross-Lingual Transfer

  12. Adapting Foundation ASR Models to Dysarthric Speech: A Case Study

    Jun 30, 2026Christian Huber, Laura Kernahan, Alexander WaibelDysarthric SpeechAutomatic Speech Recognition Systems

  13. Tone-Conditioned Curriculum Learning for Low-Resource Bantu Speech Recognition

    Jun 30, 2026Kesego Mokgosi, Vukosi Marivate, Sitwala Mundia +3Multilingual Automatic Speech RecognitionBert-Based Models

  14. How Bilingual Are SSL Speech Models? Cross-Lingual Probing of Articulatory Encoding with Finnish and Russian EMA

    Jun 30, 2026Ailín Pollio San Pedro, Tomi Kinnunen, Alexandre Nikolaev +1Multilingual Automatic Speech RecognitionArticulatory

  15. Building an ASR Solution for Training and Assessing Children's Reading

    Jun 30, 2026Yacouba Diarra, Nouhoum Souleymane Coulibaly, Mamadou Dembele +2Automatic Speech Recognition SystemsAfrican Languages

  16. LOPA: Enhancing Spoken Language Assessment via Latent Ordinal Prototype Alignment

    Jun 30, 2026Hong-Yun Lin, Fu-An Chao, Bi-Cheng Yan +1Speech EncoderLatent Representation Alignment

  17. FlexiSLM: A Spoken Language Model with Dynamic and Controllable Frame Rates

    Jun 30, 2026Jiaqi Li, Chaoren Wang, Xiaohai Tian +9Speech Large Language ModelsNeural Audio Codecs

  18. Preserving Speech-to-Text LLM Capabilities in Speech-to-Speech Generation

    Jun 29, 2026Yuxuan Hu, Heng Lu, Ruchao Fan +8Speech Large Language ModelsZero-Shot Text-To-Speech

  19. Comparing Human and Automatic Recognition of Dutch Dysarthric Continuous Speech: A Case Study

    Jun 29, 2026Yuanyuan Zhang, Dimme de Groot, Jorge Martinez +1Dysarthric SpeechAutomatic Speech Recognition Systems

  20. SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopy

    Jun 29, 2026Bohao Chen, Yanchao Zhang, Yanan Lv +3Diffusion-Based Super-Resolution FrameworkMicroscopy

  21. Preference-ASR: A Preference-Aware Test Set for Benchmarking ASR in the Era of Speech LLMs

    Jun 28, 2026Nithin Rao Koluguri, Sasha Meister, Nikolay Karpov +4Speech Large Language ModelsLegal Natural Language Processing Benchmarks

  22. AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification

    Jun 28, 2026Chuxiao Zuo, Yao Zhu, Minqiang Xu +3Multilingual Automatic Speech RecognitionAdaptive Routing

  23. Do Speech Emphasis Models Generalize across Languages and Emotions?

    Jun 26, 2026Megan Wei, Deepali Aneja, Jiaqi Su +3Multilingual Automatic Speech RecognitionProsodic Features

  24. What Was That Again? Certified Robustness for Automatic Speech Recognition

    Jun 26, 2026Andrew C. Cullen, Neil G. Marchant, Jiani Xie +2Automatic Speech Recognition SystemsAcoustic

  25. SamaVaani: Auditing and Debiasing Multilingual Clinical ASR for Indian Languages

    Jun 25, 2026Subham Kumar, Prakrithi Shivaprakash, Abhishek Manoharan +7Multilingual Automatic Speech RecognitionPsychiatric Reasoning

  26. FBK's Long-form SpeechLLMs for IWSLT 2026 Instruction Following

    Jun 25, 2026Zhihang Xie, Marco Gaido, Sara Papi +2Speech-LlmsInstruction

  27. AnySimLite: A Lightweight Few-Shot Similarity Encoder for On-Device Speech-Adjacent Classification

    Jun 24, 2026Sourav Ghosh, Yash Bhatia, Keshav Goyal +3Speech Large Language ModelsChannel

  28. Fully Differentiable Neural Forced Alignment via Soft Dynamic Programming

    Jun 24, 2026Rotem Rousso, Eyal Cohen, Joseph KeshetPhoneme-Level AnalysisCross-Lingual Alignment

  29. Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?

    Jun 24, 2026Tomoya Mizumoto, Yusuke FujitaSpeech EncoderSpeech Translation

  30. CrossAccent-TTS: Cross-Lingual Accent-Intensity Controllable Text-to-Speech via Disentangled Speaker and Accent Representations

    Jun 24, 2026Ram Annamdevula, Ankit Tatawat, Ashishkumar P. Gudmalwar +2Accented SpeechZero-Shot Text-To-Speech

  31. Supervised Post-training of Speech Foundation Models for Robust Adaptation in Speech Deepfake Detection

    Jun 24, 2026Zihan Pan, Sailor Hardik, Jinyang WuAudio Deepfake DetectionSpoofed Speech

  32. video-SALMONN-R3^3: Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding

    Jun 23, 2026Yixuan Li, Guangzhi Sun, Yudong Yang +1Video UnderstandingSpeech-Llms

  33. Data Scale, Not Latency, Shapes Cross-Lingual Encoder Transfer in Streaming ASR

    Jun 23, 2026Nenad BanficSpeech EncoderEncoders

  34. Progressive Alignment Objectives for Aligner-Encoder based ASR

    Jun 23, 2026Jaeyoung Lee, Masato Mimura, Takafumi MoriyaLlm-Based Automatic Speech RecognitionBrain Alignment

  35. VieSpeaker: A Large-Scale Vietnamese Speaker Recognition Dataset Beyond Visual Dependency

    Jun 23, 2026Viet Hoang Pham, Tran Trung Nguyen, Bao Thu Ho +2LibrispeechSpeaker Identity

  36. The Anatomy of the CTC Oracle Gap: Acoustic Exhaustion and Linguistic Recovery

    Jun 22, 2026Ivan NovosadLibrispeechAcoustic Representation

  37. HALAS: A Human-Annotated Dataset of Hallucinations of Modern ASR Systems

    Jun 22, 2026Mateusz Barański, Jan Jasiński, Julitta Bartolewska +2Automatic Speech Recognition SystemsLlm-Based Automatic Speech Recognition

  38. Cross-lingual Retrieval-Augmented Classification for Dysarthria Severity Assessment

    Jun 22, 2026Taeyoung Jeong, Insung Lee, Du-Seong Chang +1Dysarthric SpeechMultilingual Automatic Speech Recognition

  39. Neural Speaker Diarization via Multilingual Training: Evaluation on Low-Resource Nepali-Hindi Speech

    Jun 21, 2026Samip Neupane, Sandesh Pokhrel, Sandesh Pyakurel +1Speaker DiarizationMultilingual Automatic Speech Recognition

  40. Kiwano: A Cutting-Edge Open-Source Toolkit for Speaker Verification

    Jun 21, 2026Mickael Rouvier, Pierre Michel BousquetSpeaker Verification PerformanceLibrispeech

  41. Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR

    Jun 20, 2026Enes Yavuz Ugan, Alexander WaibelCode-SwitchingMultilingual Automatic Speech Recognition

  42. ESPnet3: Infrastructure for Scalable Speech and Audio Research in the Foundation Model Era

    Jun 20, 2026Masao Someki, Alexander Polok, Carlos Carvalho +14Speech Large Language ModelsLarge Models

  43. Error-Aware TF-IDF Retrieval-Augmented Generation for ASR Error Correction

    Jun 19, 2026Mohammad Aref Jafari-RaddaniAutomatic Speech Recognition SystemsCorrection

  44. CORTIS: Text-Only Adaptation of Spoken Language Models for Task-Oriented Voice Agents

    Jun 19, 2026Youngwon Choi, Hyeonyu Kim, Taeyoun Kwon +2Speech Large Language ModelsVoice Agents

  45. OpenWER: Improving Cross-Lingual ASR Evaluation and Enabling Token-Based Accuracy Metrics

    Jun 19, 2026Korbinian Kuhn, Gottfried ZimmermannWord Error RateMultilingual Automatic Speech Recognition

  46. PolSeT: Polish Semantics of Timbre Dataset

    Jun 18, 2026Jan JasińskiLibrispeechMultimodal Dataset

  47. CARE: Competence-Aware Reward Shaping for Adaptive Reasoning Length in Video-MLLMs

    Jun 18, 2026Chengwen Liu, Hao Peng, Jisheng Dang +3Video UnderstandingPotential-Based Reward Shaping

  48. ViCoStream: Streaming VideoLLMs Can Run Beyond 100 FPS with Stage-Wise Coordinated Inference

    Jun 18, 2026Yang Tan, Junlong Tong, Linan Yue +3Streaming VideoSpeech-Llms

  49. A Comparative Study of Pretrained Transformer Models for Quranic ASR: Speech Representations, Label Formats, and Dataset Composition

    Jun 18, 2026Nabil Mosharraf Hossain, Riasat Islam, Unaizah ObaidellahLlm-Based Automatic Speech RecognitionDiscrete Speech Representations

  50. Adaptive Speech-to-Spike Encoding for Spiking Neural Networks

    Jun 17, 2026Taharim Rahman Anon, Jakaria Islam EmonSpiking Neural NetworksSpeech Encoder

  51. Responsible ASR: Overcoming Challenges of Foundational Models in Narrow-Band and Low-Resource Settings

    Jun 17, 2026Tejas Godambe, Nutan Choudhary, Sanket Shah +2Automatic Speech Recognition SystemsLow-Resource Languages

  52. Low-resource Language Discrimination Towards Chinese Dialects with Transfer learning and Data Augmentation

    Jun 17, 2026Fan Xu, Yangjie Dan, Keyu Yan +2DialectsLlm-Based Automatic Speech Recognition

  53. Montreal Forced Aligner and the state of speech-to-text alignment in 2026

    Jun 16, 2026Michael McAuliffe, Kaylynn Gunter, Michael Wagner +1Cross-Lingual AlignmentBrain Alignment

  54. Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs

    Jun 16, 2026Chengwen Liu, Zhe Huang, Jisheng Dang +3Video UnderstandingFeature Alignment

  55. Learning task-specific subspaces via interventional post-training of speech foundation models

    Jun 16, 2026Jack Cox, Jon BarkerDiscrete Speech RepresentationsSpeaker Verification Performance

  56. When Multiple Scripts Matter: Evaluating ASR in Clinical Settings

    Jun 16, 2026Jean Seo, Minkyu Kim, Jeonguk Lee +3Multilingual Automatic Speech RecognitionLlm-Based Automatic Speech Recognition

  57. Improving low-resource ASR using bilingual fine-tuning with language identification: a cross-linguistic evaluation

    Jun 16, 2026Reihaneh Amooie, Yun Hao, Wietse de Vries +3Multilingual Automatic Speech RecognitionMultilingual Language Models

  58. L-Proto: Language-Aware Episodic Prototypical Training for Multilingual Speaker Verification

    Jun 16, 2026Hyung-Seok Oh, Deok-Hyeon Cho, Seung-Bin Kim +1Speaker Verification PerformanceMultilingual Automatic Speech Recognition

  59. SpeechDx: A Multi-Task Benchmark for Clinical Speech AI

    Jun 15, 2026Sejal Bhalla, Larry Kieu, Aina Merchant +2Librispeech

  60. Are you speaking my languages? On spoken language adherence in multimodal LLMs

    Jun 15, 2026Hyungwon Kim, Kandarp Joshi, Lillian Zhou +2Multilingual Automatic Speech RecognitionEnglish