Speech Large Language Models

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

17 new papers

A weekly snapshot of new work published in Speech Large Language Models.

Period ending 2026-09-14

21 new papers

A weekly snapshot of new work published in Speech Large Language Models.

Period ending 2026-09-07

36 new papers

A weekly snapshot of new work published in Speech Large Language Models.

Inside this field

Focused directions

327 papers

Latest in Speech Large Language Models

Browse all topics →
CardsList

  1. CraBERT: Efficient Phoneme Encoder Pre-Training via Cascade Fusion of Subword Representations for Text-to-Speech

    Jun 15, 2026Dong Yang, Yuki Saito, Wataru Nakata +1Speech EncoderSubword Tokenization

  2. Decoding while Adapting: Zero-Shot Online Speaker Adaptation via Audio-Textual Prompts for Elderly Speech Recognition

    Jun 15, 2026Chengxi Deng, Xurong Xie, Shujie Hu +7Speech Large Language ModelsParameter-Efficient Adaptation

  3. TMASC: Transmasculine Attitude and Speech Corpus

    Jun 15, 2026Sidney WongLibrispeechText Corpora

  4. ROMPAR: Morphological Completion and Demographic Unlearning for Romanian-Accented Speech Recognition

    Jun 14, 2026Andrei-Marius Avram, Aureliu-Valentin Antonie, Ştefan-Bogdan Badea +3Automatic Speech Recognition SystemsText Corpora

  5. Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment

    Jun 13, 2026Lipeng He, Yihan Wang, Jiawen Zhang +1Indirect Prompt InjectionHigher Attack Success Rates

  6. Listening with Attention: Entropy-Guided Explainability for Transformer-Based Audio Models

    Jun 12, 2026Ravi Ranjan, Utkarsh Grover, Xiaomin Lin +1Llm-Based Automatic Speech RecognitionExplainability

  7. MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition

    Jun 12, 2026Theresa Pekarek Rosin, Matthias Kerzel, Stefan WermterAutomatic Speech Recognition SystemsEfficient Continual Learning

  8. Leveraging Audio-LLMs to Filter Speech-to-Speech Training Data

    Jun 11, 2026Qixu Chen, Satoshi NakamuraSpeech TranslationSimultaneous Speech Translation

  9. Balancing ASR and diarization in end-to-end LLMs for multi-talker speech recognition

    Jun 11, 2026Naijun Zheng, Yuke Lin, Sanli Tian +4Speaker DiarizationAutomatic Speech Recognition Systems

  10. Towards Data-free and Training-free Compression for Speech Foundation Models Using Parameter Clustering

    Jun 10, 2026Haoning Xu, Zhaoqing Li, Huimeng Wang +4Large Language Model CompressionSpeech Large Language Models

  11. Fast Speech Foundation Model Distillation Using Interleaved Stacking

    Jun 10, 2026Eungbeom Kim, Kyogu LeeSpeech Large Language ModelsInference Latency

  12. UR-BERT: Scaling Text Encoders for Massively Multilingual TTS Through Universal Romanization and Speech Token Prediction

    Jun 10, 2026Sangmin Lee, Eekgyun Ahn, Woongjib Choi +1Multilingual Automatic Speech RecognitionBert-Based Models

  13. Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models

    Jun 10, 2026Maneesha Rani Saha, Catherine Bao, Neal PatwariPhonetic RepresentationsAutomatic Speech Recognition Systems

  14. SARA: A Dual-Stream VAE for High-Fidelity Speech Generation via Integrating Semantic and Acoustic Representations

    Jun 10, 2026Peijie Chen, Wenhao Guan, Weijie Wu +7Zero-Shot Text-To-SpeechSpeech Encoder

  15. Gumbel-BEARD: Automatic Layer Selection for Self-Supervised Adaptation of Whisper in Low-Resource Domains

    Jun 9, 2026Zilai Wang, Natarajan Balaji Shankar, Mohan Shi +2Speech EncoderDomain Adaptation

  16. AuRA: Internalizing Audio Understanding into LLMs as LoRA

    Jun 9, 2026Bo Cheng, Lei Shi, Zhanyu Ma +5Speech Large Language ModelsSpeech Encoder

  17. Multilingual Word-Level Forced Alignment with Self-Supervised Representations and Learned Dynamic Programming

    Jun 9, 2026Roy Weber, Meidan Zehavi, Rotem Rousso +1Cross-Lingual AlignmentMultilingual Automatic Speech Recognition

  18. Speaker Group Encoding in Self-supervised Speech Recognition Models

    Jun 9, 2026Felix Herron, Solange Rossato Alexandre Allauzen, Benoit Favre +1Self-Supervised Speech ModelsAutomatic Speech Recognition Systems

  19. Entropy-Aware Domain-Routed Mixture-of-Experts Speech-LLM Framework: A Case Study of Multi-Domain Child-Adult ASR

    Jun 9, 2026Mohan Shi, Kaiyuan Zhang, Zilai Wang +3Speech-LlmsMixture-Of-Expert Language Models

  20. Enhancing Multilingual LLM-based ASR with Mixture of Experts and Dynamic Downsampling

    Jun 9, 2026Guodong Lin, Ziqi Chen, Yuxiang Fu +2Llm-Based Automatic Speech RecognitionMultilingual

  21. Speech Meets ELF: Audio Conditional Continuous-Target Diffusion for Speech Recognition and Translation

    Jun 9, 2026Xuanchen Li, Tianrui Wang, Yuheng Lu +11Speech EncoderAudio

  22. LLM can Read Spectrogram: Encoder-free Speech-Language Modeling

    Jun 8, 2026Ruchao Fan, Yiming Wang, Yuxuan Hu +6Speech Large Language ModelsSpeech-Llms

  23. OpenBibleTTS: Large-Scale Speech Resources and TTS Models for Low-Resource Languages

    Jun 8, 2026David Guzmán, Luel Hagos Beyene, Jesujoba Oluwadara Alabi +3LibrispeechZero-Shot Text-To-Speech

  24. Overcoming Decoder Inconsistencies in Whisper for Dravidian and Low-Resource Languages

    Jun 8, 2026Chowdam Venkata Kumar, Kumud Tripathi, Pankaj WasnikMultilingual Automatic Speech RecognitionLow-Resource Languages

  25. A Finetuned SpeechLLM for Joint Multi-Granular L2 Assessment and Natural-Language Rationales

    Jun 8, 2026Aditya Kamlesh Parikh, Cristian Tejedor-Garcia, Catia Cucchiarini +1Speech Large Language ModelsRationales

  26. Is Text All You Need? Text as a Universal Information Bottleneck for Speech LLMs

    Jun 8, 2026Ming-Hao Hsu, Yuxuan Hu, Shujie Liu +3Speech-LlmsSpeech Large Language Models

  27. HydraQE: OSU's Submission for the IWSLT 2026 Speech Translation Metrics Shared Task

    Jun 7, 2026Kevin Krahn, Eric Fosler-LussierSimultaneous Speech TranslationSpeech Translation

  28. TRADE: Transducer-Augmented Decoder for Speech LLM

    Jun 7, 2026Yun Tang, Shanil Puri, Shinji Watanabe +1Speech Large Language ModelsMarket

  29. Hiding in Plain Floats: Steganographic Carriers for Indirect Prompt and Content Injection

    Jun 7, 2026Mudit Sinha, Sanika ChavanIndirect Prompt InjectionLanguage Model Evasion Attacks

  30. KIT's Submission to Cross-Lingual Voice Cloning in IWSLT 2026

    Jun 5, 2026Seymanur Akti, Alexander WaibelCross-Lingual Voice CloningMultilingual Automatic Speech Recognition

  31. Multilingual Multi-Speaker Unit Vocoders: A Systematic Analysis of Discrete Speech Representations

    Jun 4, 2026Naman Kothari, Arjun Gangwar, Adarsh Arigala +1Discrete Speech RepresentationsMultilingual Automatic Speech Recognition

  32. FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognition

    Jun 4, 2026Fernando López, Santosh Kesiraju, Jordi LuqueSpeech EncoderSpeech Large Language Models

  33. Multi-task Learning is Not Enough: Representational Entanglement in Dual-output Second Language Speech Recognition

    Jun 4, 2026Seung Hwan Cho, Young-Min KimMultilingual Automatic Speech RecognitionMulti--Task Learning

  34. Towards Truly Multilingual ASR: Generalizing Code-Switching ASR to Unseen Language Pairs

    Jun 4, 2026Gio Paik, Hyunseo Shin, Soungmin LeeMultilingual Automatic Speech RecognitionMultilingual

  35. Do speech foundation models perceive speaker similarity as humans do?

    Jun 4, 2026Minoru Kishi, Hayato Yagi, Shinnosuke Takamichi +1Speech Large Language ModelsSemantic Similarity Metrics

  36. Beyond Waveform Robustness: Robust Feature-Vocoder Adversarial Attacks on Automatic Speech Recognition

    Jun 4, 2026Yifan Liao, Zongmin Zhang, Zhen Sun +3Llm-Based Automatic Speech RecognitionModel-Agnostic Defense

  37. Domain-Aware Mispronunciation Detection and Diagnosis Using Language-Specific Statistical Graphs

    Jun 4, 2026Huu Tuong Tu, Hanh Nguyen, Thien Van Luong +3Mispronunciation DetectionMultilingual Automatic Speech Recognition

  38. Audio Interaction Model

    Jun 3, 2026Zhifei Xie, Zihang Liu, Ze An +8Audio RepresentationAudio

  39. Read What You Hear: Reference-Free Hypotheses Evaluation with Acoustic Discrepancy

    Jun 3, 2026Zhihan Li, Hankun Wang, Yiwei Guo +3Automatic Speech Recognition SystemsAcoustic

  40. Test-Time Compute Scaling for ASR with Depth-Conditioned Looped Transformers

    Jun 3, 2026Yacouba Kaloga, Shashi Kumar, Shakeel A. Sheikh +3Automatic Speech Recognition SystemsTransformer Architectures

  41. Entity Binding Failures in Speech LLM Reasoning: Diagnosis and Chain-of-Thought Intervention

    Jun 3, 2026Ming-Hao Hsu, Xiaohai Tian, Jun Zhang +1Speech-LlmsEfficient Chain-Of-Thought Reasoning

  42. Efficient ASR Training with Conversations that Never Happened

    Jun 2, 2026Máté Gedeon, Péter MihajlikLibrispeech

  43. WAXAL-NET: Finetuned Edge ASR Across 19 African Languages

    Jun 1, 2026Victor Tolulope Olufemi, Oreoluwa Babatunde, Ramsey Njema +28Llm-Based Automatic Speech RecognitionAfrican Languages

  44. Echo: A Joint-Embedding Predictive Architecture for Speaker Diarization and Speech Recognition in a Shared Latent Space

    Jun 1, 2026Louis MouchonSpeaker DiarizationSpeech Encoder

  45. SpeechEditBench: A Bilingual Multi-Attribute Benchmark for Instruction-Guided Speech Editing

    Jun 1, 2026Hanlin Zhang, Daxin Tan, Dehua Tao +3Speech Large Language ModelsMultilingual Benchmark

  46. A 1000-hour EEG-EMG-audio dataset of Japanese speech production

    May 31, 2026Motoshige Sato, Ilya Horiguchi, Masakazu Inoue +6ElectrocorticographyElectroencephalography Spatial Super-Resolution

  47. Spiking and Event-driven Neuromorphic Mamba Models for Efficient Speech Recognition

    May 31, 2026Tauseef Ahmed, Tao Sun, Jeronimo Castrillon +2Neuromorphic HardwareSparse Expert Activation

  48. PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects

    May 31, 2026Sicheng Yang, Shulan Ruan, Shiwei Wu +4Speech Large Language ModelsDialects

  49. LaSR: Context-Aware Speech Recognition via Latent Reasoning

    May 30, 2026Heyang Liu, Ziyang Cheng, Jiayi Huang +5Speech Large Language ModelsEfficient Latent Reasoning

  50. SALSA: Speech Aware LLM Adaptation via Learned Steering Activation Vectors

    May 30, 2026Yekaterina Yegorova, Argyrios Gerogiannis, Haolong Zheng +3Speech Large Language ModelsAutomatic Speech Recognition Systems

  51. Scaling Conversational Hungarian ASR: The BEA-Dialogue+ Corpus

    May 29, 2026Máté Gedeon, Piroska Zsófia Barta, Péter Mihajlik +1LibrispeechConversational Datasets

  52. LEAF: Growing Trees Without Branching for Speech-Aware Large Language Model Post-Training

    May 29, 2026Argyrios Gerogiannis, Yekaterina Yegorova, Mark Hasegawa-Johnson +1Speech Large Language ModelsSpeech-Llms

  53. DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs

    May 29, 2026Sara Papi, Luisa BentivogliSimultaneous Speech TranslationSpeech Large Language Models

  54. Subtitle-Aligned Fine-Tuning of Whisper for Swiss German ASR: Benchmark Contamination, Convention Mismatch, and an Honest Baseline at 25.6% WER (13.8% cWER)

    May 29, 2026Felix AkeretSpeech Large Language ModelsContamination-Aware Benchmarking Framework

  55. TokTalk: Expressive Real-time Facial Animation from Audio-LLM Tokens

    May 29, 2026Qingcheng Zhao, Yifang Pan, Karan SinghFacial AnimationTalk

  56. A Unified and Reproducible Experimentation Framework for Speech Understanding

    May 29, 2026Jing Peng, Junhao Du, Chenghao Wang +21Speech Large Language ModelsReproducibility

  57. Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seeking

    May 28, 2026Songbo Hu, Yinhong Liu, Ej Zhou +5Conversational DatasetsMultilingual Data

  58. MELD: Mel-Spectrogram-Based Speech Language Modeling with Discrete Latent Variables

    May 28, 2026Sung-Lin Yeh, Wei Zhou, Gil Keren +6Speech Large Language ModelsZero-Shot Text-To-Speech

  59. Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding

    May 28, 2026Jeong Hun Yeo, Minsu Kim, Hyeongseop Rha +1Llm-Based Automatic Speech RecognitionAutoregressive Decoding

  60. Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation

    May 28, 2026Zixuan Jiang, Yanqiao Zhu, Peng Wang +8Automatic Speech Recognition SystemsWord Error Rate