Speech Language Models

Follow this topic Ask about this topic

Recent momentum

-58%

5 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Speech Language Models.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Speech Language Models.

86 papers

Latest in Speech Language Models

Open your feed →

Deconstructing Stereotypes: Scope-Conditioned Generation for Effective Multilingual Counterspeech
Sep 15, 2026Greta Damo, Elias Urios Alacreu, Elena Cabrio +2Stereotype Mitigation Speech Language Models
Psychosis involves a deficit of information compression in connected speech
Sep 14, 2026Samuele Vallisa, Claudio Palominos, Rui He +6Speech Language Models
Reducing the Output-Mode Gap in Speech Language Models via Joint-Output On-Policy Distillation
Sep 14, 2026Daxin Tan, Dehua Tao, Chengxi Deng +2Speech Language Models
Nuha-Speech: Building General-Purpose Arabic Speech-LLMs
Sep 11, 2026Yingzhi Wang, Reem Alhazzani, Muhammad AlqurishiArabic Natural Language Processing Speech Language Models
$S^3$ -Bench: Evaluating Speech Interaction Models as Scientific Voice AssistantsS^3-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistants
Sep 9, 2026Heyang Liu, Jiayi Huang, Wenyang Xiao +8Speech Language Models Voice Agents
Rethinking Sign Language Translation: The Impact of Signer Dependence on Model Evaluation
Sep 7, 2026Keren Artiaga, Sabyasachi Kamila, Haithem Afli +2Sign Language Translation Online Signature Verification
Decoupling Turn-Taking from Semantics: A Decoupled Data Approach for Finite-State-Machine-Based Full-Duplex Dialogue
Sep 3, 2026Yihang Li, Chenhui ChuFull-Duplex Dialogue Turn-Taking
Leveraging Speech Acts for Low-Data and Cross-Domain Conversation Derailment Forecasting
Aug 26, 2026Angela Yifei Yuan, Christine De Kock, Christopher LeckieSpeech Language Models Crisis Response
It's How You Ask: Gender-Associated Linguistic Bias in LLMs
Aug 13, 2026Katherine Van Koevering, Anjalie FieldLarge Language Model Bias Gender
Never Stop Speaking: a Denial-of-Service Attack on End-to-End Speech Language Models
Aug 11, 2026Shuozhe Cheng, Kunlan Xiang, Mingxuan Li +3Speech Language Models Adversarial Attack Strategies
EmoS: A Theory-Grounded Framework for Evaluating and Aligning Emotional Intelligence in Spoken Language Models
Aug 10, 2026Junyu Wang, Siyuan Zhang, Peiyuan Jiang +11Speech Language Models Evaluation Benchmarks
Bridging the Gap Between Semantics and Reconstruction:Unifying Sign Language Translation and Production
Aug 10, 2026Xiao Liu, Shiwei Gan, Yafeng Yin +5Sign Language Translation Speech Language Models
SignLlama: Enhancing Gloss-free Sign Language Translation by Prioritizing Visual Features for LLMs
Aug 10, 2026Shiwei Gan, Xiao Liu, Yafeng Yin +5Sign Language Translation Pre-Trained Vision-Language Models
Do Language Models Know Their Slang? Queer Slang Understanding in User-Generated Content
Aug 5, 2026Arianna Denitto, Beatrice SavoldiLinguistics Large Language Model Bias
Towards More Expressive Spoken LLMs: Fine-Grained Intent Benchmarking and Acoustic-Lexical Decoupled Policy Optimization
Aug 4, 2026Xiang Lin, Tian-Hao Zhang, Chunfeng Wang +3Paralinguistic Cues Speech Language Models
Separating Decision-Rule Misalignment from Readout-Coverage Limitations in Speech Language Models
Aug 3, 2026Linkai Peng, Baorian NuchgedSpeech Language Models Logit Lens
SpeechLLM Meets Federated Learning for End-to-End ASR: English and Italian Case Studies
Jul 28, 2026Mohamed Nabih Ali, Daniele Falavigna, Alessio BruttiSpeech Language Models Speech Encoder
Speech Signals Complement LLMs for Predicting Interpersonal Attraction in Speed Dating
Jul 25, 2026Yuriko Kikuchi, Takato Hayashi, Ryusei Kimura +3Speech Language Models Speaker Identity
Efficient Chain-of-Modality Reasoning via Progressive Compression for Spoken Language Models
Jul 22, 2026Pengchao Feng, Chao-Hong Tan, Qian Chen +3Speech Language Models LLM Reasoning Methods
SimulS2ST-Omni: Data-Efficient Streaming Speech-to-Speech Translation via Explicit Trajectory Supervision
Jul 22, 2026Rongshen He, Xinyu Liang, Dekun Chen +3Simultaneous Speech Translation Speech Translation
Hearing Like Humans? Sound Symbolism and Perceptual Alignment in Speech Language Models
Jul 11, 2026Yun-Shao Tsai, Chun-Wei Chen, Chee-En Yu +2Speech Language Models Audio Generation and Processing
Efficiently Adapting Spoken Language Models for the Singaporean Context
Jul 11, 2026Ng Jia Sheng JasonSpeech Language Models Multilingual Benchmark
Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs
Jul 7, 2026Zhenyu Liu, Xuanyu Zhang, Yunxin Li +10Full-Duplex Dialogue Speech Language Models
SPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language Models
Jul 6, 2026Thomas Thebaud, Yuzhe Wang, Hao Zhang +5Speech Language Models Dialogue Benchmarks
ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation
Jul 4, 2026Ahmed Abul Hasanaath, Bicheng Xu, Mir Rayat Imtiaz Hossain +2Sign Language Translation Speech Language Models
Unlocking Speech-Text Compositional Powers: Instruction-Following Speech Language Models without Instruction Tuning
Jul 2, 2026Congrui Du, Yang Zhang, Kaizhi Qian +1Speech Language Models Large Audio Language Models
An Efficient vLLM-Based Inference Pipeline for Unified Audio Understanding and Generation
Jul 2, 2026Haoran Wang, Jinchuan Tian, Siddhant Arora +1Speech Language Models Audio Reasoning
Rethinking Speech-LLM Integration for ASR: Effective Joint Speech-Text Training by Interleaving
Jul 2, 2026Ruchao Fan, Yiming Wang, Rui Zhao +10Speech Language Models Automatic Speech Recognition
A Geometric Perspective on Composable Emotion Steering in Text-to-Speech Models
Jul 1, 2026Siyi Wang, James Bailey, Ting DangSpeech Language Models Text-To-Speech
LOPA: Enhancing Spoken Language Assessment via Latent Ordinal Prototype Alignment
Jun 30, 2026Hong-Yun Lin, Fu-An Chao, Bi-Cheng Yan +1Speech Language Models Speech Encoder
FlexiSLM: A Spoken Language Model with Dynamic and Controllable Frame Rates
Jun 30, 2026Jiaqi Li, Chaoren Wang, Xiaohai Tian +9Speech Language Models Neural Audio Codecs
When transformers learn "impossible" languages, what do they learn?
Jun 29, 2026Ram Janarthan, Coleman Haley, Sharon GoldwaterProtein Language Model Linguistics
HybridCodec: Modeling Discrete and Continuous Representations for Efficient Speech Language Models
Jun 26, 2026Artem Ploujnikov, Francesco Verdini, Samir Sadok +1Speech Language Models Hybrid Transformer
Heterogeneous Neural Predictivity from Language Models During Naturalistic Comprehension
Jun 25, 2026Xiao JiaProtein Language Model Comprehension
SpeechEQ: Benchmarking Emotional Intelligence Quotient in Socially Aware Voice Conversational Models
Jun 24, 2026Liang-Yuan Wu, Zih-Ching Chen, Tongshuang Wu +2Speech Language Models Dialogue Benchmarks
SFL-MTSC: Leveraging Semantic Frame-Level Multi-Task Self-Consistency for Robust Multi-Intent Spoken Language Understanding
Jun 24, 2026Po-Yen Chen, Berlin ChenSpeech Language Models Semantic Reasoning
Evaluating Japanese Dialect Robustness Across Speech and Text-based Large Language Models
Jun 24, 2026Tomoya Mizumoto, Yusuke Fujita, Hao Shi +3Dialects Speech Language Models
Selective Capability Unlearning in End-to-End Spoken Language Understanding
Jun 23, 2026Akanksha Singh, Vinod Kumar KurmiSpeech Language Models Natural Language Processing
On the Effect of Segmentation Width and Cluster Size on Speech Resynthesis and Continuation in Generative Spoken Language Models
Jun 22, 2026Shunsuke Kando, Wataru Nakata, Shinnosuke Takamichi +1Speech Language Models Speech Synthesis
Interleaved Speech Language Models Latently Work In Text
Jun 21, 2026Talia Sternberg, Gallil Maimon, Yossi AdiSpeech Language Models Large Language Model Post-Training
Improving Code-Switching ASR with Code-Mixing Guided Synthetic Speech
Jun 14, 2026Yue Heng Yeo, Haoyang Li, Yizhou Peng +6Code-Switching Automatic Speech Recognition
BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM
Jun 12, 2026Qingkai Fang, Shoutao Guo, Yang FengFull-Duplex Dialogue Speech Language Models
Overcoming State Inertia in Full-Duplex Spoken Language Models via Activation Steering
Jun 9, 2026Cheng-Kuang Chang, Kai-Wei Chang, Alexander H. Liu +1Speech Language Models Full-Duplex Dialogue
The Dynamics of Human and AI-Generated Language: How Semantics Fluctuates across Different Timescales
Jun 9, 2026Han-Jen Chang, Yasir Çatal, Angelika Wolman +5Speech Language Models Linguistics
Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models
Jun 9, 2026Atsumoto Ohashi, Neil Zeghidour, Alexandre Défossez +1Full-Duplex Dialogue Speech Language Models
ParaBridge: Bridging Paralinguistic Perception and Dialogue Behavior in Speech Language Models
Jun 9, 2026Yuxiang Wang, Qinke Ni, Shengbo Cai +3Paralinguistic Cues Speech Language Models
Linguistically Augmented Audio Speech Data (LinguAS)
Jun 8, 2026Ashley R. Keaton, Zahra Khanjani, Christine Mallinson +1Audio Deepfake Detection Speech Language Models
A Finetuned SpeechLLM for Joint Multi-Granular L2 Assessment and Natural-Language Rationales
Jun 8, 2026Aditya Kamlesh Parikh, Cristian Tejedor-Garcia, Catia Cucchiarini +1Speech Language Models Large Audio Language Models
Interpreting Brain Responses to Language with Sparse Features from Language Models
Jun 5, 2026Michael A. Lepori, Kendrick Kay, Greta TuckuteProtein Language Model Linguistics
SpeechEditBench: A Bilingual Multi-Attribute Benchmark for Instruction-Guided Speech Editing
Jun 1, 2026Hanlin Zhang, Daxin Tan, Dehua Tao +3Speech Language Models Large Audio Language Models
Conditional Collapse in Sign Language Production: A Diagnostic and a Scaling Argument
Jun 1, 2026Rui Hong, Jana KošeckáSign Language Translation Speech Language Models
Child-directed speech facilitates production, not comprehension, in BabyLMs
May 31, 2026Bastian Bunzeck, Sina ZarrießSpeech Language Models Linguistics
Target-Side Paraphrase Augmentation for Sign Language Translation with Large Language Models
May 29, 2026Pedro Dal Bianco, Jean Paul Nunes Reinhold, Oscar Stanchi +3Sign Language Translation Speech Language Models
Neuron-Level Interventions for Gendered and Gender-Neutral Generation in Language Models
May 29, 2026Zhiwen You, Nafiseh Nikeghbal, Jana DiesnerGender Large Language Model Bias
MELD: Mel-Spectrogram-Based Speech Language Modeling with Discrete Latent Variables
May 28, 2026Sung-Lin Yeh, Wei Zhou, Gil Keren +6Speech Language Models Text-To-Speech
KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs
May 27, 2026Haechan Kim, Seungjun Chung, Inkyu Park +2Speech Language Models Multilingual Automatic Speech Recognition
Lost in Sampling: Assessing Lexical Reachability in LLMs via the Word Coverage Score (WCS)
May 26, 2026Samer Awad, Javier Conde, Carlos Arriaga +3Speech Language Models Corpus
UniSRM: A Unified Speech Reward Model for Reasoning-Based Fine-grained Assessment
May 22, 2026Yuanyuan Wang, Dongchao Yang, Yayue Deng +4Speech Language Models Speaker Identity
A Proactive Multi-Agent Dialogue Framework for Assessing Social Language Disorder Traits in Autism
May 21, 2026Chuanbo Hu, Minglei Yin, Bin Liu +4Autism Spectrum Disorder Dialogue Systems
Do Factual Recall Mechanisms Carry over from Text to Speech in Multimodal Language Models?
May 21, 2026Luca Modica, Filip Landin, Mehrdad Farahani +3Speech Language Models Large Multimodal Models

Sep 15, 2026 · cs.CLJ/K move · Enter open · S save

Deconstructing Stereotypes: Scope-Conditioned Generation for Effective Multilingual Counterspeech

Greta Damo, Elias Urios Alacreu, Elena Cabrio, Paolo Rosso+1

Counterspeech (CS) - direct responses that counter online Hate Speech (HS) using reasoning and alternative viewpoints - has emerged as an alternative to content removal. Current automatic CS generation methods, however, frequently produce generic, ineffective replies that fail to target the implicit stereotypes behind HS. To bridge this gap, we propose a novel scope-conditioned generation framework that explicitly integrates structured stereotype characteristics into Large Language Models prompts. We validate our approach on a novel, human-curated dataset annotated in English, Italian, and Spanish. Extensive evaluations show that stereotype-conditioned prompting substantially outperforms generic baselines across all three languages, obtaining significant gains in factuality, specificity, cogency, and effectiveness for both explicit and implicit implied stereotypes.

Stereotype Mitigation Speech Language Models Minority

Open paper Ask about it PDF