Speech Emotion Recognition

Follow this topic Ask about this topic

Latest papers 65

9 papers in the last four weeks, up 29% on the four weeks before. 0.1% of all new papers.

All topics

ACR-Net: Mitigating Semantic Dominance via Contrastive Acoustic-Semantic Decoupling
Oct 14, 2026Mengke Zhang, Yanda Shao, Tianhe Wu +1Speech Emotion Recognition Audio-Language Model Evaluation
Beijing University of Posts and Telecommunications, China
How Language-Independent Are Emotional Attributes? A Study on Training Data Scaling and Cross-Lingual Generalization
Oct 10, 2026Dániel Halmai, Gábor GosztolyaSpeech Emotion Recognition
Institute of Informatics, University of Szeged, Szeged, Hungary · HUN-REN–SZTE Research Group on Artificial Intelligence, Szeged, Hungary
SEER: Source-Conditioned Emotion Enhancement via Retrieval for Cochlear-Implant Speech
Oct 8, 2026Hsing-Hang Chou, Yun-Shao Lin, Ching-Chin Sung +1Speech Processing Speech Enhancement
Department of Electrical Engineering, National Tsing Hua University, Taiwan · Research Center for Information Technology Innovation, Academia Sinica, Taiwan
EMODE: Dynamic Para-Semantic Experts for Emotion-Aware Speech Language Modeling
Oct 3, 2026Jianan Pan, Yiwen Gu, Xinze Li +2Speech Language Models Emotion Representation in Language Models
Zhejiang University Hangzhou, China
From Speech to Editable Concepts: Probing Emotion Recognition with Concept Bottleneck Models
Sep 30, 2026Hezhao Zhang, Thomas HainConcept Bottleneck Models Emotion Recognition in Conversations
School of Computer Science, University of Sheffield Sheffield, United Kingdom
A barrier or a booster? Familiarity effects on Mandarin emotion prosody recognition using AI-powered voice cloning
Sep 30, 2026Feng Xu, Gaoyuan Zhang, Shanshan Xue +4Speech Prosody Speech Emotion Recognition
Institute of Software, Chinese Academy of Sciences · Department of Linguistics, Macquarie University
Finding Emotions Where They Belong: Rethinking Audio Emotion Recognition through Masked Temporal Affective Grounding
Sep 26, 2026Abdelrahman Mohamed, Lars Kai Hansen, Zheng-Hua TanSpeech Emotion Recognition Temporal Audio Grounding
Aalborg University Pioneer Centre for AI · Technical University of Denmark Pioneer Centre for AI
VoiceNet: Fine-Grained Voice Understanding Beyond Emotion at Scale
Sep 25, 2026Christoph Schuhmann, Robert Kaczmarczyk, Gollam Rabby +7Audio-Language Models Speech Emotion Recognition
LAION e.V. · Scalable Learning & Multi-Purpose AI (SLAMPAI) Lab, Forschungszentrum Jülich GmbH · L3S Research Center +5
Enriching Speech Emotion Representations with Conversational Context
Sep 22, 2026Arthur Peuvot, Romaric Besançon, Gaël de Chalendar +2Representation Learning Emotion Recognition in Conversations
Université Paris-Saclay, CEA, List, France · LISN, CNRS, Université Paris-Saclay, France
Reading Emotions in the Token Space: Discriminative Adaptation of SpeechLLMs for Emotion Recognition
Sep 17, 2026Hasindri Watawana, Sergio Burdisso, Esaú Villatoro-Tello +4Speech Emotion Recognition Speech Language Models
Idiap Research Institute, Switzerland · EPFL, Switzerland · Uniphore, USA & India +1
RAFM-SER++: A Lightweight Multimodal Emotion Recognition Framework for Real-Time Behavioral Monitoring in Surveillance Systems
Sep 7, 2026Ngo Truong Dinh, Tung-Lam Bui, Chi-Trung Duong +3Efficient Multimodal Inference Multimodal Emotion Recognition
Faculty of Information Technology University of Science, VNU-HCM Ho Chi Minh City, Vietnam
SETEAB: Multiscale approach with Squeeze-and-Excitation Temporal Enhanced Aware Block for Speech Emotion Recognition
Sep 5, 2026Duy Vo, Kiet Anh Hoang, Hao DoSpeech Emotion Recognition Lightweight CNNs
Faculty of Information Technology, University of Science, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam · UNEY, Switzerland
SISER: Speaker-Invariant Speech Emotion Recognition with Entropy-Based Adversarial Training
Aug 31, 2026Eunseo Choi, Hyunku Kang, Chanwoo KimSpeech Emotion Recognition Invariant Representation Learning
Korea Univiersity, South Korea
VocalAffectBench: Evaluating Vocal Emotion Recognition in AI Audio Models
Aug 28, 2026Luc Debaupte, Tyler Baumgartner, Brandon Tai +3Audio-Language Model Evaluation Speech Emotion Recognition
Besimple AI, San Mateo, CA
Benchmarking Open-Source Speech Emotion Recognition in Naturalistic Mandarin Spine Clinic Consultations: A Pilot Validation Study
Aug 24, 2026Tsz Yuet Yeung, Zonglin He, Dong Chen +3Speech Emotion Recognition Clinical Speech Processing
The LKS Faculty of Medicine, The University of Hong Kong, Hong Kong SAR · The University of Hong Kong-Shenzhen Hospital, Shenzhen
Dual-Scale State-Space Modeling with Speaker-Wise Dynamic CRF for Speech Emotion Recognition in Conversation
Aug 23, 2026Guan-Hua Wen, Hou-Chiang Tseng, Kuan-Yu ChenEmotion Recognition in Conversations Speech Emotion Recognition
National Taiwan University of Science and Technology, Taipei, Taiwan
Emotion Across Speech and Faces: Shared Affective Mechanisms in Multimodal Foundation Models
Aug 17, 2026Xiutian Zhao, Luqi Sun, Björn Schuller +1Multimodal Foundation Models Multimodal Emotion Recognition
Center for Language and Speech Processing (CLSP), Johns Hopkins University, USA · Group on Language, Audio & Music (GLAM), Imperial College London, UK
HyPASE: Hyperbolic Geometry for Parameter-Efficient Speech Emotion Fine-Tuning Framework for Large Audio-Language Models
Aug 5, 2026Tian Jin, Ruikang Zhang, Zefeng Zhao +2Audio-Language Models Multimodal Emotion Recognition
Tongji University Shanghai, China · Peking University Beijing, China · The Chinese University of Hong Kong, Shenzhen Shenzhen, China
Separating Decision-Rule Misalignment from Readout-Coverage Limitations in Speech Language Models
Aug 3, 2026Linkai Peng, Baorian NuchgedAudio-Language Model Evaluation Speech Emotion Recognition
Institute for the Brain and Cognitive Sciences, University of Connecticut, Storrs, CT 06269, USA · Department of Linguistics, The University of Texas at Austin, Austin, TX 78712, USA
Discriminative Axis, Not Data Volume: What a Contrastive Corpus Teaches an Audio Embedding
Aug 3, 2026Abdul Basit TonmoyContrastive Learning Audio Representation Learning
Eximius Labs · Wabash College
AMRD: Adaptive Multi-Teacher Relational Distillation for Lightweight Speech Emotion Recognition
Jul 28, 2026Yuqi Li, Yi-Cheng Lin, Xianglong Wang +5Relational Knowledge Distillation Speech Emotion Recognition
Department of Electrical Engineering, The City College of New York · National Taiwan University · Wyze Inc. +1
Looking for Affect in Spontaneous Finnish Speech through Linguistic Interpretability
Jul 27, 2026Kalle Lahtinen, Liisa Mustanoja, Okko RäsänenValence-Arousal Modeling Multimodal Emotion Recognition
Signal Processing Research Centre, Tampere University, Finland · Research Centre Plural, Tampere University, Finland
Explainable Lightweight Compact Deep Models for Speech Emotion Recognition
Jul 18, 2026Nelly ElsayedSpeech Emotion Recognition Convolutional Neural Networks
School of Information Technology University of Cincinnati Ohio, United States
Automatic Detection of Stress from Speech in the Trier Social Stress Test
Jul 1, 2026Hanna Drimalla, Wieland R. Cremer, Christine Kraus +1Speech Emotion Recognition Affective Computing
Human-Centered Artificial Intelligence Group, Faculty of Technology, Bielefeld University, Bielefeld, Germany. · Department of Cognitive Psychology, Faculty of Psychology, Ruhr University Bochum, Bochum, Germany.
SIGMA: Saliency-Guided Sparse Mask Attacks for Speech Emotion Recognition
Jun 29, 2026Qiyang Sun, Yi Chang, Zixing Zhang +1Adversarial Attacks Speech Emotion Recognition
GLAM, Department of Computing, Imperial College London, UK · College of Computer Science and Electronic Engineering, Hunan University, China · Shenzhen Research Institute, Hunan University, China +4
Learning from Annotation Uncertainty: Entropy-Aware Curriculum for Speech Emotion Recognition
Jun 25, 2026Zahra Omidi, John H. L. HansenAnnotator Disagreement Label Distribution Learning
Center for Robust Speech Systems, The University of Texas at Dallas, USA
Real-Time Voice AI Hears but Does Not Listen
Jun 24, 2026Martijn Bartelds, Federico Bianchi, James ZouAudio-Language Model Evaluation Voice Agent Evaluation
Together AI · Stanford University
Comparative Reasoning: Making an Audio Language Model Better at Comparing Emotions
Jun 23, 2026Abinay Reddy Naini, Jaeyeon Kim, Chao-Han Huck Yang +2Audio-Language Model Evaluation Pairwise Comparison
Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PA, 15213, US · NVIDIA
EmotionAI: A Privacy-Preserving Computational Intelligence Pipeline for Speech-Emotion-Grounded Conversational Analysis
Jun 22, 2026Wai Laam Mak, Isibor Kennedy Ihianle, Pedro MachadoSpeech Processing Emotion Recognition in Conversations
School of Science and Technology, Nottingham Trent University, Nottingham, UK
Backdoor Attacks on Speech Emotion Recognition via TTS-Generated Poisoning
Jun 19, 2026Yongbin Huang, Xihao Xie, Jia ZhangBackdoor Attacks Speech Emotion Recognition
Department of Computer Science Southern Methodist University Dallas, USA

Oct 14, 2026J/K move · Enter open · S save

ACR-Net: Mitigating Semantic Dominance via Contrastive Acoustic-Semantic Decoupling

Mengke Zhang, Yanda Shao, Tianhe Wu, Kai Feng

Beijing University of Posts and Telecommunications, China

Speech Emotion Recognition Audio-Language Model Evaluation Adversarial Robustness Multimodal Contrastive Learning

Open paper AskPDF arXiv

Speech Emotion Recognition (SER) models and Audio LLMs fail when vocal tone contradicts textual semantics. Extensive training on congruent data engenders a rigid semantic prior, causing "Semantic Dominance", a severe text bias during cross-modal conflicts. We introduce the ASPIRE benchmark of adversarial audio-text pairs across four conflict types, alongside two metrics: Semantic Overconfidence Penalty (SOP) and Latent Decoupling Degree (LDD). Unlike fusion methods that merely re-weight collapsed features, our Acoustic Conflict Resolution Network (ACR-Net) uses Cross-Modal Attention and Contrastive Decoupling Loss to disentangle contradictory representations into orthogonal latent spaces. Experiments show existing models fail under polarity conflicts due to extreme semantic overconfidence. Conversely, ACR-Net preserves acoustic fidelity, maintaining high LDD to drive SOP near zero, achieving superior Acoustic Accuracy (ACC) in both adversarial and standard scenarios.