cs.SDMar 9, 2026

Disentangling Reasoning in Large Audio-Language Models for Ambiguous Emotion Prediction

Authors: Xiaofeng Yu, Jiaheng Dong, Jean Honorio, Abhirup Ghosh, Hong Jia, Ting Dang

Organizations: University of Auckland, New Zealand · The University of Melbourne, Australia · University of Birmingham, United Kingdom

Abstract

Speech emotion recognition plays an important role in various applications. However, most existing approaches predict a single emotion label, oversimplifying the inherently ambiguous nature of human emotional expression. Recent large audio-language models show promise in generating richer outputs, but their reasoning ability for ambiguous emotional understanding remains limited. In this work, we reformulate ambiguous emotion recognition as a distributional reasoning problem and present the first systematic study of ambiguity-aware reasoning in LALMs. Our framework comprises two complementary components: an ambiguity-aware objective that aligns predictions with human perceptual distributions, and a structured ambiguity-aware chain-of-thought supervision that guides reasoning over emotional cues. Experiments on IEMOCAP and CREMA-D demonstrate consistent improvements across SFT, DPO, and GRPO training strategies.

Figures & tables

Explore similar work

CardsList
  1. Comparative Reasoning: Making an Audio Language Model Better at Comparing Emotions

    Jun 23, 2026Abinay Reddy Naini, Jaeyeon Kim, Chao-Han Huck Yang +2Audio-Language Model EvaluationPairwise Comparison

  2. EmoLASP: Emotion Recognition with Language Models and Answer Set Programming

    Aug 29, 2026Thao Le, Michael ThielscherEmotion Recognition in ConversationsEmotion Recognition

  3. ALARM: Audio-Language Alignment for Reasoning Models

    Mar 10, 2026Petr Grinberg, Hassan ShahmohammadiAudio-Language ModelsAudio Reasoning