Emotion Recognition in Conversations

Overview

Emotion Recognition in Conversations aims to identify how people feel from dialogue, accounting for both the words they use and how emotions shift across turns and speakers. Common approaches combine text, speech prosody, and facial or visual features using transformers, speaker-aware graphs, recurrent or state-space models, and adaptive fusion; some also track valence and arousal or represent uncertainty instead of assigning a single fixed label. Research commonly evaluates on benchmarks such as IEMOCAP and MELD, while newer work examines longer-range memory, implicit affect, streaming speech, and emotion-cause relations. A central challenge is that labels can be ambiguous and modalities unreliable or conflicting, so high benchmark scores do not always guarantee robust interpretation across speakers, settings, and cultures.

Latest papers

CardsList

61 papers4 papers in the last four weeks, down 64% on the four weeks before. 0.0% of all new papers.

  1. REFLECT: Role-Aware Detection of Sentiment, Emotion, Politeness, and Formality

    Oct 9, 2026Sangpil Youm, Annabel Stocks Natalias, Hayden Heninger +4Emotion Recognition in ConversationsSentiment Analysis

  2. From Expression to Reaction: Role-aware Visual Transfer and Stimulus-guided Reasoning for Interlocutor Emotion Recognition

    Oct 2, 2026Wei Wang, Zhaowu Li, Jianjie Luo +3Emotion Recognition in ConversationsMultimodal Emotion Recognition

  3. From Speech to Editable Concepts: Probing Emotion Recognition with Concept Bottleneck Models

    Sep 30, 2026Hezhao Zhang, Thomas HainConcept Bottleneck ModelsEmotion Recognition in Conversations

  4. Empath: Tracing Multi-Level Emotion Dynamics in Crisis Counseling Dialogues

    Sep 24, 2026Ziwei Gong, Yuchen Huang, Wen Liang +4Mental Health CounselingEmotional Support Conversation

  5. Enriching Speech Emotion Representations with Conversational Context

    Sep 22, 2026Arthur Peuvot, Romaric Besançon, Gaël de Chalendar +2Representation LearningEmotion Recognition in Conversations

  6. ReH-FUSE: Reliability-Aware Hierarchical Fusion of Experts for Multimodal Emotion Recognition in Conversation

    Sep 12, 2026Guan-Hua Wen, Hou-Chiang Tseng, Kuan-Yu ChenEmotion Recognition in ConversationsMultimodal Emotion Recognition

  7. Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometry

    Sep 9, 2026Oriol Marín, Roger Marí, Gloria Haro +1Emotion Recognition in ConversationsMultimodal Emotion Recognition

  8. Exposing Weaknesses in Emotion Recognition in Conversations

    Sep 5, 2026Amir Ben Khalifa, Fanny Bezancon, Bessam Abdulrazak +1Emotion Recognition in Conversations

  9. Emotion as a Distribution: Joint Valence-Arousal Probability Learning for Speaker-Independent Multimodal Emotion Recognition

    Sep 4, 2026Tingyi Lin, Wen-Ren Yang, Kuanwei ChenMultimodal Emotion RecognitionEmotion Recognition in Conversations

  10. EmoLASP: Emotion Recognition with Language Models and Answer Set Programming

    Aug 29, 2026Thao Le, Michael ThielscherEmotion Recognition in ConversationsEmotion Recognition

  11. DiaRelay: Relaying Dialogue Context with a Constant-Size Memory for Emotion Recognition in Conversation

    Aug 24, 2026Zihao Zhou, Bin Yang, Jinghui Qin +1Emotion Recognition in ConversationsMemory-Augmented Language Models

  12. Dual-Scale State-Space Modeling with Speaker-Wise Dynamic CRF for Speech Emotion Recognition in Conversation

    Aug 23, 2026Guan-Hua Wen, Hou-Chiang Tseng, Kuan-Yu ChenEmotion Recognition in ConversationsSpeech Emotion Recognition

  13. Do SpeechLMs Hear Their Own Opinions? Diagnosing and Mitigating Previous-Belief Contamination in Streaming Emotion Understanding

    Aug 21, 2026Haoyue Liu, Zhichao Wang, Ye Chen +2Emotion Recognition in ConversationsSpeech Language Models

  14. Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse

    Aug 11, 2026Zhenyan Zheng, Yunyao Zhang, Junxi Sheng +2Stance DetectionIntent Classification

  15. Rationale-Guided Learning for Multimodal Emotion Recognition

    Aug 11, 2026Sujung Oh, Jung Uk Kim, Sangmin LeeMultimodal ReasoningEmotion Recognition in Conversations

  16. SpEmoC: A Balanced Speaker-Segment Multimodal Emotion Benchmark

    Jul 20, 2026Sania Bano, Shahzad Ahmad, Santosh Kumar Vipparthi +2Emotion Recognition in ConversationsMultimodal Emotion Recognition

  17. EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation

    Jul 19, 2026Zilong Huang, Kong Aik Lee, Chong-Xin Gan +3Emotion Recognition in ConversationsMultimodal Emotion Recognition

  18. EmoEUS: Uncertainty Supervision for Multimodal Emotion Recognition in Conversation

    Jul 19, 2026Zilong Huang, Kong Aik Lee, Junjie Li +2Emotion Recognition in ConversationsMultimodal Emotion Recognition

  19. TRACE: Temporal Relationship-Aware Conversational Entrainment Detection in Dyadic Speech

    Jun 29, 2026Sathvik Manikantan Napa Ugandhar, Hao Zhang, Alison Gunzler +5Emotion Recognition in Conversations

  20. EmotionAI: A Privacy-Preserving Computational Intelligence Pipeline for Speech-Emotion-Grounded Conversational Analysis

    Jun 22, 2026Wai Laam Mak, Isibor Kennedy Ihianle, Pedro MachadoSpeech ProcessingEmotion Recognition in Conversations

  21. Learning Robust Pair Confidence for Multimodal Emotion-Cause Pair Extraction

    Jun 17, 2026Zhuangzhuang Pan, Ning Dong, Yingna Su +1Pairwise Preference LearningMultimodal Robustness