Multimodal Emotion Recognition

Ask about this topic

Latest papers 141

19 papers in the last four weeks, down 10% on the four weeks before. 0.1% of all new papers.

All topics
CardsList

  1. To Fuse or to Drop? Dual-Path Learning for Resolving Modality Conflicts in Multimodal Emotion Recognition

    May 6, 2026Yangchen Yu, Qian Chen, Jia Li +5Cross-Modal LearningMultimodal Robustness

    School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China · School of Computing and Information Systems, Singapore Management University, Singapore · College of Computing and Data Science, Nanyang Technological University, Singapore +1

  2. EmoMM: Benchmarking and Steering MLLM for Multimodal Emotion Recognition under Conflict and Missingness

    May 1, 2026Yueru Sun, Yimeng Zhang, Haoyu Gu +5Missing-Modality LearningMultimodal Large Language Models

    School of Future Technology, South China University of Technology, Guangzhou, China

  3. Introducing WARM-VR: Benchmark Dataset for Multimodal Wearable Affect Recognition in Virtual Reality

    Apr 30, 2026Karim Alghoul, Faisal Mohd, Fedwa Laamarti +2Wearable SensingMultimodal Emotion Recognition

    School of Electrical Engineering and Computer Science, University of Ottawa, Canada · Computer Vision Department, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE

  4. ML-SAN: Multi-Level Speaker-Adaptive Network for Emotion Recognition in Conversations

    Apr 28, 2026Kexue Wang, Yinfeng Yu, Liejun WangSpeech ProcessingEmotion Recognition in Conversations

    Joint Research Laboratory for Embodied Intelligence, Xinjiang University · Joint International Research Laboratory of Silk Road Multilingual Cognitive Computing, Xinjiang University · School of Computer Science and Technology, Xinjiang University, Urumqi 830017, China

  5. Learning Invariant Modality Representation for Robust Multimodal Learning from a Causal Inference Perspective

    Apr 20, 2026Sijie Mai, Shiqin HanDisentangled Representation LearningCausal Representation Learning

    School of Computer Science, South China Normal University

  6. Dynamic Emotion and Personality Profiling for Multimodal Deception Detection

    Apr 18, 2026Li Zheng, Yanyi Luo, Hao Fei +5Multimodal Emotion RecognitionUncertainty-Aware Multimodal Fusion

    Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University, Wuhan, China · National University of Singapore, Singapore, Singapore

  7. GAViD: A Large-Scale Multimodal Dataset for Context-Aware Group Affect Recognition from Videos

    Apr 17, 2026Deepak Kumar, Abhishek Pratap Singh, Puneet Kumar +2Multimodal Emotion RecognitionEmotion Recognition

    Department of Computer Science and Engineering, Indian Institute of Technology Roorkee, Roorkee, India · Indian Institute of Technology Ropar, Punjab, India · Zhejiang University, China +1

  8. Watching Movies Like a Human: Egocentric Emotion Understanding for Embodied Companions

    Apr 17, 2026Ze Dong, Hao Shi, Zejia Gao +3Multimodal RobustnessEgocentric Video Understanding

    Nanyang Technological University, Singapore · Zhejiang University, China · Ant Group, China +1

  9. Why Do Vision Language Models Struggle To Recognize Human Emotions?

    Apr 16, 2026Madhav Agarwal, Sotirios A. Tsaftaris, Laura Sevilla-Lara +1VLM EvaluationMultimodal Emotion Recognition

    The University of Edinburgh, UK

  10. Cognition-Inspired Dual-Stream Semantic Enhancement for Vision-Based Dynamic Emotion Modeling

    Apr 14, 2026Huanzhen Wang, Ziheng Zhou, Zeng Tao +5Facial Expression RecognitionMultimodal Emotion Recognition

    College of Intelligent Robotics and Advanced Manufacturing, Fudan University, Shanghai, China · Shanghai Key Lab of Intelligent Information Processing, College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China · School of Data Science and Engineering, East China Normal University, Shanghai, China

  11. AffectAgent: Collaborative Multi-Agent Reasoning for Retrieval-Augmented Multimodal Emotion Recognition

    Apr 14, 2026Zeheng Wang, Zitong Yu, Yijie Zhu +9Multimodal Emotion RecognitionMultimodal RAG

    Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen, Guangdong, China · Great Bay University, Dongguan, Guangdong, China · Guangdong Provincial Key Laboratory of Intelligent Information Processing & Shenzhen Key Laboratory of Media Security, Shenzhen University, Shenzhen, Guangdong, China

  12. Multimodal Ambivalence/Hesitancy Recognition in Videos for Personalized Digital Health Interventions

    Apr 13, 2026Manuela González-González, Soufiane Belharbi, Muhammad Osama Zeeshan +8HealthcareMultimodal Emotion Recognition

    Dept. of Health, Kinesiology, & Applied Physiology, Concordia University, Montreal, Canada · Montreal Behavioural Medicine Centre, CIUSSS Nord-de-l’Ile-de-Montréal, Canada · LIVIA, Dept. of Systems Engineering, ETS Montreal, Canada +1

  13. LaScA: Language-Conditioned Scalable Modelling of Affective Dynamics

    Apr 8, 2026Kosmas Pinitas, Ilias MaglogiannisAffective ComputingMultimodal Emotion Recognition

    Department of Digital Systems, University of Piraeus

  14. Evaluating multimodal emotion recognition in proactive conversational agents: A user study

    Apr 6, 2026Adnana Dragut, Raquel Lacuesta, F. Xavier Gaya-Morey +1Emotion Recognition in ConversationsMultimodal Emotion Recognition

    Escuela Universitaria Politécnica de Teruel, Universidad de Zaragoza, C/ Atarazana, 2, Teruel, 44003, Aragón, Spain · I3A (Institute of Engineering Research of Aragon), Universidad de Zaragoza, C. de Mariano Esquillor Gómez, s/n, Zaragoza, 50018, Aragón, Spain · Universitat de les Illes Balears, Universitat de les Illes Balears, Carretera de Valldemossa, km 7.5, Palma, 07122, Illes Balears, Spain

  15. Disentangled Dual-Branch Graph Learning for Conversational Emotion Recognition

    Apr 3, 2026Chengling Guo, Yuntao Shou, Tao Meng +3Emotion Recognition in ConversationsMultimodal Emotion Recognition

    College of Computer and Mathematics, Central South University of Forestry and Technology · Changsha Hospital for Maternal and Child Health Care · Department of Computer Science, State University of New York

  16. MECO: A Multimodal Dataset for Emotion and Cognitive Understanding in Older Adults

    Apr 3, 2026Hongbin Chen, Jie Li, Wei Wang +4Multimodal Emotion RecognitionEmotion Recognition

    Nanjing Medical University Nanjing, China · University of Exeter Exeter, U.K. · University of Oxford Oxford, U.K.

  17. Variational Encoder--Multi-Decoder (VE-MD) for Privacy-by-functional-design (Group) Emotion Recognition

    Apr 2, 2026Anderson Augusma, Dominique Vaufreydaz, Fédérique LetuéEmotion RecognitionPrivacy-Preserving ML

    UGA, LIG, M-PSI · Univ. Grenoble Alpes, CNRS, Grenoble INP, LIG, 38000 Grenoble, France · Univ. Grenoble Alpes, CNRS, Grenoble INP, LJK, 38000 Grenoble, France +2

  18. SURE: Synergistic Uncertainty-aware Reasoning for Multimodal Emotion Recognition in Conversations

    Apr 2, 2026Yiqiang Cai, Chengyan Wu, Bolei Ma +4Emotion Recognition in ConversationsMultimodal Emotion Recognition

    Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials · School of Electronic Science and Engineering (School of Microelectronics), South China Normal University · LMU Munich & Munich Center for Machine Learning +2

  19. Dual-branch Graph Domain Adaptation for Cross-scenario Multi-modal Emotion Recognition

    Mar 27, 2026Yuntao Shou, Jun Zhou, Tao Meng +2Emotion Recognition in ConversationsMultimodal Emotion Recognition

    College of Computer and Mathematics, Central South University of Forestry and Technology · Department of Computer Science, State University of New York

  20. Crab: Multi Layer Contrastive Supervision to Improve Speech Emotion Recognition Under Both Acted and Natural Speech Condition

    Mar 24, 2026Lucas H. Ueda, João G. T. Lima, Paula D. P. CostaContrastive LearningMultimodal Emotion Recognition

    Dept. of Computer Engineering and Automation (DCA), Faculdade de Engenharia El´etrica e de Computac¸˜ao, and are part of the AI Lab., Recod.ai, Institute of Computing, Universidade Estadual de Campinas, UNICAMP

  21. Foundation Model Embeddings Meet Blended Emotions: A Multimodal Fusion Approach for the BLEMORE Challenge

    Mar 24, 2026Masoumeh Chapariniya, Aref Farhadipour, Sarah Ebling +2Emotion RecognitionMultimodal Emotion Recognition

    Department of Computational Linguistics, University of Zürich, Switzerland

  22. ERM-MinMaxGAP: Benchmarking and Mitigating Gender Bias in Multilingual Multimodal Speech-LLM Emotion Recognition

    Mar 22, 2026Zi Haur Pang, Xiaoxue Gao, Tatsuya Kawahara +1Speech Emotion RecognitionMultimodal Emotion Recognition

    Kyoto University, Japan · Agency for Science, Technology, and Research (A*STAR), Singapore

  23. Dynamic Fusion-Aware Graph Convolutional Neural Network for Multimodal Emotion Recognition in Conversations

    Mar 22, 2026Tao Meng, Weilun Tang, Yuntao Shou +4Emotion Recognition in ConversationsMultimodal Emotion Recognition

    College of Computer and Mathematics, Central South University of Forestry and Technology, 410004, Hunan, Changsha, China · Department of Computer Science, State University of New York, New Paltz, New York, 12561, USA

  24. Relational graph-driven differential denoising and diffusion attention fusion for multimodal conversation emotion recognition

    Mar 22, 2026Ying Liu, Yuntao Shou, Wei Ai +2Emotion Recognition in ConversationsMultimodal Emotion Recognition

    College of Computer and Mathematics, Central South University of Forestry and Technology, 410004, Hunan, Changsha China · Department of Computer Science, State University of New York, New Paltz, New York, 12561, USA

  25. Memory Bear AI Memory Science Engine for Multimodal Affective Intelligence: A Technical Report

    Mar 18, 2026Deliang Wen, Ke Sun, Yu WangAffective ComputingEmotion Recognition

  26. Follow the Clues, Frame the Truth: Hybrid-evidential Deductive Reasoning in Open-Vocabulary Multimodal Emotion Recognition

    Mar 17, 2026Yu Liu, Lei Zhang, Haoxun Li +4Multimodal Emotion RecognitionMultimodal Reasoning

    Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, China.

  27. Anchoring Emotions in Text: Robust Multimodal Fusion for Mimicry Intensity Estimation

    Mar 16, 2026Lingsi Zhu, Yuefeng Zou, Yunxiang Zhang +7Multimodal FusionMultimodal Emotion Recognition

    University of Science and Technology of China · Unisound AI Technology Co., Ltd. · Pingan Technology Co., Ltd.

  28. Solution for 10th Competition on Ambivalence/Hesitancy (AH) Video Recognition Challenge using Divergence-Based Multimodal Fusion

    Mar 15, 2026Aislan Gabriel O. Souza, Agostinho Freire, Leandro Honorato Silva +6Ambivalence and Hesitancy RecognitionMultimodal Fusion

    Universidade de Pernambuco (UPE), Escola Polit´ecnica de Pernambuco (POLI), Recife, Brazil

  29. Multimodal Emotion Regression with Multi-Objective Optimization and VAD-Aware Audio Modeling for the 10th ABAW EMI Track

    Mar 14, 2026Jiawen Huang, Chenxi Huang, Zhuofan Wen +7Emotion RecognitionMultimodal Emotion Recognition

    School of Artificial Intelligence, University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · Tianjin Normal University

  30. A Two-Stage Dual-Modality Model for Facial Emotional Expression Recognition

    Mar 12, 2026Jiajun Sun, Zhe GaoFacial Expression RecognitionMultimodal Emotion Recognition

    Shanghai Normal University