Facial Expression Recognition

Overview

Facial expression recognition (FER) aims to identify visible expressions, estimate continuous affect such as valence and arousal, and detect fine-grained facial actions, including brief micro-expressions. Methods range from convolutional neural networks and vision transformers to temporal models, action-unit and landmark guidance, and audio-visual or language-assisted systems; common evaluations use datasets such as AffectNet, RAF-DB, DFEW, and CASME II. Current work addresses real-world challenges with domain adaptation, synthetic data, efficient token selection, and models that report uncertainty or explain their predictions. A central tension is that expressions can be ambiguous and culturally or individually variable, while many benchmarks impose fixed labels, so robustness, fairness, privacy, and meaningful evaluation remain open concerns.

Latest papers

CardsList

85 papers7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

  1. Reweighting Framewise Attention in Video Transformers for Facial Expression Understanding

    Jun 29, 2026Seongro Yoon, Donghyeon Cho, Jinsun Park +1Vision TransformerFacial Expression Recognition

  2. STAG: Spatio-temporal Evolving Structural Representation of Action Units for Micro-expression Recognition

    Jun 26, 2026Nandani Sharma, Varun Sharma, Dinesh SinghFacial Expression RecognitionMicro-Expression Recognition

  3. TraMP-LLaMA: Generative Interpretability with Decoupled Instruction Tuning for Facial Expression Quality Assessment

    Jun 25, 2026Shuchao Duan, Alan Whone, Hossein Rahmani +2Medical DiagnosisFacial Expression Recognition

  4. SAC2^2-Net: Semantic Anchoring and Complementary-Consensus Fusion for Multimodal Micro-Expression Recognition

    Jun 24, 2026Xuepeng Zheng, Tong Chen, Chaoping Gui +3Cross-Modal AlignmentMultimodal Emotion Recognition

  5. Interpretable Uncertainty Routing Separating Emotion Ambiguity from Distribution Shift in Facial Expression Recognition

    Jun 21, 2026Keito Inoshita, Takato UenoUncertainty QuantificationSelective Prediction

  6. CDER-SME: A Cross-Device Event-RGB Micro-Expression Dataset under Multi-Level Stress Induction

    Jun 16, 2026Jingting Li, Hui Sha, Su-Jing WangCross-Modal AlignmentMultimodal Emotion Recognition

  7. Faithful Action-unit Causal Reasoning for Counterfactually Faithful Emotion Explanations

    Jun 14, 2026Van Thong Huynh, Hong Hai Nguyen, Thuy Pham +2Counterfactual EvaluationCounterfactual Explanations

  8. The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition

    Jun 14, 2026Van Thong Huynh, Hong Hai Nguyen, Soo-Hyung KimClass-Imbalanced LearningFacial Expression Recognition

  9. Facial Affect Analysis for Service-Oriented Systems: Advances, Challenges, and Future Visions

    Jun 13, 2026Spyridon Georgiou, Aggelos Psiris, Thomas Lagkas +4Software EngineeringFacial Action Unit Detection

  10. Facial Expression Recognition in the Deep Learning Era: A Systematic Multi-Criteria Review of Methods, Models, Datasets, Performance, Challenges, and Future Research Directions

    Jun 7, 2026Spyridon Georgiou, Aggelos Psiris, Spyridon Evangelatos +5Facial Expression Recognition

  11. Beyond Universality: The GCC-FER Dataset and Culture-Aware Adaptation for Dynamic Facial Expression Recognition

    Jun 5, 2026Sonalika Singh, Jyotirindra Dandapat, Avishi Razdan +3Facial Expression Recognition

  12. Horse Eye Blink Detection and Classification for Equine Affective State Assessment

    Jun 3, 2026João Alves, Signe Møller-Skuldbøl, Pia Haubro Andersen +1Facial Action Unit DetectionFacial Expression Recognition

  13. A Multiscale Network with Supervised Contrastive Learning for Real-Time Facial Emotion Recognition

    May 31, 2026Rejoy Chakraborty, Archisman Adhikary, Chayan Halder +3Facial Expression Recognition

  14. Evaluation of Conversational Agents: Understanding Culture, Context and Environment in Emotion Detection

    May 28, 2026Martha Teiko Teye, Yaw Marfo Missah, Emmanuel Ahene +2Sentiment AnalysisEmotion Recognition in Conversations

  15. From Affect to Complex Behavior: Advancing Multimodal Human-Centered AI at the 10th ABAW Workshop & Competition

    May 24, 2026Dimitrios Kollias, Panagiotis Tzirakis, Alan Cowen +10Facial Action Unit DetectionValence-Arousal Modeling

  16. LaCoVL-FER: Landmark-Guided Contrastive Learning Network with Vision-Language Enhancement for Facial Expression Recognition

    May 19, 2026Jiaxin Wang, Muwei Jian, Hui Yu +2VLM AdaptationFacial Expression Recognition

  17. On Applicability of Synthetic Datasets for Facial Expression Recognition

    May 17, 2026Ali Azmoudeh, Erdi Sarıtaş, Ömer Yıldırım +1Class-Imbalanced LearningSynthetic Data Generation

  18. SuperFace: Preference-Aligned Facial Expression Estimation Beyond Pseudo Supervision

    May 7, 2026Zejian Kang, Xuanyang Xu, Wentao Yang +6Facial Expression RecognitionPreference Learning

  19. A cross-modal network for facial expression recognition

    May 6, 2026Chunwei Tian, Jingyuan Xie, Qi Zhang +3Facial Expression Recognition

  20. Improving Facial Emotion Recognition through Dataset Merging and Balanced Training Strategies

    Apr 22, 2026Serap KırbızClass-Imbalanced LearningFacial Expression Recognition

  21. MEDN: Motion-Emotion Feature Decoupling Network for Micro-Expression Recognition

    Apr 20, 2026Chenxing Hu, Kun Xie, Qiguang Miao +3Disentangled Representation LearningVision Transformer

  22. Why Do Vision Language Models Struggle To Recognize Human Emotions?

    Apr 16, 2026Madhav Agarwal, Sotirios A. Tsaftaris, Laura Sevilla-Lara +1VLM EvaluationMultimodal Emotion Recognition

  23. Cognition-Inspired Dual-Stream Semantic Enhancement for Vision-Based Dynamic Emotion Modeling

    Apr 14, 2026Huanzhen Wang, Ziheng Zhou, Zeng Tao +5Facial Expression RecognitionMultimodal Emotion Recognition

  24. ARGen: Affect-Reinforced Generative Augmentation towards Vision-based Dynamic Emotion Perception

    Apr 14, 2026Huanzhen Wang, Ziheng Zhou, Jiaqi Song +4Synthetic Data AugmentationFacial Expression Recognition

  25. Product Review Based on Optimized Facial Expression Detection

    Apr 13, 2026Vikrant Chaugule, Abhishek D, Aadheeshwar Vijayakumar +2Facial Expression Recognition

  26. Bidirectional Learning of Facial Action Units and Expressions via Structured Semantic Mapping across Heterogeneous Datasets

    Apr 12, 2026Jia Li, Yu Zhang, Yin Chen +5Facial Action Unit DetectionFacial Expression Recognition