cs.CVNov 6, 2026

A Privacy-Aware Deep Learning Benchmark for Facial Emotion Recognition

Authors: Larissa Palhares, Maria Machado, Hudson Bruno, Raphael Ramos, Andrew Vale, Barbara Barbosa, Inara Souza, Fabio Grassiotto

Organizations: Eldorado Research Institute, Campinas, SP, Brazil.

Abstract

Facial Expression Recognition (FER) traditionally relies on raw RGB images, introducing privacy risks, sensitivity to illumination variations, and susceptibility to identity-confounding visual shortcuts. As an alternative, this work proposes a lightweight, privacy-aware pipeline using exclusively geometric representations-facial landmarks (478 points) and blendshapes (52 coefficients, ARKit standard)-eliminating persistent raw video storage. Six neural architectures trained from scratch on fused CREMA-D and RAVDESS datasets were benchmarked against an ImageNet-pretrained ResNet50 baseline under a 5-fold subject-independent cross-validation protocol. Geometric models consistently outperformed the pixel baseline on unseen subjects with 12-124 times fewer parameters, while demonstrating superior robustness on subtle emotional expressions such as sadness. Ablation studies reveal that blendshapes capture the primary discriminative signal, while landmarks provide essential complementary spatial topology. These results demonstrate that compact geometric representations preserve affective semantics, eliminate downstream transfer learning dependency on visual backbones, and enable efficient, privacy-aware emotion recognition.

Figures & tables

Explore similar work

CardsList
  1. SRE-FER: Regional residual evidence learning for mitigating local evidence dilution in fine-grained facial expression recognition

    Aug 9, 2026Jiaye Song, Ruochen Zhang, Yuliang Wang +1Residual LearningFacial Expression Recognition

  2. Facial Expression Recognition in the Deep Learning Era: A Systematic Multi-Criteria Review of Methods, Models, Datasets, Performance, Challenges, and Future Research Directions

    Jun 7, 2026Spyridon Georgiou, Aggelos Psiris, Spyridon Evangelatos +5Facial Expression Recognition

  3. Towards Emotion Recognition with 3D Pointclouds Obtained from Facial Expression Images

    Mar 29, 2026Laura Rayón Ropero, Jasper De Laet, Filip Lemic +6Facial Expression RecognitionPoint Cloud Learning