This paper proposes a method to review public acceptance of products based on their brand by analyzing the facial expression of the customer intending to buy the product from a supermarket or hypermarket. In such cases, facial expression recognition plays a significant role in product review. Here, facial expression detection is performed by extracting feature points using a modified Harris algorithm. The modified Harris algorithm reduced the time complexity of the existing feature extraction Harris Algorithm. A comparison of time complexities of existing algorithms is done with proposed algorithm. The algorithm proved to be significantly faster and nearly accurate for the needed application by reducing the time complexity for corner points detection.
Figures & tables
Fig. 1: Haar like feature
Fig. 2: Cascade of feature Classifiers
Fig. 3: Graph showing high sigma values require significantly more calculations per pixel
Fig. 4: flow chart of the proposed approach
Fig. 5: Corner Detection Theory
Fig. 6: Comparison on happy face
Fig. 7: Comparison on sad face
Fig. 8: Table showing time required for processing
Fig. 9: Graph showing time required for processing
Fig. 10: Table showing comparison of accuracy over previous algorithm
Fig. 11: Graph showing comparison of accuracy over previous algorithm
Facial expression detection requires spotting when expressions occur and recognizing which emotional category they belong to. Despite their close relationships, existing approaches typically address these tasks separately, limiting performance and robustness in real-world settings. In this work, we propose FEDN, a Facial Expression Detection Network, which unifies spotting and recognition into a single detection task performed fully end-to-end. FEDN introduces two temporal attention modules, segment-level attention to capture fine-grained local dynamics and sliding window attention to capture the broader temporal context. Their output is combined in a multi-scale temporal feature pyramid, which enables spotting of expressions with varying duration. This unified framework enables joint optimization and shared representation learning across tasks. FEDN outperforms strong baselines in both spotting and detection on three public benchmarks, demonstrating the effectiveness of unifying spotting and recognition across multiple temporal scales. Additionally, we uncover a previously unreported discrepancy between expert-annotated and self-reported emotion labels, highlighting a key challenge in expression benchmarking and motivating the development of more nuanced annotation protocols.
Yini Fang, Alec F. Diallo, Frederic Jumelle +1
Hong Kong University of Science and Technology · University of Edinburgh · Ydentity Organization
Deep neural networks enriched with structural information have been widely employed for facial expression recognition tasks. However, these methods often depend on hierarchical information rather than face property to finish expression recognition. In this paper, we propose a cross-modal network with strong biological and structural information for facial expression recognition (CMNet). CMNet can respectively learn expression information via face symmetry on a whole face, left and right half faces to extract complementary facial features. To prevent negative effect of biological and structural information fusion, a salient facial information refinement module can obtain salient facial expression information to improve stability of an obtained facial expression classifier. To reduce reliance on unilateral facial features, a half-face alignment optimization mechanism is designed to align obtained expression information of learned left and right half faces. Our experimental results demonstrate that CMNet outperforms several novel methods, i.e., SCN and LAENet-SA for facial expression recognition. Codes can be obtained at https://github.com/hellloxiaotian/CMNet.
Chunwei Tian, Jingyuan Xie, Qi Zhang +3
School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China · School of Software, Northwestern Polytechnical University, Xi’an 710072, China · School of Economics and Management, Harbin Institute of Technology at Weihai, Weihai, 264209, China +2
Micro-expressions, characterized by transience and subtlety, pose challenges to existing optical flow-based recognition methods. To address this, this paper proposes a dual-branch micro-expression feature extraction network integrated with parallel attention. Key contributions include: 1) a residual network designed to alleviate gradient anishing and network degradation; 2) an Inception network constructed to enhance model representation and suppress interference from irrelevant regions; 3) an adaptive feature fusion module developed to integrate dual-branch features. Experiments on the CASME II dataset demonstrate that the proposed method achieves 74.67% accuracy, outperforming LBP-TOP (by 11.26%), MSMMT (by 3.36%), and other comparative methods.
Mingjie Zhang, Bo Li, Wanting Liu +5
School of Petroleum China University of Petroleum (Beijing) Karamay Campus Karamay, China · Artificial Intelligence Research Institute China Tower Corporation Limited Beijing, China · Low Carbon Business Department South Electric Power Science and Technology Development Co., Ltd. Guangzhou, China +1