cs.CLMar 14, 2026

CMHL: Contrastive Multi-Head Learning for Emotionally Consistent Text Classification

Authors: Menna Elgabry, Ali Hamdi, Khaled Shaban

Organizations: Faculty of Computer Science, October University for Modern Sciences and Arts (MSA), Giza, Egypt. · Computer Science and Engineering Department, College of Engineering, Qatar University, Doha, Qatar.

Abstract

Textual Emotion Classification (TEC) is one of the most difficult NLP tasks. State of the art approaches rely on Large language models (LLMs) and multi-model ensembles. In this study, we challenge the assumption that larger scale or more complex models are necessary for improved performance. In order to improve logical consistency, We introduce CMHL, a novel single-model architecture that explicitly models the logical structure of emotions through three key innovations: (1) multi-task learning that jointly predicts primary emotions, valence, and intensity, (2) psychologically-grounded auxiliary supervision derived from Russell's circumplex model, and (3) a novel contrastive contradiction loss that enforces emotional consistency by penalizing mutually incompatible predictions (e.g., simultaneous high confidence in joy and anger). With just 125M parameters, our model outperforms 56x larger LLMs and sLM ensembles with a new state-of-the-art F1 score of 93.75% compared to (86.13%-93.2%) on the dair-ai Emotion dataset. We further show cross domain generalization on the Reddit Suicide Watch and Mental Health Collection dataset (SWMH), outperforming domain-specific models like MentalBERT and MentalRoBERTa with an F1 score of 72.50% compared to (68.16%-72.16%) + a 73.30% recall compared to (67.05%-70.89%) that translates to enhanced sensitivity for detecting mental health distress. Our work establishes that architectural intelligence (not parameter count) drives progress in TEC. By embedding psychological priors and explicit consistency constraints, a well-designed single model can outperform both massive LLMs and complex ensembles, offering a efficient, interpretable, and clinically-relevant paradigm for affective computing.

Figures & tables

Explore similar work

CardsList
  1. Decoding Affective Nuances: Enhancing MLLMs via Hierarchical Emotion Reasoning and Contrastive Discriminative Pruning

    Sep 29, 2026Cheng Ye, Weidong Chen, Zhaobo Qi +2Multimodal Large Language ModelsMultimodal Emotion Recognition

  2. Emotion is Not Just a Label: Latent Emotional Factors in LLM Processing

    Mar 10, 2026Benjamin Reichman, Adar Avsian, Samuel Webster +1Emotion Representation in Language ModelsLLM Interpretability

  3. Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparison

    Apr 5, 2026Jihoon JeongEmotion Representation in Language ModelsSmall Language Models