cs.CVJan 14, 2026

GRCF: Group-wise Ranking and Calibration Framework for Multimodal Sentiment Analysis

Authors: Manning Gao, Leheng Zhang, Shiqin Han, Haifeng Hu, Yuncheng Jiang, Sijie Mai

Organizations: South China Normal University, Guangzhou 510631, China · Sun Yat-sen University, Guangzhou 510275, China

Abstract

Most multimodal sentiment analysis algorithms focus on point-wise regression. While straightforward, it uses absolute values to represent subjective sentiment and overlooks the ordinal nature of sentiment, resulting in unstable predictions and poor correlation. Inspired by the way humans perceive sentiment, pair-wise ordinal learning frameworks emerged to address this gap, capturing relative order by learning from comparisons. However, they have two limitations: First, they assign uniform importance to all pairs, failing to adaptively focus on hard-to-rank samples. Second, they employ static ranking margins, which fail to reflect the varying semantic distances between sentiment groups. To address this, we propose a Group-wise Ranking and Calibration Framework (GRCF) that introduces the Adaptive Error-weighting and Dynamic Margin mechanism, which resolves these limitations by simultaneously preserving the relative ordinal structure and ensuring absolute score calibration. Specifically, Stage 1 introduces a Group-aware Ranking Loss to build a fine-grained ordinal structure by assigning higher optimization priority to confusable pairs. Stage 2 then employs an MAE-driven objective to align the prediction magnitudes. To validate its generalizability, we extend GRCF to classification tasks, including Multimodal Humor and Sarcasm Detection. It achieves state-of-the-art performance on regression datasets while also showing strong generalizability in classification tasks.

Figures & tables

Explore similar work

CardsList
  1. Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities

    May 16, 2026Chenglizhao Chen, Yuchen Cao, Xinyu Liu +3Missing-Modality LearningMultimodal Robustness

  2. Uncertainty-Guided Multimodal Consensus for Multimodal Sentiment Analysis

    Oct 23, 2025Guowei Zhong, Junjie Li, Huaiyu Zhu +2Multimodal Sentiment AnalysisUncertainty-Aware Multimodal Fusion