Multimodal Sentiment Analysis

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, level with the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21

Latest papers 27

All topics

Prediction-Layer Branch Calibration for Multimodal Sentiment Analysis
Sep 29, 2026Yulin Sun, Kele Xu, Yong DouMultimodal Sentiment Analysis Multimodal Fusion
National University of Defense Technology
SemMSA: Latent Semantic-Aided Robust Multimodal Sentiment Analysis with Incomplete Data
Sep 24, 2026Wenhao Li, Zhibin Wu, Chong Xiao +1Multimodal Sentiment Analysis Incomplete
Software School, Shandong University · Shenzhen Loop Area Institute
Divide and Conquer: Mixture-of-Bottleneck Experts in Informative Ordinal Space for Video-based Multimodal Sentiment Analysis
Sep 16, 2026Ronghao Lin, Qiaolin He, Zefeng Lu +5Multimodal Sentiment Analysis Multimodal Deep Learning
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China · Nanyang Technological University, Singapore, 639798 · School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou 510006, China +4
Robust Multimodal Sentiment Analysis with Incomplete Modalities via Semantic-aware Completeness based Reconstruction
Sep 12, 2026Han-Jun Choi, Byunggill Joe, Saim Shin +1Multimodal Sentiment Analysis Missing Modalities
Korea Electronics Technology Institute (KETI) Seongnam, South Korea
The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods
Sep 11, 2026Ioanna Kaffeza, Efthymios Georgiou, Alexandros PotamianosMultimodal Sentiment Analysis Modalities
PERSEE Center, Mines Paris-PSL University, Sophia-Antipolis, France · National Technical University of Athens, Athens, Greece · University of Bern, Bern, Switzerland +2
Multimodal Adaptive Expert Selection with Text Routing and Ordinal Prototype Optimization for Sentiment Analysis
Aug 31, 2026Xiaode Chen, Jiakang Yu, Hongtao Deng +3Multimodal Sentiment Analysis Sentiment
Jianghan University Wuhan, China
Dual-Model Sentiment Analysis of Consumer Reviews in the Retail Coffee Sector Using Machine Learning and Deep Learning Approaches
Aug 12, 2026Muntasir Hasan Kanchan, Md. Alamgir Hossain, Md. Samiul Islam +1Sentiment Multimodal Sentiment Analysis
Department of Computer Science and Engineering, State University of Bangladesh, Dhaka, Bangladesh · Skill Morph Research Lab., Skill Morph, Dhaka, Bangladesh · Department of Computer Science, American International University - Bangladesh, Dhaka, Bangladesh
Multiclass Sentiment Analysis for Identifying Political Viewpoints
Aug 11, 2026Girma Yohannis Bade, Olga Kolesnikova, Jose Luis Oropeza +1Multimodal Sentiment Analysis Sentiment
Centro de Investigaciones en Computación (CIC), Instituto Politécnico Nacional (IPN), Miguel Othon de Mendizabal, Ciudad de México, 07320, México
MIDAS: Mutual Information Disentanglement with Uncertainty-Aware Fusion for Incomplete Multimodal Sentiment Analysis
Aug 6, 2026Yuhua Wen, Yingying Zhou, Qifei Li +4Multimodal Sentiment Analysis Uncertainty-Aware Fusion
School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China · Zhongguancun Academy, Beijing 100094, China · Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China +1
MoCA: Implicit Social Context Analysis
Aug 6, 2026Wenhao Xu, Kaiwen Zhang, Hao Li +10Multimodal Sentiment Analysis Complex Societies
National University of Singapore, Singapore, Singapore. · Wuhan University, Wuhan, China. · University of Oxford, Oxford, United Kingdom.
Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations
Aug 4, 2026Chunlei Meng, Jacqueline J. Pang, Pengbin Feng +3Multimodal Sentiment Analysis Missing Modalities
The College of Intelligent Robotics and Advanced Manufacturing (CIRAM), Fudan University · J.P. Morgan Chase · University of Southern California (USC) +1
Semantic-Aligned Structural Abstraction for Multimodal Sentiment Analysis
Jul 30, 2026Wei Chen, Junkai Li, Tongguan Wang +4Multimodal Sentiment Analysis Affective Computing
Huazhong Agricultural University Wuhan, China · Hubei University Wuhan, China · Engineering Research Center of Intelligent Technology for Agriculture, Hubei Engineering Technology Research Center of Agricultural Big Data, Key Laboratory of Smart Farming for Agricultural Animals.
StanceFlip: A Comprehensive Multi-Dimensional Benchmark for Multimodal Conversational Stance Flipping Forecasting
Jul 27, 2026Heyan Chai, Xin Li, Wenjie Wang +5Multimodal Sentiment Analysis Flips
College of Computer Science and Software Engineering, Shenzhen University Shenzhen, China · Harbin Institute of Technology Shenzhen, China · Shenzhen University Shenzhen, China +1
Token-Region Guided Cross-Attention Fusion for Multimodal Affect Interpretation
Jul 26, 2026Musa Tur Farazi, Nufayer Jahan RezaMultimodal Sentiment Analysis Bangla
RMS@CC-MMD 2026: Multimodal Misogyny Detection via Geometric Interaction and Multi-View Consensus
Jul 20, 2026Md. Ajwad HossainMemes Multimodal Sentiment Analysis
Department of Electronics and Telecommunication Engineering Chittagong University of Engineering & Technology (CUET) Chattogram, Bangladesh
Should Missing Modalities Always Be Necessary to Repair for Multi-modal Sentiment Analysis?
Jul 19, 2026Yubo Gao, Haotian Wu, Xiaoyu Xu +9Multimodal Sentiment Analysis Missing Modalities
The Hong Kong University of Science and Technology (Guangzhou) · The Hong Kong University of Science and Technology · Nanyang Technological University +2
MRUF: Multi-granularity Routing with Uncertainty-Aware Fusion for Robust Multimodal Sentiment Analysis
Jul 12, 2026Haoran Ma, Yinfeng Yu, Liejun WangMultimodal Sentiment Analysis Multimodal Fusion
School of Computer Science and Technology, Xinjiang University, Urumqi 830017, China. · Joint International Research Laboratory of Silk Road Multilingual Cognitive Computing. · Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center. +2
Audio Sentiment Analysis via Distillation and Cross-Modal Integration of Generated Multilingual Transcripts
Jul 7, 2026Andrei-George Durdun, Victor Constantinescu, Radu Tudor IonescuMultimodal Sentiment Analysis Speech Translation
Department of Computer Science, University of Bucharest, 15G Iuliu Maniu, Bucharest 061075, Romania · Department of Data Science, PPC Romania, 30 Mircea Voda, Bucharest 030667, Romania
MAF: Multimodal Adaptive Few-shot Prompting for Sentiment Analysis with MLLMs
Jun 14, 2026Hangling XieMultimodal Sentiment Analysis Multimodal Large Language Models
Nanjing University of Posts and Telecommunications, Wenyuan Road No.9, Xixia District, Nanjing City, Jiangsu Province, China
A Unified Multi-Modal Framework for Intelligent Financial Systems: Integrating Reinforcement Learning, High-Frequency Trading, and Game-Theoretic Approaches with Cross-Modal Sentiment Analysis
Jun 9, 2026Fanrong Liu, Zhang Yuwei, Mingni LuoFinancial Sentiment Analysis Multimodal Sentiment Analysis
Henan University, International Eurasia College, Kaifeng, Henan, China · City University of Hong Kong, College of Business, Hong Kong, China · Northeastern University, School of Electronic and Information Engineering, Seattle, United States
Explicit Representation Alignment for Multimodal Sentiment Analysis
Jun 8, 2026Baode Wang, Ziming Wang, Huacan Wang +2Multimodal Sentiment Analysis Modality-Specific Encoders
AgentAlpha
Beyond Generative Decoding: Discriminative Hidden-State Readout from a Native Omni-Modal LLM for Multimodal Sentiment Analysis
Jun 4, 2026Bin Wen, Tien-Ping TanMultimodal Sentiment Analysis Readout
School of Computer Sciences, Universiti Sains Malaysia, Penang, Malaysia.
A Conflict-Aware Penalty and Statistical Loss Framework for Balancing Modalities and Enhancing Stability in Multimodal Sentiment Analysis
May 27, 2026Jianheng Dai, Jiazhang Liang, Sijie MaiMultimodal Sentiment Analysis Complementary Modalities
School of Computer Science, South China Normal University, Guangzhou, Guangdong, China
ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection
May 20, 2026Yingjia Xu, Jiulong Wu, Bowen Zhang +3Humor Multimodal Sentiment Analysis
School of Computer Science and Technology, Soochow University, Suzhou, China · Baidu Inc., Beijing, China · Zhipu AI, Beijing, China
Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities
May 16, 2026Chenglizhao Chen, Yuchen Cao, Xinyu Liu +3Multimodal Sentiment Analysis Missing Modalities
Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China) · Shandong Key Laboratory of Intelligent Oil & Gas Industrial Software · The Hong Kong University of Science and Technology (Guangzhou)
PC-MNet: Dual-Level Congruity Modeling for Multimodal Sarcasm Detection via Polarity-Modulated Attention
May 4, 2026Maoheng Li, Ling Zhou, Xiaohua Huang +3Humor Cross-Modal Conflicts
School of Computer Science and Engineering, Macau University of Science and Technology, Macao SAR 999078, China · Oulu School, Nanjing Institute of Technology, Nanjing 210096, China · School of Computer Science and Engineering, Macau University of Science and Technology, Macao SAR 999078, China, and also with the Macau University of Science and Technology Zhuhai MUST Science and Technology Research Institute, Zhuhai 519099, China +2
Directed Social Regard: Surfacing Targeted Advocacy, Opposition, Aid, Harms, and Victimization in Online Media
May 1, 2026Scott Friedman, Ruta Wheelock, Sonja Schmer-Galunder +6Sentiment Multimodal Sentiment Analysis
SIFT, 319 N 1st Ave, Minneapolis, 55401, MN, USA. · Department of Computer & Information Science & Engineering, University of Florida, 432 Newell Drive, Gainesville, 32611, FL, USA. · Center for Information Systems & Technology, Claremont Graduate University, 150 E 10th St., Claremont, 91711, CA, USA. +1

Sep 29, 2026, cs.SDJ/K move · Enter open · S save

Prediction-Layer Branch Calibration for Multimodal Sentiment Analysis

Yulin Sun, Kele Xu, Yong Dou

National University of Defense Technology

Multimodal Sentiment Analysis Multimodal Fusion Soft-Token Representations Contrastive Learning

Open paper AskPDF arXiv

Multimodal sentiment analysis integrates textual, acoustic and visual cues, yet current language-model-based fusion methods typically leave prediction-layer branch allocation implicit. We introduce Branch-Calibrated Multimodal Language Fusion (BC-MLF), which explicitly models prediction-layer branch allocation through a Branch-Calibrated Task Head (BCHead), complemented by Fusion Token Contrastive Learning (FTCL) for sentiment-aware fusion-token regularization. FTCL organizes mean-pooled fusion-token representations according to continuous sentiment affinity, while BCHead combines fusion, text and audiovisual predictions through a lightweight sample-adaptive constrained mixture. Without modifying the fusion backbone, BC-MLF consistently improves the reproduced DeepMLF baseline and achieves the strongest results among the compared methods on CMU-MOSEI and CH-SIMS across classification and regression metrics. The controlled ablations show that sample-adaptive prediction-layer branch allocation consistently outperforms static branch aggregation. Code is available at https://github.com/sunyulin0421/BC-MLF.

Momentum

Related topics

Latest papers 27