cs.CLNov 5, 2026

Polarity Classification with Multitask Learning Syntax Augmentation

Authors: Muhammad Imran, Carlos Gómez-Rodríguez

Organizations: Universidade da Coruña, CITIC, Depto. de Ciencias de la Computación y Tecnologías de la Información, Campus de Elviña s/n, 15071 A Coruña, Spain

Abstract

Sentiment Analysis (SA) is a fundamental NLP task concerned with the identification and categorization of subjective information in text. While lexicon-based methods offer transparency, they often struggle with linguistic phenomena such as negation and intensification. Syntactic parsing has been integrated into SA pipelines to address this, but conventional parsers introduce significant computational overhead. Recent work shows that reformulating dependency parsing as a Sequence Labeling (SEL) task can improve efficiency. We propose and compare two strategies for integrating syntactic knowledge into a neural sentiment analysis model under unified Multi-Task Learning (MTL). The first, Standard-MTL, jointly learns dependency parsing (via sequence labeling) and sentiment polarity classification using a shared encoder with two task-specific heads. The second, Contrastive-MTL, provides implicit syntactic guidance through a contrastive auxiliary objective and a syntax-biased attention pooling mechanism, without requiring explicit label prediction. Both rely on syntactic annotations during training and eliminate need for hand-crafted compositional rules or external parsing at inference. We evaluate eleven datasets spanning seven languages---the MARC corpus (English, Spanish, French, German) and seven datasets from SemEval-2022 Task 10 (English, Spanish, Norwegian, Basque, Catalan)---using four established SEL encodings. With the relative encoding, Contrastive-MTL outperforms a syntax-naive baseline on 10 of 11 datasets and surpasses the external rule-based pipeline (SELSP) that parses at inference on all six datasets where the latter applies, while being 1.5--9×\times faster at evaluation. Standard-MTL is more dataset- and encoding-dependent. These results show implicit syntactic supervision during training can match or exceed explicit parsing at inference without computational overhead.

Figures & tables

Explore similar work

CardsList
  1. Multi-Task Learning by using Contextualized Word Representations for Syntactic Parsing of a Morphologically Rich Language

    Sep 24, 2026Toqeer Ehsan, Miriam Butt, Sarmad Hussain +2Multi-Task LearningLow-Resource Language Processing

  2. Structured Sentiment Analysis Using Sequence Labeling as Dependency Graph Parsing

    Oct 8, 2026Muhammad Imran, Ana Ezquerro, Carlos Gómez-Rodríguez +2Sentiment AnalysisAspect-Based Sentiment Analysis