cs.CLNov 2, 2026

Finding Errors Is Not Enough: Selective Model Escalation for Entity-Targeted Sentiment Analysis

Authors: Nishan Chatterjee, Matthew Purver, Antoine Doucet, Senja Pollak

Organizations: Jožef Stefan Institute, Ljubljana, Slovenia · Jožef Stefan International Postgraduate School, Ljubljana, Slovenia · University of La Rochelle, La Rochelle, France · Queen Mary University of London, London, United Kingdom · 

Abstract

Improving a sentiment classifier with limited resources involves more than simply deciding how much data to collect or which model to train. A labelled collection may lack examples of an important class. Once trained, a classifier may benefit from another model even when that model is weaker on its own. We study these decisions in document-level Entity-Level Sentiment Analysis (ELSA), primarily using South Slavic news. We first compare acquisition orders as collections grow. We then use uncertainty to choose which predictions to revisit, how many to process, and whether an alternative encoder or local LLM can correct them. Finally, we select complete routing policies on development data for held-out evaluation. Minority-prioritised acquisition helps at some very small training sizes, but not consistently thereafter. On SentiCoref, an oracle correcting all errors in the least-confident 10% without harming correct predictions would add 9.14 Macro-F1 points; however the best evaluated action gains only 0.90. Encoder averaging helps on AspectBench and NewsMTSC but harms SentiCoref, where selective LLM assistance is more promising. Both development-selected policies route 30% of records to the encoder-assisted LLM, yielding observed gains of 1.02 points on SentiCoref (interval includes zero) and 1.71 on NewsMTSC, at substantially different inference costs.

Figures & tables

Appendix figures & tables30 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. QuadAI at SemEval-2026 Task 3: Ensemble Learning of Hybrid RoBERTa and LLMs for Dimensional Aspect-Based Sentiment Analysis

    Mar 8, 2026A. J. W. de Vink, Filippos Karolos Ventirozos, Natalia Amat-Lefort +1Aspect-Based Sentiment AnalysisLanguage Model Ensembles

  2. Evaluating Escalation Signals for LLM Routing: Targets, Controls, and Five Ways to Fool Yourself

    Oct 5, 2026Ramin Pishehvar, Andrea Morandi, Mahesh ViswanathanLLM RoutingLanguage Model Cascading