Improving Neural Argumentative Stance Classification in Controversial Topics with Emotion-Lexicon Features
Authors: Mohammad Yeghaneh Abkenar, Weixing Wang, Manfred Stede, Davide Picca, Mark A. Finlayson, Panagiotis Ioannidis
Organizations: Innovations Department, Bundesdruckerei GmbH, Berlin, Germany · Department of Linguistics, University of Potsdam, Germany · Hasso-Plattner-Institut, University of Potsdam, Germany · University of Lausanne, Switzerland · Knight Foundation School of Computing & Information Sciences, Florida International University, USA · Pisquared, Germany
Argumentation mining comprises several subtasks, among which stance classification focuses on identifying the standpoint expressed in an argumentative text toward a specific target topic. While arguments-especially about controversial topics-often appeal to emotions, most prior work has not systematically incorporated explicit, fine-grained emotion analysis to improve performance on this task. In particular, prior research on stance classification has predominantly utilized non-argumentative texts and has been restricted to specific domains or topics, limiting generalizability. We work on five datasets from diverse domains encompassing a range of controversial topics and present an approach for expanding the Bias-Corrected NRC Emotion Lexicon using DistilBERT embeddings, which we feed into a Neural Argumentative Stance Classification model. Our method systematically expands the emotion lexicon through contextualized embeddings to identify emotionally charged terms not previously captured in the lexicon. Our expanded NRC lexicon (eNRC) improves over the baseline across all five datasets (up to +6.2 percentage points in F1 score), outperforms the original NRC on four datasets (up to +3.0), and surpasses the LLM-based approach on nearly all corpora. We provide all resources-including eNRC, the adapted corpora, and model architecture-to enable other researchers to build upon our work.
Figures & tables
Figure 1: An example with five segments from the Argumentative Microtext corpus (Part 1), showing stance labels (For or Against) toward a controversial target topic.
Figure 2: Trimodal similarity distributions across emotion categories in the original NRC lexicon.
Figure 3: Three-cluster structure of NRC word embeddings in PCA-reduced space
Figure 4: Aligned similarity distributions after cluster-based normalization.
Figure 5: Analysis of lexicon expansion under varying similarity thresholds.
Corpora
Full Name
Domain
Size
Argument Types
Stance Labels
#Topics
Average #Tokens
AMT1
Microtext Corpus 1
Short argumentative texts
112 texts, 576 segments (ADUs)
Premise, Claim
Pro/Opp
19
14
AMT2
Microtext Corpus 2
Short argumentative texts
116 texts, 614 segments (ADUs)
Premise, Claim
Pro/Opp
34
13
PE
Persuasive Essays
Student essays
402 essays, 7,116 segments(ADUs), (1506 used)
Premise, Claim, Major Claim
For/Against
402
16
IBM
IBM Debater Claim Stance
Debate arguments
2,394 segments
Claim
Pro/Con
55
12
UKP
UKP Sentential Argument Mining
Web discourse
25,492 segments
Argumentative segment
For/Against/No
8
24
Table 1: Overview of original datasets before preprocessing and conversion. Actual subset sizes used in experiments are indicated where applicable.
Figure 6: Distribution of stance labels in the preprocessed corpora.
Figure 7: Illustration of the NASCA model. The Topic and Arg. are composed into a single prompt and fed into the BERT model. Arg. stands for Argumentative segment.
IBM
UKP
PE
AMT1+2
MajC
35.6
35.7
44.9
45.3
Qwen2.5-7B
36.2
30.7
38.9
62.3
noNRC
64.7
67.3
56.9
64.1
NRC
64.8
65.4
60.3
63.4
eNRC
65.9 †
68.4 †
62.9
68.5
Table 2: Comparison of eNRC with other methods, majority class baseline (MajC), and Qwen2.5-7B on our corpora. We report the macro F1 scores as the evaluation metric.
Figure 8: Threshold analysis of eNRC. We report the macro F1 scores using eNRC features with different thresholds.
Figure 9: Performance improvements after unfreezing the BERT model. We report the change in macro F1 score.
In computational argumentation, obtaining arguments that explicitly support or attack given claims is a critical precursor to downstream reasoning tasks. When these supporting and attacking arguments are to be retrieved using semantic search methods, they need to be assessed for topic-relevance to the claims of interest as well as for correctness of their (positive or negative) stance towards the claims. In this paper we explore how dense embedding models (hereafter, models), powering modern retrieval pipelines, can serve as the basis of semantic search incorporating this dual assessment. We show experimentally that existing models struggle with asymmetric reasoning, exhibiting a strong bias toward topical overlap while ignoring instructional stance. We also show that correcting this bias via contrastive training triggers a new failure mode where models over-correct, over-fixating on polarity keywords (e.g., "supports" or "refutes") at the expense of the semantic topic. We thus introduce diagnostic word-ablation metrics to quantify this phenomenon and propose a data-centric solution. By implementing a balanced argument curriculum alongside LLM-augmented, stance-inverted arguments, we force the (embedding) models to learn deeper directional logic rather than exploiting superficial lexical shortcuts. Our evaluation demonstrates that, for sufficiently powerful models, this approach can alleviate the observed overcorrection, achieving further improvements in stance-aware argument retrieval.
Angelo Sparacino, Francesca Toni, Adam Dejl
Department of Computing, Imperial College London, UK
Argument mining and stance detection are central to understanding how opinions are formed and contested in online discourse. However, most publicly available resources focus on mainstream platforms such as Twitter and Reddit, leaving conversational structure on alt-tech platforms comparatively under-studied. We introduce TruthStance, a large-scale dataset of Truth Social conversation threads spanning 2023-2025, consisting of 24,378 posts and 523,360 comments with reply-tree structure preserved. We provide a human-annotated benchmark of 1,500 instances across argument mining and claim-based stance detection, including inter-annotator agreement, and use it to evaluate large language model (LLM) prompting strategies. Using the best-performing configuration, we release additional LLM-generated labels for 24,352 posts (argument presence) and 107,873 comments (stance to parent), enabling analysis of stance and argumentation patterns across depth, topics, and users. All code and data are released publicly.
Argument Mining (AM) is a critical NLP task that remains significantly under-resourced in Arabic. This paper presents \testttSTAR−Ar, a BERT-BiLSTM-CRF architecture for argument discourse detection and classification, as our system for Daleel 2026, the inaugural Arabic argument mining shared task. The task requires the identification and classification of argumentative discourse units (ADUs) in debate and editorial texts.We jointly model these two objectives as a token-level sequence labeling task using a BERT-BiLSTM-CRF architecture that combines contextual transformer embeddings with structural transition constraints to support accurate span detection. \testttSTAR−Ar achieves an F1-score of 72.69 on validation and 73.7 on test data. Our domain-specific analysis shows that models trained exclusively on editorials underperform those trained on debates, a disparity we primarily attribute to the smaller size of the editorial dataset. The code for \testttSTAR−Ar is available at [\faGithubTTLabatDaleel2026](https://github.com/ENTAILab/daleel2026Arabic−Argumentative−Discourse−Mining)
Bhuvanesh Verma, Ali Abusaleh, Alexander Mehler
Text Technology Lab (TTLab), Goethe University Frankfurt