cs.CLNov 8, 2026

Continuous modeling of manipulative participation for stance analysis: Online discourse on the 2024 Street Animal Law in Türkiye

Authors: Ulya Bayram, Ebru Belkıs Güzeloğlu, Emel Kuşku Özdemir, Elif Üstündağlı Erten, Öyküm Esra Yiğit

Organizations: Department of Electrical and Electronics Engineering, Faculty of Engineering, C¸ anakkale Onsekiz Mart University, C¸ anakkale, 17110, Türkiye · Department of Public Relations and Publicity, Faculty of Communication, Ege University, Izmir, 35100, Türkiye · Department of Media and Communication, Faculty of Communication, Ege University, Izmir, 35100, Türkiye · Department of Business Administration, Faculty of Economics and Administrative Sciences, Ege University, Izmir, 35100, Türkiye · 

Abstract

Studies of online political discourse commonly infer public opinion through stance analysis while implicitly assuming that observed user participation is authentic. Meanwhile, studies focusing on detecting manipulative participation are typically modeling it as a binary phenomenon, overlooking the varying degrees to which users may engage in coordinated or inauthentic behavior. This study proposes a continuous modeling approach for manipulative participation and examines its integration with stance analysis. Using online discourse on the 2024 Street Animal Law in Türkiye as a case study, we collected a dataset comprising 7,320,574 tweets from 537,994 users. From this corpus, 301 users were selected through a high-information sampling strategy and manually annotated by domain experts using a 10-criterion rubric that yields user-level continuous manipulative participation scores. Evaluation under a unified user-level cross-validation protocol showed that the proposed framework accurately estimates both manipulative participation and user stance, with gradient boosting methods providing the best manipulative participation estimates and BERTurk achieving the highest stance classification performance. External validation on an independently annotated user set demonstrated good generalization performance. The findings support modeling manipulative participation as a continuous construct rather than a binary label, providing a more informative basis for computational analyses of the relationship between manipulative participation and stance in online political discourse.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

Oct 28, 2026

Author-Informed Stance Detection: A Dataset and Findings

Stance detection in social media is challenging, as interpreting a text often requires understanding the author's perspective. We re-frame political stance detection as an author-informed text understanding task, where it is desired to infer both the author's political leaning and their stance towards the target from the text. We first show that human annotators struggle to infer authors' political leanings and stances from individual tweets, and that pretrained large language models (LLMs) perform below human level in this setting. We then demonstrate that author context improves stance detection for both humans and LLMs, with particularly pronounced benefits for tweets perceived as sarcastic. Through extensive experiments, we further show that LLMs can be effectively fine-tuned to predict authors' political affiliations, and that author-informed fine-tuning yields better stance detection performance than standard fine-tuning. This approach not only surpasses human performance but also improves generalization across datasets. To support further research on author-informed political stance detection, we release a large dataset of stance-labeled tweets enriched with author-context information.
Oct 15, 2026

Political Narratives in the 2024 Moldovan Presidential Election: Stance, Amplification, and Influence

Social media platforms play a central role in shaping political discourse during elections, particularly in geopolitically contested regions. We study how political narratives emerged, aligned, and propagated during the 2024 Moldovan presidential election by analyzing publicly available posts collected from X, Facebook, and Reddit between August and October 2024. Combining multilingual stance detection, coordination analysis, and causal inference, we examine both descriptive and causal mechanisms underlying online political discourse. First, we apply large language models to classify stance toward European integration, Russia, and the two main presidential candidates, revealing clear cross-platform and cross-linguistic differences in how political positions are expressed. Second, we construct retweet-based and semantic alignment networks on X to identify amplification and aligned framing of dominating narratives. Finally, we use a proximal causal inference framework to estimate peer influence effects in stance formation. Our results indicate consistently positive and statistically significant average treatment effects across major stance categories. These findings provide evidence that amplification and peer exposure contribute to the reinforcement of political narratives online. This work offers the first analysis of social media discourse surrounding the 2024 Moldovan presidential election and demonstrates the value of integrating language-based annotation, network analysis, and causal inference for studying political influence in multilingual and geopolitically sensitive contexts.
Oct 2, 2026

StanceEval 2026: The Second Stance Detection Shared Task

StanceEval 2026 is the second edition of the StanceEval shared task series on stance detection in Arabic social media text. Stance detection aims to identify a writer's stance toward a given topic. Given a tweet and a target, participating systems must determine whether the writer's stance is Favor, Against, or None. This edition focuses on cross-target generalization across two distinct evaluation tracks: Track 1 evaluates thematically related cross-target transfer (testing on Women Driving, related to Women Empowerment from training data), while Track 2 evaluates cross-domain transfer to completely unseen targets (E-Cars and Trimester System). The shared task attracted 80 registered teams from 12 countries. During the evaluation phase, 30 unique teams submitted entries, with 21 teams officially ranked in Track 1 and 13 in Track 2 following validation filtering, and 20 teams submitting system-description papers. Participating teams employed diverse methodologies, including fine-tuned pretrained language models, prompt-based and retrieval-augmented large language models (LLMs), fine-tuned LLMs, and hybrid cascades. Top systems achieved impressive Favg2F_{avg2} scores of 0.8994 on Track 1 and 0.9400 on Track 2, substantially outperforming the strongest baselines (0.7366 and 0.7475, respectively), where Favg2F_{avg2} denotes the macro-averaged F1 score over the Favor and Against classes. Counterintuitively, performance on the unseen targets was higher than on the related target, a disparity could be driven by extreme target polarization, class imbalance, and dialectal or sarcastic nuance across topics.