Reliable News or Propagandist News? A Neurosymbolic Model Using Genre, Topic, and Persuasion Techniques to Improve Robustness in Classification
Authors: Géraud Faye, Benjamin Icard, Morgane Casanova, Guillaume Gadek, Guillaume Gravier, Wassila Ouerdane, Céline Hudelot, Sylvain Gatepaille, Paul Égré
Organizations: Airbus Defence and Space, France · Université Paris-Saclay, CentraleSupélec, MICS, France · LIP6, Sorbonne Université, CNRS, France · Université de Rennes, CNRS, Inria, IRISA, France · IRL Crossing, CNRS, Australia
Among news disorders, propagandist news are particularly insidious, because they tend to mix oriented messages with factual reports intended to look like reliable news. To detect propaganda, extant approaches based on Language Models such as BERT are promising but often overfit their training datasets, due to biases in data collection. To enhance classification robustness and improve generalization to new sources, we propose a neurosymbolic approach combining non-contextual text embeddings (fastText) with symbolic conceptual features such as genre, topic, and persuasion techniques. Results show improvements over equivalent text-only methods, and ablation studies as well as explainability analyses confirm the benefits of the added features. Keywords: Information disorder, Fake news, Propaganda, Classification, Topic modeling, Hybrid method, Neurosymbolic model, Ablation, Robustness
Figures & tables
Figure 1: News genre distribution on the two corpora.
Figure 2: Topic distribution on the two corpora.
Figure 3: Mean number of persuasion techniques by article, on the two corpora.
Figure 4: Our hybrid architecture, combining neural features and extracted concepts.
Sources
Train
Validation
Test
MAINSTREAM
APNews
CNN USA Today Forbes Fox News
CBSNews
The Guardian
NBC News NYTimes Washington Post
Daily Mail
PPN
RRN
TribunalUkraine War on Fakes
Table 1: News distribution in the Sources , Political , and Credibility splits.
Random
Sources
Political
Credibility
Method
Acc.
F1
Acc.
F1
Acc.
F1
Acc.
F1
Hybrid
78.08
87.5
79.45
88.37
69.86
81.66
79.45
86.95
Hybrid Lite
79.45
88.54
34.24
31.42
67.12
79.66
56.16
69.81
Text Only
79.45
88.54
20.54
0.0
79.45
88.54
20.54
0.0
Table 2: Results for propaganda detection with different data splits and different ablations.
Figure 5: Mean SHAP values for the Hybrid method depending on split.
Disinformation research has produced increasingly accurate automated fake-news detectors, but many systems remain difficult to interpret and are weakly connected to established theories of persuasion, credibility, and human judgment. In this paper, we develop a theory-informed computational framework that translates cross-disciplinary theories of fake news into measurable features for automated detection and explanation through statistical techniques and large language models. To that end, we conduct a structured cross-disciplinary review of theories from social sciences, psychology, economics, among other disciplines that reveal how fake news persuades and spreads, thereby establishing a broad theoretical foundation for computational modeling. Experiments on benchmark datasets show that theory-derived features are predictive and provide interpretable, theory-referenced diagnostic signals. Multi-feature models generally outperform individual features, although gains among the strongest small feature combinations are modest. Our work highlights the value of interdisciplinary perspectives in building robust and interpretable fake news detection systems, advancing the foundation for human-centered approaches in combating disinformation.
Zhaoyang Cao, Miriam Metzger, Reza Zafarani
Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY, USA · Department of Communication, University of California, Santa Barbara, Santa Barbara, CA, USA
Fake news generally refers to false information that is spread deliberately to deceive people, which has detrimental social effects. Existing fake news detection methods primarily learn the semantic features from news content or integrate structural features from propagation. However, in practical scenarios, due to the semantic ambiguity of informal language and unreliable user interactive behaviors on social media, there are inherent semantic and structural noises in news content and propagation. Although some recent works consider the effect of irrelevant user interactions in a hybrid-modeling way, they still suffer from the mutual interference between structural noise and semantic noise, leading to limited performance for robust detection. To alleviate this issue, this paper proposes a novel Propagation Structure-Semantic Transfer Learning framework (PSS-TL) for robust fake news detection under a teacher-student architecture. Specifically, we design dual teacher models to learn semantics knowledge and structure knowledge from noisy news content and propagation structure independently. Besides, we design a Multi-channel Knowledge Distillation (MKD) loss to enable the student model to acquire specialized knowledge from the teacher models, thereby avoiding mutual interference. Extensive experiments on two real-world datasets validate the effectiveness and robustness of our method.
Mengyang Chen, Lingwei Wei, Han Cao +3
Institute of Information Engineering, Chinese Academy of Sciences, Haidian District Beijing 100085, China · School of Cyber Security, University of Chinese Academy of Sciences, Huairou District Beijing 101408, China · State Key Laboratory of Communication Content Cognition, People’s Daily Online, Chaoyang District Beijing 100020, China
Propaganda detection in social media is challenging due to noisy, short texts and low annotation agreements. We introduce a new intent-focused taxonomy of propaganda techniques and compare it against an established, higher-agreement schema. Along three dimensions (model portfolio, schema effects, and prompting strategy) we evaluate the taxonomies as a classification task with the help of four language models (GPT-4.1-nano, Phi-4 14B, Qwen2.5-14B, Qwen3-14B). Our results show that fine-tuning is essential, since it transforms weak zero-shot baselines into competitive systems and reveals methodological differences that are hidden using base models. Across schemas, the Qwen models achieve the strongest overall performance, and Phi-4 14B consistently outperforms GPT-4.1-nano. Our hierarchical prompting method (HiPP), which predicts fine-grained techniques before aggregating them, is especially beneficial after fine-tuning and on the more ambiguous, low-agreement taxonomy, while remaining competitive on the simpler schema. The HQP dataset, annotated with the new intent-based labels, provides a richer lens on propaganda's strategic goals and a challenging benchmark for future work on robust, real-world detection.
Lukas Stähelin, Veronika Solopova, Max Upravitelev +6
Technische Universität Berlin, QU Lab, XplaiNLP Group, Berlin, Germany · German Research Center for Artificial Intelligence (DFKI), Berlin, Germany · Centre for European Research in Trusted AI (CERTAIN)