Reliable News or Propagandist News? A Neurosymbolic Model Using Genre, Topic, and Persuasion Techniques to Improve Robustness in Classification
Organizations: Airbus Defence and Space, France · Université Paris-Saclay, CentraleSupélec, MICS, France · LIP6, Sorbonne Université, CNRS, France · Université de Rennes, CNRS, Inria, IRISA, France ·
Abstract
Among news disorders, propagandist news are particularly insidious, because they tend to mix oriented messages with factual reports intended to look like reliable news. To detect propaganda, extant approaches based on Language Models such as BERT are promising but often overfit their training datasets, due to biases in data collection. To enhance classification robustness and improve generalization to new sources, we propose a neurosymbolic approach combining non-contextual text embeddings (fastText) with symbolic conceptual features such as genre, topic, and persuasion techniques. Results show improvements over equivalent text-only methods, and ablation studies as well as explainability analyses confirm the benefits of the added features. Keywords: Information disorder, Fake news, Propaganda, Classification, Topic modeling, Hybrid method, Neurosymbolic model, Ablation, Robustness
Figures & tables
| Sources | Train | Validation | Test |
| MAINSTREAM | APNews | CNN USA Today Forbes Fox News | CBSNews |
| The Guardian | NBC News NYTimes Washington Post | Daily Mail | |
| PPN | RRN | TribunalUkraine War on Fakes | |
| Random | Sources | Political | Credibility | |||||
|---|---|---|---|---|---|---|---|---|
| Method | Acc. | F1 | Acc. | F1 | Acc. | F1 | Acc. | F1 |
| Hybrid | 78.08 | 87.5 | 79.45 | 88.37 | 69.86 | 81.66 | 79.45 | 86.95 |
| Hybrid Lite | 79.45 | 88.54 | 34.24 | 31.42 | 67.12 | 79.66 | 56.16 | 69.81 |
| Text Only | 79.45 | 88.54 | 20.54 | 0.0 | 79.45 | 88.54 | 20.54 | 0.0 |
Fake News Detection
Fake news detection identifies false or misleading claims by analyzing content, context, evidence, and how information spreads.
See all 98 papers