Measuring the Semantic Structure and Evolution of Conspiracy Theories
Organizations: University of Iowa, Iowa City
Abstract
Research on conspiracy theories has largely focused on belief formation, exposure, and diffusion, while paying less attention to how their meanings change over time. This gap persists partly because conspiracy-related terms are often treated as stable lexical markers, making it difficult to separate genuine semantic changes from surface-level vocabulary changes. In this paper, we measure the semantic structure and evolution of conspiracy theories in online political discourse. Using 169.9M comments from Reddit's r/politics subreddit spanning 2012--2022, we first demonstrate that conspiracy-related language forms coherent and semantically distinguishable regions of language space, allowing conspiracy theories to be treated as semantic objects. We then track how these objects evolve over time using aligned word embeddings, enabling comparisons of semantic neighborhoods across periods. Our analysis reveals that conspiracy theories evolve non-uniformly, exhibiting patterns of semantic stability, expansion, contraction, and replacement that are not captured by keyword-based approaches alone.
Figures & tables
| Category | Concept Label | Conspiracy Description |
| [ samples from semantic neighborhood ] | ||
| Staged Violence | Crisis actor | Victims and survivors of violent events are hired actors. |
| [ hoaxer, paid actor ] | ||
| False flag | Acts committed with the intent to pin blame on another party. | |
| [ Soros paid, inside job ] | ||
| Sandy Hook | The school shooting was staged to advance gun control. |
| Level 1 | Level 2 | Level 3 | |
| (Closest) | (Farthest) | ||
| Average accuracy across all annotators | |||
| Accuracy (%) | 60.8% | 70.4% | 72.9% |
| Bootstrap comparisons computed relative to Level 3 (farthest) | |||
| -12.6% | -4.0% | – | |
| 95% CI ΔL3 | [ , ] | [ , ] | – |
| Pattern | HAD | CSD | NCD | LO |
| Sem. Stability | Low | Low | Low | High |
| Sem. Narrowing | High | Low | Low | |
| Sem. Replacement | High | High | ||
| Sem. (De)fragmentation | High | High | ||
| Lex. Replacement | Low | Low | Low | Low |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Concept | Words per Level | Sample Words Removed |
| sandy_hook | [10264, 252, 41, 30 ] | accidentally_shot, james_holmes, jared_loughner, shooting_since |
| chemtrails | [10418, 460, 294, 278 ] | canola, cask, coral_reef, fished, lead_based, sprayed_roundup |
| crisis_actor | [4298, 26, 16 ] | audio_tape, feud, operation_chaos |
| birther | [4298, 69, 39 ] | bullshit_attack, called_romney, crazy_statement, mccain_pow, medium_went |
Semantic Change Detection
Semantic change detection identifies how meanings, concepts, or scene contents differ across time in text, images, and other data.
See all 62 papers