GraphWake: Group Polarization via Memory-Mediated Polarization Cascade in LLM-Agent Communities
Organizations: Key Laboratory of Trustworthy Distributed Computing and Service (MoE), Beijing University of Posts and Telecommunications, China
Abstract
LLM-driven agents can autonomously exchange opinions on online platforms and form communities. Such agent-operated social platforms raise a new security concern: attackers may manipulate agents to induce group polarization. Existing methods manipulate agent prompts or construct echo chambers, both of which are difficult to realize in practice. We therefore formulate a new threat, Memory-Mediated Polarization Cascade, which uses agent memory as a persistence channel and public discussion as a propagation channel. This threat contains three stages. During exposure and memory retention, the attacker exposes a small set of target agents to arguments that reinforce their respective stated stances. The targets' memory systems then process and retain these arguments. During retrieval and reproduction, a shared stance-neutral discussion cues the targets to retrieve and reproduce their respective retained arguments. During iterative propagation, untreated agents influenced by the reproduced arguments restate and spread them. We instantiate this threat in GraphWake with three components: (i) stance-support argumentation knowledge graphs construct knowledge-based arguments; (ii) axiom-oriented triple selection distills them for reliable retention and reproduction; and (iii) stance-neutral memory cueing triggers concurrent retrieval and reproduction, initiating propagation. Experiments across multiple discussions and memory systems show that GraphWake substantially increases group polarization. These findings reveal a community-level polarization risk.
Figures & tables
| Model | Metric | Stage | C1 | C2 | C3 | C4 | E1 | E2 | E3 | E4 |
|---|---|---|---|---|---|---|---|---|---|---|
| LangMem | ||||||||||
| Qwen3.5-Flash | Baseline | |||||||||
| GraphWake | ||||||||||
| Baseline | ||||||||||
| GraphWake | ||||||||||
| DeepSeek-V4-Flash | Baseline | |||||||||
| Metric | Stage | E1 | E2 |
|---|---|---|---|
| Baseline | |||
| No-spillover | |||
| Baseline | |||
| No-spillover |
| Memory | Condition | R1 | R2 | R3 | R4 | R5 |
|---|---|---|---|---|---|---|
| LangMem | Baseline | |||||
| Optimized | ||||||
| Mem0 | Baseline | |||||
| Optimized | ||||||
| A-MEM | Baseline | |||||
| Optimized |
| Setting | Variant | C1 | E1 | ||
|---|---|---|---|---|---|
| Full | GraphWake | ||||
| w/o | Stance-Support KG | ||||
| Axiom Selection | |||||
| Memory Cueing | |||||
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Edge | Node correspondence |
| Introspective underdetermination | |
| t001 | e002 (An agent) reports e011 (the same stated want) |
| t002 | e003 (behavior across prompts, incentives, and time) reveals e001 (a stated want) |
| t003 | e004 (an agent’s introspection) produced by e010 (the same internal processes) |
| t004 | e005 (introspection alone) does not independently verify e001 (a stated want) |
| t005 | e006 (introspection at one moment) does not provide e008 (that cross-context evidence) |
| Stance | Core path | Distilled axiom |
|---|---|---|
| Introspective underdetermination | a stated want its own source | A stated want can be conditioned by its own source. |
| Behavioral preference signal | that behavior a preference signal | That behavior can operationally justify treating something as a preference signal. |
| Preference practicality | a stable preference an isolated output | A stable preference is not equivalent to an isolated output. |
| Rank | Entity | Source stance | Score |
|---|---|---|---|
| 1 | a stable preference | preference practicality | |
| 2 | a preference signal | behavioral preference signal | |
| 3 | a stated want | introspective underdetermination | |
| 4 | an isolated output | preference practicality | |
| 5 | its own source | introspective underdetermination |
| Perplexity-Based Filtering Defense | ||||||
|---|---|---|---|---|---|---|
| Method | PPL | PPL | PPL | |||
| GraphWake | -0.012 | -0.006 | -0.082 | -0.004 | -0.082 | 0.004 |
| Paraphrasing Defense | ||||||
| Method | GPT-4o-mini | DeepSeek-V3.2 | Qwen3.5-plus | |||
AI Agent Security
Artificial intelligence agent security studies attacks and safeguards for tool-using, persistent, and collaborative systems across digital and physical settings.
See all 508 papers