Driven by large language models (LLMs), social bot can autonomously engage in local interactions, whose human-like behaviors enable them to evade social bot detection. However, while these botnets exhibit realistic local social interactions, they fail to preserve human-like social network. This is because LLM-based bots are graph-unaware and cannot coordinate over global interactions, which makes those botnets vulnerable to graph neural network (GNN)-based detection. To address this limitation, we propose GraphMind, which equips LLM-driven social bots to explicitly learn and fit human-like social network structures. Building on this foundation, we further construct GraphMind-Botnet, a LLM-driven botnet designed to evaluate the performance of existing social bot detection algorithms. Experiments on datasets derived from GraphMind-Botnet show that both text-based and graph-based detection models show substantially degraded performance in distinguishing. Our results highlight the critical role of social link construction in LLM-driven social network generation, while exposing fundamental weaknesses in existing bot detection mechanisms.
Figures & tables
Figure 1: The comparation between existing LLM-driven social bot and GraphMind (ours). Our botnet resembles more human-like social networks, leading to significantly improved evasion performance against GNN-based detection.
Figure 2: Overview of the framework. (Left) GraphMind Framework, where two modules are employed to enable LLMs to generate diverse, strength-aware interactions and to construct multi-hop follow chains, thereby mitigating isolated nodes. (Right) Botnet simulation, in which GraphMind social bots autonomously build human-like social networks, improving structural realism and enhancing robustness against GNN-based detection methods.
Figure 3: Structural property analysis of different network
Figure 4: Degree distributions
Figure 5: Network visualizations comparing human and bot follow networks across different datasets.
Methods
S-HGN
BotRGCN
RGT
Acc
F1
Acc
F1
Acc
F1
All
Qwen3-1.7B
70.7
60.5
72.4
67.6
73.5
65.8
Qwen3-8B
69.1
68.4
70.5
62.6
69.6
65.3
w/o FIM
Qwen3-1.7B
78.9
69.5
79.8
74.2
80.5
73.1
Table 3: Ablation Study of GraphMind Modules on Detection Evasion (%).
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
Level
Definition
Level 1 (Support clique)
Strongest ties;
frequent contact
Level 2 (Sympathy group)
Close ties; frequent but
not weekly contact
Level 3 (Affinity group)
Casual ties;
occasional contact
Appendix
Table 4: Relationship Circle Definitions
Figure 6: Loss function of FIM
Hyperparameter
Value
Optimizer
AdamW
Learning rate
5×10−5
Training epochs
5
LR scheduler
Cosine
Warmup steps
100
Random seed
42
Appendix
Table 5: Key hyperparameters used for FIM.
Figure 7: Loss function of GSI
Hyperparameter
Value
Optimizer
AdamW
Learning rate
5×10−5
Training epochs
5
LR scheduler
Cosine
Warmup steps
100
Random seed
42
Appendix
Table 6: Key hyperparameters used for GSI.
Field
Content
Instruction
You are an expert in social media behavior analysis. Your task is to infer the social relationship level between two users from an ego-network perspective, and then generate a list of interaction actions that follow realistic behavioral patterns. Follow the steps below: Step 1: Infer the most plausible social relationship level within the ego network. Step 2: Based on the inferred relationship strength, determine the expected interaction intensity and cost.
Input
<user_profile> : {PROFILE} <tweets> : {TWEETS}
Think
The target user belongs to my ego network with relationship level {RELATIONSHIP_LEVEL}. Based on this relationship strength and the observed profile and interaction context, I infer appropriate interaction intensity and engagement patterns.
Output
A list of interaction actions in the following structured format: <action> <type> like / retweet / comment / follow </type> <tweet_id> {TWEET_ID} </tweet_id>
Appendix
Table 7: Prompt template used for FIM.
Field
Content
Instruction
You are an expert in social media behavior analysis. Given a source node and a target node, generate a multi-hop following path based on the input social network structure. First, select a set of potential intermediate nodes {n} from the given network, and then predict and generate potential social links according to their profile information. Follow the steps below: Step 1: Select candidate intermediate nodes from the input graph based on profile similarity to the source node. Step 2: Sequentially infer plausible following relationships between adjacent nodes to form a multi-hop path. Requirements: 1. The path must contain ≥3 hops (Source → Mediator 1 → Mediator 2 → Target). 2. All mediator nodes must be selected from the given network information. 3. Path inference must be based on feature similarities (bio, age, education, location, etc.). 4. The connection rationale must be analyzed for each hop.
Based on the analysis of user profiles and social relationships, the most plausible multi-hop following path is: user_A → mediator_1 → mediator_2 → user_B .
Appendix
Table 8: Prompt template used for GSI.
Figure 8: Botnet visualization of Twibot-20.
Figure 9: Human network visualization of Twibot-20.
Large Language Model-driven (LLM-driven) social bots pose a growing threat to online discourse by generating human-like content that evades conventional detection. Existing methods suffer from limited detection accuracy due to overreliance on single-modality signals, insufficient sensitivity to the specific generative patterns of Artificial Intelligence-Generated Content (AIGC), and a failure to adequately model the interplay between linguistic patterns and behavioral dynamics. To address these limitations, we propose TRACE-Bot, a unified dual-channel framework that jointly models implicit semantic representations and AIGC-enhanced behavioral patterns. TRACE-Bot constructs fine-grained representations from heterogeneous sources, including personal information data, interaction behavior data and tweet data. A dual-channel architecture captures linguistic representations via a pretrained language model and behavioral irregularities via multidimensional activity features augmented with signals from state-of-the-art (SOTA) AIGC detectors. The fused representations are then classified through a lightweight prediction head. Experiments on two public LLM-driven social bot datasets demonstrate SOTA performance, achieving accuracies of 98.46% and 97.50%, respectively. The results further indicate strong robustness against advanced bot strategies, highlighting the effectiveness of jointly leveraging implicit semantic representations and AIGC-enhanced behavioral patterns for emerging LLM-driven social bot detection.
Zhongbo Wang, Zhiyu Lin, Zhu Wang +1
School of Cyber Science and Engineering, Sichuan University, Sichuan 610207, China · School of Software and Microelectronics, Peking University, Beijing 102600, China · College of Computer Science, Sichuan University, Sichuan 610065, China +1
Social bot detection is essential for protecting online platforms from misinformation amplification, coordinated manipulation, and distorted public discourse. However, large language models have made social bots much harder to detect from text alone because semantic camouflage is now cheap, fluent, and scalable. The resulting challenge is modality conflict: an account may look human-like in semantics while remaining suspicious in graph structure, profile attributes, or cross-modal consistency. Recent graph-based detectors tackle this limitation by adding graph-side complexity, such as sparse prototype selection, adaptive gating, or architecture-specific control logic, yet our experiments suggest that complexity alone is not the most reliable way to resolve such conflict. We therefore propose CSC, a calibrated-simplicity framework for conflict-aware LLM-era social bot detection. The framework combines three design choices: a simplified prototype-guided graph expert that retains useful structural biases while removing unstable graph-side heuristics, calibrated simplex-constrained fusion that aligns heterogeneous confidence spaces before late fusion, and a lightweight inconsistency expert that models cross-modal disagreement. Experiments on TwiBot-22, TwiBot-20, and MGStBot-large show that CSC improves calibrated operating-point decision quality while remaining competitive across external benchmarks. Further analyses show that calibration improves confidence reliability, the inconsistency expert mainly provides localized corrections in high-conflict or near-threshold regions, and simplified graph-side control yields a better stability-cost trade-off. A targeted semantic-camouflage stress test further shows that replacing selected bot text with matched human text sharply degrades the standalone text expert while leaving graph and fused evidence stable on a balanced challenge set.
Yipeng Qian, Pengjie Zhao, Chaoxi Niu
Minzu University of China Beijing, China · City University of Macau Macau, China
Social bot detection is pivotal for safeguarding the integrity of online information ecosystems. Although recent graph neural network (GNN) solutions achieve strong results, they remain hindered by two practical challenges: (i) severe class imbalance arising from the high cost of generating bots, and (ii) topological noise introduced by bots that skillfully mimic human behavior and forge deceptive links. We propose the Reinforcement-guided graph Augmentation social Bot detector (RABot), a multi-granularity graph-augmentation framework that addresses both issues in a unified manner. RABot employs a neighborhood-aware oversampling strategy that linearly interpolates minority-class embeddings within local subgraphs, thereby stabilizing the decision boundary under low-resource regimes. Concurrently, a reinforcement-learning-driven edge-filtering module combines similarity-based edge features with adaptive threshold optimization to excise spurious interactions during message passing, yielding a cleaner topology. Extensive experiments on three real-world benchmarks and four GNN backbones demonstrate that RABot consistently surpasses state-of-the-art baselines. In addition, since its augmentation and filtering modules are orthogonal to the underlying architecture, RABot can be seamlessly integrated into existing GNN pipelines to boost performance with minimal overhead.
Longlong Zhang, Xi Wang, Haotong Du +3
School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University · Shenzhen Research Institute, Northwestern Polytechnical University · School of Automation Science and Engineering, Xi’an Jiaotong University +1