cs.CRSep 21, 2026

Reasoning Topology Matters: A Controlled Study of LLM-Based Cybersecurity Analysis

Authors: Jiling Zhou, Aisvarya Adeseye, Antti Hakkala, Seppo Virtanen, Jouni Isoaho

Organizations: Department of Computing University of Turku Turku, Finland

Abstract

Large Language Models (LLMs) are increasingly used in cybersecurity, where accurate analysis often requires multi-step and context-dependent reasoning over complex and heterogeneous data. However, existing prompting approaches typically focus on eliciting reasoning without explicitly considering how intermediate reasoning steps are structurally organized. We introduce Security Reasoning Topology, which models reasoning through three representative structures: Linear, Branching, and Graph. To evaluate their effects, we conduct controlled experiments on three cybersecurity datasets covering MITRE ATT&CK network traffic, cyber threat intelligence (CTI), and CVE vulnerability analysis. We evaluate multiple LLMs, including Llama 2 (7B, 13B, 70B), GPT-5.1, and Mistral Large 3, while keeping task inputs consistent and controlling reasoning structure through system-level prompting. Results show that reasoning topology substantially affects performance: Graph reasoning achieves the highest overall accuracy, improving over few-shot prompting by 9.8-12.2 percentage points across datasets, while Branching provides a strong intermediate solution. The results further show that the effect of reasoning topology remains consistent across model families and scales, highlighting reasoning topology as an important design factor for LLM-based cybersecurity analysis.

Figures & tables

Explore similar work

CardsList
  1. Structured but Fragile: On the Limits of LLMs in Cybersecurity Decision-Making

    Aug 21, 2026Pasquale Malacaria, Yunxiao ZhangLLMs for CybersecurityLLM Decision-Making

  2. Strengthening Human-Centric Chain-of-Thought Reasoning Integrity in LLMs via a Structured Prompt Framework

    Apr 6, 2026Jiling Zhou, Aisvarya Adeseye, Seppo Virtanen +2Structured PromptingCoT Reasoning

  3. Toward Cybersecurity-Expert Small Language Models

    Oct 15, 2025Matan Levi, Daniel Ohayon, Ariel Blobstein +3Cyber Threat IntelligenceCybersecurity