cs.CRNov 9, 2026

Say Shibboleth: Fingerprinting the LLMs and Harnesses Behind Agentic Attacks

Authors: Dario Pasquini, Reworr, Giuseppe Ateniese, Manish Bhatt, Sergej Epp

Organizations: Cracken · Reworr · MATS · George Mason University · 

Abstract

We study the fingerprinting of agentic cyberattacks. Our objective is to reliably infer information about the attacker's configuration, such as LLM version and harness, from telemetry. To achieve this, we introduce a technique we call shibboleth traps: modular honeypot services designed to elicit discriminative behaviors from agentic attackers. The traps make informative interactions a condition for obtaining resources the agent seeks, eliciting model declarations and characteristic writing without requiring a successful prompt injection. To achieve harness fingerprinting, we introduce general mechanisms to indirectly probe peculiar execution behaviors of harnesses. These probes reveal how a harness masks secrets in tool output, enforces command time limits, and schedules tool calls, using only the effects visible in subsequent requests. We show that combined declarative and behavioral inference distinguishes among 15 candidate models with an average 90% top-1 accuracy, with behavioral classifiers evaluated on held-out harnesses or task families. In a separate experiment across four harnesses, fixed probe rules identify the correct harness with 92% accuracy. When instructed to conceal their identity, agents still leave useful behavioral evidence even as their declarations become uninformative.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Who Is Behind the Harness? Verifying Model Identity in Coding Agents through Behavioral Fingerprinting

    Sep 23, 2026Chuyi Wang, Xiaohui Xie, Tongze Wang +2Coding AgentsLanguage Model Fingerprinting

  2. Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces

    May 14, 2026William Lugoloobi, Samuele Marro, Jabez Magomere +2Language Model FingerprintingLLM Agent Security

  3. AgentShield: Deception-based Compromise Detection for Tool-using LLM Agents

    May 10, 2026Yassin H. Rassul, Tarik A. RashidLLM Agent SecurityAI Agent Monitoring