CSTS: A Canonical Security Telemetry Substrate for AI-Native Cyber Detection
Abstract
Cybersecurity data remains fragmented across vendors, formats, schemas, and deployment environments, forcing AI and analytics programs to spend disproportionate effort on ingestion, normalization, and brittle source-specific engineering. This paper introduces the Canonical Security Telemetry Substrate (CSTS), a canonical, AI-ready telemetry foundation designed to harmonize heterogeneous cyber data into a common representation over persistent entities, typed relations, events, temporal state, and provenance. CSTS is intended to move cybersecurity analytics beyond ad hoc record normalization toward a reusable substrate that supports anomaly detection, graph learning, forecasting, behavior-based modeling, and agentic cyber AI. We formalize the core design principles of CSTS, define its representational components, and explain how it preserves source-specific nuance through explicit mappings and extensible metadata while still enabling portable downstream inference. We further position CSTS as a cloud-agnostic and deployment-agnostic substrate suitable for on-prem, hybrid, and multi-cloud environments. The result is a unifying telemetry model that reduces the blue-collar burden of cyber data engineering and creates a clearer path to scalable, interoperable, and model-agnostic cyber AI.
Figures & tables
| Task | Setting | Method | [email protected] | Prec. | Rec. | AUROC | Best F1 |
| LM | EnvA EnvA | Baseline | 0.894 | 0.840 | 0.955 | 0.955 | 0.894 |
| LM | EnvA EnvB | Baseline | 0.135 | 0.079 | 0.457 | 0.660 | 0.182 |
| LM | EnvA EnvA | CSTS | 0.378 | 0.236 | 0.955 | 0.772 | 0.382 |
| LM | EnvA EnvB | CSTS | 0.508 | 0.941 | 0.348 | 0.991 | 0.821 |
| Task | Level | Method | [email protected] | AUROC | Best F1 |
| LM | P0 | Baseline | 0.135 | 0.660 | 0.182 |
| LM | P1 | Baseline | 0.000 | 0.000 | 0.000 |
| LM | P2 | Baseline | 0.000 | 0.000 | 0.000 |
| LM | P3 | Baseline | 0.000 | 0.000 | 0.000 |
| LM | P0 | CSTS | 0.316 | 0.690 | 0.356 |
| LM | P1 | CSTS | 0.233 | 0.664 | 0.337 |
| Task | Setting | Method | [email protected] | Prec. | Rec. | AUROC | Best F1 | Best Thr. | Train+ | Train- | Test+ | Test- | AUROC CI Low | AUROC CI High | F1 CI Low | F1 CI High |
| LM | EnvA EnvA | Baseline | 0.000 | 0.000 | 0.000 | 0.316 | 0.000 | 0.05 | 4 | 87 | 1 | 38 | 0.189 | 0.500 | 0.000 | 0.000 |
| LM | EnvA EnvB | Baseline | 0.000 | 0.000 | 0.000 | 0.640 | 0.041 | 0.05 | 5 | 125 | 1 | 125 | 0.500 | 0.726 | 0.000 | 0.000 |
| LM | EnvA EnvA | CSTS | 0.000 | 0.000 | 0.000 | 0.203 | 0.000 | 0.05 | 7 | 53 | 3 | 23 | 0.000 | 0.500 | 0.000 | 0.000 |
| LM | EnvA EnvB | CSTS | 0.000 | 0.000 | 0.000 | 0.218 | 0.063 | 0.10 | 10 | 76 | 3 | 58 | 0.000 | 0.600 | 0.000 | 0.000 |
| Task | Level | Method | [email protected] | AUROC | Best F1 | Best Thr. | Train+ | Train- | Test+ | Test- |
| LM | P0 | Baseline | 0.000 | 0.640 | 0.041 | 0.05 | 5 | 125 | 1 | 125 |
| LM | P1 | Baseline | 0.000 | 0.000 | 0.000 | 0.50 | 0 | 0 | 0 | 0 |
| LM | P2 | Baseline | 0.000 | 0.000 | 0.000 | 0.50 | 0 | 0 | 0 | 0 |
| LM | P3 | Baseline | 0.000 | 0.000 | 0.000 | 0.50 | 0 | 0 | 0 | 0 |
| LM | P0 | CSTS | 0.000 | 0.218 | 0.063 | 0.10 | 10 | 76 | 3 | 58 |
| LM | P1 | CSTS | 0.000 | 0.218 | 0.063 | 0.10 | 10 | 76 | 3 | 58 |
| Task | Setting | Method | [email protected] | Prec. | Rec. | AUROC | Best F1 | Best Thr. | Train+ | Train- | Test+ | Test- | AUROC CI Low | AUROC CI High | F1 CI Low | F1 CI High |
| LM | EnvA EnvA | Baseline | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.50 | 0 | 0 | 0 | 0 | 0.000 | 0.000 | 0.000 | 0.000 |
| LM | EnvA EnvB | Baseline | 0.057 | 0.029 | 1.000 | 0.864 | 0.093 | 0.85 | 1 | 14 | 2 | 143 | 0.500 | 0.993 | 0.000 | 0.136 |
| LM | EnvA EnvA | CSTS | 0.000 | 0.000 | 0.000 | 0.500 | 0.000 | 0.05 | 1 | 3 | 0 | 3 | 0.500 | 0.500 | 0.000 | 0.000 |
| LM | EnvA EnvB | CSTS | 0.154 | 0.085 | 0.800 | 0.738 | 0.178 | 0.95 | 1 | 6 | 5 | 103 | 0.362 | 0.926 | 0.038 | 0.296 |
| Task | Level | Method | [email protected] | AUROC | Best F1 | Best Thr. | Train+ | Train- | Test+ | Test- |
| LM | P0 | Baseline | 0.057 | 0.864 | 0.093 | 0.85 | 1 | 14 | 2 | 143 |
| LM | P1 | Baseline | 0.000 | 0.000 | 0.000 | 0.50 | 0 | 0 | 0 | 0 |
| LM | P2 | Baseline | 0.000 | 0.000 | 0.000 | 0.50 | 0 | 0 | 0 | 0 |
| LM | P3 | Baseline | 0.000 | 0.000 | 0.000 | 0.50 | 0 | 0 | 0 | 0 |
| LM | P0 | CSTS | 0.154 | 0.738 | 0.178 | 0.95 | 1 | 6 | 5 | 103 |
| LM | P1 | CSTS | 0.154 | 0.738 | 0.178 | 0.95 | 1 | 6 | 5 | 103 |
| Quantity | CADETS (train) | TRACE (test) |
| Window minutes ( ) | 30 | |
| Quantile ( ) | 0.40 | |
| Number of windows ( ) | 181 | 16 |
| Windows above train threshold | 74 | 0 |
| Train-only threshold ( ) | 3.972 | |
| Score median (p50) | 3.812 | 3.678 |
| Task | Setting | Method | [email protected] | Prec. | Rec. | AUROC | Best F1 |
| ZDT | EnvA EnvA | Baseline | 0.217 | 0.131 | 0.640 | 0.728 | 0.315 |
| ZDT | EnvA EnvB | Baseline | 0.170 | 0.105 | 0.447 | 0.593 | 0.205 |
| ZDT | EnvA EnvA | CSTS | 0.145 | 0.081 | 0.719 | 0.520 | 0.151 |
| ZDT | EnvA EnvB | CSTS | 0.118 | 0.064 | 0.765 | 0.459 | 0.125 |
Cybersecurity
Cybersecurity develops methods to protect digital and cyber-physical systems from attacks, vulnerabilities, data loss, and misuse.
See all 354 papers