Agent-Native Telemetry: Verifiable State-Delta Evidence for Autonomous Operations
Abstract
Operational telemetry is predominantly engineered for human reading: systems repeatedly serialize verbose prose, static keys, and redundant context across billions of log lines. As autonomous AI agents become primary operational consumers, feeding them traditional logs wastes scarce context capacity parsing lexical syntax rather than reasoning over system state changes -- all while lacking cryptographic guarantees of provenance or collection completeness. This paper introduces agent-native telemetry, an operational evidence architecture for autonomous machine operators founded on verifiable state deltas rather than human prose. We present the Agent Telemetry Protocol (ATP) and the State-Delta Evidence Ledger, an implementation that structures operational facts into four core evidence primitives (Transitions, Observations, Relations, and State Checkpoints) governed by content-addressed schemas, while isolating uncurated text as digest-verified opaque references. Producers sign and hash-chain batches for atomic collector append. Verified records feed two parallel agent access paths: a stateless protocol decoder emitting compact positional rows, and a stateful semantic gateway serving bounded graph capsules. We prove an information-preservation lower bound and formalize a ledger-relative verified negative theorem for provable event non-occurrence. On distributed microservice benchmarks (AIOpsLab and OpenTelemetry Astronomy Shop), ATP reduces raw wire payload and modeled cloud query scan costs by 96.4% relative to OpenTelemetry JSON, reduces LLM context tokens by 88.8% and query operations by 66.2%, detects all 500 tested adversarial storage mutations, and yields zero successful prompt injections across 50 adversarial trials per ATP configuration.
Figures & tables
| Layer | Concrete representation |
|---|---|
| 1. Schema | k8s.deployment.status:1.0.0; [old: Ready, new: Degraded, ready: 1, total: 3, reason: CrashLoop] |
| 2. Dict | schemas[0]=sha256:7f8a...; entities[0]="deploy/payments" |
| 3. Wire | 0x00 0x00 0x0A 0x00 0x00 0x01 0x0001 0x0003 0x01 (18 B) |
| 4. Decoder | # k8s.status: entity=deploy/payments, new=Degraded, ready=1/3, reason=CrashLoop |
| 5. Gateway | {"focus": "deploy/payments", "state": {"status": "Degraded", "ready": 1/3}, "active_invariants": ["replica_mismatch"], "causal": ["pod/pay-7d9b (CrashLoop)"], "coverage": "complete"} |
| 6. Human | “At 10:00:00Z, deployment ‘payments’ became Degraded (1/3 replicas) due to CrashLoop.” |
| Adversarial Action | Detection Mechanism & Guarantees |
|---|---|
| Payload bit flip / mutation | Merkle root or Ed25519 signature fails; batch rejected. |
| Batch reorder / splicing | ; verification halts. |
| Intermediate record omission | Sequence jump ; flagged as gap . |
| Suffix truncation | Sequence signed checkpoint; flagged as truncated . |
| Schema alteration | Manifest digest mismatch ; rejected. |
| Unmonitored code omission | Outside profile ; excluded from completeness scope. |
| Telemetry Representation | Raw Wire | zstd Wire | Storage | Ingestion Cost | Daily Scan Cost | Cost Ratio | Relative Change |
| (Bytes/Rec) | (Bytes/Rec) | (GB/Day) | ($/Month) | ( \rho_{\}0.005/GB) | ( \rho_{\}$ vs Config C) | vs Config C | |
| Config A (Unstructured Text Logs) | 38.42 | $576.30 | $0.192 | 0.750 | |||
| Config B (Standard Triad: Logs+Metrics+Traces) | 64.20 | $963.00 | $0.321 | 1.254 | |||
| Config C (Structured OTel JSON Events) | 51.24 | $768.60 | $0.256 | 1.000 | Baseline | ||
| OTLP Protobuf (gRPC Binary Envelope) | 14.86 | $222.90 | $0.074 | 0.290 | |||
| CLP (Compressed Log Codec) [ 1 ] | 4.21 | $63.15 | $0.021 | 0.082 |
| LLM Model | Configuration | Tokens / Incident ( ) | Token Ratio ( ) | Operations ( ) | TT-RCA Mean ( ) | Recall ( ) | F1-Score |
|---|---|---|---|---|---|---|---|
| Claude-3.5-Sonnet | Config A (Text Logs) | 1.412 (1.37, 1.45) | |||||
| Config B (Standard Triad) | 1.826 (1.78, 1.88) | ||||||
| Config C (OTel JSON) | 1.000 (Baseline) | ||||||
| Config D (ATP Stateless) | 0.335 (0.32, 0.35) | ||||||
| Config E (ATP Gateway) | 0.112 (0.10, 0.12) | ||||||
| GPT-4o | Config A (Text Logs) | 1.391 (1.35, 1.43) |
| Pipeline Operation | Latency / Core | Throughput / Core |
|---|---|---|
| Producer Record Serialization | / record | records/s |
| Producer Merkle Tree Generation | / record | records/s |
| Producer Ed25519 Batch Signing (256 rec) | / batch | records/s |
| Total Producer Work (Combined) | 0.266 / record | 3.76 M records/s |
| Collector Batch Verification (CPU Kernel) | / batch | records/s |
| Collector Atomic Append (Storage Commit) | / batch | records/s |
| System family | State-change model | Schema identity | Signed sequence | Externally retained head | Predicate-relative negative | Opaque separation | Dual agent access |
|---|---|---|---|---|---|---|---|
| OpenTelemetry Logs, Events, Weaver, Arrow [ 9 , 10 , 19 , 20 , 21 ] | A | A | – | – | – | – | – |
| CloudEvents, ECS, OCSF [ 22 , 4 , 23 ] | – | A | – | – | – | – | – |
| Compression & compressed-query [ 1 , 5 , 24 , 25 , 2 ] | – | – | – | – | – | – | – |
| Vector & semantic log indexing [ 12 , 11 ] | – | – | – | – | – | – | – |
| Agent-facing telemetry gateways [ 26 , 6 ] | – | – | – | – | – | – | A |
| Signed Syslog & secure audit logs [ 27 , 28 ] | – | – | P | – | – | – | – |
AI Agent Monitoring
AI agent monitoring tracks actions, tool use, and execution traces to detect failures, misuse, drift, and policy violations during operation.
See all 279 papers