cs.LGApr 14, 2026

CLAD: Efficient Log Anomaly Detection Directly on Compressed Representations

Authors: Benzhao Tang, Shiyu Yang

Organizations: Guangzhou University

Abstract

The explosive growth of system logs makes streaming compression essential, yet existing log anomaly detection (LAD) methods incur severe pre-processing overhead by requiring full decompression and parsing. We introduce CLAD, the first deep learning framework to perform LAD directly on compressed byte streams. CLAD bypasses these bottlenecks by exploiting a key insight: normal logs compress into regular byte patterns, while anomalies systematically disrupt them. To extract these multi-scale deviations from opaque bytes, we propose a purpose-built architecture integrating a dilated convolutional byte encoder, a hybrid Transformer--mLSTM, and four-way aggregation pooling. This is coupled with a two-stage training strategy of masked pre-training and focal-contrastive fine-tuning to effectively handle severe class imbalance. Evaluated across five datasets, CLAD achieves a state-of-the-art average F1-score of 0.9909 and outperforms the best baseline by 2.72 percentage points. It delivers superior accuracy while completely eliminating decompression and parsing overheads, offering a robust solution that generalizes to structured streaming compressors.

Figures & tables

Explore similar work

CardsList
  1. DP-FlogTinyLLM: Differentially private federated log anomaly detection using Tiny LLMs

    Apr 21, 2026Isaiah Thompson, Tanmay Sen, Ritwik BhattacharyaFederated LearningAnomaly Detection

  2. LogNEO: A GPT-Neo Reinforcement Learning Framework for Accurate Real-Time Log Anomaly Detection

    Jun 6, 2026David Eje, Tanmay Sharma, Khush Patel +2RL for Language ModelsOnline Anomaly Detection