cs.CRNov 2, 2026

Malware Clustering in the Wild: Taxonomy, Challenges, and Evaluation Metrics

Authors: Raguvir S, Bojing Li, Prajna Bhandary, Charles Nicholas

Organizations: University of Maryland, Baltimore County, Department of Computer Science and Electrical Engineering, Baltimore, 21250, Maryland, USA

Abstract

As malware continues to grow in volume, diversity, and sophistication, clustering has emerged as a critical technique for analyzing large malware corpora. Clustering enables the discovery of structural relationships, behavioral patterns, and evolutionary trends, and is widely used to group unknown samples, infer malware family boundaries, and identify novel variants. However, existing research remains fragmented, employing a wide range of clustering techniques with no unified perspective that systematically organizes prior work or clearly identifies gaps in the literature. This survey addresses this gap by organizing previous malware clustering research into seven categories: centroid-based, hierarchical-based, density-based, distribution-based, mixed- type, fuzzy, and AI-driven approaches. In addition, this survey summarizes publicly available malware datasets commonly used in clustering research and examines the feature representations derived from these datasets. Our goal is to clarify the current landscape and outline promising avenues for future research on malware clustering, including how AI-driven methods may shape large-scale and reproducible analysis.

Figures & tables

Explore similar work

CardsList
  1. Self-Supervised Representations for Binary Program Clustering: From Empirical Study to Retrieval-Augmented Learning

    Aug 3, 2026Martin Mocko, Daniela ChudáRepresentation LearningSelf-Supervised Learning

  2. AutoPYara: Next-Gen YARA Rule Generator for Malware Family Clustering

    Nov 5, 2026Mabon Ninan, Nhat Nguyen, Soumyajyoti Dutta +2Malware AnalysisMalware Detection

  3. TUANDROMD-X: Advanced Entropy and Visual Analytics Dataset for Enhanced Malware Detection and Classification

    May 7, 2026Parthajit Borah, Upasana Sarmah, D. K. Bhattacharyya +1Malware ClassificationMalware Analysis