cs.LGNov 13, 2026

Clustering-Based Artificial Tree Ensembles for Random Forest Approximation

Authors: Lea L. Kronziel, Maren S. Wieder, Silke Szymczak, Björn-Hergen Laabs

Organizations: Institute of Medical Biometry and Statistics, University of Luebeck, Ratzeburger Allee 160, Luebeck, 23562, Germany. · Department of Medical Statistics, University Medical Center Goettingen, Humboldtallee 32, Goettingen, 37073, Lower Saxony, Germany. · CAIMed, Lower Saxony Center for Artificial Intelligence and Causal Methods in Medicine, Lower Saxony, Germany.

Abstract

Random Forests (RFs) offer strong prediction performance but are difficult to interpret. Most representative trees (MRTs) and artificial representative trees (ARTs) provide surrogate explanations, but a single tree may miss patterns within a forest. We investigate benefits and limitations of clustering-based representative tree ensembles for RF surrogate modeling and assess the contribution of similarity-based clustering relative to random tree partitions. Using linear and nonlinear simulations and regression benchmarks, we evaluate fidelity, prediction accuracy, complexity, and prediction stability against equally sized ensembles of top-ranked MRTs and randomly selected trees. Increasing ensemble size generally improves fidelity, accuracy, and prediction stability. ART ensembles show higher fidelity in simulations and often greater prediction stability for small ensembles. Compared with random tree partitions, similarity-based clustering generally improves ART fidelity in simulations and often on benchmarks. On benchmark datasets, MRT-based ensembles generally achieve higher fidelity and prediction accuracy, whereas ART ensembles have fewer terminal nodes. ART ensembles provide compact surrogates when reduced complexity matters and their fidelity and prediction accuracy meet application requirements. These findings clarify both the trade-offs of representative tree ensembles as RF surrogates and the contribution of similarity-based clustering beyond random clustering.

Figures & tables

Appendix figures & tables17 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Interpreting Random Forests: Comparing Surrogate Models and Rule Extraction Methods

    Nov 14, 2026Lea L. Mairhöfer, Jonathan B. Krause, Björn-Hergen Laabs +1Interpretable MLSurrogate Modeling

  2. Beyond Point Prediction: Artificial Representative Trees with Uncertainty

    Sep 21, 2026Lea L. Mairhöfer, Silke Szymczak, Björn-Hergen Laabs +1Interpretable MLConformal Prediction

  3. Cross-Cluster Weighted Forests

    May 17, 2021Maya Ramchandran, Rajarshi Mukherjee, Giovanni ParmigianiCancer GenomicsEnsemble Learning