stat.MENov 14, 2026

Interpreting Random Forests: Comparing Surrogate Models and Rule Extraction Methods

Authors: Lea L. Mairhöfer, Jonathan B. Krause, Björn-Hergen Laabs, Silke Szymczak

Organizations: Institute of Medical Biometry and Statistics, University of Luebeck, Lübeck, Germany · Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany · CAIMed, Lower Saxony Center for Artificial Intelligence and Causal Methods in Medicine, Göttingen

Abstract

Random forests (RFs) often achieve high prediction performance, but their ensemble structure can be difficult to interpret. Surrogate models and rule extraction methods offer interpretable approximations, yet guidance on selecting an appropriate method for a specific research question remains limited. We compared 12 methods for interpreting RFs, with a decision tree as a prediction-oriented reference, across 11 simulation settings and 67 benchmark datasets for regression and classification. Evaluation addressed prediction and structural similarity to the RF, model complexity, prediction performance, and runtime. Simulations additionally assessed explainability using known effect and noise variables. No method performed best across all objectives. For regression, SLIM provided the strongest general performance for prediction similarity or performance on test data, while a linear model offered a simpler global interpretation of linear effects when performance was comparable. For classification, inTrees achieved the strongest overall benchmark performance, with CTree and OC-CART providing useful alternatives. ART consistently produced the most compact representations. NH and SIRUS offered strong structural similarity for regression, while MRT most closely reproduced RF variable usage in the classification simulations, illustrating that prediction-oriented rankings do not necessarily identify the best structural explanation. Outcome-type restrictions, runtime limits, and method-specific failures reduced result availability for several approaches and should be considered alongside performance when selecting a method. Method selection should therefore be guided by the outcome type, anticipated data structure, and intended interpretability objective. Prediction similarity alone is insufficient for explaining an RF and should be considered jointly with structural similarity and model complexity.

Figures & tables

Explore similar work

CardsList
  1. Clustering-Based Artificial Tree Ensembles for Random Forest Approximation

    Nov 13, 2026Lea L. Kronziel, Maren S. Wieder, Silke Szymczak +1Surrogate ModelingExplainable Artificial Intelligence

  2. Beyond Point Prediction: Artificial Representative Trees with Uncertainty

    Sep 21, 2026Lea L. Mairhöfer, Silke Szymczak, Björn-Hergen Laabs +1Interpretable MLConformal Prediction

  3. SR4-Fit: A Unified Interpretable Rule-Based Machine Learning Framework for Informative and Trustworthy Decision-Making

    Sep 27, 2026Shyam Sundar Murali Krishnan, Dean Frederick HougenInterpretable ML