stat.MLAug 25, 2026

qshap: Fast Shapley Decomposition of R2R^2 for Gradient-Boosted Trees

Authors: Zhongli Jiang, Min Zhang, Dabao Zhang

Organizations: University of California, Irvine

Abstract

Numerous methods have been developed to quantify feature attributions in individual predictions for tree ensembles. However, many applications require global measures of feature contributions to overall model performance. Although local attribution scores can be aggregated to characterize feature importance, such summaries do not directly decompose measures of predictive performance, such as R2R^2. This article introduces qshap, available in both R and Python, which provides Shapley decomposition of R2R^2 values for gradient-boosted decision trees (GBDTs) to quantify feature-specific contributions to model performance. By decomposing the quadratic loss of individual observations, qshap provides flexible tools to explore the importance of individual features and observations. qshap currently supports widely used GBDT implementations, including xgboost, lightgbm, and catboost, through a unified tree representation and efficient C++ backends. Its modular design can accommodate other GBDT implementations built from binary decision trees. In addition, we introduce a specialized backend for oblivious trees that exploits their symmetric structure to substantially accelerate computation.

Figures & tables

Explore similar work

CardsList
  1. Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactions

    May 6, 2026Ron Wettenstein, Rory Mitchell, Peng YuNumerical IntegrationSHAP Feature Attribution

  2. RoSHAP: A Distributional Framework and Robust Metric for Stable Feature Attribution

    May 14, 2026Lanxin Xiang, Liang Shi, Youhui Ye +3Feature AttributionShapley Value Attribution

  3. A Polynomial-Time Axiomatic Alternative to SHAP for Feature Attribution

    Feb 28, 2026Kazuhiro Hiraki, Shinichi Ishihara, Takumi Kongo +1Feature AttributionShapley Value Attribution