cs.LGNov 16, 2026

Explaining Cross-Label Decision Structure in Multi-Output Tree Ensembles

Authors: Sylvio Barbon Junior, Hiago F. F. Oliveira, Rafael Figueira Gonçalves, Jessica Fernandes Lopes, Ricardo Cerri

Organizations: University of Trieste, Trieste, Italy · Institute of Mathematics and Computer Sciences, University of São Paulo, São Carlos, Brazil · SENAI, Londrina, Brazil

Abstract

A multi-output tree ensemble predicts several binary labels through decision paths that it largely shares across those labels, yet the attribution methods commonly used to explain such models treat each output in isolation. We propose multi-sink Decision Predicate Graphs (ms-DPGs), which extend decision predicate graphs with one sink per label: each leaf contributes to the sink of every label its in-bag positive count for that label. On this representation we define Shared Predicate Flow (SPF), the share of a label's decision mass that passes through conditions active for both labels of a pair, and a contracted view of the graph in which label-specific lifts indicate whether a shared condition raises the probability of both labels or of one at the expense of the other. Controlled experiments show that SPF captures shared decision conditions rather than mere feature overlap. On nine multi-label benchmarks, native multi-output forests share substantially more decision structure than Binary Relevance on eight, including five of the six on which the two are at predictive parity, even at equal hyperparameters, whereas per-label TreeSHAP rankings register the change of architecture without showing whether more is shared. Because a native forest routes every label through the same splits, SPF describes the fitted model rather than the data, and on eight of the nine benchmarks it rises when the feature-label signal is removed; a high SPF is therefore not evidence of shared predictive information. ms-DPG offers a global, predicate-level account of how a multi-output ensemble reuses decision conditions across its labels.

Figures & tables

Appendix figures & tables12 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Where Tree Ensembles Decide: Structural Local Explanation with Decision Predicate Graphs

    Nov 13, 2026Sylvio Barbon Junior, Luca LongoInterpretable MLTabular Prediction

  2. Woodelf++: A Fast and Unified Partial Dependence Plot Algorithm for Decision Tree Ensembles

    May 14, 2026Ron Wettenstein, Alexander Nadel, Udi BokerFeature Interaction ModelingFeature Interaction Attribution