cs.LGJul 2, 2025

Symbolic Branch Networks: Tree-Inherited Neural Models for Interpretable Multiclass Classification

Authors: Dalia Nöth-Rodríguez

Organizations: Independent Researcher, Germany

Abstract

Symbolic Branch Networks (SBNs) are neural models whose architecture is derived directly from an ensemble of decision trees. Each root-to-parent-of-leaf decision path is mapped to a hidden neuron, while the matrices W1 (feature-to-branch) and W2 (branch-to-class) encode the structural relationships induced by the teacher ensemble. This provides an explicit correspondence between teacher branches and neural components, enabling feature-level and branch-level interpretation while retaining the flexibility of gradient-based optimization. The primary configuration studied in this work trains the teacher-derived feature-to-branch matrix W1 through gradient-based learning while keeping the branch-to-class matrix W2 fixed; this configuration is denoted SBN1,0. Across 29 multiclass tabular datasets, this configuration improves upon the teacher ensemble on 28 of 29 datasets, increasing mean accuracy from 84.0% to 87.9%. For reference, XGBoost and TabPFN achieve mean accuracies of 87.3% and 91.3%, respectively, on the same datasets. A one-sided Wilcoxon signed-rank test on dataset-level mean accuracies indicates a statistically significant improvement of SBN1,0 over the teacher ensemble (p=4.71x10-7). Beyond predictive performance, SBN provides an explicit structural basis for interpretation. Global feature importance can be derived from the teacher-induced feature-to-branch connectivity, while individual predictions can be traced to selected branch-neurons, their associated features, and their class contributions. An analysis across ten independently constructed teacher ensembles shows consistent predictions for a selected instance but only partial stability in its local feature rankings.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Neural Logic Networks for Interpretable Classification

    Aug 11, 2025Vincent Perreault, Katsumi Inoue, Richard Labib +1Boolean Function LearningNeural Network Interpretability

  2. Adaptive Multi-Branching for Shallow Decision Tree Induction

    Aug 29, 2026Hanul Park, Jeonghoon Choi, Juseong Kim +2Decision Tree LearningTabular ML

  3. Multistage Defer Trees for Hybrid Interpretability: If at First You Can't Succeed, Tree Again

    Jun 30, 2026Zakk Heile, Hayden McTavish, Margo Seltzer +1Ensemble LearningLearning to Defer