cs.LGFeb 3, 2026

Partition Tree: Conditional Density Estimation over General Outcome Spaces

Authors: Felipe Angelim, Alessandro Leite

Organizations: INSA Rouen Normandy, Normandy University, LITIS Rouen, France

Abstract

We propose Partition Tree, a tree-based framework for conditional density estimation over general outcome spaces that supports both continuous and categorical variables within a unified formulation. Our approach models conditional distributions as piecewise-constant densities on data-adaptive partitions and learns trees by greedily minimizing a surrogate for conditional log-loss. This yields a scalable alternative to existing probabilistic trees that does not make parametric assumptions about the target distribution. We further introduce Partition Forest, an ensemble extension obtained by averaging conditional densities. Empirically, we demonstrate improved probabilistic prediction over CART-style trees and competitive performance compared to state-of-the-art probabilistic tree methods and Random Forests.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Prediction-Augmented Trees for Reliable Statistical Inference

    Oct 19, 2025Vikram Kher, Argyris Oikonomou, Manolis ZampetakisPrediction-Powered InferenceConfidence Region Estimation