cs.LGMar 6, 2026

XGenBoost: Synthesizing Small and Large Tabular Datasets with XGBoost

Authors: Jim Achterberg, Marcel Haas, Bram van Dijk, Marco Spruit

Organizations: Public Health & Primary Care, Leiden University Medical Center, Leiden, The Netherlands · Research and Development, Statistics Netherlands (CBS), The Hague, The Netherlands · Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands

Abstract

Tree ensembles such as XGBoost are often preferred for discriminative tasks in mixed-type tabular data, due to their inductive biases, minimal hyperparameter tuning, and training efficiency. We argue that these qualities, when leveraged correctly, can make for better generative models as well. As such, we present XGenBoost, a pair of generative models based on XGBoost: i) a Denoising Diffusion Implicit Model (DDIM) with XGBoost as score-estimator suited for smaller datasets, and ii) a hierarchical autoregressive model whose conditionals are learned via XGBoost classifiers, suited for large-scale tabular synthesis. The architectures follow from the natural constraints imposed by tree-based learners, e.g., in the diffusion model, combining Gaussian and multinomial diffusion to leverage native categorical splits and avoid one-hot encoding while accurately modelling mixed data types. In the autoregressive model, we use a fixed-order factorization, a hierarchical classifier to impose ordinal inductive biases when modelling numerical features, and de-quantization based on empirical quantile functions to model the non-continuous nature of most real-world tabular datasets. Through two benchmarks, one containing smaller and the other larger datasets, we show that our proposed architectures outperform previous neural- and tree-based generative models for mixed-type tabular synthesis at lower training cost.

Figures & tables

Appendix figures & tables29 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. ReTabSyn: Realistic Tabular Data Synthesis via Reinforcement Learning

    Mar 11, 2026Xiaofeng Lin, Seungbae Kim, Zhuoya Li +3Synthetic Tabular Data GenerationTabular Data Synthesis

  2. CDMD: A Cross-Dataset Mixed-Type Diffusion Model for Tabular Data

    Sep 30, 2026Mohamed Amine Ketata, Maximilian Schambach, Stephan GünnemannMasked Diffusion ModelsTabular Diffusion Models

  3. SYNTHONY: A Stress-Aware, Intent-Conditioned Agent for Deep Tabular Generative Models Selection

    Mar 31, 2026Hochan Son, Xiaofeng Lin, Jason Ni +1Synthetic Data SelectionTabular Data Synthesis