Gradient-Boosted Decision Trees

Also known as GBDT

Overview

Gradient-boosted decision trees build an additive predictor by fitting each new tree to the loss or residual errors left by earlier trees; systems such as XGBoost, LightGBM, and CatBoost make this practical with histogram-based splits and efficient training. Researchers extend them with custom objectives, quantile and probabilistic prediction, constraints, calibration, and methods for privacy, interpretability, and faster inference. They remain strong on many tabular and structured forecasting tasks, but broad benchmarks show no model family wins everywhere, and deep or foundation models can be preferable in some settings. Key challenges include reliable performance under distribution shift, trustworthy explanations, costly hyperparameter tuning, and avoiding misleading results from weak validation designs.

Latest papers

CardsList

64 papers8 papers in the last four weeks, up 167% on the four weeks before. 0.1% of all new papers.

  1. How Much Do Foundation Models Add to Gradient Boosting on Financial Event Sequences?

    Nov 13, 2026Carlos Eduardo Martins Relvas, Gustavo di Giovanni BernardoFinancial Time SeriesCredit Scoring

  2. MammothDP: Private Boosted Decision Trees Ready for Trusted Hardware and Leakage-free Hyperparameters

    Nov 10, 2026Moritz Kirschte, Thorsten Peinemann, Kari Kostiainen +3Privacy-Preserving MLGradient-Boosted Decision Trees

  3. Reconstructing Boundary Layer Wind Profiles with Machine Learning: A Comparative Study on IGRA Radiosonde Data

    Nov 9, 2026Fedor Buzaev, Dmitry Efremenko, Daria Pugacheva +4Tabular MLGradient-Boosted Decision Trees

  4. CRAFT-GBM: Selecting Best Features for Gradient-Boosted Machine Learning

    Nov 9, 2026Basil Kuok, Yi Zhou, Yao Xuan +2Gradient-Boosted Decision TreesFeature Selection

  5. SAMBoost: Spatially Aware Mesh Boosting

    Nov 7, 2026Mulah Moriah, Franck Vermet, Pierre Ailliot +1Spatial Context ModelingGradient-Boosted Decision Trees

  6. CERBO: Certified Recourse at a Requested Rate for Gradient-Boosted Trees

    Nov 2, 2026Farhan Shahriyar Hossain, Taufikur Rahman Fuad, Md. Zarif Bin Hasnat +2Algorithmic RecourseGradient-Boosted Decision Trees

  7. Affine-invariant Cubic Newton with Weak Learners

    Oct 24, 2026Nikita Zozoulenko, Daniel Falkowski, Thomas Cass +1Curvature-Aware OptimizationGradient-Boosted Decision Trees

  8. Comparing a gradient boosting algorithm to the GOES FDC for wildfire detection

    Oct 1, 2026Asaf Vanunu, Boaz Nadler, Arnon KarnieliGradient-Boosted Decision TreesWildfire Detection

  9. Fixing a Model That Learned Worse Cancer Means Lower Risk: Monotonic Constraints in Bladder Cancer Recurrence Prediction

    Oct 1, 2026Saram Abbas, David Thomas, Naeem Soomro +3Counterfactual EvaluationGradient-Boosted Decision Trees

  10. Machine Learning for Invisible Dark Boson Searches at the Electron-Ion Collider

    Sep 18, 2026Rojae Mighty, Ankush Reddy KanugantiHigh-Energy PhysicsClassification

  11. Are Gradient Boosting Models Suitable for Intermittent Demand Forecasting?

    Sep 13, 2026Vladislav Kislinskii, Mazhar HameedTime Series ForecastingGradient-Boosted Decision Trees

  12. Predictors and Orchestrators: Parsimonious Machine Learning within an Agentic AI Harness for Multi-Horizon Karst Aquifer Forecasting

    Sep 6, 2026Pramod Lekhak, Chetan Sharma, Hakan Başağaoğlu +2Time Series ForecastingSpatiotemporal Forecasting

  13. Local Updates, Global Learning (LUGL): Playing Games with non-incremental Learners

    Sep 3, 2026David Milec, Spyridon Samothrakis, Michael Fairbank +1Gradient-Boosted Decision TreesGame-Playing Agents

  14. Convolution Smoothed Quantile Regression for XGBoost

    Aug 15, 2026Mandy Yao, Meredith FranklinQuantile RegressionGradient-Boosted Decision Trees

  15. FQTree: Fine-grained Quantization and Hardware Generation of Boosted Decision Trees

    Aug 12, 2026Zhiqiang Que, Chang Sun, Haiyang Wang +6Gradient-Boosted Decision TreesQuantization-Aware Training

  16. XGBoost "is all you need": the case of forecasting transmitted heat energy in District Heating Systems

    Aug 11, 2026Milan ZdravkovićGradient-Boosted Decision TreesEnergy-Efficient ML

  17. Machine Learning and ARIMA Model Averaging for Adaptive Public Health Forecasting: Comparative Evaluation and an Ontario COVID-19 Case Study

    Aug 7, 2026Yushu Zou, Ye Li, Johra Moosa +3Epidemic ForecastingGradient-Boosted Decision Trees

  18. Double Descent in Gradient Boosting Decision Trees via Split-Candidate Scaling

    Aug 4, 2026Ryuichi KanohDouble DescentGradient-Boosted Decision Trees

  19. Spectrally Deconfounded Gradient Boosting

    Jul 10, 2026Andrea Nava, Peter Bühlmann, Fabio SigristSpectral RegularizationGradient-Boosted Decision Trees

  20. path_boost: A Python Package for Interpretable Graph-Level Prediction using Path-Based Gradient Boosting

    Jul 8, 2026Claudio Meggio, Johan Pensar, Riccardo De BinGradient-Boosted Decision TreesGraph Representation Learning

  21. Beyond Gradient-Based Attacks: Adversarial Robustness and Explainability Stability in Cybersecurity Classifiers

    Jul 2, 2026Mona Rajhans, Vishal KhawareyGradient-Boosted Decision TreesSHAP Feature Attribution

  22. CW-B: Class Weighted Boosting Framework for Imbalance Resilient Multi Class Cardiac Phenotyping

    Jun 29, 2026Sijia Li, Xiaoyu Tan, Chen Zhan +3Class-Imbalanced LearningGradient-Boosted Decision Trees