Gradient Boosting

Gradient boosting is a machine learning technique that combines multiple weak prediction models to create a strong, accurate predictive model. Current research focuses on extending its applications to diverse areas, including survival analysis, audio classification, essay scoring, and medical diagnosis, often employing variations like XGBoost, LightGBM, CatBoost, and novel architectures such as Diffusion Boosted Trees. This versatility makes gradient boosting a powerful tool across numerous scientific fields and practical applications, offering improved prediction accuracy and, in some cases, enhanced interpretability through techniques like SHAP values. The method's efficiency and effectiveness are driving ongoing efforts to optimize its performance and expand its capabilities.

Papers

November 16, 2022

Indoor Positioning via Gradient Boosting Enhanced with Feature Augmentation using Deep Learning
Ashkan Goharfar, Jaber Babaki, Mehdi Rasti, Pedro H. J. Nardelli
Deep Learning Internet of Thing Gradient Boosting Feature Augmentation Indoor Positioning Positioning Accuracy

October 31, 2022

Large scale traffic forecasting with gradient boosting, Traffic4cast 2022 challenge
Martin Lumiste, Andrei Ilie
Challenge Task Traffic Prediction Traffic Forecasting Gradient Boosting Traffic4cast Competition Accurate Traffic Prediction Accurate Traffic Forecasting

October 18, 2022

Towards Domain-Independent Supervised Discourse Parsing Through Gradient Boosting
Patrick Huber, Giuseppe Carenini
Natural Language Processing Gradient Boosting Discourse Structure Discourse Parsing Discourse Aware Discourse Parser

October 13, 2022

Multi-Target XGBoostLSS Regression
Alexander März
Regression Task Gradient Boosting Multi Target Probabilistic Regression

October 3, 2022

Diagnosis of Parkinson's Disease Based on Voice Signals Using SHAP and Hard Voting Ensemble Method
Paria Ghaheri, Hamid Nasiri, Ahmadreza Shateri, Arman Homafar
Medical Diagnosis Parkinson Disease Gradient Boosting Extreme Gradient Boosting Voting Ensemble

September 28, 2022

TRBoost: A Generic Gradient Boosting Machine based on Trust-region Method
Jiaqi Luo, Zihao Wei, Junkai Man, Shixin Xu
Gradient Boosting Trust Region Gradient Boosting Machine

September 25, 2022

Feature Encodings for Gradient Boosting with Automunge
Nicholas J. Teague
Supervised Learning Natural Gradient Diverse Datasets Gradient Boosting Categorical Feature Feature Encoding Z Score

September 3, 2022

Classification of Breast Tumours Based on Histopathology Images Using Deep Features and Ensemble of Gradient Boosting Methods
Mohammad Reza Abbasniya, Sayed Ali Sheikholeslamzadeh, Hamid Nasiri, Samaneh Emami
Classification Code Feature Extraction Breast Cancer Histopathology Image Deep Feature Gradient Boosting Breast Cancer Detection Breast Cancer Diagnosis Breast Cancer Histopathology Image

July 25, 2022

Forecasting the Short-Term Energy Consumption Using Random Forests and Gradient Boosting
Cristina Bianca Pop, Viorica Rozina Chifu, Corina Cordea, Emil Stefan Chifu, Octav Barsan
Practical Algorithm Random Forest Energy Consumption Gradient Boosting Weighted Ensemble

July 12, 2022

AGBoost: Attention-based Modification of Gradient Boosting Machine
Andrei Konstantinov, Lev Utkin, Stanislav Kirpichenko
Gradient Boosting Attention Model Attention Weight Shallow Learning Gradient Attention Catboost Model

June 14, 2022

Loss Functions for Classification using Structured Entropy
Brian Lucena
Classification Code Loss Function Cross Entropy Loss Gradient Boosting Structural Entropy

June 11, 2022

Gradient Boosting Performs Gaussian Process Inference
Aleksei Ustimenko, Artem Beliakov, Liudmila Prokhorenkova
Gaussian Process Decision Tree Epistemic Uncertainty Kernel Method Gradient Boosting Domain Detection

May 21, 2022

Deep Learning vs. Gradient Boosting: Benchmarking state-of-the-art machine learning algorithms for credit scoring
Marc Schmitt
Deep Learning Machine Learning Artificial Intelligence Practical Algorithm Gradient Boosting Credit Scoring Credit Risk

May 14, 2022

High Performance of Gradient Boosting in Binding Affinity Prediction
Dmitrii Gavrilev, Nurlybek Amangeldiuly, Sergei Ivanov, Evgeny Burnaev
Drug Discovery Gradient Boosting Protein Ligand High Performance Gradient Boosted Decision Tree Binding Affinity

April 14, 2022

Gradient boosting for convex cone predict and optimize problems
Andrew Butler, Roy H. Kwon
Natural Gradient Gradient Boosting Prediction Method Counterfactual Regret Convex Regression Decision Optimization

April 3, 2022

FedGBF: An efficient vertical federated learning framework via gradient boosting and bagging
Yujin Han, Pan Du, Kai Yang
Decision Tree Gradient Boosting Learning Framework Boosting Algorithm Federated Gradient Boosting

March 17, 2022

GAM(L)A: An econometric model for interpretable Machine Learning
Emmanuel Flachaire, Gilles Hacheme, Sullivan Hué, Sébastien Laurent
Random Forest Interpretable Machine Learning Gradient Boosting Econometric Model Gam Depth

March 13, 2022

The Yield Curve as a Recession Leading Indicator. An Application for Gradient Boosting and Random Forest
Pedro Cadahia Delgado, Emilio Congregado, Antonio A. Golpe, José Carlos Vides
Machine Learning Random Forest Gradient Boosting Shapley Additive Explanation Spread Wave Aggregate Level Indicator

February 16, 2022

Processing the structure of documents: Logical Layout Analysis of historical newspapers in French
Nicolas Gutehrlé, Iana Atanassova
Inner Structure Document Relevance Gradient Boosting Rule Based Rule Learning Historical Newspaper

February 11, 2022

Predicting Fuel Consumption in Power Generation Plants using Machine Learning and Neural Networks
Gabin Maxime Nguegnang, Marcellin Atemkeng, Theophilus Ansah-Narh, Rockefeller Rockefeller, Gabin Maxime Nguegnang, Marco Andrea Garuti
Neural Network Machine Learning Machine Learning Algorithm Gradient Boosting Synchronous Generator Fuel Consumption

Gradient Boosting

Papers

Indoor Positioning via Gradient Boosting Enhanced with Feature Augmentation using Deep Learning

Large scale traffic forecasting with gradient boosting, Traffic4cast 2022 challenge

Towards Domain-Independent Supervised Discourse Parsing Through Gradient Boosting

Multi-Target XGBoostLSS Regression

Diagnosis of Parkinson's Disease Based on Voice Signals Using SHAP and Hard Voting Ensemble Method

TRBoost: A Generic Gradient Boosting Machine based on Trust-region Method

Feature Encodings for Gradient Boosting with Automunge

Classification of Breast Tumours Based on Histopathology Images Using Deep Features and Ensemble of Gradient Boosting Methods

Forecasting the Short-Term Energy Consumption Using Random Forests and Gradient Boosting

AGBoost: Attention-based Modification of Gradient Boosting Machine

Loss Functions for Classification using Structured Entropy

Gradient Boosting Performs Gaussian Process Inference

Deep Learning vs. Gradient Boosting: Benchmarking state-of-the-art machine learning algorithms for credit scoring

High Performance of Gradient Boosting in Binding Affinity Prediction

Gradient boosting for convex cone predict and optimize problems

FedGBF: An efficient vertical federated learning framework via gradient boosting and bagging

GAM(L)A: An econometric model for interpretable Machine Learning

The Yield Curve as a Recession Leading Indicator. An Application for Gradient Boosting and Random Forest

Processing the structure of documents: Logical Layout Analysis of historical newspapers in French

Predicting Fuel Consumption in Power Generation Plants using Machine Learning and Neural Networks