Robust Ensemble

Robust ensembles, combining multiple machine learning models, aim to improve prediction accuracy and robustness against various challenges like noisy data, adversarial attacks, and variations in input distributions. Current research focuses on enhancing ensemble diversity through techniques such as layer-wise orthogonalization, heterogeneous model combinations (e.g., integrating different model architectures or tasks), and dynamic model selection based on uncertainty estimates. This field is significant because robust ensembles demonstrate improved performance and generalizability across diverse applications, including medical image analysis, time series forecasting, and object detection, leading to more reliable and trustworthy AI systems.

Papers

October 7, 2024

April 2, 2024

Precise and Robust Sidewalk Detection: Leveraging Ensemble Learning to Surpass LLM Limitations in Urban Environments
Ibne Farabi Shihab, Benjir Islam Alvee, Sudesh Ramesh Bhagat, Anuj Sharma
Large Language Model Ensemble Learning Urban Environment Ensemble Model Accurate Detection Urban Scale Dataset Robust Ensemble Sidewalk Detection

March 28, 2024

A Robust Ensemble Algorithm for Ischemic Stroke Lesion Segmentation: Generalizability and Clinical Utility Beyond the ISLES Challenge
Ezequiel de la Rosa, Mauricio Reyes, Sook-Lei Liew, Alexandre Hutton, Roland Wiest, Johannes Kaesmacher, Uta Hanning, Arsany Hakim, Richard Zubal, Waldo Valenzuela, David Robben, Diana M. Sima, Vincenzo Anania, Arne Brys, James A. Meakin, Anne Mickan, Gabriel Broocks, Christian Heitkamp, Shengbo Gao, Kongming Liang, Ziji Zhang, Md Mahfuzur Rahman Siddiquee, Andriy Myronenko, Pooya Ashtari, Sabine Van Huffel, Hyun-su Jeong, Chi-ho Yoon, Chulhong Kim, Jiayu Huo, Sebastien Ourselin, Rachel Sparks, Albert Clèrigues, Arnau Oliver, Xavier Lladó, Liam Chalcroft, Ioannis Pappas, Jeroen Bertels, Ewout Heylen, Juliette Moreau, Nima Hatami, Carole Frindel, Abdul Qayyum, Moona Mazher, Domenec Puig, Shao-Chieh Lin, Chun-Jung Juan, Tianxi Hu, Lyndon Boone, Maged Goubran, Yi-Jui Liu, Susanne Wegener, Florian Kofler, Ivan Ezhov, Suprosanna Shit, Moritz R. Hernandez Petzsche, Bjoern Menze, Jan S. Kirschke, Benedikt Wiestler
Stronger Generalizability Robust Ensemble Ensemble Algorithm Ischemic Stroke Lesion Segmentation Diffusion Weighted MRI Challenge Result

March 14, 2024

Empowering Healthcare through Privacy-Preserving MRI Analysis
Al Amin, Kamrul Hasan, Saleh Zein-Sabatto, Deo Chimba, Liang Hong, Imtiaz Ahmed, Tariqul Islam
Deep Learning Healthcare System Sensitive Patient Robust Ensemble Federated Ensemble

October 3, 2023

Exploring Model Learning Heterogeneity for Boosting Ensemble Robustness
Yanzhao Wu, Ka-Ho Chow, Wenqi Wei, Ling Liu
Ensemble Diversity Robust Ensemble Heterogeneous Ensemble Model Heterogeneity Deep Neural Network Ensemble

August 1, 2023

Dynamic ensemble selection based on Deep Neural Network Uncertainty Estimation for Adversarial Robustness
Ruoxi Qin, Linyuan Wang, Xuehui Du, Xingyuan Chen, Bin Yan
Adversarial Attack Adversarial Robustness Robust Recognition Robust Ensemble Ensemble Selection Deep Uncertainty

July 15, 2023

Generative Meta-Learning Robust Quality-Diversity Portfolio
Kamer Ali Yuksel
Meta Learning Deep Generative Model Quality Diversity Robust Ensemble Robust Portfolio

July 5, 2023

Exploring new ways: Enforcing representational dissimilarity to learn new features and reduce error consistency
Tassilo Wald, Constantin Ulrich, Fabian Isensee, David Zimmerer, Gregor Koehler, Michael Baumgartner, Klaus H. Maier-Hein
New Way Intermediate Representation Representational Similarity Robust Ensemble New Feature Ensemble Accuracy

May 26, 2023

An Improved Model Ensembled of Different Hyper-parameter Tuned Machine Learning Algorithms for Fetal Health Prediction
Md. Simul Hasan Talukder, Sharmin Akter
Machine Learning Support Vector Machine Machine Learning Algorithm Hyper Parameter Model Improvement Robust Ensemble Fetal Health

April 9, 2023

Ensemble Modeling for Time Series Forecasting: an Adaptive Robust Optimization Approach
Dimitris Bertsimas, Leonard Boussioux
Time Series Forecasting Robust Optimization Ensemble Model Robust Ensemble Adaptive Ensemble Tropical Cyclone Intensity

February 12, 2023

Interpretable Diversity Analysis: Visualizing Feature Representations In Low-Cost Ensembles
Tim Whitaker, Darrell Whitley
Diverse Ensemble Feature Representation Ensemble Method Robust Ensemble Diversity Analysis Low Cost Ensemble

November 15, 2022

MORA: Improving Ensemble Robustness Evaluation with Model-Reweighing Attack
Yunrui Yu, Xitong Gao, Cheng-Zhong Xu
Adversarial Attack Model Attack Robust Ensemble Ensemble Defense

July 4, 2022

A Robust Ensemble Model for Patasitic Egg Detection and Classification
Yuqi Wang, Zhiqiang He, Shenghui Huang, Huabin Du
Deep Learning Classification Code Object Detector Microscopy Image Robust Ensemble

June 7, 2022

Building Robust Ensembles via Margin Boosting
Dinghuai Zhang, Hongyang Zhang, Aaron Courville, Yoshua Bengio, Pradeep Ravikumar, Arun Sai Suggala
Adversarial Attack Adversarial Training Adversarial Robustness Cross Entropy Margin Maximization Robust Ensemble

June 2, 2022

Feature Space Particle Inference for Neural Network Ensembles
Shingo Yashima, Teppei Suzuki, Kohta Ishikawa, Ikuro Sato, Rei Kawakami
Deep Neural Network Deep Ensemble Particle Based Variational Inference Weight Space Robust Ensemble

March 30, 2022

BBE-LSWCM: A Bootstrapped Ensemble of Long and Short Window Clickstream Models
Arnab Chakraborty, Vikas Raturi, Shrutendra Harsola
User Behavior Long Span Robust Ensemble

December 24, 2021

Generalized Wasserstein Dice Loss, Test-time Augmentation, and Transformers for the BraTS 2021 challenge
Lucas Fidon, Suprosanna Shit, Ivan Ezhov, Johannes C. Paetzold, Sébastien Ourselin, Tom Vercauteren
Transformer Megatron Decepticons Challenge Task Brain Tumor Segmentation Test Time Augmentation 3D U Net Robust Ensemble BRAT Challenge Robust Inference

December 7, 2021

Saliency Diversified Deep Ensemble for Robustness to Adversaries
Alex Bogun, Dimche Kostadinov, Damian Borth
Native Robustness Saliency Map Deep Ensemble Transferable Attack Adversary Agent Robust Ensemble Ensemble Defense

Robust Ensemble

Papers

Optimizing Parking Space Classification: Distilling Ensembles into Lightweight Classifiers

LOTOS: Layer-wise Orthogonalization for Training Robust Ensembles

Precise and Robust Sidewalk Detection: Leveraging Ensemble Learning to Surpass LLM Limitations in Urban Environments

A Robust Ensemble Algorithm for Ischemic Stroke Lesion Segmentation: Generalizability and Clinical Utility Beyond the ISLES Challenge

Empowering Healthcare through Privacy-Preserving MRI Analysis

Exploring Model Learning Heterogeneity for Boosting Ensemble Robustness

Dynamic ensemble selection based on Deep Neural Network Uncertainty Estimation for Adversarial Robustness

Generative Meta-Learning Robust Quality-Diversity Portfolio

Exploring new ways: Enforcing representational dissimilarity to learn new features and reduce error consistency

An Improved Model Ensembled of Different Hyper-parameter Tuned Machine Learning Algorithms for Fetal Health Prediction

Ensemble Modeling for Time Series Forecasting: an Adaptive Robust Optimization Approach

Interpretable Diversity Analysis: Visualizing Feature Representations In Low-Cost Ensembles

MORA: Improving Ensemble Robustness Evaluation with Model-Reweighing Attack

A Robust Ensemble Model for Patasitic Egg Detection and Classification

Building Robust Ensembles via Margin Boosting

Feature Space Particle Inference for Neural Network Ensembles

BBE-LSWCM: A Bootstrapped Ensemble of Long and Short Window Clickstream Models

Generalized Wasserstein Dice Loss, Test-time Augmentation, and Transformers for the BraTS 2021 challenge

Saliency Diversified Deep Ensemble for Robustness to Adversaries