Fairness Testing

Fairness testing aims to identify and quantify biases in artificial intelligence systems, particularly focusing on how these systems treat different groups. Current research emphasizes developing automated methods, often employing search-based algorithms like genetic algorithms and particle swarm optimization, to efficiently discover discriminatory behavior in various model architectures, including deep learning models for image recognition and recommender systems. This work is crucial for ensuring the ethical and responsible deployment of AI, mitigating potential harms, and promoting fairness across diverse applications.

Papers

December 30, 2024

Towards Effective Discrimination Testing for Generative AI
Thomas P. Zollo, Nikita Rajaneesh, Richard Zemel, Talia B. Gillis, Emily Black
Generative AI AI Fairness Bias Metric Fairness Assessment Fairness Testing

December 28, 2024

MAFT: Efficient Model-Agnostic Fairness Testing for Deep Neural Networks via Zero-Order Gradient Search
Zhaohui Wang, Min Zhang, Jingran Yang, Bojie Shao, Min Zhang
Deep Neural Network Individual Fairness FAIrness Testing Fairness Testing

November 10, 2023

Search-Based Fairness Testing: An Overview
Hussaini Mamman, Shuib Basri, Abdullateef Oluwaqbemiga Balogun, Abdullahi Abubakar Imam, Ganesh Kumar, Luiz Fernando Capretz
Search Based Artificial Intelligence Bias FAIrness Testing Fairness Testing

May 8, 2023

Distribution-aware Fairness Test Generation
Sai Sathiesh Rajan, Ezekiel Soremekun, Yves Le Traon, Sudipta Chattopadhyay
Image Datasets Recognition System Fairness Analysis Fairness Testing Class Fairness

April 14, 2023

FairRec: Fairness Testing for Deep Recommender Systems
Huizhong Guo, Jinfeng Li, Jingyi Wang, Xiangyu Liu, Dongxia Wang, Zehong Hu, Rong Zhang, Hui Xue
Deep Learning Procedural Fairness Fairness Notion FAIrness Testing Fairness Testing

August 24, 2022

TESTSGD: Interpretable Testing of Neural Networks Against Subtle Group Discrimination
Mengdi Zhang, Jun Sun, Jingyi Wang, Bing Sun
Neural Network Level Test Group DIscrimination FAIrness Testing Fairness Testing

May 16, 2022

Explanation-Guided Fairness Testing through Genetic Algorithm
Ming Fan, Wenying Wei, Wuxia Jin, Zijiang Yang, Ting Liu
Genetic Algorithm FAIrness Testing Fairness Attribute Fairness Testing

November 17, 2021

Fairness Testing of Deep Image Classification with Adequacy Metrics
Peixin Zhang, Jingyi Wang, Jun Sun, Xinyu Wang
Image Classification Fairness Perception FAIrness Testing Fairness Testing Adequacy Metric