Bias Evaluation

Bias evaluation in machine learning focuses on identifying and quantifying unfair biases in models' outputs, aiming to promote fairness and mitigate discriminatory outcomes. Current research emphasizes developing new metrics and benchmarks to assess bias across diverse model architectures, including large language models and computer vision systems, often employing techniques like counterfactual analysis and probing methods to detect subtle biases. This work is crucial for ensuring the responsible development and deployment of AI systems, impacting fields ranging from healthcare and criminal justice to social media and autonomous driving, where biased algorithms can have significant societal consequences.

Papers

November 16, 2024

Bias in Large Language Models: Origin, Evaluation, and Mitigation
Yufei Guo, Muzhe Guo, Juntao Su, Zhou Yang, Mengqiu Zhu, Hongfei Li, Mengyang Qiu, Shuo Shuo Liu
Language Model Natural Language Processing Global Evaluation Absolute Stance Bias Faulty Negative Mitigation Visual Creation Bias Evaluation BIAS Detection

November 5, 2024

Mitigating Metric Bias in Minimum Bayes Risk Decoding
Geza Kovacs, Daniel Deutsch, Markus Freitag
Bias Evaluation Bias Metric Minimum Bayes Risk Neural Metric

October 23, 2024

Mapping the Media Landscape: Predicting Factual Reporting and Political Bias Through Web Interactions
Dairazalia Sánchez-Cortés, Sergio Burdisso, Esaú Villatoro-Tello, Petr Motlicek
Absolute Stance Bias Bias Evaluation Factual Claim Ethnic Medium News Medium Political Communication News Source Multi Character Interaction

October 21, 2024

How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making?
Kenza Benkirane, Jackie Kay, Maria Perez-Ortiz
Bias Mitigation Bias Evaluation Racial Bias Clinical Language LLM Bias

October 20, 2024

A Novel Interpretability Metric for Explaining Bias in Language Models: Applications on Multilingual Models from Southeast Asia
Lance Calvin Lim Gamboa, Mark Lee
Language Model Multilingual Model Bias Evaluation LLM Bias Bias Challenge Interpretability Evaluation

October 18, 2024

Enabling Scalable Evaluation of Bias Patterns in Medical LLMs
Hamed Fayyaz, Raphael Poulain, Rahmatollah Beheshti
Large Language Model Knowledge Graph Bias Evaluation LLM Based Evaluation BiOmedical Ontology Medical Large Language Model Large Scale Evaluation

October 14, 2024

Assessing Bias in Metric Models for LLM Open-Ended Generation Bias Benchmarks
Nathaniel Demchak, Xin Guan, Zekun Wu, Ziyi Xu, Adriano Koshiyama, Emre Kazim
New Benchmark Social Bias Stereotype Content Bias Evaluation Inherent Bias Demographic Attribute Bias Benchmark LLM Bias

October 13, 2024

Investigating Implicit Bias in Large Language Models: A Large-Scale Study of Over 50 LLMs
Divyanshu Kumar, Umang Jain, Sahil Agarwal, Prashanth Harshangi
Large Language Model Study Feature Bias Mitigation Implicit Bias Bias Evaluation LLM Prediction

September 3, 2024

Comprehensive Equity Index (CEI): Definition and Application to Bias Evaluation in Biometrics
Imanol Solano, Alejandro Peña, Aythami Morales, Julian Fierrez, Ruben Tolosana, Francisco Zamora-Martinez, Javier San Agustin
Application Proficiency Bias Evaluation Physiological Biometrics Novel Metric Market Index

August 29, 2024

GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative Models
Moreno D'Incà, Elia Peruzzo, Massimiliano Mancini, Xingqian Xu, Humphrey Shi, Nicu Sebe
Absolute Stance Bias Bias Evaluation Bias Detection Text to Image Generative Model Visual Question Answering Model Quantifying Bias Bias Detection Method

August 15, 2024

Covert Bias: The Severity of Social Views' Unalignment in Language Models Towards Implicit and Explicit Opinion
Abeer Aldayel, Areej Alokaili, Rehab Alahmadi
Absolute Stance Bias Bias Evaluation Implicit Language Subtle Bias Political Sentiment Misalignment State Explicit Communication Bias Challenge

July 11, 2024

Are Large Language Models Really Bias-Free? Jailbreak Prompts for Assessing Adversarial Robustness to Bias Elicitation
Riccardo Cantini, Giada Cosenza, Alessio Orsino, Domenico Talia
Adversarial Robustness Jailbreak Attack Bias Evaluation Subtle Bias Confirmation Bias Inclusive Artificial Intelligence

July 3, 2024

Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Bias
Jayanta Sadhu, Maneesha Rani Saha, Rifat Shahriyar
Social Bias Bangla Text Gender Inclusive Text Bias Evaluation BIAS Detection Bias Benchmark Bangla Natural Language

July 2, 2024

CEB: Compositional Evaluation Benchmark for Fairness in Large Language Models
Song Wang, Peng Wang, Tong Zhou, Yushun Dong, Zhen Tan, Jundong Li
Natural Language Processing Procedural Fairness Bias Evaluation Compositionality Benchmark

June 25, 2024

June 12, 2024

Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Prediction
Micol Spitale, Jiaee Cheong, Hatice Gunes
Medical LLM Gender Bias Depression Detection Bias Evaluation Quantitative Explanation Group Fairness Metric Gender Fairness

June 6, 2024

BEADs: Bias Evaluation Across Domains
Shaina Raza, Mizanur Rahman, Michael R. Zhang
Large Language Model Natural Language Processing Bias Evaluation Domain Name Bias Detection Bias Measurement Bias Evaluation Across Domain Benign Data

May 28, 2024

FAIntbench: A Holistic and Precise Benchmark for Bias Evaluation in Text-to-Image Models
Hanjun Luo, Ziye Deng, Ruizhe Chen, Zuozhu Liu
New Benchmark Absolute Stance Bias Text to Image Model Text to Image Benchmark Study Bias Evaluation Holistic Approach Potential Bias

May 24, 2024

Information-theoretic Generalization Analysis for Expected Calibration Error
Futoshi Futami, Masahiro Fujisawa
Calibration Performance Generalization Error Bias Evaluation Calibration Error Estimation Bias Information Theoretic Generalization

Bias Evaluation

Papers

Bias in Large Language Models: Origin, Evaluation, and Mitigation

Mitigating Metric Bias in Minimum Bayes Risk Decoding

Mapping the Media Landscape: Predicting Factual Reporting and Political Bias Through Web Interactions

How Can We Diagnose and Treat Bias in Large Language Models for Clinical Decision-Making?

A Novel Interpretability Metric for Explaining Bias in Language Models: Applications on Multilingual Models from Southeast Asia

Enabling Scalable Evaluation of Bias Patterns in Medical LLMs

Assessing Bias in Metric Models for LLM Open-Ended Generation Bias Benchmarks

Investigating Implicit Bias in Large Language Models: A Large-Scale Study of Over 50 LLMs

Comprehensive Equity Index (CEI): Definition and Application to Bias Evaluation in Biometrics

GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative Models

Covert Bias: The Severity of Social Views' Unalignment in Language Models Towards Implicit and Explicit Opinion

Are Large Language Models Really Bias-Free? Jailbreak Prompts for Assessing Adversarial Robustness to Bias Elicitation

Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Bias

CEB: Compositional Evaluation Benchmark for Fairness in Large Language Models

Less can be more: representational vs. stereotypical gender bias in facial expression recognition

Beyond Silence: Bias Analysis through Loss and Asymmetric Approach in Audio Anti-Spoofing

Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Prediction

BEADs: Bias Evaluation Across Domains

FAIntbench: A Holistic and Precise Benchmark for Bias Evaluation in Text-to-Image Models

Information-theoretic Generalization Analysis for Expected Calibration Error