Performance Metric
Performance metrics are crucial for evaluating the effectiveness of machine learning models, particularly in complex applications like recommender systems, code generation, and medical image analysis. Current research emphasizes aligning automated metrics with human preferences, developing causal frameworks for auditing model behavior, and addressing challenges like imbalanced datasets and the need for metrics sensitive to different error types. This work is vital for ensuring model reliability, fairness, and ultimately, the responsible deployment of AI across diverse fields.
Papers
December 8, 2023
Emissions Reporting Maturity Model: supporting cities to leverage emissions-related processes through performance indicators and artificial intelligence
Victor de A. Xavier, Felipe M. G. França, Priscila M. V. Lima
Conformal Prediction in Multi-User Settings: An Evaluation
Enrique Garcia-Ceja, Luciano Garcia-Banuelos, Nicolas Jourdan
November 3, 2023
October 3, 2023
September 29, 2023
September 15, 2023
August 20, 2023
August 17, 2023
July 5, 2023
April 15, 2023
March 16, 2023
January 10, 2023
December 30, 2022
November 13, 2022
November 11, 2022
September 26, 2022
September 12, 2022
August 27, 2022
August 21, 2022