Performance Metric
Performance metrics are crucial for evaluating the effectiveness of machine learning models, particularly in complex applications like recommender systems, code generation, and medical image analysis. Current research emphasizes aligning automated metrics with human preferences, developing causal frameworks for auditing model behavior, and addressing challenges like imbalanced datasets and the need for metrics sensitive to different error types. This work is vital for ensuring model reliability, fairness, and ultimately, the responsible deployment of AI across diverse fields.
Papers
October 8, 2024
October 3, 2024
September 20, 2024
September 19, 2024
August 12, 2024
August 9, 2024
July 30, 2024
July 11, 2024
July 7, 2024
June 20, 2024
June 11, 2024
May 3, 2024
April 27, 2024
January 9, 2024
December 19, 2023
December 8, 2023
Emissions Reporting Maturity Model: supporting cities to leverage emissions-related processes through performance indicators and artificial intelligence
Victor de A. Xavier, Felipe M. G. França, Priscila M. V. Lima
Conformal Prediction in Multi-User Settings: An Evaluation
Enrique Garcia-Ceja, Luciano Garcia-Banuelos, Nicolas Jourdan
November 3, 2023