Task Utility
Task utility, in the context of machine learning and AI, focuses on evaluating the usefulness and effectiveness of algorithms and models in achieving specific tasks, often considering trade-offs with other factors like privacy, fairness, and computational efficiency. Current research emphasizes developing robust benchmarking methods and algorithms to measure and improve utility across diverse applications, including data synthesis, optimization problems, and human-AI collaboration, employing techniques like generative adversarial networks, spectral graph learning, and temporal point processes. Understanding and maximizing task utility is crucial for responsible AI development, ensuring that models not only perform well but also deliver practical value and align with ethical considerations in real-world deployments.
Papers
A Meta-Analysis of the Utility of Explainable Artificial Intelligence in Human-AI Decision-Making
Max Schemmer, Patrick Hemmer, Maximilian Nitsche, Niklas Kühl, Michael Vössing
Don't Throw it Away! The Utility of Unlabeled Data in Fair Decision Making
Miriam Rateike, Ayan Majumdar, Olga Mineeva, Krishna P. Gummadi, Isabel Valera