Quality Issue
Research on quality issues spans diverse fields, focusing on developing methods to objectively assess and improve the quality of data, models, and processes. Current efforts concentrate on refining evaluation metrics, leveraging machine learning models (like transformers and diffusion models) for quality prediction and enhancement, and designing algorithms to optimize for quality while managing computational constraints. These advancements are crucial for improving the reliability and trustworthiness of AI systems across various applications, from medical diagnosis and financial reporting to language processing and image analysis, ultimately leading to more robust and impactful technologies.
Papers
Robust Statistical Scaling of Outlier Scores: Improving the Quality of Outlier Probabilities for Outliers (Extended Version)
Philipp Röchner, Henrique O. Marques, Ricardo J. G. B. Campello, Arthur Zimek, Franz Rothlauf
Responsible AI for Test Equity and Quality: The Duolingo English Test as a Case Study
Jill Burstein, Geoffrey T. LaFlair, Kevin Yancey, Alina A. von Davier, Ravit Dotan
Quality Assured: Rethinking Annotation Strategies in Imaging AI
Tim Rädsch, Annika Reinke, Vivienn Weru, Minu D. Tizabi, Nicholas Heller, Fabian Isensee, Annette Kopp-Schneider, Lena Maier-Hein
Deep Koopman-based Control of Quality Variation in Multistage Manufacturing Systems
Zhiyi Chen, Harshal Maske, Devesh Upadhyay, Huanyi Shui, Xun Huan, Jun Ni
How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligence
Luke Zaphir, Jason M. Lodge, Jacinta Lisec, Dom McGrath, Hassan Khosravi
xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics
Daniil Larionov, Mikhail Seleznyov, Vasiliy Viskov, Alexander Panchenko, Steffen Eger