Error Detection
Error detection research focuses on identifying and correcting inaccuracies in various data types and model outputs, aiming to improve the reliability and trustworthiness of AI systems and data analysis. Current research emphasizes developing methods for detecting errors in large language models (LLMs), including hallucinations and reasoning failures, often leveraging internal model representations or ensemble techniques, as well as improving error detection in other machine learning contexts through techniques like feature selection and novel algorithms for specific data types (e.g., scientific data, surgical videos). These advancements have significant implications for enhancing the accuracy and reliability of AI-driven applications across diverse fields, from healthcare and scientific computing to natural language processing and robotics.
Papers
LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations
Hadas Orgad, Michael Toker, Zorik Gekhman, Roi Reichart, Idan Szpektor, Hadas Kotek, Yonatan Belinkov
Fast nonparametric feature selection with error control using integrated path stability selection
Omar Melikechi, David B. Dunson, Jeffrey W. Miller