High Disagreement
High disagreement in human annotations, particularly in subjective tasks like legal case classification and sentiment analysis of social media, presents a significant challenge for machine learning. Current research focuses on developing models that can effectively learn from datasets containing substantial human disagreement, exploring techniques like incorporating multiple ground truths and leveraging graph neural networks to capture complex interaction patterns within data. These efforts aim to improve model accuracy, calibration, and explainability, ultimately leading to more robust and trustworthy AI systems for applications ranging from legal tech to social media moderation.
Papers
October 22, 2024
July 9, 2024
March 6, 2024
February 11, 2024
October 18, 2023
July 7, 2023
May 23, 2023