Crowdsourcing Context
Crowdsourcing context research focuses on leveraging human intelligence to improve data quality and efficiency in various machine learning tasks, particularly where labeled data is scarce or expensive. Current research emphasizes developing robust models for aggregating noisy or biased crowdsourced labels, often incorporating Bayesian methods or mixture-of-experts architectures to account for individual worker expertise and task difficulty. This work is crucial for advancing AI applications across diverse fields, from image recognition and natural language processing to scientific discovery and healthcare, by providing high-quality training data and mitigating the limitations of relying solely on automated methods.
Papers
Mitigating Observation Biases in Crowdsourced Label Aggregation
Ryosuke Ueda, Koh Takeuchi, Hisashi Kashima
Agile Modeling: From Concept to Classifier in Minutes
Otilia Stretcu, Edward Vendrow, Kenji Hata, Krishnamurthy Viswanathan, Vittorio Ferrari, Sasan Tavakkol, Wenlei Zhou, Aditya Avinash, Enming Luo, Neil Gordon Alldrin, MohammadHossein Bateni, Gabriel Berger, Andrew Bunner, Chun-Ta Lu, Javier A Rey, Giulia DeSalvo, Ranjay Krishna, Ariel Fuxman