cs.AIMay 8, 2026

PLACO: A Multi-Stage Framework for Cost-Effective Performance in Human-AI Teams

Authors: Pranavkumar MallelaVinay KumarShashi Shekhar JhaShweta Jain

Organizations: Indian Institute of Technology Ropar

Abstract

Human-AI teams play a pivotal role in improving overall system performance when neither the human nor the model can achieve such performance on their own. With the advent of powerful and accessible Generative AI models, several mundane tasks have morphed into Human-AI team tasks. From writing essays to developing advanced algorithms, humans have found that using AI assistance has led to an accelerated work pace like never before. In classification tasks, where the final output is a single hard label, it is crucial to address the combination of human and model output. Prior work elegantly solves this problem using Bayes rule, using the assumption that human and model output are conditionally independent given the ground truth. Specifically, it discusses a combination method to combine a single deterministic labeler (the human) and a probabilistic labeler (the classifier model) using the model's instance-level and the human's class-level calibrated probabilities.

Explore similar work

CardsList
  1. Generative Augmented Inference

    Apr 16, 2026Cheng Lu, Mengxin Wang, Dennis J. Zhang +1Generative Artificial IntelligenceOnline Inference