cs.HCNov 11, 2026

Understanding the Effects of Multi-Agent Deliberation for Human-AI Decision-Making

Authors: Harry Yizhou Tian, Ming Yin

Organizations: Purdue University, West Lafayette, Indiana, USA

Abstract

Multi-agent deliberation (MAD), where multiple LLMs engage in structured discussion, improves AI performance on many benchmarks, but whether it helps humans make better decisions remains untested. We conduct two user studies on LLM-response-verification and fact-checking. We first compare MAD against common AI decision-support methods that isolate its two defining dimensions --- multiple AIs and multi-round interaction. We find MAD outperformed single-round AI assistance on both tasks; multi-round interaction was the main driver of this benefit, while a second AI added value when the single AI had room to improve. Then, we study two design choices in MAD --- AI persona and human engagement level --- finding a devil's advocate persona to lower accuracy and user experience, while humans' active participation in MAD improved accuracy in one task at the cost of frustration. We conclude by discussing implications for when, why, and how multi-agent deliberation can support human decision-making.

Figures & tables

Appendix figures & tables15 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LLM Agents for Deliberative Collaboration: A Study on Joint Decision Making Under Partial Observability

    Jul 7, 2026Chenxu Wang, Yongkun Yang, Boyuan Du +2LLM Agent EvaluationMulti-Agent Collaboration

  2. When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?

    Oct 23, 2025Yongqiang Chen, Gang Niu, James Cheng +2Multi-Agent DebateMulti-Agent Collaboration

  3. The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberation

    Jun 2, 2026Herun Wan, Jiaying Wu, Minnan Luo +4Multi-Agent LLM SystemsLLM Agent Evaluation