cs.CLApr 7, 2026

DQA: Diagnostic Question Answering for IT Support

Authors: Vishaal Kapoor, Mariam Dundua, Sarthak Ahuja, Neda Kordjazi, Evren Yortucboylu, Vaibhavi Padala, Derek Ho, Jennifer Whitted, 

Organizations: Amazon

Abstract

Enterprise IT support interactions are fundamentally diagnostic: effective resolution requires iterative evidence gathering from ambiguous user reports to identify an underlying root cause. While retrieval-augmented generation (RAG) provides grounding through historical cases, standard multi-turn RAG systems lack explicit diagnostic state and therefore struggle to accumulate evidence and resolve competing hypotheses across turns. We introduce DQA, a diagnostic question-answering framework that maintains persistent diagnostic state and aggregates retrieved cases at the level of root causes rather than individual documents. DQA combines conversational query rewriting, retrieval aggregation, and state-conditioned response generation to support systematic troubleshooting under enterprise latency and context constraints. We evaluate DQA on 150 anonymized enterprise IT support scenarios using a replay-based protocol. Averaged over three independent runs, DQA achieves a 78.7% success rate under a trajectory-level success criterion, compared to 41.3% for a multi-turn RAG baseline, while reducing average turns from 8.4 to 3.9.

Figures & tables

Explore similar work

CardsList
  1. RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents

    Sep 17, 2026Mingxuan Zhang, Xiaowen Wang, Anupma Sharan +4Case-Based ReasoningRetrieval-Augmented Generation

  2. Case-Aware LLM-as-a-Judge Evaluation for Enterprise-Scale RAG Systems

    Feb 23, 2026Mukul Chhabra, Luigi Medrano, Arush VermaRAG EvaluationMulti-Turn Dialogue Evaluation