cs.CLApr 8, 2026

EchoChain: A Full-Duplex Benchmark for State-Update Reasoning Under Interruptions

Authors: Smit Nautambhai Modi, Gandharv Mahajan, Marc Wetter, Randall Welles

Organizations: Applied Machine Learning Research

Abstract

Real-time voice assistants must revise task state when users interrupt mid-response, but existing spoken-dialog benchmarks largely evaluate turn-based interaction and miss this failure mode. We introduce EchoChain, a controlled benchmark for evaluating full-duplex state-update reasoning under mid-speech interruptions. EchoChain identifies three recurring failure patterns in post-interruption continuations: contextual inertia, interruption amnesia, and objective displacement. The benchmark generates scenario-driven conversations and injects interruptions at a standardized point relative to assistant speech onset, enabling controlled cross-model comparison. In a paired half-duplex control, total failures drop by 40.2% relative to interrupted runs, indicating that many errors are driven by state-update reasoning under interruption rather than task difficulty alone. Across evaluated real-time voice models, no system exceeds a 50% pass rate, showing substantial room for improvement in mid-generation state revision. EchoChain provides a reproducible benchmark for diagnosing state-update reasoning failures in full-duplex voice interaction.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Same Words, Different Actions: Paired Turn-Taking Evaluation under Rewritten Dialogue Contexts

    Sep 15, 2026Shuofeng Zhao, Hongwei Cai, Wenke Fan +9Spoken Dialogue SystemsMulti-Turn Dialogue Evaluation

  2. Duplex-MPE: Benchmarking Multi-Party Interaction in Full-Duplex Dialogue

    Sep 25, 2026Chengqian Ma, Wenhao Feng, Weixuan Jin +7Voice Agent EvaluationFull-Duplex Spoken Dialogue Systems

  3. IHBench: Evaluating Post-Interruption Recovery in Voice Agents with Structured Workflows

    Jun 17, 2026Ahmad Salimi, Wentao Ma, Yuzhi Tang +3Audio-Language Model EvaluationAI Agent Benchmarks