Overview

Turn-taking research examines how people and conversational systems manage the floor: detecting when a speaker is finished, recognizing backchannels, choosing who speaks next, and timing interruptions. Methods range from voice-activity and prosody models to streaming speech-language models that combine acoustic, semantic, and sometimes visual cues such as gaze; systems are trained with supervised data, synthetic dialogues, and reinforcement learning. Benchmarks increasingly test full-duplex and multi-party interaction, different conversational intents, and noisy or overlapping speech, while measuring timing alongside response content. A central challenge is making systems as context-sensitive as human listeners: they must avoid both premature interruptions and missed opportunities to speak, and current systems still struggle to match human timing reliably.

Latest papers

CardsList

38 papers5 papers in the last four weeks, down 55% on the four weeks before. 0.0% of all new papers.

  1. Conversation Is a Two-Body Problem: Dyadic Evaluation of Full-Duplex Dialogue Models

    Oct 6, 2026Sungnyun Kim, Sungwoo Cho, Jihwan Oh +1Multi-Turn Dialogue EvaluationFull-Duplex Spoken Dialogue Systems

  2. An automated pipeline for standardised speech-unit annotation in spontaneous dialogue

    Oct 2, 2026Hanlu He, Harald Vilhelm Skat-Rørdam, Ingvi Örnólfsson +1Speech ProcessingTurn-Taking in Dialogue

  3. DuplexAct-Bench: Broadening Full-Duplex Speech Evaluation toward Proactive Interaction across Diverse Behavioral Requirements

    Sep 30, 2026Keyue Xing, Wentao Ding, Mengmeng Wang +3Full-Duplex Spoken Dialogue SystemsTurn-Taking in Dialogue

  4. AdaptDuplex: From Static to Adaptive Full-Duplex Spoken Dialogue

    Sep 24, 2026Zhiyang Zhou, Yingxin Shang, Zhou Wang +9Spoken Dialogue SystemsSpeech Language Models

  5. A Harness for Synthesizing Diverse Naturalistic Full-Duplex Conversations

    Sep 23, 2026Matthew Sun, Vinay Kothapally, Meng Yu +4Spoken Dialogue SystemsSynthetic Data Generation

  6. Full-Duplex Speech Models Take the Floor When Asked, Not When Needed

    Sep 17, 2026Linkai Peng, Baorian Nuchged, Kaiqi Fu +1Language Model Safety EvaluationSpoken Dialogue Systems

  7. Same Words, Different Actions: Paired Turn-Taking Evaluation under Rewritten Dialogue Contexts

    Sep 15, 2026Shuofeng Zhao, Hongwei Cai, Wenke Fan +9Spoken Dialogue SystemsMulti-Turn Dialogue Evaluation

  8. Audio-Visual Turn-taking Prediction in Cocktail Party Scenarios

    Sep 15, 2026Long-Vu Hoang, Naomi HarteDomain AdaptationTurn-Taking Prediction

  9. Less can be More: What Aspects of Speech Drive End-of-Turn Detection

    Sep 10, 2026Rini Sharon, Manickavela A, Kadri Hacioglu +1Speech ProsodyTurn-Taking Prediction

  10. Using Semantic Uncertainty to Estimate Transition Relevance in Turn-taking

    Sep 10, 2026Muhammad Umair, Jan P. de RuiterSpoken Dialogue SystemsTurn-Taking Prediction

  11. TEIDAN: A Multilingual Multiparty Dialogue Corpus

    Sep 1, 2026Taiga Mori, Koji Inoue, Mikey Elmers +2Spoken Dialogue SystemsTurn-Taking in Dialogue

  12. When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions

    Aug 29, 2026Zachary Ellis, Spencer Hazel, Adam Brandt +3Voice Agent EvaluationClinical Language Model Evaluation

  13. Predicting Turn-Taking Outcomes in Multi-Party Conversation: Interpretable Modelling of Speech and Gaze Dynamics with Interpersonal Closeness

    Aug 28, 2026Mark Dourado, Karim Haddad, Henrik G. Hassager +1Turn-Taking PredictionTurn-Taking in Dialogue

  14. TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue

    Aug 25, 2026Freeman Jiang, Ramon Sanabria, Soham Deshmukh +16Spoken Dialogue SystemsMulti-Turn Dialogue Evaluation

  15. Cocktail-Talker: Multi-Speaker Dialog Modeling in Noisy Social Environments with Turn Action GRPO

    Jul 30, 2026Xilin Jiang, Riki Shimizu, Sukru Samet Dindar +3Spoken Dialogue SystemsSpeech Language Models

  16. DuplexGen: Adaptive Synthesis of Human-AI Turn-Taking Dialogues

    Jul 28, 2026Takyoung Kim, Kang-wook Kim, Sang Hoon Woo +3Human-in-the-Loop AISynthetic Data Generation for Language Models

  17. Low-Latency Turn-Taking via Context-Aware Preface Generation in a Real-World Dialogue Robot

    Jul 25, 2026Yuki Okafuji, Koji Inoue, Yoshiki OhiraSpoken Dialogue SystemsTask-Oriented Dialogue Systems

  18. Modeling turn-taking with distant viewing: investigating silence thresholds in human and AI-generated discourse

    Jul 20, 2026Taylor Arnold, Nicolas Ballier, Artem SaloevTurn-Taking in Dialogue

  19. TurnNat: Automatic Evaluation of Turn-Taking Naturalness in Dyadic Spoken Dialogue

    Jul 1, 2026Hao Zhang, Thomas Thebaud, Georgi Tinchev +2Automated EvaluationFull-Duplex Spoken Dialogue Systems

  20. Next-Turn: Duration-Aware Streaming Endpoint Detection via Time-to-Next-Speech-Onset Prediction

    Jun 16, 2026Tristan Tsoi, Jiajun Deng, Yingke Zhu +5Event Time PredictionStreaming ASR

  21. MuVAP: Multimodal Multiparty Voice Activity Projection for Turn-taking Prediction in the Wild

    Jun 15, 2026Haotian Qi, Gabriel SkantzeMultimodal GroundingAudio-Visual Understanding

  22. Fast When, Careful Who: Dual-Process Multiparty Turn-Taking with Diffusion Augmentation

    Jun 15, 2026Rutherford A. Patamia, Ming Liu, Wei Luo +2Spoken Dialogue SystemsTurn-Taking Prediction

  23. BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM

    Jun 12, 2026Qingkai Fang, Shoutao Guo, Yang FengSpoken Dialogue SystemsSpeech Language Models