Overview

Turn-taking prediction studies when a speaker is likely to finish or continue, who may speak next, and whether an entry is a floor change, backchannel, or interruption. Systems use acoustic and prosodic cues such as pauses and intonation, often with voice activity projection, while other approaches add words, gaze, facial motion, speaker roles, or dialogue context. Current work combines streaming speech recognition with turn-state prediction and trains models using supervised, self-supervised, or synthetic conversational data. A central challenge is acting at the right time across noisy, overlapping, and multi-party conversations: early responses risk interruptions, while cautious systems may miss opportunities, and benchmarks do not always capture human judgments of appropriate timing.

Latest papers

CardsList

42 papers5 papers in the last four weeks, down 37% on the four weeks before. 0.0% of all new papers.

  1. Leveraging Dual-Process Theory for Multimodal Multiparty Turn-Taking Prediction

    Nov 14, 2026Rutherford A. Patamia, Ming Liu, Wei Luo +4Turn-Taking PredictionMultimodal Understanding

  2. AVCC: Audio-Visual Conversation Corpus for Turn-Taking Prediction with a Human Benchmark

    Nov 10, 2026Haotian Qi, Gabriel SkantzeTurn-Taking PredictionSpeech Corpus Construction

  3. TurnTurk-GPT: Text-Based Turn-Taking Prediction for Turkish

    Oct 30, 2026Ahmet Tuğrul Bayrak, Fatma Nur Korkmaz, Nur Yağmur Tuncer +1Turn-Taking Prediction

  4. The Importance of Speech Genre for End-of-Turn Detector Training

    Oct 29, 2026Rini Sharon, Kadri Hacioglu, Jeena Prakash +1Turn-Taking Prediction

  5. HiPLEX: Hierarchical Policy Factorization for Full Duplex Speech Language Models

    Oct 6, 2026Kyudan Jung, Hyunsin Park, Yoonhyung Lee +5RL for Language ModelsSpeech Language Models

  6. XTurnix: Large-Scale Self-Supervised Turn Control through Two-State Binary Decisions

    Oct 3, 2026Zhanxun Liu, Yifan Duan, Hengtao Wu +7Turn-Taking PredictionSpoken Dialogue Systems

  7. Multimodal Voice Activity Projection for Social Robot Mediation: Expected Behavior and Deployment Constraints

    Sep 23, 2026Antonio Cano, Guillermo Perez, Luis Merino +1Turn-Taking PredictionHuman-Robot Interaction

  8. Same Words, Different Actions: Paired Turn-Taking Evaluation under Rewritten Dialogue Contexts

    Sep 15, 2026Shuofeng Zhao, Hongwei Cai, Wenke Fan +9Spoken Dialogue SystemsMulti-Turn Dialogue Evaluation

  9. Audio-Visual Turn-taking Prediction in Cocktail Party Scenarios

    Sep 15, 2026Long-Vu Hoang, Naomi HarteDomain AdaptationTurn-Taking Prediction

  10. Exploring Multimodal Turn-Taking Cues in Face-to-Face Conversation using Voice Activity Projection

    Sep 13, 2026Willem Berner, Julio Cesar Cavalcanti, Kalle Åström +1Turn-Taking PredictionAudio-Visual Understanding

  11. Less can be More: What Aspects of Speech Drive End-of-Turn Detection

    Sep 10, 2026Rini Sharon, Manickavela A, Kadri Hacioglu +1Speech ProsodyTurn-Taking Prediction

  12. Using Semantic Uncertainty to Estimate Transition Relevance in Turn-taking

    Sep 10, 2026Muhammad Umair, Jan P. de RuiterSpoken Dialogue SystemsTurn-Taking Prediction

  13. Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meeting

    Sep 3, 2026Muneeb Khan, Frederic Kirstein, Terry Ruas +1LLM Agent EvaluationConversational Agents

  14. Predicting Turn-Taking Outcomes in Multi-Party Conversation: Interpretable Modelling of Speech and Gaze Dynamics with Interpersonal Closeness

    Aug 28, 2026Mark Dourado, Karim Haddad, Henrik G. Hassager +1Turn-Taking PredictionTurn-Taking in Dialogue

  15. TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue

    Aug 25, 2026Freeman Jiang, Ramon Sanabria, Soham Deshmukh +16Spoken Dialogue SystemsMulti-Turn Dialogue Evaluation

  16. Real-TurnTurk: A Multimodal Turkish Corpus for Turn-Taking Prediction

    Aug 22, 2026Ahmet Tuğrul Bayrak, Fatma Nur Korkmaz, Bekir Berker Türker +2Turn-Taking Prediction

  17. Cocktail-Talker: Multi-Speaker Dialog Modeling in Noisy Social Environments with Turn Action GRPO

    Jul 30, 2026Xilin Jiang, Riki Shimizu, Sukru Samet Dindar +3Spoken Dialogue SystemsSpeech Language Models

  18. On the Structure of Address in Multi-Party Dialogue: From Discrete Labels to Continuous Levels

    Jul 17, 2026Taiga Mori, Koji Inoue, Divesh Lala +1Turn-Taking Prediction

  19. Multimodal Voice Activity Projection for Turn-Taking in Social Robots with Voice-Activity-Related Pretrained Encoders

    Jul 8, 2026Antonio Cano, Guillermo Pérez, Luis Merino +1Conversational AgentsHuman-Robot Interaction

  20. Evaluating Large Language Models Abilities for Addressee, Turn-change, and Next Speaker Prediction in Meetings

    Jun 16, 2026Ryo Fukuda, Takatomo Kano, Siddhant Arora +7LLM EvaluationMultimodal Large Language Models

  21. MuVAP: Multimodal Multiparty Voice Activity Projection for Turn-taking Prediction in the Wild

    Jun 15, 2026Haotian Qi, Gabriel SkantzeMultimodal GroundingAudio-Visual Understanding