cs.AIAug 31, 2026

Conversation Coach: A Voice-enabled AI System that Helps Practice Difficult Workplace Conversations

Authors: Fanyou WuSuraj MaharjanAinur YessenalinaDennis Xu ChenRahul SrivastavaSrinivasan H. Sengamedu

Organizations: Amazon

Abstract

Effective manager-employee communication is critical for retaining high performers and developing underperformers, yet training managers in these skills remains costly. Text-based chatbots offer a scalable approach but cannot provide realistic rehearsal: managers need to practice speaking aloud to build confidence before high-stakes conversations. In this paper, we propose Conversation Coach, a voice-first AI system that enables managers to rehearse difficult workplace conversations in a realistic spoken format. The system addresses three challenges: achieving low-latency interactions with strong language understanding, enabling adaptive conversations through configurable bot personalities that simulate different employee types, and generating personalized feedback on content and policy compliance. We compare an end-to-end speech-to-speech model with a cascaded approach combining automatic speech recognition, a large language model, and text-to-speech synthesis. The end-to-end approach achieves 3×\times lower median (P50) latency with native barge-in capability at an estimated 8×\times lower cost, while the cascaded approach offers superior reasoning essential for coaching quality. We deployed the cascaded architecture in production, where 40,000+ managers used it over six months, with adoption patterns indicating selective use for difficult conversations.

Explore similar work

CardsList
  1. Adaptive Turn-Taking for Real-time Multi-Party Voice Agents

    Jun 11, 2026Soumyajit Mitra, Prabhat Pandey, Abhinav Jain +2Turn-TakingVoice Agents

  2. VAmoS Bench: Voice Agent Simulation Bench

    Jul 29, 2026Joshua Meyer, Sahar Shayegan, Ritiz Tambi +5Voice Agents