Overview

Speaker diarization divides audio into speaker turns and assigns each turn to a speaker, often alongside word-level transcription. Common approaches detect speech, create speaker embeddings, and cluster them; end-to-end neural models, streaming systems, and speech-language models instead learn speaker activity or joint transcription and attribution. Systems are tested on meeting and conversational benchmarks such as AMI, AliMeeting, and DIHARD, as well as multilingual, clinical, and long-form recordings. A central challenge is maintaining accurate identities through overlap, long recordings, and domain shifts while meeting latency constraints; annotation conventions and evaluation metrics can also change how errors are measured.

Latest papers

CardsList

59 papers8 papers in the last four weeks, up 14% on the four weeks before. 0.0% of all new papers.

  1. S2SND-v2: Unified Online and Offline Speaker Diarization with Speaker-Adapted w2v-BERT 2.0

    Oct 26, 2026Jincheng Wang, Li Li, Weixin Zhu +4Speaker DiarizationSpeaker Embedding

  2. Slots Are Not Speakers: Training-Free Speaker Linking for Frozen Streaming Diarizers

    Oct 20, 2026Aditya Srinivas Menon, Kumarmanas Nethil, Kavya ManoharSpeaker Diarization

  3. Beyond Two Tracks: Speaker-Anchored Full-Duplex Dialogue Recovery

    Oct 19, 2026Yuxuan Chen, Yang Xiao, Jack Sun +3Full-Duplex Spoken Dialogue SystemsSpeaker Diarization

  4. Anuvani-Diarization: Zero Shot Speaker Diarization and Annotation Conventions Across 22 Languages

    Oct 14, 2026Stephen Fernandes, Narayan ChoudharySpeaker Diarization

  5. SepRQ : Self-Supervised Speech Mixture Representation Learning via Mask-Free, Multi-Scale Source Separation

    Oct 3, 2026Séverin Baroudi, Hervé Bredin, Ricard MarxerSelf-Supervised Speech Representation LearningSpeech Separation

  6. FASTDIAR: Frame-level speaker encoder for Streaming Diarization

    Oct 2, 2026Nikita Torgashov, Okan KöpüklüSpeaker EmbeddingSpeaker Diarization

  7. Training-Free Affinity Fusion of Neural and Embedding-Based Speaker Diarization

    Sep 30, 2026Yehoshua Dissen, Joseph Keshet, Eduard GolshteinSpeaker DiarizationFeature Fusion

  8. STAM-ASR: Speaker-Temporal Anchoring with Memory for Multi-Speaker ASR

    Sep 24, 2026Victor Tolulope Olufemi, Syeda Faiza Ahmed Sara, Shammur Absar ChowdhuryMulti-Speaker ASRAudio-Language Models

  9. The Second MLC-SLM Challenge: Multilingual Conversational Speech Diarization, Recognition, and Understanding

    Sep 23, 2026Bingshen Mu, Mingchen Shao, Zhennan Lin +7Spoken Language UnderstandingMultilingual Language Model Evaluation

  10. DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization

    Sep 15, 2026Weiming Li, Ana Catarina Fidalgo Barata, Miguel Constante +1Automatic Speech RecognitionSpeaker Diarization

  11. Neural Multichannel Distant Speaker Diarization with Heavy-tailed Source Separation Model

    Sep 10, 2026Sicheng Mao, Baihan Li, Mathieu Fontaine +2Audio Source SeparationSpeaker Diarization

  12. Diarization Error Decomposition Under Pause Annotation Ambiguity

    Sep 10, 2026Shota Horiguchi, Marc Delcroix, Naohiro Tawara +1Speaker Diarization

  13. Over-Tightening-Aware Pseudo-Labeling for Tight-Boundary Speaker Diarization

    Sep 9, 2026Shota Horiguchi, Takanori Ashihara, Marc Delcroix +2Pseudo-LabelingBoundary-Aware Segmentation

  14. Neural Multichannel Distant Speaker Diarization and Source Separation with Beta Speaker Activity Prior

    Aug 21, 2026Sicheng Mao, Mathieu Fontaine, Anthony Larcher +1Speaker Diarization

  15. Target Speaker Identification: A Low-Latency Streaming Pipeline

    Aug 18, 2026Patrick S. Burke, Satyam Raj, Sean KinahanSpeaker DiarizationSpeaker Verification

  16. From Speech to Interaction: Analyzing Multimodal Systems in Cocktail-Party Scenarios

    Aug 9, 2026Thai-Binh Nguyen, Zhaolin Li, Jan Niehues +1Target Speaker ExtractionAutomatic Speech Recognition

  17. Towards Operational Conversational Intelligence: A Speech Intelligence Framework

    Jul 27, 2026C. Vishnoi, S. Khurana, A. Timmapur +2Automatic Speech RecognitionSpeaker Diarization

  18. Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages

    Jul 26, 2026Deovrat Mehendale, Aditya Mehndiratta, Dhruv Rathi +2ASR EvaluationSpeech Processing

  19. Listen, Do Not Copy: Internalizing Audio-Grounded Scaffold Context for Robust Omni-Model Speech Understanding

    Jul 24, 2026Pengfei Zhang, Biao Tian, Tianxin Xie +3Speaker-Attributed ASRContextual ASR

  20. An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challenge

    Jul 14, 2026Shuming Fang, Shuifei ZengASR EvaluationAutomatic Speech Recognition

  21. Reasoning LLM Improves Speaker Recognition in Long-form TV Dramas

    Jul 2, 2026Yuxuan Li, Lingxi Xie, Xinyue Huo +6Audio-Visual UnderstandingSpeaker Diarization

  22. DG^VoiC: Speaker Clustering for Fraud Investigation under Real Call-Centre Conditions

    Jun 26, 2026Muhammad Shakeel Akram, Amal Htait, Abdul Hamid Sadka +2Speaker VerificationFinancial Fraud Detection

  23. Neural Speaker Diarization via Multilingual Training: Evaluation on Low-Resource Nepali-Hindi Speech

    Jun 21, 2026Samip Neupane, Sandesh Pokhrel, Sandesh Pyakurel +1Low-Resource Language ProcessingSpeaker Diarization