cs.CVMar 25, 2026

POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan

Authors: Marta Moscati, Muhammad Saad Saeed, Marina Zanoni, Mubashir Noman, Rohan Kumar Das, Monorama Swain, Yufang Hou, Elisabeth Andre, 

Organizations: Institute of Computational Perception, Johannes Kepler University Linz, Austria · University of Michigan-Flint, USA · Sapienza University of Rome, Italy · Mohamed bin Zayed University of Artificial Intelligence · 

Abstract

Multimodal speaker identification systems typically assume the availability of complete and homogeneous audio-visual modalities during both training and testing. However, in real-world applications, such assumptions often do not hold. Visual information may be missing due to occlusions, camera failures, or privacy constraints, while multilingual speakers introduce additional complexity due to linguistic variability across languages. These challenges significantly affect the robustness and generalization of multimodal speaker identification systems. The POLY-SIM Grand Challenge 2026 aims to advance research in multimodal speaker identification under missing-modality and cross-lingual conditions. Specifically, the Grand Challenge encourages the development of robust methods that can effectively leverage incomplete multimodal inputs while maintaining strong performance across different languages. This report presents the design and organization of the POLY-SIM Grand Challenge 2026, including the dataset, task formulation, evaluation protocol, and baseline model. By providing a standardized benchmark and evaluation framework, the challenge aims to foster progress toward more robust and practical multimodal speaker identification systems.

Figures & tables

Explore similar work

CardsList
  1. Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challenge

    Jul 15, 2026Marta Moscati, Muhammad Saad Saeed, Marina Zanoni +9Missing-Modality LearningMultimodal Robustness

  2. AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification

    Jun 28, 2026Chuxiao Zuo, Yao Zhu, Minqiang Xu +3Multimodal RobustnessSpeech Processing

  3. Missing-Token Prompted Reliability-Aware Fusion for Robust Polyglot Speaker Identification

    Jun 10, 2026Peng Jia, Li Dai, Jia Li +3Missing-Modality LearningMultimodal Robustness