cs.HCMar 20, 2026

Demonstration of Adapt4Me: An Uncertainty-Aware Authoring Environment for Personalizing Automatic Speech Recognition to Non-normative Speech

Authors: Niclas Pokel, Yiming Zhao, Pehuén Moure, Yingqiang Gao, Roman Böhringer

Organizations: Institute of Neuroinformatics, University of Zurich and ETH Zurich · Department of Computer Science, ETH Zurich · Department of Computational Linguistics, University of Zurich

Abstract

Personalizing Automatic Speech Recognition (ASR) for non-normative speech remains challenging because data collection is labor-intensive and model training is technically complex. To address these limitations, we propose Adapt4Me, a web-based decentralized environment that operationalizes Bayesian active learning to enable end-to-end personalization without expert supervision. The app exposes data selection, adaptation, and validation to lay users through a three-stage human-in-the-loop workflow: (1) rapid profiling via greedy phoneme sampling to capture speaker-specific acoustics; (2) backend personalization using Variational Inference Low-Rank Adaptation (VI-LoRA) to enable fast, incremental updates; and (3) continuous improvement, where users guide model refinement by resolving visualized model uncertainty via low-friction top-k corrections. By making epistemic uncertainty explicit, Adapt4Me reframes data efficiency as an interactive design feature rather than a purely algorithmic concern. We show how this enables users to personalize robust ASR models, transforming them from passive data sources into active authors of their own assistive technology.

Figures & tables

Explore similar work

CardsList
  1. Two-Stage Adaptation for Non-Normative Speech Recognition: Revisiting Speaker-Independent Initialization for Personalization

    Mar 16, 2026Shan Jiang, Jiawen Qi, Chuanbing Huo +2Automatic Speech RecognitionDomain Adaptation for ASR

  2. Adapting Foundation ASR Models to Dysarthric Speech: A Case Study

    Jun 30, 2026Christian Huber, Laura Kernahan, Alexander WaibelPersonalized Speech RecognitionAutomatic Speech Recognition

  3. ASR Personalization in Pathological Voice: Accuracy, Efficiency, and Duration Effects

    Oct 17, 2026Giuseppe Giaimis, Sergei Katkov, Muhammad Azfar Yaqub +1Automatic Speech RecognitionPersonalized Speech Recognition