cs.SDNov 2, 2026

Metadata-Conditioned Audio Transformers for Adaptive Respiratory Sound Classification

Authors: George Kontogiannis, Pantelis Tzamalis, Sotiris Nikoletseas

Organizations: Computer Engineering and Informatics Department, University of Patras, Patras, Greece

Abstract

Respiratory sound classification from auscultation recordings is confounded by heterogeneous acquisition conditions, including recording device, auscultation site, and patient characteristics, that introduce systematic variability unrelated to the underlying pathology. Although such metadata is often available, existing approaches either ignore it or rely on naïve fusion strategies that do not model how distinct metadata sources influence different components of the acoustic representation. We propose a family of metadata-conditioning mechanisms for the Audio Spectrogram Transformer (AST), progressing from gated residual fusion to Feature-wise Linear Modulation (FiLM) adapted to the Transformer architecture. We further introduce two novel variants: Token-Aware FiLM (TAFiLM), which applies distinct modulation to classification and patch tokens, and Soft-Factorized FiLM (SoftFiLM), which learns soft masks to align metadata factors with disentangled feature subspaces. Experiments on the ICBHI benchmark demonstrate consistent gains across all conditioning strategies. SoftFiLM achieves 64.11% on the official 4-class task (+3.94% over the baseline) and 72.40% on the 2-class task, establishing a new state-of-the-art on the 2-class task and competitive performance on the 4-class benchmark.

Figures & tables

Explore similar work

CardsList
  1. Lung-SRAD: Spectral-Aware Regularized Audio DASS with Dual-Axis Patch-Mix Contrastive Learning for Respiratory Sound Classification

    Jun 10, 2026Hemansh Shridhar, Miika Toikkanen, June-Woo KimContrastive LearningSpectral Regularization

  2. Clinically Informed Acoustic-Aware Attribute Modeling for Respiratory Sound Classification

    Oct 16, 2026Xinhong Li, Li Xiao, Ziyang Chen +2Respiratory Sound ClassificationClassification

  3. Mitigating Stethoscope-Induced Shortcuts in Respiratory Sound Classification under Federated Domain Generalization with Causality-Inspired Interventions

    May 28, 2026Heejoon Koo, Yoon Tae Kim, Miika Toikkanen +1OOD GeneralizationFederated Domain Generalization