eess.ASOct 10, 2026

FAM-gate: field-aware metadata attention with prior-constrained vector gating for audio classification

Authors: Xiangyu Jing, Hongqing Liu, Liming Shi

Organizations: School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China

Abstract

User-generated audio collections frequently contain textual metadata such as titles, tags, and descriptions. Effectively leveraging these complementary fields requires accounting for both field het erogeneity and varying semantic relevance relative to the acoustic content. We propose FAM-Gate, a two-stage framework for metadata-enriched audio classification. In the first stage, field-aware metadata-view attention dynamically aggregates multiple metadata views using audio-guided weighting, explicit field-identity embeddings, a shared identity-initialized projection, and mean-anchored regularized aggregation. In the second stage, a prior-constrained vector gate performs bounded, dimension-wise fusion of audio and metadata representations centered around an acoustic prior. Ex periments on BSD10K, BSD35K, and FSD50K show consistent improvements in both hierarchical single-label and multi-label classification. Compared with matched random-view scalar-fusion base lines, FAM-Gate improves the hierarchical F-score by 2.53 and 5.72 percentage points on BSD10K and BSD35K, respectively, while increasing macro mAP and macro F1 by 5.07 and 10.25 percentage points on FSD50K.

Figures & tables

Explore similar work

CardsList
  1. A Multi-Branch Hierarchy-Aware Framework for Heterogeneous Audio Classification

    Jul 2, 2026Beile Ning, Jiayi Yu, Zitong Wang +5Hierarchical ClassificationAudio Classification

  2. MADS: A Multiview Acoustic Descriptor Set Beyond Standard Spectral Summaries

    Sep 1, 2026Utsab Ghosh, Roshni ChakrabortyAudio Classification

  3. Unlocking Strong Supervision: A Data-Centric Study of General-Purpose Audio Pre-Training Methods

    Mar 26, 2026Xuanru Zhou, Yiwen Shao, Wei-Cheng Tseng +1Audio Representation LearningAudio Classification