Parameter isolation with domain-specific experts for incremental audio classification
Organizations: Dept. of AI Convergence, Gwangju Institute of Science and Technology (GIST) · Dept. of EECS, Gwangju Institute of Science and Technology (GIST) · AunionAI Co., Ltd., Gwangju, Korea · AI Lab., R&D Center, Hanwha Vision, Seongnam, Korea
Abstract
To successfully deploy a model in time-varying environments such as streaming data prediction and sensing control, domain-incremental learning (DIL) has attracted attention since it aims to adapt a previously trained model to newly arriving domains, while reserving knowledge from earlier domains without accessing their data. Incremental learning across domains can be regarded as a recurrent update, in which the current model is obtained by updating the model carried over from previous domains. Conventional DIL approaches that rely on domain-invariant feature learning and weight regularization gradually overwrite or constrain parameters learned in previous domains, leading to catastrophic forgetting. Instead, this paper proposes a new domain-specific parameter-isolation architecture that retains all past domains. The proposed architecture mitigates catastrophic forgetting through a full-order recurrent update, constructing a new expert using domain-specific data conditioned on all previously frozen models. To achieve this, we incorporate data-free generative replay to reconstruct previous-domain data and cross-domain feature generation to recover later expert features missing from earlier domain samples. Finally, we apply the proposed model architecture to domain-agnostic incremental learning for audio classification, as defined in the DCASE 2026 Challenge Task 7. Consequently, we achieve micro and macro accuracies of 78.4% and 78.9%, respectively, representing increases of 33 and 25 percentage points over the Challenge baseline. Ablation studies are conducted to examine the effectiveness of each processing component in terms of classification accuracy.
Figures & tables
| System | ( ) | ( ) | ( ) |
|---|---|---|---|
| FoIL-FineTune | CNN14 | CNN14 | CNN14 |
| FoIL | CNN14 | CNN14 , CRNN | CNN14 , CNN14 |
| FoIL-FDY | CNN14 | CNN14 , FDY-CNN14 | CNN14, CNN14 |
| FoIL-NoReplay | CNN14 | CNN14, FDY-CNN14 | CNN14, CNN14 |
| Dev-test Avg. | ||||||
|---|---|---|---|---|---|---|
| System | micro | macro | micro | macro | micro | macro |
| Challenge Baseline | ||||||
| OR-KDL | – | – | – | |||
| FoIL-FineTune | ||||||
| FoIL | ||||||
| FoIL-Ensemble | 78.38 | 78.92 | ||||
| Components | Macro Acc. (%) | |||||
|---|---|---|---|---|---|---|
| Variant | Replay | MLP-Gen | Feat-Mean | Avg. | ||
| FoIL-None | 72.88 | 72.05 | 72.47 | |||
| FoIL-R | ✓ | 74.98 | 74.19 | 74.59 | ||
| FoIL-M | ✓ | 79.22 | 74.42 | 76.82 | ||
| FoIL-RM | ✓ | ✓ | 81.88 | 73.97 | 77.92 | |
| FoIL-RF | ✓ | ✓ | 65.33 | 75.50 | 70.42 | |
Domain-Incremental Learning
Domain-incremental learning studies how models adapt to changing input distributions while retaining performance on previously encountered domains.
See all 53 papers