Clinically Informed Acoustic-Aware Attribute Modeling for Respiratory Sound Classification
Authors: Xinhong Li, Li Xiao, Ziyang Chen, Yuhong Yang, Weiping Tu
Organizations: School of Computer Science, Wuhan University, Wuhan, China · Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University, Wuhan, China
Automated respiratory sound classification (RSC) aims to identify normal and adventitious respiratory sounds, such as crackles and wheezes. Most existing methods formulate RSC as a flat four-class classification problem over norma, crackle, wheeze and both. However, unlike conventional classification tasks with semantically independent and mutually exclusive categories, the commonly used four-class RSC labels have a compositional structure and can be represented by two clinically meaningful sound attributes: crackle presence and wheeze presence. Existing flat classifiers do not explicitly exploit this structure, which may increase the learning burden by treating the four labels as independent targets. Meanwhile, crackles and wheezes exhibit distinct temporal characteristics, with sparse transient crackle events and sustained continuous wheeze patterns, making a single temporal aggregation strategy less suitable for modeling different adventitious sound evidence. To address these limitations, we propose an Acoustic-Aware Asymmetric Framework (AAAF) for RSC. AAAF reformulates four-class recognition as two sound-attribute detection tasks and recovers the final category through logical composition during inference. Built upon a pretrained BEATs encoder, AAAF employs branch-specific multi-layer fusion and asymmetric temporal aggregation to capture localized crackle evidence and sustained wheeze patterns. Auxiliary normal--abnormal supervision and a batch-adaptive dynamic loss are further introduced to improve global discrimination and robustness under imbalanced labels. Experiments on ICBHI and SPRSound demonstrate that AAAF improves overall RSC performance and generalizes across datasets, achieving a state-of-the-art four-class Score of 65.30% on ICBHI.
Figures & tables
Fig. 1: Motivation of AAAF: flat four-class RSC versus crackle–wheeze attribute modeling with acoustic-aware temporal aggregation.
Fig. 2: Overview of the proposed AAAF. Hierarchical BEATs representations are fused and fed into two attribute-specific branches for crackle and wheeze presence detection. Temporal Top- K pooling emphasizes localized crackle evidence, while average pooling with channel attention captures sustained wheeze patterns. The final four-class prediction is obtained by logical composition, with auxiliary normal–abnormal supervision and batch-adaptive dynamic loss for joint optimization.
Method
Architecture
Pretrain
Venue
Sp (%)
Se (%)
Score (%)
4-class eval.
Patch-Mix [ 15 ]
AST
IN + AS
INTERSPEECH’23
81.66
43.07
62.37
SG-SCL [ 6 ]
AST
IN + AS
ICASSP’24
79.87
43.55
61.71
RepAugment [ 14 ]
AST
IN + AS
EMBC’24
82.47
40.55
61.51
LungAdapter [ 5 ]
AST
IN + AS
INTERSPEECH’24
80.43
44.37
62.40
BTS [ 21 ]
CLAP
LA
INTERSPEECH’24
81.40
45.67
63.54
AMG-SCL [ 22 ]
AST
IN + AS
JBHI’25
76.18
47.91
62.04
TABLE I: Performance comparison on the ICBHI 2017 benchmark. Bold and underline indicate the best and second-best results, respectively. IN, AS, and LA denote ImageNet [ 18 ] , AudioSet [ 19 ] , and LAION-Audio-630K [ 20 ] pretraining.
Method
Architecture
Pretrain
4-class eval.
2-class eval.
Sp (%)
Se (%)
Score (%)
Sp (%)
Se (%)
Score (%)
ResNet-50 †
CNN
IN
91.33
82.81
87.07
89.72
90.07
89.90
EfficientNet-B0 †
CNN
IN
91.68
83.57
87.63
90.30
91.15
90.72
AST †
AST
IN + AS
90.85
84.65
87.75
89.80
92.57
91.19
BEATs †
BEATs
AS
91.39
85.36
88.38
90.06
93.99
92.02
SCL [ 4 ]
CNN
AS
90.49
80.69
85.59
–
–
–
TABLE II: External validation results on the SPRSound dataset. † denotes results reproduced by us under the same evaluation protocol. Pretraining abbreviations follow Table I .
TABLE IV: Comparison of BEATs layer selection strategies for hierarchical feature extraction.
K
Sp (%)
Se (%)
Score (%)
1
82.13 ± 4.03
46.29 ± 3.77
64.21 ± 0.84
3
79.38 ± 2.68
50.09 ± 1.74
64.74 ± 0.64
5
80.25 ± 3.57
50.35 ± 3.15
65.30 ± 0.50
7
79.54 ± 7.57
48.84 ± 6.35
64.19 ± 1.00
9
84.23 ± 6.32
45.18 ± 7.19
64.70 ± 0.94
11
80.11 ± 5.15
49.02 ± 4.65
64.57 ± 0.50
TABLE V: Impact of Top- K pooling in the crackle branch.
Fig. 3: Frame-wise branch responses on a Both sample before temporal pooling. The crackle branch produces sparse peak responses around localized transient regions, with selected Top- K frames marked by dots, while the wheeze branch shows broader sustained activations over longer intervals.
Backbone
Method
Sp (%)
Se (%)
Score(%)
ResNet-50
CE
76.53 ± 4.56
32.01 ± 2.95
54.24 ± 1.00
AAAF
79.11 ± 2.02
31.47 ± 2.71
55.29 ± 0.71
Eff.-B0
CE
77.63 ± 3.94
37.72 ± 3.19
57.68 ± 0.79
AAAF
86.92 ± 0.87
31.05 ± 1.46
58.98 ± 0.66
AST
CE
73.12 ± 3.38
45.91 ± 2.19
59.52 ± 0.84
AAAF
75.27 ± 4.46
47.03 ± 5.19
61.15 ± 0.51
TABLE VI: Backbone generalization on ICBHI four-class evaluation.
RSC LAB, MODULABS, Republic of Korea · Department of Electronic Engineering, Wonkwang University, Republic of Korea · AI Convergence Research Institute, Wonkwang University, Republic of Korea