EDMFormer: Genre-Specific Self-Supervised Learning for Music Structure Segmentation
Organizations: University of Waterloo
Abstract
Music structure segmentation is a key task in audio analysis, but existing models perform poorly on Electronic Dance Music (EDM). This problem exists because most approaches rely on lyrical or harmonic similarity, which works well for pop music but not for EDM. EDM structure is instead defined by changes in energy, rhythm, and timbre, with different sections such as buildup, drop, and breakdown. We introduce EDMFormer, a transformer model that combines self-supervised audio embeddings using an EDM-specific dataset and taxonomy. We release this dataset as EDM-98: a group of 98 professionally annotated EDM tracks. EDMFormer improves boundary detection and section labelling compared to existing models, particularly for drops and buildups. The results suggest that combining learned representations with genre-specific data and structural priors is effective for EDM and could be applied to other specialized music genres or broader audio domains.
Figures & tables
| Model | [email protected] | HR@3 | ACC |
|---|---|---|---|
| SongFormer (Pop Taxonomy) | 0.569 | 0.608 | 0.148 |
| EDMFormer (EDM Taxonomy) | 0.616 | 0.635 | 0.883 |
Music Information Retrieval
Music Information Retrieval develops computational methods for finding, classifying, describing, and analyzing music from audio, scores, and metadata.
See all 153 papers