Rethinking Magnitude Compression in Spectral Losses for DDSP Parameter Estimation
Organizations: University of Illinois Urbana-Champaign, Siebel School of Computing and Data Science, USA 61801
Abstract
Spectral losses for differentiable digital signal processing (DDSP) commonly compress magnitudes, for example by using log-magnitude terms. Such compression mimics human perception, but whether it helps the optimization is less clear, and is usually found only by comparing trained models. In this work, we show that whether compression helps depends on the system's informative region: the region of its dynamic range that carries the information pointing toward the target. To indicate where this region lies without having to train, we introduce concordance, which measures how well a loss orders candidate parameter settings by their distance from the target. We then compare uncompressed, compressed, and combined losses by fitting a modal plate reverb and a subtractive synthesizer model to target sounds. A third system, selected for its low-energy informative region, tests the relationship in the opposite direction. In every system, the loss that matches the informative region performs best: the uncompressed one where the region lies at high energies, and the compressed one where it lies low. Surprisingly, the common combination of both log-magnitude and linear-magnitude terms performs best in none of the systems. Code and audio examples are available at https://github.com/superstem000/compression-analysis
Figures & tables
| Synth. | Reverb | ||
| amplitude | 2 | – | |
| filter cutoff | 1 | 1 | |
| fundamental | – | 1 | |
| frequency ratio | 1 | – | |
| oscillator mix | 2 | 1 | |
| filter resonance | 1 | 1 |
| System | difference | |||
|---|---|---|---|---|
| Plate | 0.773 | 0.756 | ||
| Synth. | 0.781 | 0.771 | ||
| Reverb | 0.711 | 0.748 |
| linear | log | hybrid | ||
|---|---|---|---|---|
| Plate | MFCC (rendered) | 7.88 | 8.76 | 8.35 |
| NMSE | 0.036 | 0.218 | 0.221 | |
| MFCC (real) | 13.92 | 19.01 | 15.98 | |
| Synth. | MFCC (rendered) | 6.91 | 11.80 | 12.02 |
| NMSE | 0.0072 | 0.0157 | 0.0161 | |
| MFCC (real) | 11.45 | 14.01 | 12.76 |
| System | linear log | 95% CI | listeners | |
|---|---|---|---|---|
| Plate | 0.016 | 6/7 | ||
| Synth. | 0.033 | 6/7 |
Parameter Estimation
Parameter estimation studies how to infer unknown quantities in statistical, physical, and machine-learning models from observed data.
See all 144 papers