Paper ID: 2209.14609

Dataset Distillation Using Parameter Pruning

Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

In this study, we propose a novel dataset distillation method based on parameter pruning. The proposed method can synthesize more robust distilled datasets and improve distillation performance by pruning difficult-to-match parameters during the distillation process. Experimental results on two benchmark datasets show the superiority of the proposed method.

Submitted: Sep 29, 2022