Coreset Selection
Overview
Coreset selection studies how to keep a small, useful subset of data while preserving the performance or statistical properties of the full dataset. Methods include geometric coverage and clustering, sensitivity and importance sampling, gradient or training-dynamics scores, and submodular, determinantal, or optimal-transport selection; newer approaches also use model representations and foundation-model embeddings. These methods support settings from image and medical annotation to language-model tuning, benchmark compression, graph learning, clustering, and memory-bounded anomaly detection. A central tension is that carefully selecting data can improve efficiency, but selection itself costs time and memory, and results depend on the learner and budget; random subsets or full-data training can still be competitive, so no method is best across settings.
Latest papers
59 papers8 papers in the last four weeks, up 14% on the four weeks before. 0.0% of all new papers.