Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AI
Organizations: Department of Computer Science, University of Copenhagen, Copenhagen, Denmark · Division of Statistics and Machine Learning, Linköping University, Linköping, Sweden · Department of Electrical and Photonics Engineering, Technical University of Denmark, Kongens Lyngby, Denmark
Abstract
This position paper argues that the machine learning community must move from preaching to practising data frugality for responsible artificial intelligence (AI) development. For too long, progress has been equated with ever-larger datasets, driving remarkable advances but now yielding increasingly diminishing performance gains alongside rising energy use and carbon emissions. While awareness of data frugal approaches has grown, their adoption has remained rhetorical, and data scaling continues to dominate development practice. We argue that this gap between preach and practice must be closed, as continued data scaling entails substantial and under-accounted environmental impacts. To ground our position, we provide indicative estimates of the energy use and carbon emissions associated with the downstream use of ImageNet-1K. We then present empirical evidence that data frugality is both practical and beneficial, demonstrating that subset selection methods can substantially reduce training energy consumption with little loss in accuracy, while also mitigating dataset bias. Finally, we outline actionable recommendations for moving data frugality from rhetorical preaching to concrete practice for responsible development of AI.
Figures & tables
| minutes/epoch | kWh/epoch | ||||||
|---|---|---|---|---|---|---|---|
| Model | Param. | Full | 25% pruned | Gain | Full | 25% pruned | Gain |
| ResNet-34 | 21.8M | 35.2 | 23.8 | 32% | 0.2798 | 0.1989 | 29% |
| ResNet-50 | 25.6M | 40.7 | 24.3 | 40% | 0.3940 | 0.2645 | 33% |
| Swin-T | 28.3M | 58.7 | 44.6 | 24% | 0.7002 | 0.5300 | 24% |
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Observed | Projected | ||||||||
| Metric | 2017 | 2018 | 2019 | 2020 | 2021 | 2022 | 2023 | 2024 | 2025 |
| Total accepted (real) | 196 | 336 | 502 | 687 | 858 | 1094 | 1574 | 2260 | 3704 |
| ImageNet papers | 75 | 129 | 183 | 238 | 319 | 395 | 554 | 785 | 1270 |
| ImageNet ratio | 0.383 | 0.384 | 0.365 | 0.346 | 0.372 | 0.361 | 0.352 | 0.348 | 0.343 |
| Trained on ImageNet | 28 | 43 | 55 | 80 | 105 | 110 | 154 | 207 | 315 |
| Trained on ImageNet / total | 0.143 | 0.128 | 0.110 | 0.116 | 0.122 | 0.101 | 0.098 | 0.091 | 0.085 |
| 2017 | 2018 | 2019 | 2020 | 2021 | 2022 | 2023 | 2024 | 2025 | |
|---|---|---|---|---|---|---|---|---|---|
| Total published | 12,998 | 21,389 | 31,538 | 38,374 | 48,294 | 53,825 | 59,847 | 63,516 | 65,124 |
| Trained on ImageNet | 1,104 | 1,946 | 3,090 | 3,875 | 5,891 | 6,243 | 6,583 | 8,130 | 9,312 |
Responsible AI
Responsible AI studies how to design, evaluate, and govern AI systems to promote fairness, safety, transparency, accountability, privacy, and sustainability.
See all 132 papersAI-CARE: Carbon-Aware Reporting Evaluation Metric for AI Models
Beyond State-of-the-Art: Standardising Environmental Impact Metrics for AI Research
Smallest Model that Achieves the Job' (SMAJ), a framework which challenges the field to prioritise computational efficiency and environmental accountability alongside traditional State-of-the-Art' (SotA) accuracy.