Data-Efficient Learning

Ask about this topic

Overview

Data-efficient learning studies how to build useful models when labels, examples, simulations, or interaction data are costly or limited. Common approaches include active learning and coreset selection, semi-supervised and self-supervised pretraining, transfer and meta-learning, and curricula that prioritize examples suited to a model’s current abilities. In scientific and clinical settings, physical laws, domain knowledge, and synthetic data can provide useful structure when observations are scarce. A central challenge is that the best strategy depends on the task, data distribution, and compute budget, so gains in accuracy must be weighed against training cost, robustness, and reliable evaluation.

Latest papers

CardsList

245 papers28 papers in the last four weeks, up 56% on the four weeks before. 0.2% of all new papers.

  1. TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning

    Apr 14, 2026Chaoyao Shen, Linfeng Jiang, Yixian Shen +5Data-Efficient Learning

    Southeast University, China · University of Amsterdam, Netherlands · Southeast University & Shandong Yunhai Guochuang Innovative Technology Co., Ltd., China

  2. Black-Box Optimization From Small Offline Datasets via Meta Learning with Synthetic Tasks

    Apr 14, 2026Azza Fadhel, The Hung Tran, Trong Nghia Hoang +1Black-Box OptimizationSurrogate-Assisted Optimization

    School of EECS, Washington State University, Pullman, WA, USA

  3. Not All Forgetting Is Equal: Retention Dynamics in Fine-Tuned Image Classifiers

    Apr 13, 2026Miit Daga, Swarna Priya RamuFine-TuningData Selection

    School of Computer Science Engineering and Information Systems, Vellore Institute of Technology, Vellore, 632014, Tamil Nadu, India

  4. Energy-Efficient Federated Edge Learning For Small-Scale Datasets in Large IoT Networks

    Apr 12, 2026Haihui Xie, Wenkun Wen, Shuwu Chen +2Federated LearningEnergy-Efficient ML

    College of Computer and Information Sciences, Fujian Agriculture and Forestry University, and also with the Engineering Research Center of Smart Sensing and Agricultural Chip Technology, Fujian Province University, Fuzhou 350002, China · R&D Department, Techphant Technologies Company Ltd., Guangzhou 510310, China · School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou 510006, China

  5. Zero-shot World Models Are Developmentally Efficient Learners

    Apr 11, 2026Khai Loong Aw, Klemen Kotar, Wanhee Lee +6Zero-Shot LearningComputational Cognitive Modeling

    Stanford University

  6. Scaling-Aware Data Selection for End-to-End Autonomous Driving Systems

    Apr 9, 2026Tolga Dimlioglu, Nadine Chang, Maying Shen +2Training Data SelectionData-Efficient Learning

    New York University · NVIDIA · University of Ottawa

  7. A Graph Foundation Model for Wireless Resource Allocation

    Apr 8, 2026Yucheng Sheng, Jiacheng Wang, Le Liang +2Wireless Resource AllocationWireless Foundation Models

    National Mobile Communications Research Laboratory, Southeast University, Nanjing 210096, China · Department of Electrical and Computer Engineering, University of California, Santa Cruz, CA 95064, USA

  8. Generative Cross-Entropy: A Strictly Proper Loss for Data-Efficient Classification

    Apr 8, 2026Qipeng Zhan, Zhuoping Zhou, Li ShenData-Efficient LearningProper Scoring Rules

    University of Pennsylvania

  9. Batch Loss Score for Dynamic Data Pruning

    Apr 6, 2026Qing Zhou, Bingxuan Zhao, Tao Yang +3Dataset PruningData-Efficient Learning

    Northwestern Polytechnical University · The University of Hong Kong

  10. Gaze to Insight: A Scalable AI Approach for Detecting Gaze Behaviours in Face-to-Face Collaborative Learning

    Apr 1, 2026Junyuan Liang, Qi Zhou, Sahan Bulathwela +1AI in EducationGaze Estimation

    UCL Knowledge Lab, University College London, London, UK · UCL Center for Artificial Intelligence, University College London, UK

  11. InkDrop: Invisible Backdoor Attacks Against Dataset Condensation

    Mar 30, 2026He Yang, Dongyi Lv, Song Ma +4Backdoor AttacksDataset Condensation

  12. Online Learning of Kalman Filtering: From Output to State Estimation

    Mar 28, 2026Lintao Ye, Ankang Zhang, Ming Chi +2Kalman FilteringOnline System Identification

    School of Artificial Intelligence and Automation at the Huazhong University of Science and Technology, Wuhan, China · College of Automation Engineering at Nanjing University of Aeronautics and Astronautics, Nanjing, China · Elmore Family School of Electrical and Computer Engineering at Purdue University, West Lafayette, IN, USA

  13. PruneFuse: Efficient Data Selection via Weight Pruning and Network Fusion

    Mar 27, 2026Humaira Kousar, Hasnain Irshad Bhatti, Jaekyun MoonTraining Data SelectionData-Efficient Learning

    School of Electrical Engineering, KAIST · School of Electrical Engineering and Kim Jaechul Graduate School of AI, KAIST

  14. Autotuning T-PaiNN: Enabling Data-Efficient GNN Interatomic Potential Development via Classical-to-Quantum Transfer Learning

    Mar 25, 2026Vivienne Pelletier, Vedant Bhat, Daniel J. Rivera +2Machine Learning Interatomic PotentialsData-Efficient Learning

    Materials Science & Engineering, School for the Engineering of Matter, Transport, & Energy, Arizona State University, 551 E. Tyler Mall, Tempe Arizona, 85287, USA · Chemical Engineering, School for the Engineering of Matter, Transport, & Energy, Arizona State University, 551 E. Tyler Mall, Tempe Arizona, 85287, USA

  15. Heuristic-inspired Reasoning Priors Facilitate Data-Efficient Referring Object Detection

    Mar 25, 2026Xu Zhang, Zhe Chen, Jing Zhang +1Vision-Language GroundingObject Detection

    The University of Sydney, Australia · La Trobe University, Australia · Wuhan University, China +1

  16. GRMLR: Knowledge-Enhanced Small-Data Learning for Deep-Sea Cold Seep Stage Inference

    Mar 25, 2026Chenxu Zhou, Zelin Liu, Rui Cai +7Small-Data LearningData-Efficient Learning

    Shanghai Jiao Tong University, 200240 Shanghai, China

  17. The Order Is The Message

    Mar 24, 2026Jordan LeDouxData-Efficient LearningTraining Data Curation

    Independent Researcher

  18. Similarity-Aware Mixture-of-Experts for Data-Efficient Continual Learning

    Mar 24, 2026Connor Mclaughlin, Nigel Lee, Lili SuContinual LearningData-Efficient Learning

    Northeastern University, Boston, Massachusetts, USA · The Charles Stark Draper Laboratory, Inc., Cambridge, Massachusetts, USA

  19. Beyond Strict Pairing: Arbitrarily Paired Training for High-Performance Infrared and Visible Image Fusion

    Mar 23, 2026Yanglin Deng, Tianyang Xu, Chunyang Cheng +3Infrared-Visible Image FusionMulti-Source Image Fusion

    School of Artificial Intelligence and Computer Science, Jiangnan University · Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey

  20. Efficient Exploration at Scale

    Mar 18, 2026Seyed Mohammad Asghari, Chris Chute, Vikranth Dwaracherla +5RL from Human FeedbackData-Efficient Learning

    The Efficient Agent Team, Google DeepMind

  21. Level Up: Defining and Exploiting Transitional Problems for Curriculum Learning

    Mar 14, 2026Amogh Inamdar, Zhenwei Tang, Ashton Anderson +1Item Difficulty EstimationCurriculum Learning

    Department of Computer Science Columbia University · Department of Computer Science University of Toronto

  22. Foundation-Model Surrogates Enable Data-Efficient Active Learning for Materials Discovery

    Mar 13, 2026Jeffrey Hu, Rongzhi Dong, Ying Feng +2Active LearningData-Efficient Learning

    Department of Materials Science and Engineering, University of Illinois Urbana Champaign, Champaign,IL, USA · Department of Computer Science & Engineering, University of South Carolina, Columbia, SC, USA · Zuoyue Honors College, Hangzhou Dianzhi University, Hangzhou, China +1

  23. LLMs can construct powerful representations and streamline sample-efficient supervised learning

    Mar 12, 2026Ilker Demirel, Lawrence Shi, Zeshan Hussain +1Large Language Model-Based Feature EngineeringData-Efficient Learning

    MIT · Harvard Medical School

  24. CFD-HAR: User-controllable Privacy through Conditional Feature Disentanglement

    Mar 12, 2026Alex Gn, Fan Li, S Kuniyilh +1Privacy-Preserving Representation LearningHuman Activity Recognition

  25. High-resolution weather-guided surrogate modeling for data-efficient cross-location building energy prediction

    Mar 11, 2026Piragash Manmatharasan, Girma Bitsuamlak, Katarina GrolingerSurrogate ModelingCross-Domain Generalization

    Department of Electrical and Computer Engineering, Western University, London, N6A 5B9, Ontario, Canada · Department of Civil and Environmental Engineering, Western University, London, N6A 5B9, Ontario, Canada

  26. Data Agent: Learning to Select Data via End-to-End Dynamic Optimization

    Mar 8, 2026Suorong Yang, Fangjian Su, Hai Gan +5Data SelectionTraining Data Selection

    National University of Singapore · Nanjing University · Nanyang Technological University

  27. Tiny, Hardware-Independent, Compression-based Classification

    Mar 6, 2026Charles Meyers, Aaron MacSween, Erik Elmroth +1Kernel MethodsData-Efficient Learning

    Institute for Experiential AI, Northeastern University, Boston, United States · Department of Computer Science, Umeå University, Umeå, Sweden

  28. Lightweight and Scalable Transfer Learning Framework for Load Disaggregation

    Mar 5, 2026L. E. Garcia-Marrero, G. Petrone, E. MonmassonNon-Intrusive Load MonitoringTransfer Learning

    Systèmes et Applications des Technologies de l’Information et de l’Energie laboratory, Cergy-Pontoise · Dipartimento di Ingegneria dell’Informazione ed Elettrica e Matematica Applicata/DIEM, University of Salerno, 84084 Fisciano

  29. Rethinking Representativeness and Diversity in Dynamic Data Selection

    Mar 5, 2026Yuzhe Zhou, Zhenglin Hua, Haiyun Guo +1Diversity-Aware SamplingData Selection

    Southeast University, Nanjing, China · Chinese Academy of Sciences, Beijing, China

  30. When Bigger is Worse: A Practitioner's Guide to Model Selection Under Data Scarcity

    Mar 2, 2026Kwame Mbobda-Kuate, Gabriel KasmiModel SelectionEfficient Object Detection

    ENSAE Paris, Palaiseau, 91120, France. · Centre O.I.E., Mines Paris – PSL University, Sophia-Antipolis, 06904, France.