Data-Efficient Learning

Ask about this topic

Overview

Data-efficient learning studies how to build useful models when labels, examples, simulations, or interaction data are costly or limited. Common approaches include active learning and coreset selection, semi-supervised and self-supervised pretraining, transfer and meta-learning, and curricula that prioritize examples suited to a model’s current abilities. In scientific and clinical settings, physical laws, domain knowledge, and synthetic data can provide useful structure when observations are scarce. A central challenge is that the best strategy depends on the task, data distribution, and compute budget, so gains in accuracy must be weighed against training cost, robustness, and reliable evaluation.

Latest papers

CardsList

245 papers28 papers in the last four weeks, up 56% on the four weeks before. 0.2% of all new papers.

  1. Accelerating PDE Surrogates via RL-Guided Mesh Optimization

    Mar 2, 2026Yang Meng, Ruoxi Jiang, Zhuokai Zhao +3PDE Surrogate ModelingData-Efficient Learning

    UChicago · Fudan University · UAlbany

  2. Machine Learning Models to Identify Promising Nested Antiresonance Nodeless Fiber Designs

    Mar 2, 2026Rania A. Eltaieb, Sophie LaRochelle, Leslie A. RuschSmall-Data LearningData-Efficient Learning

  3. DGNet: Discrete Green Networks for Data-Efficient Learning of Spatiotemporal PDEs

    Mar 2, 2026Yingjie Tan, Quanming Yao, Yaqing WangNeural PDE SolversPDE Surrogate Modeling

    Qiuzhen College, Tsinghua University · Department of Electronic Engineering, Tsinghua University · Beijing Institute of Mathematical Sciences and Applications

  4. A Dataset is Worth 1 MB

    Feb 26, 2026Elad Kimchi Shoshani, Leeyam Gabay, Yedid HoshenData-Efficient LearningDataset Distillation

    School of Computer Science and Engineering, The Hebrew University of Jerusalem, Israel.

  5. A data- and compute-efficient chest X-ray foundation model beyond aggressive scaling

    Feb 26, 2026Chong Wang, Yabin Zhang, Yunhe Gao +9Medical Imaging Foundation ModelsMedical VLMs

    Stanford Center for Artificial Intelligence in Medicine and Imaging, Stanford University, Palo Alto, CA, USA. · Department of Radiology, Stanford University, Stanford, CA, USA. · Department of Computer Science, Stanford University, Stanford, CA, USA. +3

  6. C2^{2}TC: A Training-Free Framework for Efficient Tabular Data Condensation

    Feb 25, 2026Sijia Xu, Fan Li, Xiaoyang Wang +2Dataset CondensationData-Efficient Learning

    University of New South Wales, Australia · Shanghai Jiao Tong University, China

  7. Error-awareness Accelerates Active Automata Learning

    Feb 25, 2026Loes Kruger, Sebastian Junges, Jurriaan RotAutomata LearningActive Learning

    Institute for Computing and Information Sciences, Radboud University, Nijmegen, the Netherlands

  8. Nonparametric Teaching of Attention Learners

    Feb 24, 2026Chen Zhang, Jianghui Wang, Bingyang Cheng +7Training Data SelectionData-Efficient Learning

    The University of Hong Kong · King Abdullah University of Science and Technology · Independent Researcher

  9. Position: Stop Preaching and Start Practising Data Frugality for Responsible Development of AI

    Feb 23, 2026Sophia N. Wilson, Andrew Millard, Guðrún Fjóla Guðmundsdóttir +2Responsible AIData-Efficient Learning

    Department of Computer Science, University of Copenhagen, Copenhagen, Denmark · Division of Statistics and Machine Learning, Linköping University, Linköping, Sweden · Department of Electrical and Photonics Engineering, Technical University of Denmark, Kongens Lyngby, Denmark

  10. Learning from Complexity: Exploring Dynamic Sample Pruning of Spatio-Temporal Training

    Feb 22, 2026Wei Chen, Junle Chen, Yuqian Wu +2Data-Efficient LearningDataset Pruning

    HKUST(GZ) · HKUST

  11. WiCompass: Oracle-driven Data Scaling for mmWave Human Pose Estimation

    Feb 21, 2026Bo Liang, Chen Gong, Haobo Wang +8Human Pose EstimationOOD Generalization

    School of Computer Science, Peking University · University of Electronic Science and Technology of China · University of Pittsburgh +2

  12. On the "Induction Bias" in Sequence Models

    Feb 20, 2026M. Reza Ebrahimi, Michaël Defferrard, Sunny Panchal +1TransformerState Tracking

    Qualcomm AI Research is an initiative of Qualcomm Technologies, Inc.

  13. Neural-HSS: Hierarchical Semi-Separable Neural PDE Solver

    Feb 20, 2026Pietro Sittoni, Emanuele Zangrando, Angelo A. Casulli +2Neural PDE SolversPDE Operator Learning

    Gran Sasso Science Institute, L’Aquila, Italy · University of Edinburgh, UK

  14. Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledge

    Feb 16, 2026Siying Ma, Mehrdad M. Zadeh, Mauricio Soroco +3PDE Surrogate ModelingNeural Operators

    Simon Fraser University · Georgia Institute of Technology

  15. D2-LoRA: A Synergistic Approach to Differential and Directional Low-Rank Adaptation

    Feb 16, 2026Nozomu Fujisawa, Masaaki KondoLLM Fine-TuningLow-Rank Adaptation

    Keio University

  16. Breaking Data Efficiency Dilemma: A Federated and Augmented Learning Framework For Alzheimer's Disease Detection via Speech

    Feb 16, 2026Xiao Wei, Bin Wen, Yuqin Lin +5Speech-Based Dementia DetectionData-Efficient Learning

    Tianjin Key Laboratory of Cognitive Computing and Application, College of Intelligence and Computing, Tianjin University, Tianjin, China · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China · College of Computer and Data Science, Fuzhou University, Fuzhou, China +1

  17. Semi-supervised CAPP Transformer Learning via Pseudo-labeling

    Feb 1, 2026Dennis Gross, Helge Spieker, Arnaud Gotlieb +3TransformerPseudo-Labeling

    1- Simula Research Laboratory, Oslo Norway · 2- National Technical University of Athens, School of Mechanical Engineering, Manufacturing Technology Laboratory Greece

  18. Predictive Inorganic Synthesis based on Machine Learning using Small Data sets: a case study of Hydrodynamic Diameter-controlled Cu Nanoparticles

    Dec 18, 2025Brent Motmans, Digvijay Ghogare, Thijs G. I. van Wijk +6Small-Data LearningMaterials Property Prediction

    Hasselt University, Institute for Materials Research (IUMAT), Quantum & Artificial inTelligence design Of Materials (QuATOMs), Martelarenlaan 42, B-3500 Hasselt, Belgium · Hasselt University, Institute for Materials Research (IUMAT), Hybrid Materials Design (HyMaD), Martelarenlaan 42, B-3500 Hasselt, Belgium · imec, IUMAT, Wetenschapspark 1, B-3590 Diepenbeek, Belgium +4

  19. Is Generation Required for Data-Efficient Perception?

    Dec 9, 2025Jack Brady, Bernhard Schölkopf, Thomas Kipf +2Visual Representation LearningGenerative Modeling

    Max Planck Institute for Intelligent Systems, Tübingen, Germany · Tübingen AI Center · ELLIS Institute, Tübingen +1

  20. Geometry as a Missing Axis of Representation Quality: The Variational Geometric Information Bottleneck under Data Scarcity

    Nov 4, 2025Ronald KatendeIntrinsic DimensionalityInformation Bottleneck

    Department of Mathematics, Kabale University, Katuna Road, Kikungiri Hill, Kabale, 317, Uganda

  21. MetaCaDI: A Meta-Learning Framework for Causal Discovery from Multiple Environments with Unknown Interventions

    Oct 25, 2025Hans Jarett Ong, Yoichi Chikahara, Tomoharu IwataMeta-LearningCausal Discovery

    Nara Institute of Science and Technology, Nara, Japan · NTT Communication Science Laboratories, Kyoto, Japan

  22. CHUCKLE -- When Humans Teach AI To Learn Emotions The Easy Way

    Oct 10, 2025Ankush Pratap Singh, Houwei Cao, Yong LiuCurriculum LearningEmotion Recognition

    New York Institute of Technology, Department of Computer Science, New York, United States · New York University, Electrical and Computer Engineering Department, New York, United States

  23. Patch Rebirth: Fast and Transferable Model Inversion of Vision Transformers

    Sep 27, 2025Seongsoo Heo, Dong-Wan ChoiVision TransformerInverse Problems

    Inha University

  24. Aligning Inductive Bias for Data-Efficient Generalization in State Space Models

    Sep 25, 2025Qiyu Chen, Guozhang ChenSequence ModelingData-Efficient Learning

    School of Computer Science, National Key Laboratory for Multimedia Information Processing, Peking University, China · School of Physics, Peking University, China

  25. RF-Informed Graph Neural Networks for Accurate and Data-Efficient Circuit Performance Prediction

    Aug 22, 2025Anahita Asadi, Leonid Popryho, Inna Partin-VaisbandNeural Surrogate ModelingGraph Neural Networks

    Department of Electrical and Computer Engineering, University of Illinois Chicago, Chicago, IL 60607 USA

  26. Beyond Scaling Law: A Data-Efficient Distillation Framework for Reasoning

    Aug 13, 2025Xiaojun Wu, Xiaoguang Jiang, Huiyang Li +11CoT DistillationLanguage Model Distillation

    1Zhongxing Telecom Equipment(ZTE), China · 2China Mobile Communications Group Co Ltd

  27. EEGDM: Label-Efficient EEG Representation Learning with Generative Diffusion Model

    Aug 13, 2025Jia Hong Puah, Sim Kuan Goh, Ziwei Zhang +6ElectroencephalographyEEG Seizure Detection

    School of Artificial Intelligence and Robotics, Xiamen University Malaysia · School of Energy and Chemical Engineering, Xiamen University Malaysia · Department of Biomedical Engineering, Universiti Malaya +3

  28. Siamese Neural Network for Label-Efficient Critical Phenomena Prediction in 3D Percolation Models

    Jul 5, 2025Shanshan Wang, Dian Xu, Jianmin Shen +3Phase TransitionsSiamese Neural Networks

    Key Laboratory of Quark and Lepton Physics (MOE) and Institute of Particle Physics, Central China Normal University, , Wuhan, 430079, Hubei, China · School of Engineering and Technology, Baoshan University, , Baoshan, 678000, Yunnan, China · Ecole Superieure d’Informatique Electronique Automatique, , Ivry-sur-Seine, 94200, , France

  29. Manifold meta-learning for reduced-complexity neural system identification

    Apr 16, 2025Marco Forgione, Ankush Chakrabarty, Dario Piga +2System IdentificationMeta-Learning

    SUPSI, IDSIA - Dalle Molle Institute for Artificial Intelligence, Lugano, Switzerland. · Mitsubishi Electric Research Laboratories (MERL), Cambridge, MA, USA. · IMT School for Advanced Studies Lucca, Lucca, Italy.

  30. Towards More Efficient, Robust, Instance-adaptive, and Generalizable Sequential Decision making

    Apr 12, 2025Zhiyong WangMulti-Armed BanditsReinforcement Learning

    Department of Computer Science and Engineering, The Chinese University of Hong Kong