Overview

Data-efficient learning studies how to build useful models when labels, examples, simulations, or interaction data are costly or limited. Common approaches include active learning and coreset selection, semi-supervised and self-supervised pretraining, transfer and meta-learning, and curricula that prioritize examples suited to a model’s current abilities. In scientific and clinical settings, physical laws, domain knowledge, and synthetic data can provide useful structure when observations are scarce. A central challenge is that the best strategy depends on the task, data distribution, and compute budget, so gains in accuracy must be weighed against training cost, robustness, and reliable evaluation.

Latest papers

CardsList

259 papers18 papers in the last four weeks, down 45% on the four weeks before. 0.1% of all new papers.

  1. Sample-efficient end-to-end Optical Music Recognition through Active Learning

    Nov 19, 2026Eric Ayllon, Francisco J. Castellanos, Antonio Rios-VilaOptical Music RecognitionData-Efficient Learning

  2. X Hedging: towards an eXplainable artificial intelligence option Hedging framework

    Nov 19, 2026Bjørn André Aaslund, Johannes Berge, Ayoub Haida +2Quantitative FinanceExplainable Artificial Intelligence

  3. T2ST: Data-Efficient Spatio-Temporal Foundation Models via Temporal Data and Knowledge Transfer

    Nov 13, 2026Yue Xu, Kaiyun Wei, Wenying Duan +3Spatiotemporal ForecastingData-Efficient Learning

  4. Model Annealing: Data-Efficient Learning through Review and Consolidation

    Nov 12, 2026Ali Mohammadi Ruzbahani, Rezvan AbouzadehData-Efficient LearningSelf-Distillation

  5. When and How SignSGD Outperforms SGD: A Functional Scaling Law Perspective

    Nov 12, 2026Zilin Wang, Binghui Li, Jia-Nan Wang +3Sign-Based OptimizationStochastic Gradient Descent

  6. Label-Efficient Document-Grounded Factuality Detection via Cross-Paraphrastic Invariance Learning

    Nov 12, 2026Chao Chen, Shanshan Lin, Dongsheng Hong +4Automated Fact-CheckingLLM Grounding

  7. GradReason: LLMs as Meta-Learners that Replace Training Epochs with Training-Data-Free Weight Updates

    Nov 7, 2026Ali Mohammadi Ruzbahani, Abbas Yazdinejad, Hadis KarimipourLarge Language Model-Guided OptimizationData-Efficient Learning

  8. Scaling Laws for SAE Training Data

    Nov 5, 2026Nikita Koriagin, Nikita Balagansky, Daniil GavrilovSparse AutoencodersMemory-Efficient Training

  9. Self-Supervised Pretraining for Label-Efficient Facial Expression Recognition using Smart Glasses

    Nov 3, 2026Zhengtao Gao, Francesco Bombassei De Bona, Leonardo Alchieri +6Facial Expression RecognitionData-Efficient Learning

  10. Networked AI: Architecture, Theory, and Applications

    Nov 2, 2026Liang Song, Jiayue Jin, Peng Sun +9AI Agent ArchitectureMulti-Agent Systems

  11. OT-CAL: Optimal-Transport-Guided Adaptive Sample Selection for Efficient Visual Learning

    Oct 30, 2026Suryansh Talukdar, Jin Soung YooTraining Data SelectionData-Efficient Learning

  12. Efficient Learning of Mechanism Designs and Compositionality

    Oct 29, 2026João Pedro Gandarela, Thiago Rios, Stefan Menzel +1Compositional Representation LearningData-Efficient Learning

  13. TRIDENT-Seq: Profile-Matched Prefix-Future Contrast for Label-Efficient Payment Risk Modeling

    Oct 27, 2026Weiyu Han, Haoyu Jiang, Jie Sheng +7Financial Fraud DetectionContrastive Learning

  14. Vision Transformers for Estimating Irradiance Using Data Scarce Sky Images

    Oct 22, 2026David Hamlyn, Sunny Chaudhary, Tasmiat RahmanVision TransformerData-Efficient Learning

  15. Learning Computational Structure for Sample-Efficient Prediction

    Oct 20, 2026Hangyu Zhou, Constantine Dovrolis, Stephen MussmannData-Efficient LearningCompositional Representation Learning

  16. Pairwise Learning Increases Data Efficiency in Deep Neural Networks

    Oct 20, 2026Robert Bain, Marjan Rashidi, Elizabeth ChrastilData-Efficient LearningSmall-Data Learning

  17. Sample-efficient learning with Dense Associative Memories

    Oct 19, 2026Andrew Lucas, Dmitry KrotovAssociative MemoryData-Efficient Learning

  18. Shallow Probes Are Sufficient for Near-Oracle Personalization Depth Allocation in Federated Learning

    Oct 18, 2026Beyazit Bestami Yuksel, Emrah Dikbiyik, Ayse Yilmazer MetinFederated LearningData-Efficient Learning

  19. Diversity Without Labels: Task-Agnostic Coreset Selection Across Perception and Action

    Oct 16, 2026Julia Hindel, Benjamin Ramtoula, Kyuhwan Yeon +4Data SelectionCoreset Selection

  20. Data-Efficient Classifier Pretraining Through Diffusion Models

    Oct 16, 2026Qinyu Li, Yee Whye Teh, Chris Holmes +1Data-Efficient LearningSelf-Supervised Pre-Training

  21. Efficient Pairwise Difference Learning: A Comparative Study of Encoding Strategies and Training Pair Selection

    Oct 15, 2026Bernard Georges, Mohamed Karim Belaid, Manuel RodriguesData-Efficient LearningTraining Data Selection

  22. L2GSSL: Label-Efficient Local-to-Global Self-Supervised Learning for Volumetric Healthcare Data

    Oct 15, 2026Po-Cheng Cheng, Hung-Hsuan ChenLung Nodule DetectionMedical Image Representation Learning

  23. Mind the Tail: Data Selection Through Sparse Concepts

    Oct 14, 2026Ziheng Zhang, Neha Hulkund, Colin Lee +7Training Data SelectionData Selection

  24. Diminishing Returns of Data in Sparse Autoencoders: Functional Behavior does not Guarantee Feature Reproducibility

    Oct 14, 2026Sambit Ghosh, Madelyn Mathai, R. Venkatesh Babu +1Sparse AutoencodersData-Efficient Learning

  25. pi-Net: Empirical Latent Representations for Differentiable Physics Heads in Data-Scarce Systems

    Oct 12, 2026Akshay Dhalpe, Arnab Chattopadhyay, Shahriar Bakrani Balani +2Physics-Informed MLSurrogate Modeling

  26. HAND: A Biologically-Inspired Activation Function that Improves Generalisation and Sample Efficiency in Image Classification

    Oct 8, 2026Michael W. Spratling, Heiko H. SchüttNeural Network Activation FunctionsNeural Network Generalization