Efficient Learning
Efficient learning focuses on developing algorithms and models that achieve high performance with minimal computational resources and training data. Current research emphasizes improving the efficiency of various machine learning paradigms, including reinforcement learning (through techniques like object-centric abstraction and low interaction rank), graphical models (with optimized solvers and sparse representations), and deep learning (via methods such as Low-Rank Adaptation and random Fourier neural networks). These advancements are crucial for deploying machine learning in resource-constrained environments and for accelerating the training of increasingly complex models, impacting fields ranging from robotics and healthcare to scientific discovery.
Papers
DONUT-hole: DONUT Sparsification by Harnessing Knowledge and Optimizing Learning Efficiency
Azhar Shaikh, Michael Cochez, Denis Diachkov, Michiel de Rijcke, Sahar Yousefi
Accelerated Shapley Value Approximation for Data Evaluation
Lauren Watson, Zeno Kujawa, Rayna Andreeva, Hao-Tsung Yang, Tariq Elahi, Rik Sarkar