Loss Function
Loss functions are crucial components of machine learning models, guiding the learning process by quantifying the difference between predicted and actual values. Current research emphasizes developing loss functions tailored to specific challenges, such as class imbalance in classification (addressed through asymmetric losses and hyperparameter distributions) and robustness to noise and outliers (using bounded and smooth alternatives to standard functions like mean squared error). These advancements improve model accuracy, efficiency, and generalizability across diverse applications, including medical image analysis, time series prediction, and physics-informed neural networks. The ongoing exploration of loss function design directly impacts the performance and reliability of machine learning models in various scientific and engineering domains.
Papers
Nonlinear Operator Learning Using Energy Minimization and MLPs
Mats G. Larson, Carl Lundholm, Anna Persson
Loss Terms and Operator Forms of Koopman Autoencoders
Dustin Enyeart, Guang Lin
LossVal: Efficient Data Valuation for Neural Networks
Tim Wibiral, Mohamed Karim Belaid, Maximilian Rabus, Ansgar Scherp
LossAgent: Towards Any Optimization Objectives for Image Processing with LLM Agents
Bingchen Li, Xin Li, Yiting Lu, Zhibo Chen
Adaptive Informed Deep Neural Networks for Power Flow Analysis
Zeynab Kaseb, Stavros Orfanoudakis, Pedro P. Vergara, Peter Palensky
Active Negative Loss: A Robust Framework for Learning with Noisy Labels
Xichen Ye, Yifan Wu, Yiwen Xu, Xiaoqiang Li, Weizhong Zhang, Yifan Chen
Transformer-Metric Loss for CNN-Based Face Recognition
Pritesh Prakash, Ashish Jacob Sam
Enhanced N-BEATS for Mid-Term Electricity Demand Forecasting
Mateusz Kasprzyk, Paweł Pełka, Boris N. Oreshkin, Grzegorz Dudek
Transfer Learning for Control Systems via Neural Simulation Relations
Alireza Nadali, Bingzhuo Zhong, Ashutosh Trivedi, Majid Zamani
A Versatile Influence Function for Data Attribution with Non-Decomposable Loss
Junwei Deng, Weijing Tang, Jiaqi W. Ma
Class Distance Weighted Cross Entropy Loss for Classification of Disease Severity
Gorkem Polat, Ümit Mert Çağlar, Alptekin Temizel