Loss Function
Loss functions are crucial components of machine learning models, guiding the learning process by quantifying the difference between predicted and actual values. Current research emphasizes developing loss functions tailored to specific challenges, such as class imbalance in classification (addressed through asymmetric losses and hyperparameter distributions) and robustness to noise and outliers (using bounded and smooth alternatives to standard functions like mean squared error). These advancements improve model accuracy, efficiency, and generalizability across diverse applications, including medical image analysis, time series prediction, and physics-informed neural networks. The ongoing exploration of loss function design directly impacts the performance and reliability of machine learning models in various scientific and engineering domains.
Papers
Seeking Truth and Beauty in Flavor Physics with Machine Learning
Konstantin T. Matchev, Katia Matcheva, Pierre Ramond, Sarunas Verner
One-shot backpropagation for multi-step prediction in physics-based system identification -- EXTENDED VERSION
Cesare Donati, Martina Mammarella, Fabrizio Dabbene, Carlo Novara, Constantino Lagoa
UWFormer: Underwater Image Enhancement via a Semi-Supervised Multi-Scale Transformer
Weiwen Chen, Yingtie Lei, Shenghong Luo, Ziyang Zhou, Mingxian Li, Chi-Man Pun
Sharp error bounds for imbalanced classification: how many examples in the minority class?
Anass Aghbalou, François Portier, Anne Sabourin
Principled Approaches for Learning to Defer with Multiple Experts
Anqi Mao, Mehryar Mohri, Yutao Zhong
Theoretically Grounded Loss Functions and Algorithms for Score-Based Multi-Class Abstention
Anqi Mao, Mehryar Mohri, Yutao Zhong
Improving SCGAN's Similarity Constraint and Learning a Better Disentangled Representation
Iman Yazdanpanah, Ali Eslamian
Can bin-wise scaling improve consistency and adaptivity of prediction uncertainty for machine learning regression ?
Pascal Pernot
Fractional Concepts in Neural Networks: Enhancing Activation and Loss Functions
Zahra Alijani, Vojtech Molek
Free-text Keystroke Authentication using Transformers: A Comparative Study of Architectures and Loss Functions
Saleh Momeni, Bagher BabaAli
A Robust Deep Learning System for Motor Bearing Fault Detection: Leveraging Multiple Learning Strategies and a Novel Double Loss Function
Khoa Tran, Lam Pham, Vy-Rin Nguyen, Ho-Si-Hung Nguyen
A High Fidelity and Low Complexity Neural Audio Coding
Wenzhe Liu, Wei Xiao, Meng Wang, Shan Yang, Yupeng Shi, Yuyong Kang, Dan Su, Shidong Shang, Dong Yu