Loss Function
Loss functions are crucial components of machine learning models, guiding the learning process by quantifying the difference between predicted and actual values. Current research emphasizes developing loss functions tailored to specific challenges, such as class imbalance in classification (addressed through asymmetric losses and hyperparameter distributions) and robustness to noise and outliers (using bounded and smooth alternatives to standard functions like mean squared error). These advancements improve model accuracy, efficiency, and generalizability across diverse applications, including medical image analysis, time series prediction, and physics-informed neural networks. The ongoing exploration of loss function design directly impacts the performance and reliability of machine learning models in various scientific and engineering domains.
Papers
AnyLoss: Transforming Classification Metrics into Loss Functions
Doheon Han, Nuno Moniz, Nitesh V Chawla
GIFT: Unlocking Full Potential of Labels in Distilled Dataset at Near-zero Cost
Xinyi Shang, Peng Sun, Tao Lin
Learning with Fitzpatrick Losses
Seta Rakotomandimby, Jean-Philippe Chancelier, Michel de Lara, Mathieu Blondel
Automated Loss function Search for Class-imbalanced Node Classification
Xinyu Guo, Kai Wu, Xiaoyu Zhang, Jing Liu
Boosting Single Positive Multi-label Classification with Generalized Robust Loss
Yanxi Chen, Chunxiao Li, Xinyang Dai, Jinhuan Li, Weiyu Sun, Yiming Wang, Renyuan Zhang, Tinghe Zhang, Bo Wang
Stability Evaluation via Distributional Perturbation Analysis
Jose Blanchet, Peng Cui, Jiajin Li, Jiashuo Liu
Loss Jump During Loss Switch in Solving PDEs with Neural Networks
Zhiwei Wang, Lulu Zhang, Zhongwang Zhang, Zhi-Qin John Xu