Loss Function
Loss functions are crucial components of machine learning models, guiding the learning process by quantifying the difference between predicted and actual values. Current research emphasizes developing loss functions tailored to specific challenges, such as class imbalance in classification (addressed through asymmetric losses and hyperparameter distributions) and robustness to noise and outliers (using bounded and smooth alternatives to standard functions like mean squared error). These advancements improve model accuracy, efficiency, and generalizability across diverse applications, including medical image analysis, time series prediction, and physics-informed neural networks. The ongoing exploration of loss function design directly impacts the performance and reliability of machine learning models in various scientific and engineering domains.
Papers
DetDiffusion: Synergizing Generative and Perceptive Models for Enhanced Data Generation and Perception
Yibo Wang, Ruiyuan Gao, Kai Chen, Kaiqiang Zhou, Yingjie Cai, Lanqing Hong, Zhenguo Li, Lihui Jiang, Dit-Yan Yeung, Qiang Xu, Kai Zhang
Onset and offset weighted loss function for sound event detection
Tao Song
EAGLE: An Edge-Aware Gradient Localization Enhanced Loss for CT Image Reconstruction
Yipeng Sun, Yixing Huang, Linda-Sophie Schneider, Mareike Thies, Mingxuan Gu, Siyuan Mei, Siming Bayer, Andreas Maier
SurvRNC: Learning Ordered Representations for Survival Prediction using Rank-N-Contrast
Numan Saeed, Muhammad Ridzuan, Fadillah Adamsyah Maani, Hussain Alasmawi, Karthik Nandakumar, Mohammad Yaqub
A General Method to Incorporate Spatial Information into Loss Functions for GAN-based Super-resolution Models
Xijun Wang, Santiago López-Tapia, Alice Lucas, Xinyi Wu, Rafael Molina, Aggelos K. Katsaggelos
NTIRE 2023 Image Shadow Removal Challenge Technical Report: Team IIM_TTI
Yuki Kondo, Riku Miyata, Fuma Yasue, Taito Naruki, Norimichi Ukita
Reduced Jeffries-Matusita distance: A Novel Loss Function to Improve Generalization Performance of Deep Classification Models
Mohammad Lashkari, Amin Gheibi
Rethinking Loss Functions for Fact Verification
Yuta Mukobara, Yutaro Shigeto, Masashi Shimbo