Adaptive Loss Weighting

Ask about this topic

Momentum

8 papers in the last four weeks, up 33% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 66

All topics
CardsList

  1. Component-Level Evaluation of Adaptive PINN Training for CFD-Oriented Crystal Growth Simulation

    Oct 4, 2026Niruta Chapagain, Rohit Raj, Bertwin Kurisinkal Shine +1Neural PDE SolversPDE Surrogate Modeling

    University of Europe for Applied Sciences Potsdam, Germany · Vienna, Austria · Technische Universität Chemnitz Chemnitz, Germany +1

  2. GAW-PO: Preference Optimization with Gradient-Aligned Token Weights

    Oct 1, 2026Andreea Dutulescu, Stefan Ruseti, Mihai Masala +2LLM AlignmentDirect Preference Optimization

    National University of Science and Technology POLITEHNICA Bucharest · NVIDIA

  3. Rethinking Token Reweighting for SFT: Suppress, Reverse, and Extrapolate Learned Features

    Sep 27, 2026Cunchun Li, Haonan He, Yifan Gao +4Supervised Fine-TuningAdaptive Loss Weighting

    Shanghai AI Laboratory · University of Science and Technology of China · Fudan University +2

  4. Timestep Weighting: A Hidden Key to Effective ELBO-Based Flow-Matching RL

    Sep 26, 2026Qinwei Ma, Jingzhe Shi, Simin Fan +2RL for Image GenerationAdaptive Loss Weighting

    College of AI, Tsinghua University · Department of Electrical and Computer Engineering, Princeton University · EPFL +1

  5. FairMean: Promoting Fairness in Distributed Learning under Label Poisoning Attacks

    Sep 22, 2026Huigan Zheng, Jiaojiao Zhang, Yongxiang LiuAlgorithmic FairnessAdaptive Loss Weighting

    Sun Yat-Sen University · Pengcheng Laboratory · Great Bay University

  6. Adaptive Margin Ordinal Loss: Penalizing Center-Class Hedging in Ordinal Classification

    Sep 12, 2026Manisha KandelOrdinal RegressionAdaptive Loss Weighting

    Data Science Institute & Department of Civil, Construction & Environmental Engineering University of Delaware Newark, DE, USA

  7. A Unified Per-Token Gating Family for On-Policy Distillation: FKL/RKL Mixing with Multi-Channel and Bias Coefficients

    Sep 12, 2026Suwan Wu, Yumeng Lin, Pengcheng Yuan +1Adaptive Loss WeightingLanguage Model Distillation

    Xiaohongshu Inc. · Tianjin University

  8. Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning

    Sep 9, 2026Yaning Jia, Chunhui Zhang, Wenxuan Xu +3Numerical Reasoning in Language ModelsSupervised Fine-Tuning

    Dartmouth College · Carnegie Mellon University

  9. TRaIL-Odom: Tightly Coupled Continuous Time Radar-IMU-LiDAR Odometry with Adaptive Doppler Weighting

    Sep 3, 2026Chiyun Noh, Turcan Tuna, William Talbot +3Adaptive Loss WeightingRadar-Inertial Odometry

    Department of Mechanical Engineering, Seoul National University, S. Korea · Robotic Systems Lab (RSL), ETH Zürich, 8092 Zürich, Switzerland · Robotics and AI Institute (RAI), Zürich, Switzerland

  10. Information Density Imbalance in Visual Object Detection

    Sep 2, 2026Ziwei Zhao, Yanxi Lu, Yuwei Hu +8Object DetectionAdaptive Loss Weighting

    Technical University of Munich · Nanyang Technological University · Baidu Inc. +3

  11. Online Self-Weighted Fine-Tuning

    Sep 1, 2026Haiquan Wen, Yiwei He, Bei Peng +1Supervised Fine-TuningLLM Fine-Tuning

    University of Liverpool · University of Sheffield

  12. Error-Type-Aware Loss Reweighting for Robust Named Entity Recognition with Noisy LLM Labels

    Aug 31, 2026Elena Merdjanovska, Jonas Golde, Alan AkbikNamed Entity RecognitionLLM-Assisted Annotation

    Humboldt-Universität zu Berlin · Science of Intelligence

  13. Tissue-Mixture Entropy-Weighted Reconstruction for Partial-Volume-Aware Brain MRI Super-Resolution

    Aug 27, 2026Xiao Tong, Wenyun Yang, Ziheng Zhang +3Medical Image Super-ResolutionBrain MRI

    aState Key Laboratory of Artificial Microstructure and Mesoscopic Physics, School of Physics, Peking University, Beijing, 100871, P. R. China · bWeihai Institute of Oceanology, Peking University, Weihai, 264209, P. R. China · cBeijing MagnVue Medix Co., Ltd., Beijing, 100085, P. R. China

  14. Confusion-Geometry Rebalancing for Long-Tailed Adversarial Training

    Aug 10, 2026Mengnan Zhao, Geyong Min, Lihe Zhang +2Adversarial TrainingLong-Tailed Classification

    School of Computer Science, Anhui University, China · Department of Computer Science, University of Exeter, UK · School of Information and Communication Engineering, Dalian University of Technology, China +1

  15. NeuroGuard: Neural Gradient Update Aware of Representation Damage

    Aug 8, 2026Taigo Sakai, Kazuhito HottaClass-Incremental LearningAdaptive Loss Weighting

    Meijo University, 1-501 Shiogamaguchi, Tempaku-ku, Nagoya 468-8502, Japan

  16. Tools to Explain Neural Networks for Power System Dynamics

    Aug 8, 2026Petros Ellinas, Johanna Vorwerk, Spyros ChatzivasileiadisNeural Surrogate ModelingNeural Network Interpretability

    Department of Wind and Energy Systems, Technical University of Denmark, Lyngby, Denmark

  17. FedLBW: A Loss-Based Weighting Strategy for Federated Learning on Non-IID Data in Wireless Networks

    Aug 7, 2026Majid Kundroo, Tinku Singh, Taehong KimFederated Learning AggregationNon-IID Federated Learning

    aSchool of Information and Communication Engineering, Chungbuk National University, Cheongju, 28644, Republic of Korea · bSchool of Computer Science Engineering and Technology, Bennett University, Greater Noida, 201310, India

  18. Beyond Magnitude and Shape: A Direction-Aware Loss for Time Series Forecasting

    Aug 3, 2026Seunghan Lee, Jaehoon Lee, Jun Seo +9Time Series ForecastingAdaptive Loss Weighting

    LG AI Research

  19. Data-Driven Pinball-Loss Selection for Vertically Distributed Elastic-Net SVMs

    Aug 2, 2026Xiaofei Wu, Kai Qi, Rongmei LiangDistributed OptimizationAdaptive Loss Weighting

    Yunnan Key Laboratory of Statistical Modeling and Data Analysis, School of Mathematics and Statistics, Yunnan University, East Outer Ring South Road, University Town, Chenggong District, Kunming, Yunnan, China · National Center for Applied Mathematics in Chongqing, Chongqing Normal University, No. 37 University Town Middle Road, Shapingba District, Chongqing, China · Department of Statistics and Data Science, Southern University of Science and Technology, 1088 Xueyuan Avenue, Nanshan District, Shenzhen, Guangdong 518055, China

  20. TEXAS: Task-Expert-Aware Supervision for Downstream Mixture-of-Experts LLM Adaptation

    Jul 31, 2026Guanzhi Deng, Haibo Wang, Kuan Wu +5Mixture-of-Experts Language ModelsMixture of Experts

    City University of Hong Kong, Hong Kong, China · Carnegie Mellon University, Pittsburgh, USA · University of Waterloo, Ontario, Canada +1

  21. Beyond Static Costs: Learning-Dynamics Aware Loss Functions for Long-Tailed Classification

    Jul 28, 2026Varad Shinde, Nikhil Kumar Shrey, Magesh Rajasekaran +5Class-Imbalanced LearningLong-Tailed Classification

  22. Context-weighted Discrete Flow Matching

    Jul 23, 2026Daniil Cherniavskii, Daniel Severo, Karen UllrichNon-Autoregressive Text GenerationAdaptive Loss Weighting

    University of Amsterdam · Work done during an internship at Meta FAIR. · Meta FAIR

  23. KALE: Kernel Alignment with Loss Equilibration for Stable CLIP-DINOv2 Alignment at Web Scale

    Jul 21, 2026Michał PawłowiczVLM AdaptationAdaptive Loss Weighting

  24. Dynamic Loss Balancing for Joint SOH and RUL Prediction of Lithium-Ion Batteries via a Rotary SOH-Injected Prior Battery Transformer

    Jul 19, 2026Shuhao Chen, Tianyu Shi, Yiwen Huang +1RUL EstimationPredictive Maintenance

    School of Economics and Management, Zhejiang Sci-Tech University, Hangzhou, 310018, China.

  25. Probabilistic Physics-Informed Neural Networks for Estimating Heterogeneous Elastic Properties from Low-Resolution and Noisy Displacement Data

    Jul 16, 2026Tatthapong Srikitrungruang, Jaesung LeeStructural MechanicsMaterials Property Prediction

    Wm Michael Barnes 64 Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, 77843, USA

  26. Multi-dimensional training-priority weighting based on physical information propagation paths: a unified residual-weighting framework for physics-informed neural networks

    Jul 13, 2026Zhangyi Lian, Xinda Dong, Wenxuan Huo +3Neural PDE SolversAdaptive Loss Weighting

    College of Mechanical and Vehicle Engineering Chongqing University Chongqing 400030, China · State Key Laboratory of Tribology in Advanced Equipment Department of Mechanical Engineering Tsinghua University Beijing 100084, China

  27. Adaptive Loss Balancing for Multi-Task Bioacoustic Classification of Bird Species and Call Types

    Jul 3, 2026Paria Vali Zadeh, Sven TomfordeClass-Imbalanced LearningMulti-Task Learning

    Kiel University, Kiel, Germany

  28. ExPLoRe: Expert Patch-Level Loss Routing for Multi-Objective Masked Image Modeling

    Jun 30, 2026Konstantinos Georgiou, Maofeng Tang, Hairong QiAdaptive Loss WeightingMixture-of-Experts Models

    Min H. Kao Department of Electrical Engineering and Computer Science, The University of Tennessee, Knoxville, TN 37996, USA

  29. Adaptive Hard-Soft Physics-Informed Neural Networks for Robust Boundary-Constrained PDE Solving

    Jun 22, 2026Duc Tien Nguyen, Trinh Minh Tuan, Nguyen Duc Manh +2PDE SolvingAdaptive Loss Weighting

    aCollege of Engineering and Computer Science, VinUniversity, Hanoi, Vietnam · bCenter for AI Research, VinUniversity, Hanoi, Vietnam · dDepartment of Mathematics and Informatics, Hanoi University of Science and Technology, Hanoi, Vietnam +1

  30. Robust Diffusion Models via Divergence-Induced Weighted Denoising

    Jun 21, 2026Lei Li, Yuexiao DongNeural Network RobustnessRobust Loss Functions

    LunarAI LLC · Newark, DE 19702 · Fox School of Business +1

  31. Time-Frequency Weighted Losses for Phoneme Reconstruction in DNN-Based Speech Enhancement

    Jun 19, 2026Nasser-Eddine Monir, Paul Magron, Romain SerizelSpeech EnhancementAdaptive Loss Weighting

    Université de Lorraine, CNRS, Inria, LORIA, F-54000 Nancy, France

  32. SCR-Guided Difficulty-Aware Optimization for Infrared Small Target Detection

    Jun 17, 2026Yunus Sevim, Behçet Uğur TöreyinInfrared Small Target DetectionAdaptive Loss Weighting

    Aselsan · Ankara, Turkey · Istanbul Technical University +1

  33. Multi-Level Analyzation of Imbalance to Resolve Non-IID-Ness in Federated Learning

    Jun 8, 2026Haengbok Chung, Jae Sung LeeClass-Imbalanced LearningFederated Learning Aggregation

    Interdisciplinary Program in Artificial Intelligence, Seoul National University, Republic of Korea · Department of Nuclear Medicine, Seoul National University College of Medicine, Republic of Korea · Brightonix Imaging Inc. Seoul, Republic of Korea

  34. Forward-Only Convolutional Neural Networks with Learnable Channel-Class Assignment

    Jun 7, 2026Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani +1Adaptive Loss WeightingConvolutional Neural Networks

    Department of Computer and Data Science, Faculty of Mathematical Sciences, Shahid Beheshti University, Tehran, Iran · Cyberspace Research Institute, Shahid Beheshti University, Tehran, Iran · Cybersecurity and Computing Systems Research Group, University of Hertfordshire, Hatfield, United Kingdom

  35. Entropy as a Structural Prior: How a Log-Barrier on DiT Belief Space Drives Musical Diversity and Development

    Jun 5, 2026Zixi Li, Youzhen LiText-to-Music GenerationDiffusion Transformer

    Sun Yat-sen University · Datawhale

  36. FADRW: A Feature-Aware Modulated and Dynamically Reweighted Loss for Few-Shot Linguistic Steganalysis

    Jun 3, 2026Shuo Liu, Xianghong Lin, Yukun Wei +1Class-Imbalanced LearningFew-Shot Learning

    International School, Beijing University of Posts and Telecommunications, Beijing 100876, China · School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing 100876, China

  37. Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion

    Jun 2, 2026Oskar Natan, Jun MiuraDepth EstimationAutonomous Driving Perception

    Department of Computer Science and Engineering, Toyohashi University of Technology, Aichi 441-8580, Japan · Department of Computer Science and Electronics, Gadjah Mada University, Yogyakarta 55281, Indonesia

  38. MoEIoU: Rethinking Bounding-Box Regression as a Mixture of Experts

    May 30, 2026Vinay Edula, Priyanka BagadeMixture of ExpertsAdaptive Loss Weighting

    Department of Computer Science and Engineering Indian Institute of Technology Kanpur Kanpur, U.P, India

  39. AdaDPO: Self-Adaptive Direct Preference Optimization with Balanced Gradient Updates

    May 27, 2026Shaolong Chen, Madalina Ciobanu, Qingqing Mao +1LLM AlignmentDirect Preference Optimization

    Incept Labs Houston, TX · Incept Labs, Houston, TX · Titan Holdings, San Francisco, CA

  40. Joint Training of Multi-Token Prediction in Reinforcement Learning via Optimal Coefficient Calibration

    May 27, 2026Zili Wang, Jiajun Chai, Lin Chen +3Multi-Token PredictionRL for Language Model Reasoning

    School of Artificial Intelligence, University of Chinese Academy of Sciences, China · MAIS, Institute of Automation, Chinese Academy of Sciences, China · Meituan

  41. GAC: Noise-Aware Adaptive Mixing for Hybrid SFT-RL Post-Training

    May 25, 2026Yuelin Hu, Zhenbo Yu, Zhengxue Cheng +2Supervised Fine-TuningAdaptive Loss Weighting

    Shanghai Jiao Tong University · Shanghai Maritime University

  42. Self-Balancing Gradient Allocation for Heterogeneity-Aware Feature Generation in Click-Through Rate Prediction

    May 24, 2026Moyu Zhang, Yun Chen, Yujun Jin +3Adaptive Loss WeightingCTR Prediction

    Alibaba Group · Beijing, China

  43. OSDTW: Optimal Shared Depth and Task Weighting for Long-Tailed Recognition

    May 24, 2026Chang Chu, Qingyue Zhang, Shao-Lun Huang +1Long-Tailed ClassificationRepresentation Learning

    Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Shenzhen Zkosemi Semiconductor Technology Co., Ltd, Shenzhen, China

  44. Reducing Object Hallucination in LVLMs via Emphasizing Image-negative Tokens

    May 20, 2026Meng Shen, Minghao Wu, Deepu RajanVision-Language ModelsHallucination in Language Models

    Nanyang Technological University · Monash University

  45. LIFT and PLACE: A Simple, Stable, and Effective Knowledge Distillation Framework for Lightweight Diffusion Models

    May 19, 2026Hyunsoo Han, Sangyeop Yeo, Jaejun YooModel CompressionDiffusion Model Distillation

    Ulsan National Institute of Science and Technology (UNIST)

  46. Balancing Knowledge Distillation for Imbalance Learning with Bilevel Optimization

    May 18, 2026Anh B. H. Nguyen, Ba Tho Phan, Viet Cuong TaClass-Imbalanced LearningLong-Tail Learning

    VNU University of Engineering and Technology, Hanoi, Vietnam

  47. Avoiding Structural Failure Modes in Tabular Fair SSL: Online Primal-Dual Allocation under Confidence Gating

    May 15, 2026Hangchuan Liang, Changchun LiPrimal-Dual OptimizationGroup Fairness

    College of Computer Science and Technology, Jilin University, China · Key Laboratory of Symbolic Computation and Knowledge Engineering of the Ministry of Education, Jilin University, China

  48. InfoSFT: Learn More and Forget Less with Information-Aware Token Weighting

    May 14, 2026Mahdi Sabbaghi, George Pappas, Adel Javanmard +1Supervised Fine-TuningAdaptive Loss Weighting

    University of Pennsylvania · University of Southern California

  49. A Unified Perspective for Learning Graph Representations Across Multi-Level Abstractions

    May 12, 2026Mohamed Mahmoud Amar, Nairouz Mrabah, Mohamed Bouguessa +1Graph Representation LearningGraph SSL

    Department of Computer Science, University of Quebec at Montreal, Montreal, QC, Canada

  50. Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing

    May 11, 2026Jinchang Zhu, Jindong Li, Chengyu Zou +4Long-Context Language ModelingAdaptive Loss Weighting

    1The Hong Kong University of Science and Technology (Guangzhou) · Institute of Artificial Intelligence (TeleAI), China Telecom

  51. Per-Loss Adapters for Gradient Conflict in Physics-Informed Neural Networks

    May 11, 2026Bum Jun Kim, Gnankan Landry Regis N'guessanGradient InterferenceAdaptive Loss Weighting

    The University of Tokyo, Japan · Axiom Research Group · Department of Applied Mathematics and Computational Science, NM-AIST, Tanzania +3

  52. Rethinking Loss Reweighting for Imbalance Learning as an Inverse Problem: A Neural Collapse Point of View

    May 11, 2026Jinping Wang, Zixin Tong, Zhiwu Xie +1Long-Tailed ClassificationAdaptive Loss Weighting

    CSMT, Wenzhou-Kean University · International Frontier Interdisciplinary Research Institute, Wenzhou-Kean University

  53. When Losses Align: Gradient-Based Composite Loss Weighting for Efficient Pretraining

    May 8, 2026Ivan Karpukhin, Andrey SavchenkoSelf-Supervised Pre-TrainingAdaptive Loss Weighting

    Sber AI Lab · HSE University ISP RAS Research Center for Trusted Artificial Intelligence

  54. Beyond the False Trade-off: Adaptive EWC for Stealthy and Generalizable T2I Backdoors

    May 8, 2026Lu Bowen, Xinyu Tang, Yin Yin Low +1Backdoor AttacksElastic Weight Consolidation

    Monash University

  55. TsallisPGD: Adaptive Gradient Weighting for Adversarial Attacks on Semantic Segmentation

    May 5, 2026Alexander Matyasko, Xin Lou, Indriyati Atmosukarto +1Adversarial AttacksAdaptive Loss Weighting

    Singapore Institute of Technology, Singapore

  56. Dynamic Distillation and Gradient Consistency for Robust Long-Tailed Incremental Learning

    May 5, 2026Taigo Sakai, Kazuhiro HottaClass-Incremental LearningLong-Tail Learning

    Meijo University, 1-501 Shiogamaguchi, Tempaku-ku, Nagoya 468-8502, Japan

  57. Adaptive Equilibrium: Dynamic Weighting Framework for Generalized Interruption of DeepFake Models

    May 1, 2026Hongrui Zheng, Liejun Wang, Zhiqing GuoAdversarial AttacksAdaptive Loss Weighting

    School of Computer Science and Technology, Xinjiang University, Urumqi, China · Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center, Urumqi, China · Silk Road Multilingual Cognitive Computing International Cooperation Joint Laboratory, Xinjiang University, Urumqi, China

  58. IMPA-Net: Meteorology-Aware Multi-Scale Attention and Dynamic Loss for Extreme Convective Radar Nowcasting

    Apr 27, 2026Haofei Cui, Guangxin He, Juanzhen Sun +5Precipitation ForecastingMulti-Scale Feature Fusion

    Key Laboratory of Meteorological Disaster, Ministry of Education (KLME) / International Joint Research Laboratory on Climate and Environment Change (ILCEC) / Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Nanjing University of Information Science and Technology, Nanjing 210044, China. · Nanchang Meteorological Bureau, Nanchang 330000, China. · National Center for Atmospheric Research, Boulder, CO 80301, USA. +3

  59. Weighting What Matters: Boosting Sample Efficiency in Medical Report Generation via Token Reweighting

    Apr 22, 2026Alexander Weers, Daniel Rueckert, Martin J. MentenMedical Report GenerationHealthcare

    TUM School of Computation, Information and Technology, Technical University of Munich, DE · Munich Center for Machine Learning (MCML), DE · Department of Computing, Imperial College London, UK

  60. Meta Additive Model: Interpretable Sparse Learning With Auto Weighting

    Apr 22, 2026Xuelin Zhang, Xinyue Liu, Lingjuan Wu +1Robust RegressionAdaptive Loss Weighting

    College of Informatics, Huazhong Agricultural University, Wuhan, China