Adaptive Loss Weighting

Ask about this topic

Momentum

8 papers in the last four weeks, up 33% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 69

All topics
CardsList

  1. MetaOPD: Meta-Learned Token Weighting for On-Policy Distillation

    Oct 8, 2026Zipeng Wang, Xinpeng Dong, Yuefan Wang +6On-Policy DistillationAdaptive Loss Weighting

    East China Normal University · Zhejiang University · The Chinese University of Hong Kong, Shenzhen

  2. DLC: A Metric-Guided Dynamic Loss Controller for Multi-Objective Training

    Oct 8, 2026Jaewan Ko, Janghoon ChoiAdaptive Loss WeightingImage Restoration

    Major in Data Science Convergence, Graduate School of Data Science Kyungpook National University, Daegu, Republic of Korea

  3. Gen-PINNs: Generative Adversarial Physics Informed Neural Networks for solving partial differential equations

    Oct 7, 2026Muhammad M. Akmal, Kamy Sepehrnoori, Michael J. PyrczPDE SolvingPhysics-Informed ML

    Hilderbrand Department of Petroleum and Geosystems Engineering, The University of Texas at Austin · Department of Earth and Planetary Sciences, The University of Texas at Austin

  4. Component-Level Evaluation of Adaptive PINN Training for CFD-Oriented Crystal Growth Simulation

    Oct 4, 2026Niruta Chapagain, Rohit Raj, Bertwin Kurisinkal Shine +1Neural PDE SolversPDE Surrogate Modeling

    University of Europe for Applied Sciences Potsdam, Germany · Vienna, Austria · Technische Universität Chemnitz Chemnitz, Germany +1

  5. GAW-PO: Preference Optimization with Gradient-Aligned Token Weights

    Oct 1, 2026Andreea Dutulescu, Stefan Ruseti, Mihai Masala +2LLM AlignmentDirect Preference Optimization

    National University of Science and Technology POLITEHNICA Bucharest · NVIDIA

  6. Rethinking Token Reweighting for SFT: Suppress, Reverse, and Extrapolate Learned Features

    Sep 27, 2026Cunchun Li, Haonan He, Yifan Gao +4Supervised Fine-TuningAdaptive Loss Weighting

    Shanghai AI Laboratory · University of Science and Technology of China · Fudan University +2

  7. Timestep Weighting: A Hidden Key to Effective ELBO-Based Flow-Matching RL

    Sep 26, 2026Qinwei Ma, Jingzhe Shi, Simin Fan +2RL for Image GenerationAdaptive Loss Weighting

    College of AI, Tsinghua University · Department of Electrical and Computer Engineering, Princeton University · EPFL +1

  8. FairMean: Promoting Fairness in Distributed Learning under Label Poisoning Attacks

    Sep 22, 2026Huigan Zheng, Jiaojiao Zhang, Yongxiang LiuAlgorithmic FairnessAdaptive Loss Weighting

    Sun Yat-Sen University · Pengcheng Laboratory · Great Bay University

  9. Adaptive Margin Ordinal Loss: Penalizing Center-Class Hedging in Ordinal Classification

    Sep 12, 2026Manisha KandelOrdinal RegressionAdaptive Loss Weighting

    Data Science Institute & Department of Civil, Construction & Environmental Engineering University of Delaware Newark, DE, USA

  10. A Unified Per-Token Gating Family for On-Policy Distillation: FKL/RKL Mixing with Multi-Channel and Bias Coefficients

    Sep 12, 2026Suwan Wu, Yumeng Lin, Pengcheng Yuan +1Adaptive Loss WeightingLanguage Model Distillation

    Xiaohongshu Inc. · Tianjin University

  11. Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning

    Sep 9, 2026Yaning Jia, Chunhui Zhang, Wenxuan Xu +3Numerical Reasoning in Language ModelsSupervised Fine-Tuning

    Dartmouth College · Carnegie Mellon University

  12. TRaIL-Odom: Tightly Coupled Continuous Time Radar-IMU-LiDAR Odometry with Adaptive Doppler Weighting

    Sep 3, 2026Chiyun Noh, Turcan Tuna, William Talbot +3Adaptive Loss WeightingRadar-Inertial Odometry

    Department of Mechanical Engineering, Seoul National University, S. Korea · Robotic Systems Lab (RSL), ETH Zürich, 8092 Zürich, Switzerland · Robotics and AI Institute (RAI), Zürich, Switzerland

  13. Information Density Imbalance in Visual Object Detection

    Sep 2, 2026Ziwei Zhao, Yanxi Lu, Yuwei Hu +8Object DetectionAdaptive Loss Weighting

    Technical University of Munich · Nanyang Technological University · Baidu Inc. +3

  14. Online Self-Weighted Fine-Tuning

    Sep 1, 2026Haiquan Wen, Yiwei He, Bei Peng +1Supervised Fine-TuningLLM Fine-Tuning

    University of Liverpool · University of Sheffield

  15. Error-Type-Aware Loss Reweighting for Robust Named Entity Recognition with Noisy LLM Labels

    Aug 31, 2026Elena Merdjanovska, Jonas Golde, Alan AkbikNamed Entity RecognitionLLM-Assisted Annotation

    Humboldt-Universität zu Berlin · Science of Intelligence

  16. Tissue-Mixture Entropy-Weighted Reconstruction for Partial-Volume-Aware Brain MRI Super-Resolution

    Aug 27, 2026Xiao Tong, Wenyun Yang, Ziheng Zhang +3Medical Image Super-ResolutionBrain MRI

    aState Key Laboratory of Artificial Microstructure and Mesoscopic Physics, School of Physics, Peking University, Beijing, 100871, P. R. China · bWeihai Institute of Oceanology, Peking University, Weihai, 264209, P. R. China · cBeijing MagnVue Medix Co., Ltd., Beijing, 100085, P. R. China

  17. Confusion-Geometry Rebalancing for Long-Tailed Adversarial Training

    Aug 10, 2026Mengnan Zhao, Geyong Min, Lihe Zhang +2Adversarial TrainingLong-Tailed Classification

    School of Computer Science, Anhui University, China · Department of Computer Science, University of Exeter, UK · School of Information and Communication Engineering, Dalian University of Technology, China +1

  18. NeuroGuard: Neural Gradient Update Aware of Representation Damage

    Aug 8, 2026Taigo Sakai, Kazuhito HottaClass-Incremental LearningAdaptive Loss Weighting

    Meijo University, 1-501 Shiogamaguchi, Tempaku-ku, Nagoya 468-8502, Japan

  19. Tools to Explain Neural Networks for Power System Dynamics

    Aug 8, 2026Petros Ellinas, Johanna Vorwerk, Spyros ChatzivasileiadisNeural Surrogate ModelingNeural Network Interpretability

    Department of Wind and Energy Systems, Technical University of Denmark, Lyngby, Denmark

  20. FedLBW: A Loss-Based Weighting Strategy for Federated Learning on Non-IID Data in Wireless Networks

    Aug 7, 2026Majid Kundroo, Tinku Singh, Taehong KimFederated Learning AggregationNon-IID Federated Learning

    aSchool of Information and Communication Engineering, Chungbuk National University, Cheongju, 28644, Republic of Korea · bSchool of Computer Science Engineering and Technology, Bennett University, Greater Noida, 201310, India

  21. Beyond Magnitude and Shape: A Direction-Aware Loss for Time Series Forecasting

    Aug 3, 2026Seunghan Lee, Jaehoon Lee, Jun Seo +9Time Series ForecastingAdaptive Loss Weighting

    LG AI Research

  22. Data-Driven Pinball-Loss Selection for Vertically Distributed Elastic-Net SVMs

    Aug 2, 2026Xiaofei Wu, Kai Qi, Rongmei LiangDistributed OptimizationAdaptive Loss Weighting

    Yunnan Key Laboratory of Statistical Modeling and Data Analysis, School of Mathematics and Statistics, Yunnan University, East Outer Ring South Road, University Town, Chenggong District, Kunming, Yunnan, China · National Center for Applied Mathematics in Chongqing, Chongqing Normal University, No. 37 University Town Middle Road, Shapingba District, Chongqing, China · Department of Statistics and Data Science, Southern University of Science and Technology, 1088 Xueyuan Avenue, Nanshan District, Shenzhen, Guangdong 518055, China

  23. TEXAS: Task-Expert-Aware Supervision for Downstream Mixture-of-Experts LLM Adaptation

    Jul 31, 2026Guanzhi Deng, Haibo Wang, Kuan Wu +5Mixture-of-Experts Language ModelsMixture of Experts

    City University of Hong Kong, Hong Kong, China · Carnegie Mellon University, Pittsburgh, USA · University of Waterloo, Ontario, Canada +1

  24. Beyond Static Costs: Learning-Dynamics Aware Loss Functions for Long-Tailed Classification

    Jul 28, 2026Varad Shinde, Nikhil Kumar Shrey, Magesh Rajasekaran +5Class-Imbalanced LearningLong-Tailed Classification

  25. Context-weighted Discrete Flow Matching

    Jul 23, 2026Daniil Cherniavskii, Daniel Severo, Karen UllrichNon-Autoregressive Text GenerationAdaptive Loss Weighting

    University of Amsterdam · Work done during an internship at Meta FAIR. · Meta FAIR

  26. KALE: Kernel Alignment with Loss Equilibration for Stable CLIP-DINOv2 Alignment at Web Scale

    Jul 21, 2026Michał PawłowiczVLM AdaptationAdaptive Loss Weighting

  27. Dynamic Loss Balancing for Joint SOH and RUL Prediction of Lithium-Ion Batteries via a Rotary SOH-Injected Prior Battery Transformer

    Jul 19, 2026Shuhao Chen, Tianyu Shi, Yiwen Huang +1RUL EstimationPredictive Maintenance

    School of Economics and Management, Zhejiang Sci-Tech University, Hangzhou, 310018, China.

  28. Probabilistic Physics-Informed Neural Networks for Estimating Heterogeneous Elastic Properties from Low-Resolution and Noisy Displacement Data

    Jul 16, 2026Tatthapong Srikitrungruang, Jaesung LeeStructural MechanicsMaterials Property Prediction

    Wm Michael Barnes 64 Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, 77843, USA

  29. Multi-dimensional training-priority weighting based on physical information propagation paths: a unified residual-weighting framework for physics-informed neural networks

    Jul 13, 2026Zhangyi Lian, Xinda Dong, Wenxuan Huo +3Neural PDE SolversAdaptive Loss Weighting

    College of Mechanical and Vehicle Engineering Chongqing University Chongqing 400030, China · State Key Laboratory of Tribology in Advanced Equipment Department of Mechanical Engineering Tsinghua University Beijing 100084, China

  30. Adaptive Loss Balancing for Multi-Task Bioacoustic Classification of Bird Species and Call Types

    Jul 3, 2026Paria Vali Zadeh, Sven TomfordeClass-Imbalanced LearningMulti-Task Learning

    Kiel University, Kiel, Germany