Overview

Gradient interference occurs when tasks or objectives produce updates that compete in shared parameters, potentially causing negative transfer, forgetting, or unstable training. Researchers study it in settings such as multi-task and continual learning, multimodal models, federated training, reinforcement learning, and physics-informed neural networks. Common approaches measure gradient alignment and use projection or reweighting methods, while others isolate updates with adapters, parameter subspaces, routing, or separate modules. A central tension is that directional conflict does not always predict actual performance harm, so interventions must account for context, gradient magnitude and variance, and trade-offs among objectives.

Latest papers

CardsList

64 papers4 papers in the last four weeks, down 69% on the four weeks before. 0.0% of all new papers.

  1. Geometric Gradient Rectification for Safe Open-Set Semi-Supervised Learning

    Jun 25, 2026Jiahe Chen, Qian Shao, Qiyuan Chen +4Gradient InterferenceOpen-Set Recognition

  2. Heterogeneous Knowledge Distillation via Geometry Decoupling and Momentum-Aware Gradient Regulation

    Jun 23, 2026Wuming Yang, Xiang Zhang, Hongmin ZhaoGradient InterferenceCross-Architecture Knowledge Distillation

  3. Modularity-Free Conflict-Averse Training for Generalized PINNs

    Jun 18, 2026Heejo Kong, Beomchul Park, Sung-Jin Kim +1Neural PDE SolversGradient Interference

  4. Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts

    Jun 14, 2026Yijun Lu, Zihan Fang, Pengpeng Qiao +6Federated Learning AggregationLLM Fine-Tuning

  5. SceneMiner: Identity-Preserving Multi-Task Fine-Tuning for Unified BEV Scene Mining

    Jun 9, 2026Abdalmalek Aburaddaha, Venkatraman Narayanan, Keval Thaker +1VLM AdaptationGradient Interference

  6. On the training of physics-informed neural operators for solving parametric partial differential equations

    Jun 4, 2026Nanxi Chen, Chuanjie Cui, Airong Chen +2Neural Network OptimizationGradient Interference

  7. Class-Specific Branch Attention for Mitigating Gradient Interference under Class Imbalance

    Jun 4, 2026Arush Singhal, Umang SoniClass-Imbalanced LearningChannel Attention

  8. Multilingual Fine-Tuning via Localized Gradient Conflict Resolution

    Jun 4, 2026Long P. Hoang, Yiran Zhao, Wei Lu +1Multilingual Language ModelsLLM Fine-Tuning

  9. A Conflict-Aware Penalty and Statistical Loss Framework for Balancing Modalities and Enhancing Stability in Multimodal Sentiment Analysis

    May 27, 2026Jianheng Dai, Jiazhang Liang, Sijie MaiModality ImbalanceGradient Interference

  10. Mitigating Gradient Pathology in PINNs through Aligned Constraint

    May 24, 2026Yichen Luo, Peiyu Zhu, Dongxiao Hu +5Neural PDE SolversGradient Interference

  11. The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution

    May 21, 2026Erjian Zhang, Yatong Hao, Liejun Wang +1Radiology Report GenerationGradient Interference

  12. CRAFT: Conflict-Resolved Aggregation for Federated Training

    May 20, 2026Ziqi Wang, Qiang Liu, Nils ThuereyFederated Learning AggregationGradient Interference

  13. DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimation

    May 15, 2026Yifan Gao, Lu Zou, Zhangjin Huang +1Object Pose EstimationGradient Interference

  14. Understanding Imbalanced Forgetting in Rehearsal-Based Class-Incremental Learning

    May 14, 2026Alberto Tamajo, Srinandan Dasmahapatra, Rahman AttarClass-Incremental LearningGradient Interference

  15. HarmoGS: Robust 3D Gaussian Splatting in the Wild via Conflict-Aware Gradient Harmonization

    May 13, 2026Yulei Kang, Tianze Zhu, Jian-Fang Hu +2Multi-View Consistency3D Gaussian Splatting

  16. Low-Rank Adapters Initialization via Gradient Surgery for Continual Learning

    May 12, 2026Joana Pasquali, Ramiro N. Barros, Arthur S. Bianchessi +7Gradient InterferenceCatastrophic Forgetting

  17. Per-Loss Adapters for Gradient Conflict in Physics-Informed Neural Networks

    May 11, 2026Bum Jun Kim, Gnankan Landry Regis N'guessanGradient InterferenceAdaptive Loss Weighting

  18. MARBLE: Multi-Aspect Reward Balance for Diffusion RL

    May 7, 2026Canyu Zhao, Hao Chen, Yunze Tong +3Multi-Objective Reinforcement LearningDiffusion Model Alignment

  19. Decomposing the Basic Abilities of Large Language Models: Mitigating Cross-Task Interference in Multi-Task Instruct-Tuning

    May 7, 2026Bing Wang, Ximing Li, Changchun Li +3LLM Fine-TuningGradient Interference

  20. Conflict-Aware Harmonized Rotational Gradient for Multiscale Kinetic Regimes

    Apr 27, 2026Zhangyong LiangNeural PDE SolversGradient Interference

  21. Modeling LLM Unlearning as an Asymmetric Two-Task Learning Problem

    Apr 16, 2026Zeguan Xiao, Siqing Li, Yong Wang +4Gradient InterferenceMulti-Task Learning

  22. Harmonized Tabular-Image Fusion via Gradient-Aligned Alternating Learning

    Apr 2, 2026Longfei Huang, Yang YangMultimodal FusionGradient Interference

  23. The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery

    Mar 25, 2026Haiyang Zheng, Nan Pu, Yaqi Cai +4Generalized Category DiscoveryGradient Interference

  24. Resolving gradient pathology in physics-informed epidemiological models

    Mar 25, 2026Nickson Golooba, Woldegebriel Assefa WoldegerimaGradient InterferencePhysics-Informed ML

  25. Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders

    Mar 19, 2026Yana Veitsman, Yihong Liu, Hinrich SchützeCross-Lingual Representation AlignmentCross-Lingual Transfer

  26. Balancing Multimodal Domain Generalization via Gradient Modulation and Projection

    Mar 15, 2026Hongzhao Li, Guohao Shen, Shupan Li +2Multimodal Domain GeneralizationDomain Generalization