Balanced Learning

Follow this topic Ask about this topic

Momentum

11 papers in the last four weeks, up 175% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 68

All topics

Learn the Directions, Normalize the Gains: Post-Training Normalization for LoRA
Oct 1, 2026Zailong Tian, Yanzhe Chen, Zhuoheng Han +2Balanced Learning Rapid Adaptation
Singapore Management University · National University of Singapore · Peking University
Importance-Aware Feature Sparsification for Wireless Split Learning
Sep 30, 2026Bumjun Kim, Yoon Huh, Wan ChoiSparsity Balanced Learning
Department of Electrical and Computer Engineering, Seoul National University (SNU), and the Institute of New Media and Communications, SNU, Seoul 08826, Korea
ID Balancing: Stable Training of Extremely Sparse MoE via PID-Based Load Control
Sep 30, 2026Peng Jin, Zihan Qiu, Zekun Wang +8Load Balancing Mixture-Of-Experts Architectures
Qwen Team, Alibaba Token Hub, Alibaba Group
A Comprehensive View of Fairness through Distributional Stability
Sep 29, 2026Gayane Taturyan, Charlotte Laclau, Stephan ClémenconAlgorithmic Fairness Balanced Learning
LTCI, Télécom Paris, Institut Polytechnique de Paris, Palaiseau, France
Weighted Spline-Expanded Networks with Distributional Balancing for Continuous Treatment Effects
Sep 27, 2026Shucheng Liu, Chan Park, Guanhua ChenHeterogeneous Treatment Effects Covariate Balancing
University of North Carolina at Chapel Hill · University of Illinois Urbana-Champaign · University of Wisconsin–Madison
Exact Quantile Balancing and Load-Error Injection for Mixture-of-Experts
Sep 23, 2026Pit Neitemeier, Jiaze Li, Alessio Serra +2Load Balancing Balanced Learning
Aleph Alpha
FairMean: Promoting Fairness in Distributed Learning under Label Poisoning Attacks
Sep 22, 2026Huigan Zheng, Jiaojiao Zhang, Yongxiang LiuAlgorithmic Fairness Balanced Learning
Sun Yat-Sen University · Pengcheng Laboratory · Great Bay University
FedFIbOS: Fisher Importance based Optimal Submodelling for Heterogeneous Federated Learning
Sep 17, 2026Yasmeen Afzal, Jeremiah D. Deng, Haibo ZhangHeterogeneous Federated Learning Federated Learning
School of Computing, University of Otago, New Zealand · School of Computer Science and Engineering, University of New South Wales, Australia
Bounded Adjustment with Reliability-Guided Embedding for Imbalanced Learning with Noisy Labels
Sep 14, 2026Mushir Akhtar, Akarsh J., M. Tanveer +1Noisy Labels Imbalanced Classification
Department of Mathematics, Indian Institute of Technology Indore, India · Department of Electrical Engineering, Indian Institute of Technology Indore, India
The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods
Sep 11, 2026Ioanna Kaffeza, Efthymios Georgiou, Alexandros PotamianosMultimodal Sentiment Analysis Modalities
PERSEE Center, Mines Paris-PSL University, Sophia-Antipolis, France · National Technical University of Athens, Athens, Greece · University of Bern, Bern, Switzerland +2
BAFF: Bid-Aware Filter Family for Mitigating Training Data Interference in RTB A/B Tests
Sep 8, 2026Jeonglyul Oh, Ikkyu Choi, Inseop Youn +1Balanced Learning Ablation
Dable Inc. · Seoul, Republic of Korea
D-FROST: Decentralized Federated pRompt-tuning via Optimal tranSporT for Non-IID and Imbalanced Data
Sep 1, 2026Quan Minh Nguyen, Hoang M. Ngo, Trong Nghia Hoang +1Soft Prompt Tuning Balanced Learning
University of Florida, FL, USA · Washington State University, WA, USA
Token Distribution versus Data Volume: Domain Balancing in Multi-Domain Meeting Summarisation
Aug 16, 2026Ashima Sood, Bryan Gardiner, Joan CondellBalanced Learning Natural Language Datasets
School of Computing, Engineering and Intelligent Systems, Ulster University Londonderry, Northern Ireland, United Kingdom
Multi-perspective Imbalance-Conscious 6G Beamforming Optimization and Performance
Aug 13, 2026Chukwunonso Henry Nwokoye, Blessing Oluchi Iloka, Chikwue V. Umeugoji +2Beamforming Unsupervised
Liberal Arts & Professional Studies York University, Toronto, Canada · Physics, Engineering & Computer Science University of Hertfordshire England, United Kingdom · IT Services, Joint Admissions & Matn. Board Lagos, Nigeria +1
FEAST: Federated Shared-Space Training for Resource-Heterogeneous Clients
Aug 10, 2026Bostan Khan, Masoud DaneshtalabBalanced Learning Taco
Mälardalen University, Västerås, Sweden
NeuroGuard: Neural Gradient Update Aware of Representation Damage
Aug 8, 2026Taigo Sakai, Kazuhito HottaClass-Incremental Learning Balanced Learning
Meijo University, 1-501 Shiogamaguchi, Tempaku-ku, Nagoya 468-8502, Japan
EasyBalance: Cross-Layer Load Balancing in Distributed MoE Inference
Aug 8, 2026Yize Wu, Ke Gao, Ling Li +1Load Balancing Mixture-Of-Expert Inference
Intelligent Software Research Center, Institute of Software, CAS, Beijing, China · University of Chinese Academy of Sciences, Beijing, China
Capacity Confounds and Coverage Guarantees in Adaptive Sub-model Federated Learning
Aug 7, 2026Alireza Moayedikia, Alicia Troncoso LoraFederated Learning Long-Run Coverage Guarantees
Department of Business Technology and Entrepreneurship, Swinburne University of Technology, Melbourne, Australia · Data Science & Big Data Lab, Universidad Pablo de Olavide, Seville, Spain
One Knob to Rule Them All: A Unified Optimal Transport View of Cold-Start Active Learning
Aug 4, 2026Ning Zhu, Xiaochuan Ma, Juntao Xu +4Pool-Based Active Learning Cold-Start
Glasgow College, University of Electronic Science and Technology of China · School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China · School of Mathematical Sciences, University of Electronic Science and Technology of China
Robust and Personalized Federated Learning for Aircraft-Engine Prognostics under Benign and Adversarial Client Heterogeneity
Aug 4, 2026Chinmoy Mitra, Md. Mehedi Hasan Nipu, Mohammad Sakib Mahmood +2Federated Learning Balanced Learning
Department of Computer Science and Engineering, Rajshahi University of Engineering & Technology, Kazla, Rajshahi, 6204, Bangladesh · Department of Electrical and Computer Engineering, North South University, Dhaka 1229, Bangladesh. · Department of Computer Science, Missouri State University, Springfield, MO, 65809, USA. +2
End-to-End Fairness Optimization with Fair Decision-Focused Learning
Jul 31, 2026Yu Wang, Violet Xinying ChenAlgorithmic Fairness Balanced Learning
School of Business Stevens Institute of Technology
Learning-Augmented and Randomized Algorithms for Line Aggregation with Delays
Jul 30, 2026Tianhang Lu, Runtian Ren, Shengcai Liu +1Learning-Augmented Algorithms Queue Control
Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation, Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen 518055, China
From Perturbation Correction to Geometry-Aware Sampling: Sharpness-Guided Equilibrium Sampling for Balanced Flat Minima in Long-Tailed Learning
Jul 24, 2026Jiaxin Deng, Junbiao PangSharpness-Aware Minimization Balanced Learning
School of Information Science and Technology, Beijing University of Technology, Beijing, China
Real-Time Semantic Segmentation with Optimized RetinaNet Architectures for Embedded Automotive Systems
Jul 21, 2026Sai Sidharth DEfficient Semantic Segmentation Mobilenetv2
SpEmoC: A Balanced Speaker-Segment Multimodal Emotion Benchmark
Jul 20, 2026Sania Bano, Shahzad Ahmad, Santosh Kumar Vipparthi +2Emotion Recognition Multimodal Dataset
CVPR Lab, Indian Institute of Technology Ropar, India · Østfold University College, Norway · CVPR Lab, SCSS, Trinity College Dublin, Ireland
Dynamic Loss Balancing for Joint SOH and RUL Prediction of Lithium-Ion Batteries via a Rotary SOH-Injected Prior Battery Transformer
Jul 19, 2026Shuhao Chen, Tianyu Shi, Yiwen Huang +1Lithium-Ion Batteries Useful Life Prediction
School of Economics and Management, Zhejiang Sci-Tech University, Hangzhou, 310018, China.
Enhanced Byzantine-Robust Federated Learning Via Truncated-Quadratic Loss for Heterogeneous Data
Jul 13, 2026Zhi-Yong Wang, Hao Nan Sheng, Werner Stefan +3Federated Learning Byzantine Attacks
State Key Laboratory of Ocean Sensing, Ocean College, Zhejiang University, Hangzhou, China · Department of Electrical Engineering, City University of Hong Kong, Hong Kong, China · Department of Information and Communications Engineering, Aalto University, 02150 Espoo, Finland +1
WHERE to Generate Matters: Budget-Aware Synthetic Augmentation for Label Skewed Federated Learning
Jul 7, 2026Sangwoo Lee, Sunghwan Park, Jaewoo LeeFederated Learning Fedavg
Chung-Ang University, Seoul, South Korea
Pretraining Curricula Enable Selective Fine-tuning
Jul 6, 2026Sebastian A. Bruijns, Jirko Rubruck, Mia H. Whitefield +3Adaptive Curriculum Curriculum
University of Oxford · University of Oxford & Martian · Martian
FedProIn: Mitigating Client Drift for Learnable Prototypes in Federated Medical Imaging
Jul 5, 2026Harsh Kumar, Tarun Kumar Garg, Vaanathi SundaresanFederated Learning Fedavg
Department of Computational and Data Sciences, Indian Institute of Science Bengaluru, Karnataka 560012, India · Department of IISc Mathematics Initiative, Indian Institute of Science Bengaluru, Karnataka 560012, India
Adaptive Loss Balancing for Multi-Task Bioacoustic Classification of Bird Species and Call Types
Jul 3, 2026Paria Vali Zadeh, Sven TomfordeAnimal Vocalizations Passive Acoustic Monitoring
Kiel University, Kiel, Germany
Beyond the Performance Illusion: Structure-Aware Stratified Partitioning and Curriculum Distributionally Robust Optimization for Spatially Correlated Domains
Jul 2, 2026Prathamesh Patil, Arpit Jain, Aswanth KrishnanPartitioning Balanced Learning
1QpiAI India Pvt. Ltd.
Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching
Jun 26, 2026Guanbo Huang, Jingjia Mao, Fanding Huang +9Rectification Frequency-Aware Regularization
Tsinghua Shenzhen International Graduate School, Tsinghua University · Central Media Technology Institute, Huawei
Distribution Alignment for One-Shot Federated Learning via Optimal Transport
Jun 15, 2026Daniele Berardini, Vito Paolo Pastore, Vittorio MurinoFederated Learning Few-Shot Learning
AI for Good · AI for Good (AIGO), Italian Institute of Technology, Genoa, Italy · MaLGa-DIBRIS, University of Genoa, Genoa, Italy +1
Adaptive Loss Balancing for Noise-Robust GRPO in Generative Recommendation
Jun 7, 2026Kewei Xu, Junbo Qi, Yanyan Zou +3Reward Gradients Recommendation
Waseda University Tokyo, Japan · University of Electronic Science and Technology of China Chengdu, China
Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion
Jun 2, 2026Oskar Natan, Jun MiuraAutonomous Driving Perception Multi-Sensor Fusion
Department of Computer Science and Engineering, Toyohashi University of Technology, Aichi 441-8580, Japan · Department of Computer Science and Electronics, Gadjah Mada University, Yogyakarta 55281, Indonesia
A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router
May 27, 2026O. M. KiselevLoad Balancing Mixture-Of-Experts
Innopolis University, Innopolis, Russia
Separate Aggregation of Split Network for Personalized Federated Learning
May 26, 2026Yunseok Kang, Jaeyoung SongFederated Learning Heterogeneity
Department of Electronics Engineering, Pusan National University, Republic of Korea
Enhancing Autonomous Online Intrusion Detection for IoT with Balanced Learning, Reliable Pseudo-Labels, and Lightweight Architectures
May 24, 2026Hanzala Afzaal, Danish Memon, Chouhdary Bilal Raza +1Internet Of Thing Intrusion Detection
School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad, Pakistan
Self-Balancing Gradient Allocation for Heterogeneity-Aware Feature Generation in Click-Through Rate Prediction
May 24, 2026Moyu Zhang, Yun Chen, Yujun Jin +3Balanced Learning Click-Through Rate Prediction
Alibaba Group · Beijing, China
A Reproducible Log-Driven AutoML Framework for Interpretable Pipeline Optimization in Healthcare Risk Prediction
May 19, 2026Rui Huang, Lican HuangReadmission Prediction General Grid Search Framework
School of Basic Medicine, Hangzhou Normal University, No.2318, Yuhangtang Rd, Yuhang District, Hangzhou, 311121, Zhejiang, China. · Research Department, Hangzhou Domain Zones Technology Co.Ltd.,2026 200 Zhenhua Rd, West District, Hangzhou, 310030, Zhejiang, China.
Balancing Knowledge Distillation for Imbalance Learning with Bilevel Optimization
May 18, 2026Anh B. H. Nguyen, Ba Tho Phan, Viet Cuong TaBalanced Learning Knowledge Distillation
VNU University of Engineering and Technology, Hanoi, Vietnam
BESplit: Bias-Compensated Split Federated Learning with Evidential Aggregation
May 17, 2026Yuhan Xie, Chen Lyu, Jingrong HuangFederated Learning Balanced Learning
Shanghai University of Finance and Economics, China · MoE Key Laboratory of Interdisciplinary Research of Computation and Economics, China.
$φ$ -Balancing for Mixture-of-Experts Training
May 14, 2026Lizhang Chen, Jonathan Li, Qi Wang +5Mixture-Of-Experts Balanced Learning
University of Texas at Austin · 2Northwestern University.
Distributionally Robust Multi-Task Reinforcement Learning via Adaptive Task Sampling
May 14, 2026Nicholas E. Corrado, Wenyuan Huang, Josiah P. HannaMulti-Turn Reinforcement Learning Adaptive Sampling
Computer Sciences Department · University of Wisconsin – Madison
Agent-Based Post-Hoc Correction of Agricultural Yield Forecasts
May 12, 2026Matthew Beddows, Aiden Durrant, Georgios LeontidisAgricultural Prediction Precision Agriculture
School of Natural and Computing Sciences University of Aberdeen, UK · School of Computing Sciences University of East Anglia, UK · Department of Physics and Technology UiT The Arctic University of Norway
Fed-BAC: Federated Bandit-Guided Additive Clustering in Hierarchical Federated Learning
May 12, 2026Satwat Bashir, Tasos Dagiuklas, Muddesar IqbalHeterogeneous Federated Learning Federated Learning
Computer Science and Informatics · London South Bank University · London, UK +1
FedOUI: OUI-Guided Client Weighting for Federated Aggregation
May 12, 2026Alberto Fernández-Hernández, Jose I. Mestre, Cristian Pérez-Corral +3Federated Learning Fedavg
Universitat Politècnica de València, Valencia, Spain · Universitat Jaume I, Castelló de la Plana, Spain · Openchip & Software Technologies S.L., Spain
Per-Loss Adapters for Gradient Conflict in Physics-Informed Neural Networks
May 11, 2026Bum Jun Kim, Gnankan Landry Regis N'guessanParametric Physics-Informed Neural Network Neural Network
The University of Tokyo, Japan · Axiom Research Group · Department of Applied Mathematics and Computational Science, NM-AIST, Tanzania +3
Rethinking Loss Reweighting for Imbalance Learning as an Inverse Problem: A Neural Collapse Point of View
May 11, 2026Jinping Wang, Zixin Tong, Zhiwu Xie +1Balanced Learning Class Imbalance
CSMT, Wenzhou-Kean University · International Frontier Interdisciplinary Research Institute, Wenzhou-Kean University
When More Parameters Hurt: Foundation Model Priors Amplify Worst-Client Disparity Under Extreme Federated Heterogeneity
May 9, 2026Kiran Naseer, Umar ShoaibFederated Learning Wireless Foundation Models
University of Gujrat, Pakistan
ReLibra: Routing-Replay-Guided Load Balancing for MoE Training in Reinforcement Learning
May 9, 2026Chao Jin, Xinming Wei, Yinmin Zhong +6Load Balancing Large Language Model Reinforcement Learning
School of Computer Science, Peking University · Independent Researcher
Hessian Surgery: Class-Targeted Post-Hoc Rebalancing via Hessian Spike Perturbation
May 8, 2026Hugo Vigna, Samuel BontempsHessian Balanced Learning
CentraleSupélec – Université Paris-Saclay · ESILV – Léonard de Vinci
HARMONY: Bridging the Personalization-Generalization Gap by Mitigating Representation Skew in Heterogeneous Split Federated Learning
May 8, 2026Jiseok Youn, You Rim Choi, Goodsol Lee +3Heterogeneous Federated Learning Federated Learning
Department of ECE and INMC, Seoul National University, Seoul, South Korea · Graduate School of Data Science, Seoul National University, Seoul, South Korea · Department of Computer Science, University of Colorado Boulder, CO, USA
Knowledge Transfer Scaling Laws for 3D Medical Imaging
May 7, 2026Ho Hin Lee, Dongna Du, Chu Wang +4Medical Imaging Multimodal Pretraining
Vanderbilt University · Zhejiang University · McGill University +1
Fine-Tuning Impairs the Balancedness of Foundation Models in Long-tailed Personalized Federated Learning
May 4, 2026Shihao Hou, Chikai Shang, Zhiheng Yang +5Federated Learning Balanced Learning
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, Xiamen, China · Department of Statistical Science, University College London, London, United Kingdom · School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, China
FedKPer: Tackling Generalization and Personalization in Medical Federated Learning via Knowledge Personalization
May 1, 2026Zoe Fowler, Ghassan AlRegibFederated Learning Fedavg
Georgia Institute of Technology
Adaptive Equilibrium: Dynamic Weighting Framework for Generalized Interruption of DeepFake Models
May 1, 2026Hongrui Zheng, Liejun Wang, Zhiqing GuoDeepfake Detection Balanced Learning
School of Computer Science and Technology, Xinjiang University, Urumqi, China · Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center, Urumqi, China · Silk Road Multilingual Cognitive Computing International Cooperation Joint Laboratory, Xinjiang University, Urumqi, China
Who Trains Matters: Federated Learning under Enrollment and Participation Selection Biases
Apr 29, 2026Gota MorishitaFederated Learning Selection Bias
Centre for Brain, Mind and Markets University of Melbourne Parkville, Victoria, Australia
Improving Facial Emotion Recognition through Dataset Merging and Balanced Training Strategies
Apr 22, 2026Serap KırbızImbalanced Classification Facial Expression Recognition
aMEF University,Department of Electrical and Electronics Engineering, Huzur Mah. Maslak Ayaza˘ga Cad. No:4 Sarıyer, ˙Istanbul, 34396, Türkiye

Oct 1, 2026, cs.LGJ/K move · Enter open · S save

Learn the Directions, Normalize the Gains: Post-Training Normalization for LoRA

Zailong Tian, Yanzhe Chen, Zhuoheng Han, Houfeng Wang+1

Singapore Management University · National University of Singapore · Peking University

Balanced Learning Rapid Adaptation Post-Training

Open paper AskPDF arXiv

While Low-Rank Adaptation (LoRA) enables efficient task specialization, its learned updates can compromise capabilities beyond the target task. We identify \textbf{adaptation imbalance}: a few singular directions dominate the trained update, leaving its performance sensitive to how gains are allocated. We argue that \textbf{learning where to adapt does not ensure that adaptation gains are well balanced}. This motivates \textbf{LoRA-Norm}, a post-training normalization method that retains learned directions while rebalancing their gains. LoRA-Norm combines spectral rebalancing, a fixed nonlinear transformation of singular values, with nuclear-norm restoration, which preserves the original total spectral mass. It requires no calibration data or additional training and introduces no inference overhead. Across two backbones and three adaptation tasks, LoRA-Norm improves average specialization and capability retention, outperforming the evaluated post-hoc spectral pruning and gradient-guided editing configurations on both measures. Stronger functional equalization brings no consistent additional gains, revealing that balancing adapter gains and equalizing their responses are distinct objectives.

Momentum

Related topics

Latest papers 68