Training-Side Stage-Aware Low-Rank Adaptation

Ask about this topic

Momentum

2 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 39

All topics
CardsList

  1. Transformers Stop Thinking Too Early, and a Tiny LoRA Fixes It

    Sep 29, 2026Zehao Jin, Ruixuan Deng, Junran WangTransformer ArchitecturesGenerative Pretrained Transformers

    Georgia Institute of Technology

  2. Lightweight Adaptation of EEG Foundation Models for Stroke Motor Imagery Decoding: Domain Shift and Subject-Level Robustness

    Aug 31, 2026Anh T. Nguyen, Zihua Sun, Michelle J. JohnsonElectroencephalography Foundation ModelsRehabilitation

    School of Engineering and Applied Science, Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA · School of Engineering and Applied Science, Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, PA, USA · Department of Physical Medicine and Rehabilitation, Department of Bioengineering, and Department of Mechanical Engineering and Applied Mechanics, University of Pennsylvania, Philadelphia, PA, USA

  3. RW-LoRA: Communication-Efficient Decentralized LoRA Fine-Tuning via Random Walks

    Aug 31, 2026Xingran Chen, Rohit Bhagat, Ghadir Ayache +3Hip-LoraParameter-Efficient Fine-Tuning Methods

    Engineering Systems and Design Pillar, Singapore University of Technology and Design, Singapore 487372 · Department of Electrical and Computer Engineering, Rutgers University, Piscataway Township, NJ 08854, USA · LinkedIn, New York, NY 10118, USA +2

  4. Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA

    Aug 10, 2026Mind Lab, :, Vin Bo +74Replay-Based Continual LearningMixture-Of-Agents

  5. Understanding Is Done Early: A Depth Division of Labor in Large Language Models and Its Use for Unbounded-Context Memory

    Jul 30, 2026Hanzuo Liu, Xuan Qi, Chunyu Liu +6Efficient Long-Context InferenceLarge Language Model Memory

    Tsinghua University · Tencent

  6. MoE2^2-LoRA: When MoE Models Meet MoE-style Low-Rank Adaptation

    Jul 24, 2026Qingyu Yang, Haonan He, Minglei Li +4Mixture-Of-Experts Large Language ModelsTraining-Side Stage-Aware Low-Rank Adaptation

    Shanghai Artificial Intelligence Laboratory · KTH Royal Institute of Technology · University of Science and Technology of China +2

  7. Selective State-Space Adaptation and Retrieval for Language Model Reasoning

    Jul 21, 2026Atahan Dokme, Larry HeckLarge Language Model AdaptationTraining-Side Stage-Aware Low-Rank Adaptation

    AI Virtual Assistant (AVA) Lab Georgia Institute of Technology

  8. Stage-Aware Adaptation and Distribution Calibration for Subject-Driven Personalized Text-to-Image Generation

    Jul 8, 2026Wenyan Xu, Alizer WongText-To-ImageTraining-Side Stage-Aware Low-Rank Adaptation

    School of Computer Science, Guangdong University of Technology · School of Computer Science, Peking University · 3ManXis

  9. RSLoRA: Training-free Rank Allocation for LoRA via Representational Sensitivity Probing

    Jul 5, 2026Jiaqi Liu, Haidong Kang, Qihui Zhao +1Training-Side Stage-Aware Low-Rank AdaptationParameter-Efficient Adaptation

    School of Computer Science and Technology Dalian University of Technology · Hebei Key Laboratory of Marine Perception Network and Data Processing Northeastern University · School of Computer and Communication Engineering Northeastern University +1

  10. Co-Adaptive Multi-Task LoRA: Transfer-Aware, Label-Free Control of Domain Participation

    Jul 3, 2026Wei Zhang, Lin Tang, Ming Zhao +1Domain AdaptationTraining-Side Stage-Aware Low-Rank Adaptation

    1Sichuan University, Chengdu, China · University of Electronic Science and Technology of China, Chengdu, China

  11. Stacked LoRA for Subject-Adaptive EEG Foundation Models in Motor Imagery Decoding

    Jul 3, 2026Aymen Sarhane, Fouad Lbakali, Mouad Souissi +2Electroencephalography Foundation ModelsBrain-Computer Interface

    IMT Atlantique, Lab-STICC, Brest, France

  12. Bayesian Sparse Low-Rank Adaptation for Large Language Model Uncertainty Estimation

    Jul 2, 2026Jijie Zhang, Zhe Ren, Quan Zhang +1Large Language Model UncertaintyTraining-Side Stage-Aware Low-Rank Adaptation

    School of Artificial Intelligence, Jilin University · Michigan State University

  13. Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading

    Jun 26, 2026Hong Li, Minqi Meng, Yanjun Liang +10Avatar ReconstructionDiffusion Priors

  14. MixTTA: Low-Rank Cross-Channel Mixing for Reliable Test-Time Adaptation

    Jun 26, 2026Mansoo Jung, Youngwook Kim, Jungwoo LeeStable Test-Time AdaptationTest-Time Adaptation

    Seoul National University, Seoul, Republic of Korea · Kookmin University, Seoul, Republic of Korea · HodooAI Labs, Seoul, Republic of Korea

  15. TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts

    Jun 26, 2026Boyuan Chen, Zichen Dang, Chuang Yang +2Scene Text RecognitionImage-Text Alignment

    School of Electrical Engineering, Xi’an Jiaotong University · Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University

  16. Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generation

    Jun 11, 2026Xiaomeng Yang, Yanyu Li, Gordon Guocheng Qian +7Training-Side Stage-Aware Low-Rank AdaptationTraining-Free

    1Northeastern University, 2Snap Inc.

  17. Low-Rank Adaptation of Frozen Vision-Language Models for Blind Image Quality Assessment

    Jun 1, 2026Bishr Omer Adam, Xu LiImage Quality AssessmentFrozen Vision-Language Models

    School of Electronics and Information, Northwestern Polytechnical University, Xi’an, China

  18. Balanced LoRA: Removing Parameter Invariance to Accelerate Convergence

    May 29, 2026Valérie Castin, Kimia Nadjahi, Pierre Ablin +1Training-Side Stage-Aware Low-Rank AdaptationLow-Rank Structure

    1 ´Ecole Normale Sup´erieure PSL, Paris, France · 2CNRS · 3Apple, Paris, France.

  19. CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation

    May 25, 2026Fangtai Wu, Hailong Guo, Shijie Huang +7Multi-LoraTraining-Side Stage-Aware Low-Rank Adaptation

    Zhejiang University · Qwen Applications Business Group of Alibaba · Xi’an Jiaotong University

  20. Learning When to Adapt

    May 18, 2026Ali Zindari, Xiaowen Jiang, Rotem Mulayoff +1Training-Side Stage-Aware Low-Rank Adaptation

    1Universität des Saarlandes · 2CISPA Helmholtz Center for Information Security

  21. GLT-PEFT: Gated Lie-Tucker Parameter-Efficient Fine-Tuning for Alzheimer's Disease Diagnosis with Hippocampal Segmentation Pretraining

    May 16, 2026Guanghua He, Hancan Zhu, Gaohang Yu +1Parameter-Efficient Fine-Tuning MethodsTraining-Side Stage-Aware Low-Rank Adaptation

    Department of Mathematics, Hangzhou Dianzi University, Hangzhou, 310018, China · School of Mathematics, Physics and Information, Shaoxing2026 University, Shaoxing, 312000, China · Department of Mathematics, Zhejiang University of Science and Technology, Hangzhou, 310023, China

  22. Strategic Over-Parameterization for Generalizable Low-Rank Adaptation

    May 15, 2026Jing Gao, Zhong-Yi Lu, Pan Zhang +1Training-Side Stage-Aware Low-Rank AdaptationLow-Rank Adaptation Adapters

    School of Fundamental Physics and Mathematical Sciences, Hangzhou Institute for Advanced Study, UCAS, Hangzhou 310024, China · School of Physical Sciences, University of Chinese Academy of Sciences, No. 19A Yuquan Road, Beijing 100049, China · CAS Key Laboratory of Theoretical Physics, Institute of Theoretical Physics, Chinese Academy of Sciences, Beijing 100190, China +1

  23. GPart: End-to-End Isometric Fine-Tuning via Global Parameter Partitioning

    May 14, 2026Paolo Mandica, Michał Brzozowski, Zuzanna Dubanowska +1Parameter-Efficient Fine-Tuning MethodsTraining-Side Stage-Aware Low-Rank Adaptation

    Samsung AI Center, Warsaw, Poland · University of Warsaw, Poland

  24. Continual Fine-Tuning of Large Language Models via Program Memory

    May 13, 2026Hung Le, Svetha VenkateshTraining-Side Stage-Aware Low-Rank AdaptationReplay-Based Continual Learning

    Deakin Applied AI Initiative, Deakin University, Australia

  25. HELLoRA: Hot Experts Layer-Level Low-Rank Adaptation for Mixture-of-Experts Models

    May 11, 2026Jia Wei, Zhonghao Zhang, Ping Chen +5Training-Side Stage-Aware Low-Rank AdaptationMixture-Of-Experts Large Language Models

    Department of Computer Science and Technlogy Tsinghua University Beijing 100084, China · School of Computer Science and Technlogy Xi’an Jiaotong University · The State Key Laboratory of Blockchain and Data Security, Zhejiang University Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security

  26. Gate-and-Merge: Zero-shot Compositional Personalization of Vision Language Models

    May 9, 2026Guodong Ding, Angela YaoPersonalizationTraining-Side Stage-Aware Low-Rank Adaptation

    National University of Singapore

  27. Beyond LoRA vs. Full Fine-Tuning: Gradient-Guided Optimizer Routing for LLM Adaptation

    May 8, 2026Haozhan Tang, Xiuqi Zhu, Xinyin Zhang +3Training-Side Stage-Aware Low-Rank AdaptationLarge Language Model Adaptation

    Carnegie Mellon University · Tsinghua University · Infinigence AI

  28. Ortho-Hydra: Orthogonalized Experts for DiT LoRA

    May 5, 2026Seunghyun JiDiffusion TransformersMulti-Lora

  29. Exploring Data-Free LoRA Transferability for Video Diffusion Models

    May 3, 2026Yuchen Wang, Wenliang Zhong, Lichen Bai +6Training-Side Stage-Aware Low-Rank Adaptation

    Thrust of Data Science and Analytics, The Hong Kong University of Science and Technology (Guangzhou) · Thrust of Microelectronics, The Hong Kong University of Science and Technology (Guangzhou) · School of Intelligence Science and Technology, Nanjing University +1

  30. SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability

    May 2, 2026Shuaipeng Zhou, Yu ZhangMulti-LoraLow-Rank Adaptation Framework

    School of Computer Science and Technology, Shenyang University of Chemical Technology · 2Liaoning Key Laboratory of Intelligent Technology for Chemical Process Industry

  31. Decoupling Knowledge and Task Subspaces for Composable Parametric Retrieval Augmented Generation

    Apr 29, 2026Weihang Su, Hanwen Zhang, Qingyao Ai +1Agentic Retrieval-Augmented Generation SystemsMultimodal Retrieval Augmented Generation

    Department of Computer Science and Technology, Tsinghua University

  32. Where Should LoRA Go? Component-Type Placement in Hybrid Language Models

    Apr 24, 2026Hector Borobia, Elies Seguí-Mas, Guillermina Tormo-CarbóLarge Language Model AdaptationTraining-Side Stage-Aware Low-Rank Adaptation

    VRAIN – Valencian Research Institute for Artificial Intelligence, Universitat Politècnica de València, Valencia, Spain · Department of Economics and Social Sciences, Universitat Politècnica de València, Valencia, Spain · Department of Business Organisation, Universitat Politècnica de València, Valencia, Spain

  33. SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning

    Apr 21, 2026Boyan Shi, Wei Chen, Shuyuan Zhao +4Training-Side Stage-Aware Low-Rank AdaptationMulti--Task Learning

    School of Computer Science and Technology, Beijing Jiaotong University, China · 2Guangxi Key Lab of Trusted Software, Guilin University of Electronic Technology, China · 3Beijing Key Lab of Traffic Data Mining and Embodied Intelligence, China +2

  34. DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models

    Jan 8, 2026Guanzhi Deng, Bo Li, Ronghao Chen +5Training-Side Stage-Aware Low-Rank AdaptationHip-Lora

    City University of Hong Kong · Tsinghua University · Peking University +2

  35. On-the-Fly Adaptation to Quantization: Configuration-Aware LoRA for Efficient Fine-Tuning of Quantized LLMs

    Sep 22, 2025Rongguang Ye, Ming Tang, Edith C. H. NgaiLarge Language Model QuantizationTraining-Side Stage-Aware Low-Rank Adaptation

    Southern University of Science and Technology · The University of Hong Kong

  36. PLoRA: Efficient Concurrent LoRA Training for Large Language Models

    Aug 4, 2025Minghao Yan, Zhuang Wang, Zhen Jia +2Training-Side Stage-Aware Low-Rank AdaptationLow-Rank Adaptation Framework

    University of Wisconsin-Madison · Amazon Web Services

  37. TreeLoRA: Efficient Continual Learning via Layer-Wise LoRAs Guided by a Hierarchical Gradient-Similarity Tree

    Jun 12, 2025Yu-Yang Qian, Yuan-Ze Xu, Zhen-Yu Zhang +2Replay-Based Continual LearningTraining-Side Stage-Aware Low-Rank Adaptation

    National Key Laboratory for Novel Software Technology, Nanjing University, China · School of Artificial Intelligence, Nanjing University, China · RIKEN AIP, Tokyo, Japan

  38. BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models

    Aug 8, 2024Yupeng Chang, Yi Chang, Yuan WuTraining-Side Stage-Aware Low-Rank AdaptationLarge Language Model Adaptation

    School of Artificial Intelligence, Jilin University · Key Laboratory of Symbolic Computation and Knowledge Engineering, Jilin University · International Center of Future Science, Jilin University

  39. SPECTRA: Band-Routed Embedding and Stage-Wise LoRA for Cross-Sensor Fine-Tuning of Geospatial Foundation Models

    Date pendingXingyan Li, Jordan A. Caraballo-Vega, Jie Gong +2Geospatial Foundation ModelsParameter-Efficient Fine-Tuning Methods

    University of Maryland, Baltimore County Baltimore, Maryland, USA · NASA Goddard Space Flight Center Greenbelt, Maryland, USA