Adaptive-Rank Low-Rank Adaptation Baselines

Ask about this topic

Recent momentum

-57%

3 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Adapters

Neighbouring directions

Parameter-Efficient AdaptationAdaptersLow-Rank AdaptersUnseen-Task AdaptationLow-Rank Adaptation ExpertsRank-Gated Low-Rank AdaptationMamba-Modulated Low-Rank AdaptationStandard Low-Rank Adaptation

34 papers

Latest in Adaptive-Rank Low-Rank Adaptation Baselines

Open your feed →
CardsList

  1. Gaussian Core LoRA: Distribution-Aware Dynamic Adaptation for Broad Concept Erasure

    Sep 1, 2026Qinghui Gong, Xunlei Chen, Yu-Xuan Zhang +2Concept ErasureText-To-Image Diffusion Models

  2. Behaviorally Effective LoRA Writes Are Sparse and Structured

    Sep 1, 2026Haruto Sato, Yuki Tanaka, Ren Nakamura +2Adaptive-Rank Low-Rank Adaptation BaselinesContinuation

  3. RW-LoRA: Communication-Efficient Decentralized LoRA Fine-Tuning via Random Walks

    Aug 31, 2026Xingran Chen, Rohit Bhagat, Ghadir Ayache +3Parameter-Efficient Fine-Tuning MethodsAdaptive-Rank Low-Rank Adaptation Baselines

  4. Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA

    Aug 10, 2026Mind Lab, :, Vin Bo +74Efficient Continual LearningContinual Learning

  5. MuRA: Multi-Rank Adaptation for Efficient and Effective Test-Time Vision-Language Generalization

    Aug 4, 2026Gengyuan Liu, Nanzhou Wang, Chang Liu +5Vision-Language Model AdaptationAdaptive-Rank Low-Rank Adaptation Baselines

  6. FedChronos: Federated Fine-Tuning of Time-Series Foundation Models for Privacy-Preserving Commodity Price Forecasting

    Aug 2, 2026Amit Sharma, Nitin Auluck, Akramul AzimTime Series Foundation ModelsFederated Fine-Tuning

  7. Understanding Is Done Early: A Depth Division of Labor in Large Language Models and Its Use for Unbounded-Context Memory

    Jul 30, 2026Hanzuo Liu, Xuan Qi, Chunyu Liu +6Efficient Long-Context InferenceLarge Language Model Memory

  8. Share the Judge, Learn the Deferral: Where Specialization Helps LLM Evaluation

    Jul 30, 2026Weining ZhangJudgesLarge Language Model Evaluation

  9. IJCB-AFMFR 2026: Competition on Adapting Foundation Models for Face Recognition Using Synthetic Training Data

    Jul 27, 2026Tahar Chettaoui, Guray Ozgur, Eduarda Caldeira +13Cross-Spectral Through-Glass Face DatasetSynthetic Training Data

  10. Encoding Invisible Causation for Bridge Diagnostic Agents: Triple-Guided Retrieval-Augmented Fine-Tuning with QLoRA

    Jul 23, 2026Takato YasunoStructural DamageCausal Structure and Reasoning

  11. Stacked LoRA for Subject-Adaptive EEG Foundation Models in Motor Imagery Decoding

    Jul 3, 2026Aymen Sarhane, Fouad Lbakali, Mouad Souissi +2Electroencephalography Foundation ModelsBrain-Computer Interface

  12. Bayesian Sparse Low-Rank Adaptation for Large Language Model Uncertainty Estimation

    Jul 2, 2026Jijie Zhang, Zhe Ren, Quan Zhang +1Large Language Model UncertaintyAdaptive-Rank Low-Rank Adaptation Baselines

  13. Nonlinearity-Aware LoRA: Structured Gate Adaptation under Low-Rank Constraints

    Jun 30, 2026Shuai Yuan, Sudong Cai, Bingzhi Chen +4Standard Low-Rank AdaptationAdaptive-Rank Low-Rank Adaptation Baselines

  14. Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading

    Jun 26, 2026Hong Li, Minqi Meng, Yanjun Liang +10Animatable 3D Human AvatarsDifferentiable Rendering

  15. Enhancing LLMs for Graph Tasks via Graph-aware LoRA Generation

    Jun 21, 2026Junshu Sun, Wanxing Chang, Qingming Huang +1Graph Neural NetworksAdaptive-Rank Low-Rank Adaptation Baselines

  16. SSR-Merge: Subspace Signal Routing for Training-Free LoRA Merging in Diffusion Models

    Jun 9, 2026Zhengxuan Wei, Yi Dong, Zonghui Li +6Adaptive-Rank Low-Rank Adaptation BaselinesDiffusion Models

  17. Which LoRA? An Empirical Study on the Effectiveness of LoRA Techniques During Multilingual Instruction Tuning

    Jun 9, 2026Thamali Wijewardhana, Napoleon H. Reyes, Surangika RanathungaMultilingualIndic Languages

  18. Instruction Finetuning DeepSeek-R1-8B Model Using LoRA and NEFTune

    Jun 9, 2026Wu Yuerong, Mingni LuoNamed-Entity RecognitionLarge Language Model Fine-Tuning

  19. Amortizing Federated Adaptation: Hypernetwork Driven LoRA for Personalized Foundation Models

    Jun 4, 2026Sunny Gupta, Shambhavi Shanker, Amit SethiFederated Fine-TuningAdaptive-Rank Low-Rank Adaptation Baselines

  20. Rethinking LoRA Memory Through the Lens of KV Cache Compression

    Jun 4, 2026Chunsheng Zuo, Liaoyaqi Wang, William Jurayj +2Key-Value Cache CompressionKey-Value Cache

  21. Parameter-Efficient Fine-Tuning with Learnable Rank

    Jun 3, 2026Arpit Garg, Simon Lucey, Hemanth SaratchandranParameter-Efficient Fine-Tuning MethodsAdaptive-Rank Low-Rank Adaptation Baselines

  22. NaRA: Noise-Aware LoRA for Parameter-Efficient Fine-Tuning of Diffusion LLMs

    May 28, 2026Shuaidi Wang, Zhan Zhuang, Ruping Huang +1Diffusion Language ModelsAdaptive-Rank Low-Rank Adaptation Baselines

  23. AR1-ZO: Topology-Aware Rank-1 Zeroth-Order Queries for High-Rank LoRA Fine-Tuning

    May 19, 2026Ziye Chen, Hongbin Lin, Chenyu Zhang +3Adaptive-Rank Low-Rank Adaptation BaselinesZeroth-Order Optimization

  24. Learning When to Adapt

    May 18, 2026Ali Zindari, Xiaowen Jiang, Rotem Mulayoff +1Adaptive-Rank Low-Rank Adaptation BaselinesFinetuning

  25. A Scalable Nonparametric Continuous-Time Survival Model through Numerical Quadrature

    May 15, 2026Chaeyeon Lee, Sehwan Kim, Hyungrok DoSurvival AnalysisTime-To-Event Data

  26. Strategic Over-Parameterization for Generalizable Low-Rank Adaptation

    May 15, 2026Jing Gao, Zhong-Yi Lu, Pan Zhang +1Adaptive-Rank Low-Rank Adaptation BaselinesLow-Rank Adapters

  27. GPart: End-to-End Isometric Fine-Tuning via Global Parameter Partitioning

    May 14, 2026Paolo Mandica, Michał Brzozowski, Zuzanna Dubanowska +1Parameter-Efficient Fine-Tuning MethodsAdaptive-Rank Low-Rank Adaptation Baselines

  28. SCAR: Self-Supervised Continuous Action Representation Learning

    May 13, 2026Hongjia Liu, Fan Feng, Minghao Fu +3Latent ActionsEmbodied

  29. AdaPaD: Adaptive Parallel Deflation for PEFT with Self-Correcting Rank Discovery

    May 11, 2026Barbara Su, Fangshuo Liao, Anastasios KyrillidisAdaptive-Rank Low-Rank Adaptation BaselinesLow-Rank Factorization

  30. Exploring Data-Free LoRA Transferability for Video Diffusion Models

    May 3, 2026Yuchen Wang, Wenliang Zhong, Lichen Bai +6Video Diffusion ModelsDistribution Matching Distillation

  31. SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability

    May 2, 2026Shuaipeng Zhou, Yu ZhangLow-Rank AdaptersAdaptive-Rank Low-Rank Adaptation Baselines

  32. GramSR: Visual Feature Conditioning for Diffusion-Based Super-Resolution

    Apr 28, 2026Fabio D'Oronzio, Federico Putamorsi, Leonardo Zini +2Real-World Image Super-ResolutionAdaptive-Rank Low-Rank Adaptation Baselines

  33. Low-Rank Adaptation Redux for Large Models

    Apr 23, 2026Bingcong Li, Yilang Zhang, Georgios B. GiannakisAdaptive-Rank Low-Rank Adaptation BaselinesLarge Language Model Compression

  34. BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models

    Aug 8, 2024Yupeng Chang, Yi Chang, Yuan WuAdaptive-Rank Low-Rank Adaptation BaselinesLarge Language Model Adaptation