Parameter-Efficient Fine-Tuning Methods

Ask about this topic

Recent momentum

-87%

3 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Supervised Fine-Tuning

Neighbouring directions

FinetuningLarge Language Model Fine-TuningSupervised Fine-Tuning

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Parameter-Efficient Fine-Tuning Methods.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Parameter-Efficient Fine-Tuning Methods.

108 papers

Latest in Parameter-Efficient Fine-Tuning Methods

Open your feed →
CardsList

  1. Pre-PEFT Probing: Weight Statistics and Perturbation Robustness for Layer Selection in VLM Vision Encoders

    Sep 14, 2026Qingtao Xia, Jiahua Bao, Siyao Cheng +1Parameter-Efficient Fine-Tuning Methods

  2. TASTE: Throughput-Aware Batch Size Tuning for On-Device Edge Learning

    Sep 7, 2026Avik Bhatnagar, Federico Nicolas Peccia, Oliver BringmannBatch SizeParameter-Efficient Fine-Tuning Methods

  3. PCoMoE: Shifting MoE Inference from Monolithic Expert Selection to Fine-Grained Path Composition

    Sep 1, 2026Ziyan Gan, Fangxin Liu, Chenyang Guan +10Mixture-Of-Expert InferenceSkewed Expert Demand

  4. RW-LoRA: Communication-Efficient Decentralized LoRA Fine-Tuning via Random Walks

    Aug 31, 2026Xingran Chen, Rohit Bhagat, Ghadir Ayache +3Parameter-Efficient Fine-Tuning MethodsAdaptive-Rank Low-Rank Adaptation Baselines

  5. From Manuals to Maintenance: Fine-Tuning MedGemma for Multi-Modal Imaging System Support in Low-Resource Settings

    Aug 9, 2026Bernes Lorier Atabonfack, Zion Kongbi Nfo, Ahmed Tahiru Issah +9Multimodal Clinical DataMedical Imaging

  6. Circuit Fine-Tuning for Compute-Efficient Transformer Adaptation

    Aug 8, 2026Uri Z. Kialy, Gil Ben-ArtziParameter-Efficient Fine-Tuning MethodsSelf-Supervised Vision Transformers

  7. LoRSA: Toward Generalizable Parameter-Efficient Fine-Tuning for Biomedical Downstream Tasks

    Aug 7, 2026Saed Moradi, Benyamin Ghojogh, M. Hadi Sepanj +2Parameter-Efficient Fine-Tuning MethodsResidual Learning

  8. YOLO-PEFT: Parameter-Efficient Fine-Tuning on YOLO Family

    Aug 7, 2026Xu Lin, WenJie Nie, Jinlong Peng +4Yolo26Parameter-Efficient Fine-Tuning Methods

  9. Beyond Rotations: AuroOFT for Expressive Quantized Orthogonal Fine-Tuning

    Aug 5, 2026Yue Han, Dianlin WangLarge Language Model QuantizationParameter-Efficient Fine-Tuning Methods

  10. Energy- and Memory-Efficient PEFT Methods for Personalized On-Device SLMs on Consumer GPUs

    Aug 5, 2026Kuanysh Akhmetzhanov, Jurn-Gyu ParkParameter-Efficient Fine-Tuning MethodsFinetuning

  11. HyPASE: Hyperbolic Geometry for Parameter-Efficient Speech Emotion Fine-Tuning Framework for Large Audio-Language Models

    Aug 5, 2026Tian Jin, Ruikang Zhang, Zefeng Zhao +2Speech Emotion RecognitionLarge Audio Language Models

  12. Geometry-Informed Parameter-Efficient Fine-Tuning of Pre-trained Molecular GNNs for Blood-Brain Barrier Permeability Prediction

    Aug 4, 2026Marco Vieto Vega, Long D. Nguyen, Binh P. NguyenGraph Neural NetworksParameter-Efficient Fine-Tuning Methods

  13. Z-PEFT: Zero-shot Backdoor Detection in Parameter-Efficient Fine-Tuning via Canonical Spectral Signatures

    Aug 3, 2026Nicola Pitzalis, Donald Shenaj, Giacomo Cignoni +3Backdoor AttacksParameter-Efficient Fine-Tuning Methods

  14. MineGrad: Gradient Inversion Attacks on LoRA Fine-Tuning

    Aug 2, 2026Hasin Us Sami, Swapneel Sen, Basak GulerFederated Fine-TuningParameter-Efficient Fine-Tuning Methods

  15. EulerLoRA: Rank-Driven Jump Dynamics for Calibrated Parameter-Efficient Fine-Tuning

    Aug 2, 2026Srinivas Anumasa, Dianbo LiuRank-Gated Low-Rank AdaptationLow-Rank Adapters

  16. The Parts Are Greater Than the Sum: Automated Task Sequencing for Efficient Training of Multi-Policy LLMs

    Jul 31, 2026Jiajia Tang, Sizhe Yuen, Francisco Gomez Medina +2Parameter-Efficient Fine-Tuning MethodsSequential

  17. MoPET: Parameter-Efficient Mixture-of-Experts for Unified Medical Image Classification

    Jul 31, 2026Sebastian Doerrich, Daniel Würtinger, Francesco Di Salvo +2Parameter-Efficient Fine-Tuning MethodsMedical Imaging

  18. Federated Foundation Models Fine-Tuning with Heterogeneous Compressed Clients

    Jul 31, 2026Shengkun Zhu, Jinshan Zeng, Zhihua Allen-Zhao +5Federated Fine-TuningFedavg

  19. Parameter-Efficient Fine-Tuning for Spiking Point Cloud Models

    Jul 31, 2026Zihao Guo, Jihua Zhu, Yiding Sun +2Spiking Neural NetworksNeuromorphic Hardware

  20. How Small Can You Go? A Controlled Study of LoRA Rank, Target Modules, and Quantization Trade-offs for Text-to-SQL on a 60M-Parameter Model

    Jul 28, 2026Mahendra Singh Rathor, Anagheem AzzamLarge Language Model QuantizationParameter-Efficient Fine-Tuning Methods

  21. Towards Privacy-Preserving Federated Prompt Tuning under Data Heterogeneity: A Subspace-Decomposed Expert Approach

    Jul 23, 2026Yuhua Wang, Xiaodong Li, Yihao Guo +6Federated Fine-TuningSoft Prompt Tuning

  22. C-PTQ: Fisher-weighted Channel-wise Sensitivity for Post-training Quantization of MLLMs

    Jul 23, 2026Jiameng Li, Han Zhou, Matthew B. BlaschkoQuantizationParameter-Efficient Fine-Tuning Methods

  23. Three-Pronged Spectral Control for Federated Parameter Efficient Fine Tuning

    Jul 23, 2026Shiva Raj Pokhrel, Dipsan Bhattarai, Anwar WalidFederated Fine-TuningParameter-Efficient Fine-Tuning Methods

  24. Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understanding

    Jul 21, 2026Junlin Chang, Longhao Zou, Rui LiPoint CloudsParameter-Efficient Fine-Tuning Methods

  25. Manifold-Constrained Hyper-Connections for Parameter-Efficient Finetuning

    Jul 20, 2026Valentijn Oldenburg, Floris de Kam, Bente Zuijdam +4Parameter-Efficient Fine-Tuning MethodsTransformer Residual Streams

  26. AutoEncoder-Compressed Parallel Split Learning for Pre-trained Model Fine-Tuning

    Jul 20, 2026Bas Meuwissen, Vasileios Tsouvalas, Nirvana MeratniaParameter-Efficient Fine-Tuning MethodsModel Pretraining

  27. Federated Lightweight Fine-Tuning

    Jul 20, 2026Radhakrishna Achanta, Will ReedFederated Fine-TuningParameter-Efficient Fine-Tuning Methods

  28. Opto-ViT-v2: Noise-Resilient On-Chip Fine-Tuning for Photonic Near-Sensor Vision Transformer Accelerators

    Jul 20, 2026Xuming Chen, Deniz Najafi, Mehrdad Morsali +5Self-Supervised Vision TransformersVision Transformer

  29. Long-Context Fine-Tuning with Limited VRAM

    Jul 16, 2026Vladimir Fedosov, Aleksandr Sazhin, Artemiy Grinenko +1Efficient Long-Context InferenceDynamic Sparse Attention

  30. Efficient Tuning Before Low-Bit Post-Training Quantization for Stochastic Gradient Descent-optimized Models

    Jul 13, 2026Peng Xia, Junbiao Pang, Muhammad Ayub SabirPost-Training QuantizationQuantization Effects

  31. Super-Tuning: From Activation-Aware Pruning to Sparse Fine-Tuning

    Jul 10, 2026Ivan Ilin, Philip Zmushko, Peter RichtárikParameter-Efficient Fine-Tuning MethodsMagnitude-Based Pruning

  32. LoCA: Spatially-Aware Low-Rank Convolutional Adaptation of Vision Foundation Models

    Jul 8, 2026Sojung An, Junha Lee, Sujeong You +2Parameter-Efficient Fine-Tuning MethodsVision-Language Model Adaptation

  33. FourTune: Towards Fully 4-Bit Efficient Post-Training for Diffusion Models

    Jul 7, 2026Bowen Xue, Zihan Min, Xingyang Li +8Post-Training QuantizationDiffusion Models

  34. Efficient PEFT Methods with Adaptive Checkpointing for Vision Models and VLMs on Resource Constrained Consumer-GPUs

    Jul 2, 2026Altay Toktassyn, Jurn-Gyu ParkParameter-Efficient Fine-Tuning MethodsVision Foundation Models

  35. EPnG: Adaptive Expert Prune-and-Grow for Parameter-Efficient MoE Fine-tuning

    Jul 2, 2026Ahin Lee, Sehyun Yun, Taesik GongParameter-Efficient Fine-Tuning MethodsCold Mixture-Of-Expert Models

  36. Model Merging as Probabilistic Inference in Fine-Tuning Parameter Space

    Jul 2, 2026Long Minh Bui, Tuan Anh Le Van, Tung Phi Duc +3Continual Model MergingModel Merging

  37. SpiralFovea: Input-Adaptive Foveated Tokenization as a Third Lever of Resource-Adaptive Inference

    Jul 1, 2026Kyan Mahajan, Mohammad SaqlainParameter-Efficient Fine-Tuning MethodsWireless Foundation Models

  38. PAPA: Online Personalized Active Preference Alignment

    Jul 1, 2026Anindya Sarkar, Nasik Muhammad Nafi, Isaac Lyngaas +2Preference AlignmentParameter-Efficient Fine-Tuning Methods

  39. Mixture-of-Control: State-Aware Fine-Tuning for Transformer-based Models

    Jun 30, 2026Duc Anh Nguyen, Tien Ngoc Luu, Tung Pham +1Parameter-Efficient Fine-Tuning MethodsFinetuning

  40. EPTS: Elastic Post-Training Sparsity for Efficient Large Language Model Compression

    Jun 24, 2026Ke Xu, Jiaqi Wan, Wenhao Hu +2Large Language Model CompressionSparsity

  41. Structured Hyperedge Adaptation for Parameter-Efficient Fine-Tuning of Vision Transformers

    Jun 21, 2026Edwin Kwadwo Tenagyei, Lei Wang, Ugochukwu Ejike Akpudo +2Parameter-Efficient Fine-Tuning MethodsVision Transformer

  42. MixedPEFT: Combining Multiple PEFT Methods with Mixed Objectives for Unsupervised Domain Adaptation

    Jun 20, 2026Mohammed Rawhani, Dervis Karaboga, Ozkan Ufuk Nalbantoglu +2Unsupervised Domain AdaptationDomain Adaptation

  43. Predicting Mergeability of Parameter-Efficient Fine-Tuning Updates

    Jun 17, 2026Lin Tang, Wei Zhang, Jing Li +3Large Language Model AdaptationParameter-Efficient Fine-Tuning Methods

  44. pFedUL: Layer-Aware Federated Unlearning for Personalized Federated Learning

    Jun 15, 2026Zhuodong Liu, Xiangyu Li, Zhihao ZhangFedavgMachine Unlearning

  45. Zero-order Parameter-free Optimization for LMO-based Methods: Novel Approach for Efficient Fine-tuning

    Jun 12, 2026Dmitriy Bystrov, Daniil Medyakov, Dmitry Bylinkin +1Parameter-Efficient Fine-Tuning MethodsFinetuning

  46. FedSPC: Shared Parameter Correction for Personalized Federated Learning

    Jun 11, 2026Kannanthodath Induchoodan Ajay Menon, Christian Prehofer, Yunfei Xu +1Federated Fine-TuningParameter-Efficient Fine-Tuning Methods

  47. From Parameters to Feature Space: Task Arithmetic for Backdoor Mitigation in Model Merging

    Jun 10, 2026Zhenqian Zhu, Yamin Hu, Yiya Diao +3Continual Model MergingBackdoor Attacks

  48. Small Data, Big Noise: Adversarial Training for Robust Parameter-Efficient Fine-Tuning

    Jun 9, 2026Eitan Cohen, Idan Simai, Uri ShahamParameter-Efficient Fine-Tuning MethodsParameter-Efficient Adaptation

  49. 5% > 100%: Flatness Preference is All You Need for Multimodal Parameter-Efficient Fine-Tuning

    Jun 9, 2026Yifan Zhu, Can Lin, Hangjie Yuan +4Parameter-Efficient Fine-Tuning MethodsSharpness-Aware Minimization

  50. Fisher-Guided Progressive Parameter Selection for Adaptive Fine-Tuning

    Jun 8, 2026Ghodsiyeh Rostami, Po-Han Chen, Mahdi S. HosseiniParameter-Efficient Fine-Tuning MethodsParameter-Efficient Adaptation

  51. Parameter-Efficient Fine-Tuning with Learnable Rank

    Jun 3, 2026Arpit Garg, Simon Lucey, Hemanth SaratchandranParameter-Efficient Fine-Tuning MethodsAdaptive-Rank Low-Rank Adaptation Baselines

  52. Where Do We (Not) Need Temporal Context in Low-Resource Video Task Adaptation?

    Jun 2, 2026Luc P. J. Sträter, Hazel DoughtyParameter-Efficient Fine-Tuning MethodsVideo Representation

  53. DECA: Decentralizing Block-Wise Adam for Efficient LLM Full-Parameter Fine-Tuning on Non-IID Data

    Jun 2, 2026Yunsheng Yuan, Shaowei Li, Kai Wang +5Parameter-Efficient Fine-Tuning MethodsLarge Language Model Fine-Tuning

  54. On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters

    Jun 1, 2026Mind Lab, :, Vin Bo +64Parameter-Efficient Fine-Tuning MethodsPersistent State

  55. FACT: A Simple and Efficient Framework for Active Finetuning

    Jun 1, 2026Wenshuai Xu, You Song, Yuzhuo Cui +3Parameter-Efficient Fine-Tuning MethodsFinetuning

  56. Parameter-Efficient Fine-Tuning of Large Pretrained Models for Instance Segmentation Tasks

    Jun 1, 2026Nermeen Abou Baker, David Rohrschneider, Uwe HandmannParameter-Efficient Fine-Tuning MethodsModel Pretraining

  57. DOT-MoE: Differentiable Optimal Transport for MoEfication

    Jun 1, 2026Udbhav Bamba, Arnav Chavan, Aryamaan Thakur +2Moe-NdParameter-Efficient Fine-Tuning Methods

  58. On the Construction and Implications of Low-Loss Valleys in LoRA-based Bayesian Inference

    May 28, 2026Daniel Dold, Emanuel Sommer, Julius Kobialka +2Parameter-Efficient Fine-Tuning MethodsBayesian Inference Approaches

  59. FoRA: Fisher-orthogonal Rank Adaptation for Parameter-Efficient Fine-Tuning

    May 28, 2026Juneyoung Park, Seongbae Lee, Han-Sang Lee +6Parameter-Efficient Fine-Tuning MethodsLarge Language Model Backbones

  60. SIGMA: Bridging Structural and Distributional Gaps for Vision Foundation Model Adaptation

    May 27, 2026Lingyu Xiong, Jinjin Shi, Xuran Xu +3Recent Vision Foundation ModelsParameter-Efficient Fine-Tuning Methods