LLM Fine-Tuning

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

42 papers in the last four weeks, up 83% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 509

All topics

RF-Agent: A Practical Framework for Building Language Agents for RFIC Design
Jul 21, 2026Yueqi Xing, Houbo He, Jolie Wang +5Retrieval-Augmented Generation LLM Fine-Tuning
ECE Department, Rice University, Houston, TX, USA · ECE Department, The George Washington University, Washington, D.C., USA
Find Before You Fine-Tune: A Diagnostic Study of Small LLMs for Cybersecurity QA
Jul 21, 2026Shaswata Mitra, Subash Neupane, Trisha Chakraborty +4LLM Evaluation LLM Fine-Tuning
The University of Alabama · Meharry Medical College · Mississippi State University +1
Reasoning Fine-Tuning Induces Persistent Latent Policy States
Jul 20, 2026Abir Harrasse, Michael Lan, Hunar Batra +2Dynamical Systems Latent Dynamics Modeling
Martian · University of Oxford · University of Utah
PPL-Factory: Task-Aware and Budget-Aware Data Selection from Language Modeling to Reasoning
Jul 20, 2026Hang Zhang, Warren J. GrossLLM Fine-Tuning Efficient Language Model Training
Department of Electrical and Computer Engineering, McGill University Montreal, QC, Canada
What Transfers Under Source Shift? Definitions, Examples, and Fine-Tuning for Climate Disclosure Classification
Jul 20, 2026Guosheng Li, Fenghui Ren, Bin Liu +5LLM Fine-Tuning Few-Shot Prompting
School of Computing and Information Technology, University of Wollongong · School of Business, University of Wollongong · Business School, University of Sydney +1
Benchmarking Resource-Efficient LLMs for Research Topic Ontology Generation in the Biomedical Field
Jul 20, 2026Tanay Aggarwal, Angelo Salatino, Francesco Osborne +1Relation Extraction LLM Evaluation
Knowledge Media Institute, The Open University, Milton Keynes, UK · Department of Business and Law, University of Milano-Bicocca, Milan, IT
Large Language Models for Citation Function Classification
Jul 20, 2026Daniel Vodička, Jakub Šmíd, Pavel Král +1LLM Evaluation LLM Fine-Tuning
Department of Computer Science and Engineering · NTIS – New Technologies for the Information Society University of West Bohemia in Pilsen, Faculty of Applied Sciences Univerzitní 2732/8, 301 00 Pilsen, Czech Republic · CNRS LORIA, Université de Lorraine, Nancy, France
PoLoRA: A Preconditioned Orthogonalized LoRA Optimizer
Jul 20, 2026Nikhil Ghosh, Tetiana Parshakova, Robert M. GowerLLM Fine-Tuning Low-Rank Adaptation
Center for Computational Mathematics, Flatiron Institute, New York, NY
TopoTuner: Topological Finetuning of Large Language Models
Jul 18, 2026Abdulkadir Erol, Yash Mahajan, Vepaul Hariprashad +4Fine-Tuning LLM Fine-Tuning
Department of Computer Science University of Central Florida Orlando, USA · Department of Computer Science University of Manitoba Canada · Department of Finance University of Central Florida Orlando, USA
CRAFT: Clustering Rubrics to Diagnose Weak LLM Capabilities and Generate Targeted Fine-Tuning Data
Jul 17, 2026Vipul Gupta, Zihao Wang, Razvan-Gabriel Dumitru +3LLM Evaluation LLM Fine-Tuning
Scale AI
Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation
Jul 16, 2026Yu-Du Feng, Niels Mündler-Sasahara, Mark Vero +1Domain Adaptation LLM Fine-Tuning
Department of Computer Science, ETH Zurich, Zurich, Switzerland.
Innocuous-Seeming Data, Latent Ideology: Ideological Generalisation in Finetuned LLMs
Jul 16, 2026Robert Graham, Edward Stevinson, Yariv BarsheshatLLM Fine-Tuning Political Bias in Language Models
1Independent · 2Imperial College London.
Data-Efficient Adaptation of LLMs via Attention Head Reweighting
Jul 15, 2026Tuomas Oikarinen, Zixiao Chen, Charlotte Siska +3LLM Fine-Tuning Text Classification
UC San Diego, Microsoft Research · Microsoft Security AI · UC San Diego +1
Self-Improving is Often Sudden: Enlightenment-style Finetuning for Large-Scale Models
Jul 15, 2026Jing-Xiao Liao, Tianwei Zhang, Yu-Hao Jiang +3LLM Fine-Tuning Language Model Self-Improvement
Frontier of Artificial Network Lab, Department of Data Science, City University of Hong Kong, Hong Kong SAR, China · The Shenzhen Institute of Artificial Intelligence and Robotics for Society, Shenzhen, China, The Chinese University of Hong Kong-Shenzhen, Shenzhen, China · School of Computer Science and Artificial Intelligence, Guangdong University of Education, Guangzhou 510303, China +1
Are we Merging the Right Models? Impact of Expert Training Duration on Model Merging for LLMs
Jul 13, 2026Nikita Kozodoi, Zainab Afolabi, Jack ButlerLLM Fine-Tuning Language Model Merging
1Amazon Web Services
Similarity-Guided Curriculum Fine-Tuning of LLMs for Neural Architecture Synthesis
Jul 13, 2026Anujaya Vijayakumar, Radu Timofte, Dmitry IgnatovLarge Language Model-Guided NAS LLM Fine-Tuning
Computer Vision Lab, CAIDAS & IFI, University of Würzburg, Germany
HyperSafe: Inference-Time Safety Recovery for Fine-Tuned Language Models
Jul 13, 2026Aznaur Aliev, Carlos Hinojosa, Abdelrahman Eldesokey +3LLM Fine-Tuning LLM Safety Alignment
King Abdullah University of Science and Technology, Saudi Arabia
UMoE:Unlocking Every Expert in Domain-Specific Training
Jul 13, 2026Xuefeng Li, Pengfei LiuMixture-of-Experts Pruning Mixture-of-Experts Language Models
1SII · 2SJTU · 3GAIR
Learning to Fine-tune Foundation Models under Resource Limitations
Jul 12, 2026Thomas Tsouparopoulos, Iordanis KoutsopoulosFine-Tuning LLM Fine-Tuning
Department of Informatics Athens University of Economics and Business Athens, Greece
CARE-LoRA: Compressed Activation REconstruction for Memory-Efficient LoRA
Jul 11, 2026Gengyu Zhang, Haiyin Ran, Zhengbao He +4Fine-Tuning Memory-Efficient Fine-Tuning
Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, China
Global Merger-Arbitrage Forecasting with Language Models
Jul 10, 2026Hinal Jajal, Michal Mucha, Charles Sweat +3Long-Context Language Model Inference LLM Fine-Tuning
Balyasny Asset Management
An Emergent Mirage: Is Emergent Misalignment and Realignment Indeed a Robust Phenomenon?
Jul 10, 2026Abhinav Rao, Liancheng Gong, Bin Hu +1LLM Alignment LLM Fine-Tuning
umd · cmu
Towards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning
Jul 9, 2026Lu Dai, Ziyang Rao, Yili Wang +3Memorization in Language Models LLM Fine-Tuning
HKUST · HKUST(GZ)
LongCrafter: Towards Diverse Long-Context Understanding via Evidence-Graph-Guided Instruction Synthesis
Jul 7, 2026Chenhao Yuan, Yinhao Xu, Shuwen Xu +8LLM Fine-Tuning Evidence-Grounded Generation
University of Chinese Academy of Sciences, Beijing, China · The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
Evaluating Neural Decompilation of Dart AOT Binaries: Fine-Tuning, Metric Validity, Specification Leakage, and Reliability
Jul 7, 2026Raafat Abualazm, Ayman AboElhassan, Amr G. WassalSoftware Engineering LLM Evaluation
Cairo University, Computer Engineering Department, Faculty of Engineering, Giza, Egypt
LP-SFT: Local-Preserving Supervised Fine-Tuning via Multimodal Entropy Structure
Jul 6, 2026Yueyang Wang, Baolong Bi, Shuo Lu +1Supervised Fine-Tuning Fine-Tuning
School of Mathematical Sciences, Peking University · Institute of Computing Technology, Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences +1
Transplanting, inverting, and preventing a misalignment persona: method-conditional emergent misalignment in Qwen2.5
Jul 5, 2026Lyndon Drake, Zandi EberstadtLLM Alignment LLM Fine-Tuning
University of Oxford
MPSelectTune: Prompt-type Selection for Fine-tuning improves Concept Unlearning in LLMs
Jul 4, 2026Shubhadip Nag, Srinjoy Das, Agniva Saha +5LLM Fine-Tuning Machine Unlearning
*IIT Kharagpur · †MPI-SWS · ‡HPE Labs
Enhancement of E-commerce Sponsored Search Relevancy with LLM
Jul 4, 2026Md Omar Faruk Rokon, Andrei Simion, Weizhi Du +3LLM Fine-Tuning E-Commerce Search
Walmart AdTech, Sunnyvale, CA, USA
Probing Chemical Language Models: Effects of Pre-training and Fine-tuning
Jul 2, 2026Anna Karnysheva, Dietrich Klakow, Ji-Ung LeeLanguage Model Pretraining LLM Fine-Tuning
1RTG Neuroexplicit Models · 2Spoken Language Systems · Saarland University +1

Jul 21, 2026, cs.CLJ/K move · Enter open · S save

RF-Agent: A Practical Framework for Building Language Agents for RFIC Design

Yueqi Xing, Houbo He, Jolie Wang, Erin Ni+4

ECE Department, Rice University, Houston, TX, USA · ECE Department, The George Washington University, Washington, D.C., USA

Retrieval-Augmented Generation LLM Fine-Tuning Electronic Design Automation LLM Agent Training

Open paper AskPDF arXiv

Large language models (LLMs) have driven rapid progress in electronic design automation (EDA), yet their application to radio-frequency (RF) circuit design remains limited by the scarcity of domain-specific datasets and standardized benchmarks. We present RF-Agent, which addresses this gap through textbook-driven knowledge distillation. A multi-agent Question-Thinking-Solution-Answer (QTSA) pipeline converts a subsection-level corpus from seven canonical RF textbooks into the first-of-its-kind RF-domain reasoning dataset (over 11,000 samples) with a dedicated multiple-choice benchmark. On this benchmark we study two adaptation strategies: supervised fine-tuning (SFT) and three retrieval-augmented generation (RAG) configurations (semantic, keyword, hybrid). Across multiple LLM families, domain-specific SFT significantly improves RF reasoning, especially for small and medium-sized models; among RAG configurations, semantic retrieval performs best, indicating embedding-based context alignment suits RF reasoning better than naive fusion. The dataset and benchmark provide a reusable foundation for future work on LLM-aided RF circuit design.

Momentum

Related topics

Latest papers 509