Rapid Adaptation

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, up 43% on the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21

Latest papers 95

All topics

Learn the Directions, Normalize the Gains: Post-Training Normalization for LoRA
Oct 1, 2026Zailong Tian, Yanzhe Chen, Zhuoheng Han +2Balanced Learning Rapid Adaptation
Singapore Management University · National University of Singapore · Peking University
CLASP: Continual Low-rank Adapters for Spatially Placed Concepts from One Hypernetwork
Oct 1, 2026Wojciech Gromski, Patryk Krukowski, Jan Miksa +2Replay-Based Continual Learning Text-To-Image Diffusion Models
Wrocław University of Science and Technology · IDEAS Research Institute · Jagiellonian University, Krak´ow +2
Reward as Observation: Learning Reward-Based Policies for Rapid Adaptation
Sep 30, 2026Morgan Byrd, Maks Sorokin, Robert Wright +1Neural Policies Rapid Adaptation
Georgia Institute of Technology, Atlanta, GA, 30308, USA · Georgia Tech Research Institute, Atlanta, GA, 30308, USA
Replay on Demand: An Emergent Curriculum for Balancing Adaptation and Forgetting in Continued Pretraining
Sep 30, 2026Lukas Thede, Shengzhuang Chen, Stefan Winzeck +3Replay Pretraining
University of Tübingen, Tübingen AI Center · Helmholtz Munich · Munich Center for Machine Learning (MCML) +3
A Comprehensive Benchmark of Source-Free Universal Domain Adaptation on Time Series Representations
Sep 30, 2026Romain Mussard, Fannia Pacheco, Maxime Berar +2Domain Adaptation Time Series Foundation Models
Univ Rouen Normandie, INSA Rouen Normandie, Universit´e Le Havre Normandie, Normandie Univ, LITIS UR 4108, F-76000 Rouen, France
Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation
Sep 30, 2026Woojin Cho, Junghwan ParkNeural Operators Rapid Adaptation
TelePIX
GestAdapt: Workspace-Conditioned Co-Speech Gesture Generation for Humanoid Robots
Sep 29, 2026Bosong Ding, Xianglin Zhang, Miao Xin +2Co-Speech Gesture Generation Workspaces
Department of Intelligent Systems, Tilburg University, The Netherlands. · TU-Dresden, Dresden, Germany. · School of Artificial Intelligence, China University of Mining and Technology-Beijing (CUMTB), Beijing, China.
Compiling Learning Problems into Adaptation Programs for Language Models
Sep 29, 2026Rebecca Ramnauth, Brian ScassellatiLarge Language Model Adaptation Rapid Adaptation
Department of Computer Science Yale University New Haven, CT 06511, USA
When Should the Count Change? Learning State Maintenance for Causal Video Counting
Sep 28, 2026Pengyiang Liu, Dongyue Lyu, Junbo Niu +3Fine-Grained Video Understanding Vision State Space Models
Beihang University · Peking University
When Successful Strategies Fail: Adaptation to Environmental Novelty in Terminal Agents
Sep 27, 2026Janvijay Singh, Vaishnavi Shrivastava, Dilek Hakkani-Tur +2Large Language Model Agents Rapid Adaptation
University of Illinois Urbana-Champaign · Microsoft Research AI Frontiers
Error- and Prediction-Driven Motor Learning in the Cortico-Cerebellar Loop
Sep 24, 2026Ana Carolina Filipe, Rui Ponte Costa, Cláudia SoaresLearning-Based Control Learning Dynamics
Department of Computer Science, NOVA School of Science and Technology, Caparica, Portugal · Centre for Neural Circuits and Behaviour, University of Oxford
TOLA: Text-aware One-Step Latent Adaptation for Diffusion-based Text Image Super-Resolution
Sep 24, 2026Yike Xu, Yue Shi, Yong Guo +1Real-World Image Super-Resolution Text-To-Image Diffusion Models
Shanghai Jiao Tong University · University of Chinese Academy of Sciences · Shanghai AI Laboratory
Emergi-PersonaOS: A Persona Agent Operating System for Situational Adaptation and Controllable Evolution
Sep 23, 2026Haoluan Fu, Keni Chen, Xinyu Jia +3Emergence Rapid Adaptation
Emergi Lab of Qianzhen Digital Tech, China · Hangzhou Dianzi University, China
OceanMoE: Structured Conditional Sparse Computation for Long-Horizon Multivariate Ocean Forecasting
Sep 17, 2026Yishun Zhu, Jian WangOcean Rapid Adaptation
Hangzhou Institute for Advanced Study, University of the Chinese Academy of Sciences Zhejiang, China · Computer Network Information Center, Chinese Academy of Sciences Beijing, China
Where Should a Document Live: Context, Representations, or Parameters?
Sep 15, 2026Nathanaël Carraz Rakotonirina, Momchil Hardalov, Gonzalo Iglesias +1Rapid Adaptation
Amazon AGI
CoAdapt: An LLM-based Framework for Adaptive Collaborative Perception in IIoT Robotic Swarms
Sep 15, 2026Houssam Hajj Hassan, Antonia Maria Masucci, Lynda Zitoune +1Collaborative Perception Robotic Perception
L2S · Orange Innovation, Chˆatillon, France. · Universit´e Paris-Saclay, CNRS, CentraleSup´elec, Laboratoire des Signaux et Syst`emes, France.
Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents
Sep 14, 2026Yunqi Lu, Tyler Baumgartner, Nikhil Johri +6Full-Duplex Speech Models Full-Duplex Voice Agents
Besimple AI, San Mateo, CA
Agent-Based ML-LLM Fusion with Self-Optimizing Prompts for Plateau Weather Alerts
Sep 9, 2026Shuai Yan, Yang Xu, Shan HeWeather Prediction Automatic Prompt Optimization
Chengdu Jincheng College College of Computer and Software Chengdu, Sichuan, China
Reading the News: Adapting Large Language Models to Swedish Journalism Through Continued Pre-Training
Aug 31, 2026Lukas Borggren, Jenny Kunz, Marco KuhlmannLarge Language Model Adaptation Headlines
Linköping University · Bonnier News
Subgroup performance analysis of adaptation strategies for chest X-ray foundation models
Aug 19, 2026Dhruv Gupta, Emma A. M. Stanley, Fabio De Sousa Ribeiro +2Subgroups Algorithmic Fairness
Department of Computing, Imperial College London, UK · Causality in Healthcare AI Hub, UK · Department of Radiology, Royal Brompton Hospital, UK +1
Analysis of Motor Signatures of Social Adaptation in Autism for Efficient Human-Centric Systems
Aug 12, 2026Lara Pereira, Teresa Sousa, Miguel Castelo-Branco +1Autism Spectrum Disorder Sensorimotor Experience
Institute of Systems and Robotics, University of Coimbra, Portugal · Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT) of the University of Coimbra, Portugal · Intelligent Systems Associate Laboratory (LASI), Portugal +1
Better, Faster, Stronger: Programmatic Skill Learning Best Reduces Agent Cost
Aug 11, 2026Zixi Huang, Xiheng Wang, Andrew Wang +4Skills Self-Improving Agents
Johns Hopkins University
Knowledge-Distilled End-to-End Reinforcement Learning for Smooth 6-DOF Thrust Control and Rapid Adaptation to Ocean Currents in Remotely Operated Vehicles
Aug 9, 2026Tiankuang Wen, Huiping Li, Gang Liu +1Reinforcement Learning Control Bidirectional Thrust
Northwestern Polytechnical University, Xi’an 710129, China · Wuhan Second Ship Design and Research Institute, Wuhan 430205, China
Optimal Training-Time Scaling in Gradual Adaptation
Aug 5, 2026Zonghuan Xu, Krishna HarishBatch Training Time
Fudan University Shanghai, China · Lawrence E. Elkins High School Missouri City, Texas, USA
On the Effectiveness of Adaptation Strategies for VLM-Based Federated Learning in Remote Sensing
Aug 5, 2026Simon Lösche, Barış Büyüktaş, Mathis Adler +3Federated Learning Vision-Language Model Adaptation
BIFOLD - Berlin Institute for the Foundations of Learning and Data, 10587 Berlin, Germany · Technische Universität Berlin, 10623 Berlin, Germany · Orion Lab, School of Rural, Surveying and Geoinformatics Engineering, National Technical University of Athens, 15772 Athens, Greece +2
COSMO: Consensus-Driven Shift Modulation for Source-Free Domain Adaptation
Aug 5, 2026Bo Li, Junjie Peng, Xiaohua Xie +1Domain Adaptation Vision-Language Model Adaptation
School of Computer Science and Engineering, Sun Yat-sen University
Bridging the English-Arabic Medical Knowledge Gap: Targeted Low-Rank Adaptation via Causal Layer Selection
Jul 31, 2026Chaimae Abouzahir, Musa Khan, Hala Ali-Hassan +7Multilingual Healthcare Q&A Large Language Model Adaptation
New York University Abu Dhabi · Cleveland Clinic Abu Dhabi
Parameter-Free Heavy-Tailed Bandits
Jul 31, 2026Gianmarco Genalti, Alberto Maria MetelliLong-Tailed Distribution Bandits
Politecnico di Milano
PARALLEL: A Prefrontal-Aligned Reinforcement inspired Approach for Language-Model Learning under Explicit Limits
Jul 31, 2026Namkyung Yoon, Sanghong Kim, Hwangnam KimLarge Language Model Adaptation Language Modeling
School of Electrical Engineering, Korea University Seoul 02841, Republic of Korea
A2TTA: Anchored-and-Agile Test-Time Adaptation for Evolving Traffic Sensor Networks
Jul 28, 2026Du Yin, Xiachong Lin, Yue Tan +4Accurate Traffic Forecasting Test-Time Adaptation
University of New South Wales · Sydney, NSW, Australia · Griffith University +7
Two-Timescale Hierarchical Reinforcement Learning for Resilient Operations
Jul 26, 2026Young Hyun Cho, Franz Stoll, Will Wei Sun +2Hierarchical Reinforcement Learning Resilience
Department of Statistics, Harvard University · Edwardson School of Industrial Engineering, Purdue University · Mitch Daniels School of Business, Purdue University +3
Active few-shot segmentation by reinforcing data selection
Jul 24, 2026Chenlan Zhao, Benny Wong, Timothy F. Lundberg +8Few-Shot Segmentation Semi-Supervised Medical Image Segmentation
Centre for Bioengineering, School of Engineering and Materials Science, Queen Mary University of London, London, United Kingdom · Digital Environment Research Institute, Queen Mary University of London, London, United Kingdom · UCL Hawkes Institute; Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom +2
Language-Specific versus Cross-Lingual Knowledge Graphs for Implicit Aspect Identification in Arabic: A Comparative Study of Reasoning and Adaptation Strategies
Jul 22, 2026Lujain A. AlawwadArabic Sentiment
Department of Computing and Informatics Saudi Electronic University Riyadh, Saudi Arabia
Adjustment Speed as a Safety Constraint for Nonstationary Reinforcement Learning
Jul 21, 2026Timothy TomashevskiySafety Constraints Offline Reinforcement Learning
Department of Computing and Software McMaster University Hamilton, Ontario, Canada
Auditing Retrieval-Augmented LLM Hypotheses for Longitudinal Cell Painting Morphology
Jul 17, 2026Gilchan Park, Guang Zhao, Byung-Jun Yoon +1Cells Model Auditing
Brookhaven National Laboratory Upton, New York, USA
InduceKV: Fixed-Footprint Continual Adaptation of Multimodal LLMs via Inducing KV Memories
Jul 2, 2026Qianyu Chen, Ziteng Feng, Canran Xiao +1Multimodal Continual Instruction Tuning Multimodal Large Language Models
1Nanyang Technological University · University of Science and Technology of China · 3Shenzhen Campus of Sun Yat-sen University
QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networks
Jul 1, 2026Zhihan Zeng, Kaihe Wang, Zhongpei Zhang +1Integrated Sensing And Communication Beamforming
National Key Laboratory of Wireless Communications, University of Electronic Science and Technology of China, Chengdu 611731, China · University of Electronic Science and Technology of China, Chengdu 611731, China · College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China +2
Learning Cardiac Motion Priors for Implicit Neural Representations
Jul 1, 2026Andrew Bell, George Webber, Andrew P King +3Cardiac Magnetic Resonance Imaging Neural Representations
School of Biomedical Engineering and Imaging Sciences, King’s College London, United Kingdom · William Harvey Research Institute, Queen Mary University of London,2026 United Kingdom · Cardio-Oncology Service, Royal Brompton and Harefield Hospitals, London, United Kingdom
DriftScope: Measuring The Hidden Effects of Diffusion Model Adaptation
Jun 30, 2026Héctor Laria, Yiping Han, Julian D. Santamaria +4Text-To-Image Diffusion Models Diffusion Models
Computer Vision Center, Barcelona, Spain · Universitat Autonoma de Barcelona, Barcelona, Spain · Program of Computer Science, City University of Hong Kong (Dongguan), China +1
Real-Time Source-Free Object Detection
Jun 30, 2026Sairam VCR, Varun Gopal, Poornima Jain +2Object Detection Yolo26
1IIT Hyderabad, India · 2Microsoft Research · 3MBZUAI
Holonic Active Distillation for Scalable Multi-Agent Learning in Multi-Sensor Systems
Jun 30, 2026Dani Manjah, Tim Bary, Benoît Macq +1Model-Based Multi-Agent Systems Multi-Modal Sensing
Institute of Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), UCLouvain, 1348 Louvain-la-Neuve, Belgium · Université de Technologie de Belfort Montbéliard, UTBM, CIAD UR 7533, F-90010 Belfort cedex, France
Learning to Adapt: Reptile-D-Learning for Robust and Efficient Control Under Parametric Uncertainty
Jun 24, 2026Haipeng Cao, Zhaolong Shen, Quan QuanLyapunov Function Offline Reinforcement Learning
School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, P.R. China
Geometry-Aware Style Transfer in 3D Gaussian Splatting
Jun 23, 2026Min Hyeok Bang, Jun Hyeong Kim, Seung-Wook Kim +13D Gaussian 3D Geometry
Department of Computer Science and Artificial Intelligence/Center for Advanced Image Information Technology, Jeonbuk National University, Jeonju-si, South Korea · Division of Electronic and Communication Engineering, Pukyong National University, Busan, South Korea
Projection-Volume Fidelity Divergence: Diagnosing and Controlling Optimization Drift in Sparse-View 3D Gaussian Tomography
Jun 21, 2026Yikuang Yuluo, Ao Wang, Shen Kuan +6Sparse-View Cone-Beam Computed Tomography
1Chongqing University, Chongqing, China · 2Peking University Health Science Center, Beijing, China
Adding Robust Code-Switching Capabilities to High Performance Multilingual ASR
Jun 20, 2026Enes Yavuz Ugan, Alexander WaibelCode-Switching Multilingual Automatic Speech Recognition
Interactive Systems Lab, Karlsruhe Institute of Technology (KIT), Germany · InterACT, Carnegie Mellon University (CMU), USA
Domain Generalizable Adaptation of 3D Vision-Language Models via Regularized Fine-Tuning
Jun 16, 2026Sneha Paul, Zachary Patterson, Nizar BouguilaMultimodal Domain Generalization Vision-Language Model Adaptation
Concordia University, Canada
SDS-LoRA: Overcoming Anisotropic Gradient Scaling in Low-Rank Adaptation
Jun 15, 2026Junghun Oh, Sungyong Baik, Kyoung Mu LeeLow-Rank Structure Hip-Lora
Dept. of ECE, ASRI Seoul National University · Dept. of Artificial Intelligence Dept. of Data Science Hanyang University
Architecture-Aware Reinforcement Learning Makes Sliding-Window Attention Competitive in Math Reasoning
Jun 10, 2026Kai Liu, Peijie Dong, Xinchen Xie +5Mathematical Reasoning Benchmarks Large Language Model Reinforcement Learning
Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University · Hong Kong University of Science and Technology (Guangzhou) · Shanghai AI Laboratory
In-Context Learning for Latent Space Bayesian Optimization
Jun 8, 2026Tuan A. Vu, Harri Lähdesmäki, Julien MartinelliBayesian Optimization Molecular Optimization
Aalto University
Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
Jun 7, 2026Linqi Yin, Shiduo Zhang, Shenling Qiu +11Robot Policies Vision-Language Foundation Models
1Fudan University · 2Shanghai Innovation Institute
Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations
Jun 6, 2026Xinglong Zhang, Cong Li, Hangjie Mo +13Soft Robotics Scalable Robot Learning
College of Intelligence Science and Technology, National University of Defense Technology, Deya Road, Changsha, 410003, Hunan, China. · School of Management, Hefei University of Technology, Nanyihuan Road, Hefei, 230002,2026 Anhui, China. · State Key NanjingLaboratoryUniversityfor Novel(SuzhouSoftwareCampus),TechnologyTaihuandRoad,the Suzhou,School of215163,ScienceChina.and Technology, 4School of Computation, Information and Technology, Technical University of Munich, Boltzmann Strasse, Munich, 85748, Germany. +5
Generalizable Multi-Task Learning for Wireless Networks Using Prompt Decision Transformers
Jun 3, 2026Fatih Temiz, Shavbo Salehi, Melike Erol-KantarciMulti--Task Learning Transformer Architectures
School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, Canada
SafeGene: Reusable Adapters for Transferable Safety Alignment
Jun 2, 2026Yanghan Wang, Zhiqiang Kou, Fu Feng +2Safety Alignment Large Language Model Adaptation
Southeast University · The Hong Kong Polytechnic University
SplitAdapter: Load-Aware Humanoid Loco-Manipulation via Factorized Adaptation
Jun 2, 2026Jeonguk Kang, Hanbyel Cho, Sanghyun Kang +1Humanoid Loco-Manipulation Rapid Adaptation
Future Robot AI Group, Samsung Electronics
PRIMA: Boosting Animal Mesh Recovery with Biological Priors and Test-Time Adaptation
Jun 1, 2026Xiaohang Yu, Ti Wang, Mackenzie Weygandt MathisHuman Mesh Recovery Skeleton
École Polytechnique Fédérale de Lausanne (EPFL)
From Performance to Representational Adequacy: A Representational Bootstrap Framework for Adaptive Biological Systems
May 31, 2026Jacques Raynal, Pierre Slangen, Elsa Raynal +1Biological Rapid Adaptation
Laboratory of Bioengineering and Nanosciences (LBN), University of Montpellier, France · EuroMov Digital Health in Motion, University of Montpellier, IMT Mines Alès, Alès, France · Certified Sophrologist and Dental Assistant, Sensorimotor Practice, Montpellier, France +1
SEArch: Optimistic Policy Selection Between Scene Noise and Drift for UAV Radar Search
May 31, 2026Noor Khial, Naram Mhaisen, Loay Ismail +1Unmanned Aerial Vehicle Detection Unmanned Aerial Vehicles
College of Engineering, Qatar University, Qatar · Faculty of Electrical Engineering, Mathematics, and Computer Science, Delft University of Technology, The Netherlands
Foundation-Preserving Optimization in Generalized Eigenspace
May 28, 2026Dongjun Kim, Adrian de Wynter, Huancheng Chen +2Parameter-Efficient Adaptation Rapid Adaptation
The University of Texas at Austin · Microsoft · Microsoft AI +1
Mask the Target: A Plug-and-Play Regularizer Against LoRA Forgetting
May 28, 2026Runze Xu, Arpit Garg, Hemanth Saratchandran +1Large Language Model Adaptation Rapid Adaptation
Australian Institute for Machine Learning Adelaide University Adelaide SA 5000
Forget Less, Generalize More: Unifying Temporal and Structural Adaptation for Dynamic Graphs
May 28, 2026Qian Chang, Ciprian Doru Giurcaneanu, Runsong Jia +6Recurrent State Rapid Adaptation
University of Auckland, Auckland, New Zealand · University of Technology Sydney, Sydney, Australia · Central China Normal University, Wuhan, China

Oct 1, 2026, cs.LGJ/K move · Enter open · S save

Learn the Directions, Normalize the Gains: Post-Training Normalization for LoRA

Zailong Tian, Yanzhe Chen, Zhuoheng Han, Houfeng Wang+1

Singapore Management University · National University of Singapore · Peking University

Balanced Learning Rapid Adaptation Post-Training

Open paper AskPDF arXiv

While Low-Rank Adaptation (LoRA) enables efficient task specialization, its learned updates can compromise capabilities beyond the target task. We identify \textbf{adaptation imbalance}: a few singular directions dominate the trained update, leaving its performance sensitive to how gains are allocated. We argue that \textbf{learning where to adapt does not ensure that adaptation gains are well balanced}. This motivates \textbf{LoRA-Norm}, a post-training normalization method that retains learned directions while rebalancing their gains. LoRA-Norm combines spectral rebalancing, a fixed nonlinear transformation of singular values, with nuclear-norm restoration, which preserves the original total spectral mass. It requires no calibration data or additional training and introduces no inference overhead. Across two backbones and three adaptation tasks, LoRA-Norm improves average specialization and capability retention, outperforming the evaluated post-hoc spectral pruning and gradient-guided editing configurations on both measures. Stronger functional equalization brings no consistent additional gains, revealing that balancing adapter gains and equalizing their responses are distinct objectives.

Momentum

Related topics

Latest papers 95