cs.CVNov 19, 2026

HOPD: Historical On-Policy Distillation for SAR MLLM Continual Learning

Authors: Yuxuan Li, Derrick Goh Xin Deik, Zheng-Peng Duan, Qianru Sun, Weijie Li

Organizations: Singapore Management University · Nanyang Technological University · Nankai University · Xi’an Jiaotong University

Abstract

Continual SAR interpretation requires multimodal large language models to learn incoming sources while retaining earlier task abilities. This is difficult when acquisition and geographic shifts alter visual evidence, regionally concentrated categories bias answers, and historical images are scarce. We address this problem with Historical On-Policy Distillation (HOPD), which reuses source-acquisition LoRA states as persistent teachers for one evolving student. Archiving each state before consolidation preserves a stable source reference. The teachers supervise student-generated prefixes, transferring historical behavior to the student's changing generation contexts. To enrich sparse replay, original-view teachers guide augmented historical student views while preserving spatial coordinates. This knowledge is consolidated into a single deployed adapter that requires no source identity. On SARVQA-CL, our source-incremental evaluation protocol, HOPD achieves the highest final mean score of 54.51 among the compared methods, exceeding the strongest baseline by 2.96 points. It also improves the final source-macro score in every evaluated task over shared-memory Replay-SFT, with gains across source orders. These results support source-acquisition history as supervision for retaining earlier task performance during continual SAR adaptation. Code and data: https://github.com/zcablii/HOPD.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Attention-Spectrum Regularization for Replay-Free Continual Multimodal LLMs

    Jun 22, 2026Chuangxin Zhao, Canran Xiao, Siyuan Ma +5Visual Question AnsweringCross-Modal Attention

  2. On-Policy Replay for Continual Supervised Fine-Tuning

    May 28, 2026Yan Chen, Taojie Zhu, Meng Zhang +4Continual Learning for LLMsReplay-Based Continual Learning

  3. CAMR: Compatibility-Aware Memory Replay for Continual Learning in Large Language Models

    Oct 27, 2026Jingpu Yang, Tianhao Li, Fengxian Ji +3Continual LearningContinual Learning for LLMs