Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning
Authors: Lin Li, Jiawei Huang, Qihao Quan, Dan Li, Boxin Li, Xiao Zhang, Erli Meng, Wenjie Feng, +2 more
Organizations: Sun Yat-sen University Zhuhai, Guangdong, China · Xiaomi Corporation Beijing, China · University of Science and Technology of China Hefei, Anhui, China · National University of Singapore Singapore, Singapore
In this paper, we propose the first VLMagentic reasoning framework for few-shot multimodal Time Series Classification (MarsTSC), which introduces a self-evolving knowledge bank as a dynamic context iteratively refined via reflective agentic reasoning. The framework comprises three collaborative roles: i) Generator conducts reliable classification via reasoning; ii) Reflector diagnoses the root causes of reasoning errors to yield discriminative insights targeting the temporal features overlooked by Generator; iii) Modifier applies verified updates to the knowledge bank to prevent context collapse. We further introduce a test-time update strategy to enable cautious, continuous knowledge bank refinement to mitigate few-shot bias and distribution shift. Extensive experiments across 12 mainstream time series benchmarks demonstrate that MarsTSC delivers substantial and consistent performance gains across 6 VLM backbones, outperforming both classical and foundation model-based time series baselines under few-shot conditions, while producing interpretable rationales that ground each classification decision in human-readable feature evidence.