cs.LGMar 12, 2026

Grammar of the Wave: Towards Explainable Multivariate Time Series Event Detection via Neuro-Symbolic VLM Agents

Authors: Sky Chenwei Wan, Yifei Y. Wang, Tianjun Hou, Xiqing Chang, Aymeric Jan

Organizations: AI Lab, SLB, France · LTCI, Télécom Paris, Institut Polytechnique de Paris, France

Abstract

Time Series Event Detection (TSED) aims to localize semantically meaningful events in time series data, with critical applications in high-stakes domains. Unlike statistical anomalies, events are often defined by natural-language descriptions with internal temporal-logic structures across multiple physical channels. However, in real-world settings, dense event annotations are expensive to obtain, making purely supervised learning difficult. We introduce Language-guided TSED, a setting where a model is given textual event descriptions and must ground them to intervals in multivariate signals with little or no labeled data. To address this problem, we propose Event Logic Tree (ELT), a knowledge representation framework that converts linguistic descriptions into structured temporal logic over signal primitives. Building on ELT, we present SELA, a neuro-symbolic VLM agent framework that iteratively grounds primitives from signal visualizations and composes them under ELT constraints, producing both event intervals and faithful tree-structured explanations. We further release a real-world benchmark across energy and climate domains with expert knowledge and annotations. Experiments show that SELA improves over supervised fine-tuning and existing zero/few-shot time series reasoning baselines.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. SEER: Self-Evolving Event Reasoning and Retrieval for Time Series Forecasting

    Oct 2, 2026Mingtian Tan, Palash Goyal, Mihir Parmar +6Time Series ForecastingRetrieval-Augmented Time Series Forecasting

  2. Representing Time Series as Structured Programs for LLM Reasoning

    Jun 10, 2026Jaeho Kim, Changhun Oh, Seokhyun Lee +2Time Series ReasoningTime Series QA

  3. Lapras: Latent Reasoning for Time Series Language Models

    Oct 8, 2026Yuliang Chen, Yu Yvonne Wu, Patrick Langer +11Temporal Reasoning in Language ModelsTime Series QA