PhysioWave-T: Token-Efficient Wavelet Foundation Models for Biosignals
Organizations: School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798 · Integrated Systems Laboratory, ETH Zürich, 8092 Zürich, Switzerland · Department of Engineering “Enzo Ferrari” (DIEF), University of Modena and Reggio Emilia, 41125 Modena, Italy · Department of Electrical, Electronic and Information Engineering “Guglielmo Marconi” (DEI), University of Bologna, 40136 Bologna, Italy ·
Abstract
We present PhysioWave-T, a token-efficient wavelet foundation model family for EEG, ECG, and sEMG. Dynamic scale folding recombines J+1 wavelet subbands prior to tokenization, compressing sequence length from (J+1)CS to CS tokens for J levels, C channels, and S temporal patches. Route-specific front ends and learned channel-name embeddings allow one Transformer per modality to handle diverse montages and sampling rates, while unseen setups reuse the backbone via lightweight adapters. We pre-train a 30M-parameter EEG model on over 15M windows (19--128 channels), alongside ECG (30M) and sEMG (12M) encoders. Across four EEG routes, scale folding cuts Transformer latency by 4.0--7.2x and peak memory by 6.8--12.7x over scale expansion without accuracy loss. Our EEG encoder leads 8 of 9 metrics against BENDR, BIOT, LaBraM, and EEGPT, and surpasses LUNA-L on wearable seizure detection with fewer parameters. Reliability-aware latent fusion (RALF) further integrates summary tokens from independently pre-trained encoders via sample-adaptive weights. On SeizeIT2, RALF raises event sensitivity at 11 false alarms/h from 61.4% to 74.4% and window AUPRC from 0.321 to 0.399 over the best unimodal baseline, outperforming weighted-logit and concatenation fusion across all variants. PhysioWave-T also achieves state-of-the-art sEMG accuracies and top macro-F1 on PTB-XL Super and Chapman-Shaoxing. Code and models: https://github.com/ForeverBlue816/PhysioWave.
Figures & tables
| Modality | Corpus | Route | Windows |
|---|---|---|---|
| TUEG [ 31 ] | (19, 256) | 13,710,516 | |
| HBN [ 32 ] | (128, 512) | 1,352,818 | |
| FACED [ 33 ] | (32, 512) | 129,268 | |
| TDBRAIN [ 34 ] | (32, 512) | 86,991 | |
| M3CV [ 35 ] | (64, 256) | 81,895 | |
| PhysioNet MI [ 36 ] | (64, 256) | 36,933 |
| Sleep-EDFx | PhysioNet-P300 | KaggleERN | ||||||||
| Method | Params | BAC | Kappa | W-F1 | BAC | Kappa | AUROC | BAC | Kappa | AUROC |
| BENDR Front. Hum. Neurosci.’21 | 157M | 0.6655 | 0.6659 | 0.7507 | 0.6114 | 0.2227 | 0.6588 | 0.5672 | 0.1461 | 0.6030 |
| BIOT NeurIPS’23 | 3.2M | 0.6622 | 0.6461 | 0.7415 | 0.5485 | 0.0968 | 0.5308 | 0.5118 | 0.0297 | 0.5495 |
| LaBraM ICLR’24 | 5.8M | 0.6771 | 0.6710 | 0.7592 | 0.6477 | 0.2935 | 0.7068 | 0.5439 | 0.0944 | 0.5693 |
| EEGPT NeurIPS’24 | 25M | 0.6917 | 0.6857 | 0.7654 | 0.6502 | 0.2999 | 0.7168 | 0.5837 | 0.1882 | 0.6621 |
| PhysioWave-T (scratch) | 30M | 0.6924 | 0.7363 | 0.8043 | 0.6512 | 0.2337 | 0.7194 | 0.5704 | 0.1409 | 0.6001 |
| PTB-XL Super | CPSC 2018 | Chapman | |||||
| Method | Params | F1 | AUC | F1 | AUC | F1 | AUC |
| MERL ICML’24 | 11M | 48.1 | 91.9 | 72.8 | 92.6 | — | 87.9 |
| MaeFE TIM’23 | 9M | 64.7 | 88.6 | 71.6 | 94.5 | — | — |
| OpenECG-SimCLR arXiv’25 | 11M | 46.9 | 91.5 | 73.1 | 92.4 | 52.3 | 95.1 |
| OpenECG-BYOL arXiv’25 | 11M | 47.7 | 91.1 | 72.8 | 92.6 | 51.5 | 94.8 |
| OpenECG-MAE arXiv’25 | 11M | 48.1 | 90.9 | 74.5 | 93.2 | 50.8 | 94.2 |
| EPN-612 | GRABMyo | ||||
| Method | Params | Acc. | F1 | Acc. | F1 |
| MOMENT ICML’24 | 385M | 90.87 | 90.16 | 82.67 | 82.19 |
| OTiS arXiv’24 | 45M | 87.55 | 88.03 | 79.38 | 78.80 |
| PhysioWave-S NeurIPS’25 | 5M | 93.12 | 93.40 | 85.26 | 85.03 |
| PhysioWave-B NeurIPS’25 | 15M | 93.68 | 93.91 | 87.40 | 87.16 |
| PhysioWave-L NeurIPS’25 | 37M | 94.50 | 94.56 | 88.53 | 88.37 |
| P300 | KaggleERN | ||||
| Variant | BAC | AUROC | BAC | AUROC | |
| PhysioWave-T (full) | 67.1 | 73.7 | 61.7 | 66.3 | — |
| Scale folding (vs. dynamic fold) | |||||
| Scale expansion | 66.8 | 73.4 | 61.4 | 66.0 | |
| Static uniform fold ( ) | 65.6 | 72.0 | 60.2 | 64.5 | |
| w/o synthesis filters ( ) | 66.4 | 73.0 | 61.0 | 65.6 | |
Time-Series Foundation Models
Time-series foundation models are pretrained sequence models designed to transfer across forecasting, classification, anomaly detection, and other temporal tasks.
See all 340 papers