cs.LGNov 8, 2026

ZarrFM: A Canonical Tensor Storage Architecture for EEG Foundation-Model Pretraining

Authors: Dheeraj Chintapalli, Sunkalp Chandra

Organizations: University of Michigan, Ann Arbor · Reteena · University of Texas, Austin

Abstract

Statistical models for brain-computer interfaces (BCIs) increasingly require large, heterogeneous EEG corpora, yet existing datasets vary in sampling rates, channel layouts, window lengths, and storage formats, creating substantial preprocessing and I/O overhead. We propose ZarrFM, an execution-oriented representation that complements BIDS by storing a corpus as a single Zarr v3 hierarchy with indexed metadata, canonical channel spaces, explicit masks, hash-stable subject splits, verified event tables, and block-aligned sharding. On real PhysioNet recordings and synthetic corpora, we compare ZarrFM with EDF, FIF, NPY, HDF5, and Parquet. Across 200 recordings, its two-level index reduces metadata queries from 601 requests to 14. Preserving native signal codes reduces storage from 42.4 MB/hour in EDF to 22.7 MB/hour, while block-aligned sampling reaches 3,131 windows/s, up to 11 times faster than Parquet. Reads remain bit-identical across independent Zarr implementations, and concurrent failure-injected appends recover without data loss. These results show that ZarrFM can provide a compact, interoperable, and execution-efficient storage layer for large-scale EEG pretraining.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. STEAM: A Spatio-TEmporal Alignment Mixture-of-Experts Model with Hierarchical Pre-training for EEG Decoding

    Aug 3, 2026Zhu Chen, Dingkun Liu, Yuheng Chen +1Brain-Computer InterfacesEEG Decoding

  2. OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models

    May 30, 2026Ziling Lu, Zongsheng Li, Xinke Shen +11Brain-Computer InterfacesBenchmark Design

  3. BrainCodes: A Lightweight EEG Foundation Model over Discrete Neural Codes

    Oct 21, 2026Kleanthis Avramidis, Ivan Tashev, Dimitra EmmanouilidouEEG Foundation ModelsRepresentation Learning