cs.LGNov 6, 2026

Fifty-Two Shades of Pig: What the UCR Archive Really Asks Classifiers to Do

Authors: Omar Swelam, Jaris Küken, Shi Bin Hoo, Frank Hutter, Lennart Purucker

Organizations: University of Freiburg · Prior Labs · ELLIS Institute Tübingen

Abstract

The pigs were bleeding. That was the point of the experiment: could airway pressure reveal hemorrhage before it became critical? In the UCR Time Series Classification Archive, the de facto benchmark for Time Series Classification (TSC), the same recordings ask a different question: "which of 52 pigs produced this trace?". The dataset PigAirwayPressure is not an outlier. Although the archive is the standard benchmark, whether its tasks resemble the problems TSC is meant to solve has rarely been examined. We find that several datasets are repurposed from their original task, built from toy setups, or have flawed test splits. We further question how representative the archive's ordered non-temporal sequences (e.g. spectra, shape outlines) are of real TSC, and the potential downsides from the decomposition of multivariate problems. Our findings call for more careful interpretation of archive-wide scores and greater attention to deployment-relevant evaluation. The audit is at https://github.com/automl/ucr-provenance-audit.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Multiverse of Time Series Machine Learning: an Archive for Multivariate Time Series Classification

    Mar 20, 2026Matthew Middlehurst, Aiden Rushbrooke, Ali Ismail-Fawaz +6Time Series ClassificationMultivariate Time Series Classification

  2. TimEE: End-to-end Time Series Classification via In-Context Learning

    Jul 8, 2026Jaris Küken, Shi Bin Hoo, Martin Mráz +2Synthetic Data PretrainingTime Series Classification