stat.MLFeb 24, 2025

A Mechanistic Interpretation of Prescribed-Parameter Convolutional Kernels

Authors: Jorge Marco Blanco, Rubén Cuevas Rumín

Organizations: Universidad Carlos III de Madrid, Spain · UC3M-Santander Big Data Institute, Spain

Abstract

Prescribed-parameter convolutional transforms achieve strong time series classification performance using fixed kernels, simple pooling operations, and a linear classifier. Their success raises a mechanistic question: which properties of the representation make this construction effective? We study the proportion of positive values (PPV), a pooling operator shared by ROCKET, MiniROCKET, and MultiROCKET. We establish exact invariance to circular translations under periodic boundaries and quantify departures from invariance under finite boundaries. A complementary analysis bounds the sensitivity of a smooth PPV surrogate. We then define the population pairwise geometry induced by a distribution of convolutional parameters and show how a finite random kernel bank concentrates around that geometry. This separates the role of the parameter distribution from the number of sampled kernels. Experiments on the UCR classification collection examine effective dimensionality, distance correlation with the input, and classification accuracy using PPV-only, unit-energy ROCKET kernels. Increasing kernel count produces diminishing representational gains. Increasing kernel length generally raises effective dimensionality and distance correlation, while the best test performance occurs at intermediate lengths and training accuracy remains close to perfect. Together, these results support an interpretation in which nonlinear pooling creates a richer but structured representation that can favour linear separation, while further representational richness need not improve generalisation.

Figures & tables

Explore similar work

CardsList
  1. ROMAN: A Multiscale Routing Operator for Convolutional Time Series Models

    Apr 2, 2026Gonzalo UribarriTime Series ClassificationMultiscale Time-Series Modeling

  2. Resolution Allocation with Learnable Resizing and Spectral Filter Parameterization

    Oct 14, 2026Wei Wu, Eric C. LarsonConvolutional Neural NetworksFrequency-Domain Feature Learning

  3. Muon-C: Operator-Aligned Muon for Convolutional Kernels

    Sep 9, 2026Jiaxin Qing, Lexin LiNeural Network OptimizationMuon Optimizer