Spiking Sensory Networks
Organizations: Cerebral Systems Inc. (Cerybra.)
Abstract
Effective sensory reception is critical for survival, yet the computational mechanisms behind how peripheral sensory neurons (SNs) transduce external signals into spiking representations for downstream brain circuits remain to be fully understood. Numerous theoretical frameworks have been proposed to model sensory processing, with Bayesian approaches among the most prominent. However, existing machine learning attempts to apply Bayesian theory to spiking neurons remain largely phenomenological, disconnected from empirical biology, and poorly validated on non-stationary temporal data. Conversely, neuroscientific models often rely on strong inductive experimental biases or explicit kinetic dynamics fit post hoc to match spiking data. Here, we introduce a class of recurrent Poisson VAE models, termed Spiking Sensory Networks (SSNs), that bridge these paradigms by reconciling variational inference with biologically inspired spike transduction for time-varying stimuli. Evaluated on real-world odor plume recordings from locust olfactory receptor neurons (ORNs), SSNs match or exceed the reconstruction fidelity of Spiking Neural Network (SNN) and GLM baselines while exhibiting superior representational characteristics. Furthermore, SSNs are well-suited for neuroscientific investigation, learning empirical in vivo ORN response motifs and exhibiting emergent spike-frequency adaptation under unsupervised reconstruction without manual tuning. Moreover, we theoretically link the recurrent decoding objective to mutual information maximization, and derive a formal thermodynamic lower bound connecting the Poisson Kullback-Leibler regularizer to the excess non-equilibrium metabolic power of biophysical homeostasis. Ultimately, our work synthesizes principles from machine learning theory and empirical neuroscience, providing a viable bridge that concretizes Bayesian models with biological mechanisms.
Figures & tables
| Metric | SNN (LIF) | Adaptive SNN | Poisson GLM |
|---|---|---|---|
| Natural Odor Plume (PID) | |||
| Reconstruction MSE | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{+56.99\%}}^{*} | n.s. | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{+58.62\%}}^{*} |
| Reconstruction SNR ( ) | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{-1.75\text{ dB}}}^{*} | n.s. | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{-2.05\text{ dB}}}^{*} |
| Stimulus MI | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{-49.66\%}}^{***} | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{-61.05\%}}^{***} | {\color[rgb]{0.6367,0.625,0.082}\textbf{+22.63\%}}^{*} |
| Shannon Entropy | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{-70.06\%}}^{***} | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{-68.87\%}}^{***} | {\color[rgb]{0.6367,0.625,0.082}\textbf{+13.55\%}}^{*} |
| n.s. | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{-22.98\%}}^{*} | {\color[rgb]{0.3164,0.0508,0.0391}\textbf{-60.98\%}}^{***} | |
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
| Hyperparameter | Synthetic Wave | In Vivo PID Plume |
|---|---|---|
| Sampling Rate ( ) | Arbitrary (unit step) | Hz |
| Total Sequence Length | 100 time steps | s ( time steps) |
| Train / Test Split | Held-out seed batch | s ( ) / s ( ) |
| Window Length ( ) / Stride ( ) | Full ( ) / N/A | Full ( ) / N/A |
| Number of Channels ( ) | 8 | 16 ORNs |
| Receptive Field Length ( ) | 10 time steps | 60 time steps ( ) |