cs.SDSep 5, 2025

Encoding of musical structures in hidden units of restricted Boltzmann machines

Authors: Mutsumi Kobayashi, Hiroshi Watanabe

Organizations: Department of Applied Physics and Physico-Informatics, Faculty of Science and Technology, Keio University, Yokohama 223-8522, Japan

Abstract

Restricted Boltzmann machines (RBMs) are energy-based models originating from statistical physics. In this study, we investigate how musical structures are represented in the hidden layer of a Bernoulli-Bernoulli RBM trained on binary piano-roll representations of J.~S.~Bach's music. By examining the visible patterns induced by individual hidden units, we find that the hidden layer primarily captures local temporal and pitch-statistical features rather than explicit musical concepts such as melodies, chords, or keys. Free-energy comparisons show that the trained RBM assigns higher probabilities to the examined musical inputs than to digit or noise patterns. Analysis using t-SNE, cosine similarity, and PCA reveals that hidden representations are sensitive to absolute pitch and input overlap, with transposed versions of the same piece not necessarily mapped close together. Generated samples exhibit local pitch organization but limited long-range coherence. These findings illustrate how a simple statistical-physics model captures certain regularities in structured musical data while highlighting its limitations in representing higher-level musical relationships.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Activation Functions, Statistics and Learning of Higher-Order Interactions in Restricted Boltzmann Machines

    May 18, 2026Giovanni di Sarra, Yasser RoudiUnsupervised Representation LearningNeural Network Activation Functions

  2. From Isolated Feature to Orbits: Discovering Music Concepts via Multi-SAE Alignment

    Oct 1, 2026Liwei Lin, Gus XiaRepresentation LearningSparse Autoencoders

  3. Do Music Foundation Models Embed Pitch in Helical Structure?

    Jul 31, 2026Hayato Yagi, Shinnosuke Takamichi, Rin Sato +2Audio Representation LearningNeural Representation Geometry