Integrating Latent Block Models into Variational Autoencoders for Disentangled Representation Learning
Organizations: VEDECOM Institute · DAVID Lab, UVSQ, Paris-Saclay University · TSM Unit UVSQ, Paris-Saclay University · DAVID Lab UVSQ, Paris-Saclay University ·
Abstract
We introduce LBM-VAE, a novel framework that integrates Latent Block Models (LBMs) into Variational Autoencoders (VAEs) to jointly cluster observations and latent dimensions. Beyond its clustering capabilities, LBM-VAE provides a block-structured latent representation that naturally supports disentangled representation learning. In contrast to conventional approaches that associate each factor of variation with an individual latent dimension, our framework allows factors of variation to be encoded across groups of latent dimensions. Experimental results demonstrate the promising clustering performance of LBM-VAE, while achieving competitive results in disentangled representation learning. LBM-VAE highlights the potential of combining co-clustering and variational inference to learn structured and interpretable latent representations.
Figures & tables
| DCI | |||||
| Model | MIG | SAP | D | C | I |
| -VAE | |||||
| -TCVAE | |||||
| -VAE + HFS | |||||
| -TCVAE + HFS | |||||
| LBM-VAE | |||||
Latent Variable Models
Latent variable models infer hidden factors, classes, or states from observed data to explain structure, uncertainty, and variation.
See all 162 papers