Discrete Latent

Discrete latent variable models aim to learn underlying, unobserved categorical structures within data, improving model interpretability and performance. Current research focuses on developing efficient algorithms, such as GFlowNets and joint stochastic approximation, to handle the computational challenges posed by the combinatorial nature of discrete variables, and integrating these variables into various architectures including diffusion models, GANs, and variational autoencoders. This work has significant implications across diverse fields, enhancing model robustness in applications like medical image analysis and improving the accuracy and interpretability of predictions in natural language processing and causal inference.

Papers

July 3, 2024

DisCo-Diff: Enhancing Continuous Diffusion Models with Discrete Latents
Yilun Xu, Gabriele Corso, Tommi Jaakkola, Arash Vahdat, Karsten Kreis
Diffusion Model Discrete Latent Variable Discrete Latent

June 11, 2024

Learning Discrete Latent Variable Structures with Tensor Rank Conditions
Zhengming Chen, Ruichu Cai, Feng Xie, Jie Qiao, Anpeng Wu, Zijian Li, Zhifeng Hao, Kun Zhang
Causal Discovery Latent Variable Causal Structure Latent Causal Discrete Latent Variable Discrete Latent Tensor Rank

January 21, 2024

Enhance Eye Disease Detection using Learnable Probabilistic Discrete Latents in Machine Learning Architectures
Anirudh Prabhakaran, YeKun Xiao, Ching-Yu Cheng, Dianbo Liu
Native Robustness Machine Learning Model Fundus Image Generative Flow Network Discrete Latent Eye Disease Ophthalmic Image Dropout Mask

June 23, 2023

Prediction under Latent Subgroup Shifts with High-Dimensional Observations
William I. Walker, Arthur Gretton, Maneesh Sahani
Human Prediction High Dimensional Latent Causal Discrete Latent Latent Shift Subgroup Shift

April 30, 2023

StyleGenes: Discrete and Efficient Latent Distributions for GANs
Evangelos Ntavelis, Mohamad Shahbazi, Iason Kastanis, Radu Timofte, Martin Danelljan, Luc Van Gool
Generative Adversarial Network Discrete Environment Latent Vector Style Generation Latent Encoding Discrete Latent

February 13, 2023

GFlowNet-EM for learning compositional latent variable models
Edward J. Hu, Nikolay Malkin, Moksh Jain, Katie Everett, Alexandros Graikos, Yoshua Bengio
Variational Inference Latent Variable Model Energy Based GFlowNets Discrete Variational Discrete Latent

January 18, 2023

Discrete Latent Structure in Neural Networks
Vlad Niculae, Caio F. Corro, Nikita Nangia, Tsvetomila Mihaylova, André F. T. Martins
Neural Network Latent Structure Compositional Structure Bayesian Estimation Discrete Latent

November 7, 2022

Learning Semantic Textual Similarity via Topic-informed Discrete Latent Variables
Erxin Yu, Lan Du, Yuan Jin, Zhepei Wei, Yi Chang
Semantic Similarity Semantic Textual Similarity Discrete Latent Variable Discrete Latent

July 25, 2022

Advancing Semi-Supervised Task Oriented Dialog Systems by JSA Learning of Discrete Latent Variable Models
Yucheng Cai, Hong Liu, Zhijian Ou, Yi Huang, Junlan Feng
Semi Supervised Learning Joint Learning Task Oriented Dialog System Discrete Latent Variable Discrete Latent

February 27, 2022

Bayesian Active Learning for Discrete Latent Variable Models
Aditi Jha, Zoe C. Ashwood, Jonathan W. Pillow
Active Learning Latent Variable Model Latent State Discrete Latent Variable Bayesian Active Learning Discrete Latent

January 3, 2022

Learning with Latent Structures in Natural Language Processing: A Survey
Zhaofeng Wu
LeArning Abstract Natural Language Processing Timely Survey Inductive Bias Latent Structure Differentiable Model Surrogate Gradient Discrete Latent

November 9, 2021

Double Control Variates for Gradient Estimation in Discrete Latent Variable Models
Michalis K. Titsias, Jiaxin Shi
Variational Autoencoders Gradient Estimation Control Variate Discrete Latent Variable Discrete Latent Binary Latent Variable