Generative Modeling
Generative modeling aims to create new data instances that resemble a given dataset, focusing on learning the underlying probability distribution. Current research emphasizes hybrid approaches combining the strengths of autoregressive models (for global context) and diffusion models (for high-quality local details), as well as advancements in flow-based models and score-based methods. These techniques are significantly impacting diverse fields, including image generation, 3D modeling, time series forecasting, and even scientific applications like molecular dynamics simulation and medical image synthesis, by enabling the creation of realistic and diverse synthetic data.
Papers
Humanoid Locomotion as Next Token Prediction
Ilija Radosavovic, Bike Zhang, Baifeng Shi, Jathushan Rajasegaran, Sarthak Kamat, Trevor Darrell, Koushil Sreenath, Jitendra Malik
WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis
Paul Friedrich, Julia Wolleb, Florentin Bieder, Alicia Durrer, Philippe C. Cattin
Generative VS non-Generative Models in Engineering Shape Optimization
Muhammad Usama, Zahid Masood, Shahroz Khan, Konstantinos Kostas, Panagiotis Kaklis
One-to-many Reconstruction of 3D Geometry of cultural Artifacts using a synthetically trained Generative Model
Thomas Pöllabauer, Julius Kühn, Jiayi Li, Arjan Kuijper
Diffeomorphic Measure Matching with Kernels for Generative Modeling
Biraj Pandey, Bamdad Hosseini, Pau Batlle, Houman Owhadi
Generative Modeling of Discrete Joint Distributions by E-Geodesic Flow Matching on Assignment Manifolds
Bastian Boll, Daniel Gonzalez-Alvarado, Christoph Schnörr
Near-Minimax-Optimal Distributional Reinforcement Learning with a Generative Model
Mark Rowland, Li Kevin Wenliang, Rémi Munos, Clare Lyle, Yunhao Tang, Will Dabney
Sequential Flow Straightening for Generative Modeling
Jongmin Yoon, Juho Lee
Particle Denoising Diffusion Sampler
Angus Phillips, Hai-Dang Dau, Michael John Hutchinson, Valentin De Bortoli, George Deligiannidis, Arnaud Doucet
On the Efficacy of Eviction Policy for Key-Value Constrained Generative Language Model Inference
Siyu Ren, Kenny Q. Zhu