Generative Modeling

Follow this topic Ask about this topic

Momentum

39 papers in the last four weeks, up 144% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 347

All topics

Mechanisms of Misgeneralization in Physical Sequence Modeling
May 19, 2026Kento Nishi, Raphael Tang, Karun Kumar +2Robot Motion Generation Generative Modeling
1Harvard College · 2Harvard John A. Paulson School of Engineering and Applied Sciences · 3Comcast AI +3
Adynamical systems view of training generativemodels and the memorization phenomenon
May 19, 2026Siva Athreya, Chiranjib Bhattacharya, Vivek S. BorkarNeural Network Memorization Memorization in Generative Models
International Institute for Theoretical Sciences, Survey No. 151, Hesarghatta Road, Shivakote Hobli, Bengaluru 560089, India · Department of Computer Science and Automation, Indian Institute of Science, Bengaluru 560012, India · Department of Electrical Engineering, Indian Institute of Technology Bombay, Powai, Mumbai 400076, India
Generative Recursive Reasoning
May 19, 2026Junyeob Baek, Mingyu Jo, Minsu Kim +3Latent Variable Models Generative Modeling
KAIST · Mila – Québec AI Institute · New York University +1
Multi-Scale Generative Modeling with Heat Dissipation Flow Matching
May 19, 2026Jun Ma, Hanquan Zhang, Yanjun Qin +2Flow Matching Image Generation
Department of Systems Science, Faculty of Arts and Sciences, Beijing Normal University, Zhuhai 519087, China · School of Computer Science and Technology, Xinjiang University, Urumqi 830049, China · International Academic Center of Complex Systems, Beijing Normal University, Zhuhai 519087, China +1
Matérn Noise for Triangulation-Agnostic Flow Matching on Meshes
May 19, 2026Tianshu Kuai, Arman Maesumi, Daniel Ritchie +1Flow Matching 3D Mesh Generation
Université de Montréal & Mila, Canada · Brown University, USA
Position: Weight Space Should Be a First-Class Generative AI Modality
May 18, 2026Zhangyang Wang, Peihao Wang, Kai WangGenerative Modeling
University of Texas at Austin · Tencent
Flowing with Confidence
May 18, 2026Friso de Kruiff, Dario Coscia, Max Welling +1Flow Matching Uncertainty Quantification
CuspAI · AMLab, University of Amsterdam · mathLab, SISSA
Markov Chain Decoders Overcome the Heavy-Tail Limitations of Lipschitz Generative Models
May 18, 2026Abdelhakim Ziani, Andras Horvath, Paolo BallariniVariational Autoencoders Generative Modeling
Université Paris Saclay, Lab. MICS, CentraleSupélec, Gif-sur-Yvette, France · Università di Torino, Torino, Italy
Who Generated This 3D Asset? Learning Source Attribution for Generative 3D Models
May 18, 2026Sihan Ma, Siyuan Liang, Dacheng TaoData Provenance Generative Modeling
College of Computing & Data Science, Nanyang Technological University, Singapore
DCFold: Efficient Protein Structure Generation with Single Forward Pass
May 18, 2026Zhe Zhang, Yuanning Feng, Yuxuan Song +3Protein Structure Prediction AI-Assisted Scientific Research
Institute for AI Industry Research (AIR), Tsinghua University · Department of Computer Science and Technology, Tsinghua University · School of Computer Science and Technology, Huazhong University of Science and Technology +1
Divergence-Suppressing Couplings for Rectified Flow
May 18, 2026Yimeng Min, Carla P. GomesRectified Flow Image Generation
Department of Computer Science Cornell University Ithaca, NY 14850
TabKDE: Simple and Scalable Tabular Data Generation with Kernel Density Estimates
May 17, 2026Meysam Alishahi, Yan Zheng, Junpeng Wang +2Copula Models Synthetic Tabular Data Generation
University of Utah · Visa Research
Venom: A PyTorch Generative Modeling Toolkit
May 17, 2026Liang YanGenerative Modeling
Paul G. Allen School of Computer Science & Engineering University of Washington
PFlow-T: A Persistence-Driven Forward Process for Topology-Controlled Generation
May 17, 2026Snigdha Chandan KhilarGenerative Modeling Persistent Homology
Independent Researcher
HYVINT: Intensity-Driven Hypergraph Generation with Variational Representations
May 16, 2026Xinyi Hong, Shuntuo Xu, Zhou YuGenerative Modeling Hypergraph Learning
School of Statistics East China Normal University
Wavelet Flow Matching for Multi-Scale Physics Emulation
May 15, 2026Gabriele Accarino, Juan Nathaniel, Carla Roesch +4Flow Matching PDE Surrogate Modeling
Department of Earth and Environmental Engineering Columbia University, NY, USA · University of Edinburgh Edinburgh, Scotland, UK · Courant Institute of Mathematical Sciences New York University, NY, USA +2
Dynamics-Level Watermarking of Flow Matching Models with Random Codes
May 15, 2026Shuchan WangGenerative Modeling
Intrinsic Wasserstein Rates for Score-Based Generative Models on Smooth Manifolds
May 15, 2026Guoji Fu, Taiji Suzuki, Wee Sun Lee +1Intrinsic Dimensionality Generative Modeling
National University of Singapore · The University of Tokyo · RIKEN Center for Advanced Intelligence Project +2
StippleDiffusion: Capacity-Constrained Stippling using Controlled Diffusion
May 15, 2026Ofir Gilad, Aleksander Plocharski, Przemyslaw Musialski +1Constrained Generative Modeling Diffusion Sampling
Ben Gurion University of the Negev, Israel · Warsaw University of Technology, and Akces NCBR, Poland · Akces NCBR, Poland +1
One Pass Is Not Enough: Recursive Latent Refinement for Generative Models
May 14, 2026Mehdi Esmaeilzadeh, Alexia Jolicoeur-Martineau, Chirag Vashist +1Generative Modeling Image Generation Evaluation
1Simon Fraser University · 2Independent
Crys-JEPA: Accelerating Crystal Discovery via Embedding Screening and Generative Refinement
May 14, 2026Nian Liu, Nikita Kazeev, Stephen Gregory Dale +8Joint-Embedding Predictive Architecture Generative Modeling
1National University of Singapore · 2Loyola Marymount University · 3New York University +1
Privacy Evaluation of Generative Models for Trajectory Generation
May 14, 2026Stavros Bouras, Ioannis Kontopoulos, Chiara Pugliese +5Privacy Auditing Trajectory Generation
School of Electrical and Computer Engineering, National Technical University of Athens, Athens, Greece · Institute of Informatics and Teletematics, National Research Council (CNR), Pisa, Italy · Institute of Information Science and Technologies, National Research Council (CNR), Pisa, Italy
Action-Inspired Generative Models
May 14, 2026Eshwar R. A., Debnath PalSchrödinger Bridges Generative Modeling
Department of Computer Science Engineering PES University (EC Campus), Bengaluru
A plug-and-play generative framework for multi-satellite precipitation estimation
May 14, 2026Yunfan Yang, Haofei Sun, Xiuyu Sun +7Remote Sensing Generative Modeling
State Key Laboratory of Atmospheric Boundary Layer Physics and Atmospheric Chemistry (LAPC), Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing, China. · College of Earth and Planetary Sciences, University of Chinese Academy of Sciences, Beijing, China. · Shanghai Academy of Artificial Intelligence for Science (SAIS), Shanghai, China. +5
Generative Floor Plan Design with LLMs via Reinforcement Learning with Verifiable Rewards
May 13, 2026Luis Lara, Aristides Milios, Zhi Hao Luo +5Constrained Generative Modeling Generative Modeling
Mila – Quebec AI Institute · Université de Montréal · Polytechnique Montréal +1
Synthetic Sociality: How Generative Models Privatize the Social Fabric
May 13, 2026Ana Dodik, Moira WeigelHuman-AI Interaction Generative Modeling
MIT CSAIL, USA, Cambridge, MA · Harvard University, USA, Cambridge, MA
SurF: A Generative Model for Multivariate Irregular Time Series Forecasting
May 13, 2026Mohammad R. Rezaei, Tejas Balaji, Rahul G. KrishnanIrregular Time-Series Modeling Multivariate Time Series Forecasting
Department of Computer Science University of Toronto Vector Institute Toronto, ON, Canada
Diffusion Models, Denoiser Architecture and Creativity
May 13, 2026Itamar Levine, Yair WeissGenerative Modeling Diffusion Models
The Hebrew University of Jerusalem
Learning Local Constraints for Reinforcement-Learned Content Generators
May 13, 2026Debosmita Bhaumik, Julian Togelius, Georgios N. Yannakakis +1Constrained Generative Modeling Constrained RL
Institute of Digital Games, Msida, Malta · Game Innovation Lab, New York, New York, USA
Path-independent Flow Matching for Multi-parameter Generative Dynamics
May 13, 2026Francisco Téllez, AmirHossein Zamani, Philippe Martin +5Flow Matching Flow Map Learning
Université de Montréal, Mila · Concordia University, Mila · Concordia University +2

May 19, 2026, cs.LGJ/K move · Enter open · S save

Mechanisms of Misgeneralization in Physical Sequence Modeling

Kento Nishi, Raphael Tang, Karun Kumar, Core Francisco Park+1

1Harvard College · 2Harvard John A. Paulson School of Engineering and Applied Sciences · 3Comcast AI+3

Robot Motion Generation Generative Modeling Sequence Modeling

Open paper AskPDF arXiv

Generative sequence models are often trained to plan motion in physical domains, from robotics to mechanical simulations. When constructing a dataset to train such a model, engineers may curate demonstrations to specify how trajectories should be distributed over a physical quantity like travel distance or mechanical energy. For example, a roboticist building a maze navigation agent might choose demonstrations whose travel distances cover a fixed range uniformly, hoping to constrain the agent's expected power usage. We find that standard deep learning can violate this intent: each generated trajectory can seem plausible on its own, but the aggregate distribution over the physical quantity is wrong. We call this failure physical misgeneralization, and develop an account of its mechanism. Using controlled synthetic tasks, we show that physical misgeneralization arises when local errors typical of the model class propagate through the physical measurement to shift the recovered distribution. We estimate these errors with a data deviation kernel, and we use it to predict which physical quantities gain or lose mass in both our synthetic and more applied maze navigation and double-pendulum motion tasks. Finally, our mechanistic interpretation helps identify which mitigation strategies are structurally promising, and we use it to propose a kernel-informed intervention.

Momentum

Related topics

Latest papers 347