cs.LGSep 11, 2026

Flow Duality and Source Geometry for Categorical Generation

Authors: Etrit Haxholli

Abstract

Continuous and discrete flow matching are usually treated as separate constructions. This paper identifies a duality between them: projecting continuous convex-interpolant paths with one-hot targets through a position-wise argmax yields discrete convex-interpolant paths. The result requires source laws with appropriate coordinate symmetry and boundary regularity, and it makes the continuous source distribution an explicit design choice for categorical generation. We derive the induced discrete interpolation behavior for Gaussian, bounded-uniform, and centered negative-exponential sources, showing that different source geometries lead to qualitatively different transition timing and vocabulary-size dependence. Small visual diagnostics and a short language-modeling pilot suggest that these source-design effects can also appear in learned transports and early generative quality.

Explore similar work

CardsList
  1. Scaling Categorical Flow Maps

    May 8, 2026Oscar Davis, Anastasiia Filippova, Pierre Ablin +4Generative Flow NetworksFlow Map