cs.LGSep 27, 2026

OOD Generalization as a Bifurcation Problem

Authors: Nguyen-Thanh-Luong Doan, Quang-Vu Nguyen, Tang-Phu-Quy Le, Cong-Phap Huynh

Organizations: The University of Danang - Vietnam-Korea University of Information and Communication Technology

Abstract

Systematic out-of-distribution (OOD) generation remains a critical bottleneck for continuous-time generative models. While standard joint classifier-free guidance (CFG) routinely fails to synthesize unobserved concept combinations, exact decomposed scoring generalizes robustly at the cost of severe computational overhead. In this work, we reveal that compositional binding is not a uniform process but a highly localized phase transition. We identify the semantic bifurcation window - the precise temporal interval where joint and decomposed vector fields meaningfully diverge. Exploiting this dynamic, we propose surgical guidance, a hybrid sampling strategy that restricts exact multi-pass scoring strictly to this critical window. On an OOD bi-digit MNIST testbed, surgical guidance achieves state-of-the-art compositional fidelity at a fraction of the inference cost, yielding a +5.3% absolute improvement in pairwise accuracy over the joint baseline by intervening during just the first 15% of the diffusion trajectory. Furthermore, our empirical analysis uncovers a fundamental topological divide: diffusion models (SDEs) force conceptual resolution immediately at peak noise, whereas Conditional Flow Matching (ODEs) delays structural binding until intermediate features emerge, establishing a new temporal framework for accelerating large-scale generative decoding.

Figures & tables

Explore similar work

CardsList
  1. Catastrophic Compositional Generation: Why Vanilla Diffusion Models Fail to Extrapolate

    Jun 22, 2026Duncan Soiffer, Chandler Squires, Yuan Guan +2Diffusion ModelsGenerative Models

  2. Test-Time Compositional Generalization in Diffusion Models via Concept Discovery

    May 8, 2026Zekun Wang, Anant Gupta, Tianyi Zhu +1Diffusion ModelsCompositional Generalization

  3. What Drives Compositional Generalization in Visual Generative Models? The Importance of Continuous Training Objectives

    Oct 3, 2025Karim Farid, Rajat Sahay, Yumna Ali Alnaggar +4Compositional GeneralizationGenerative Models