Efficient Generative Modeling beyond Memoryless Diffusion via Adjoint Schrödinger Bridge Matching
Organizations: Seoul National University · Georgia Institute of Technology · Sungkyunkwan University
Abstract
Diffusion models often yield highly curved trajectories and noisy score targets due to an uninformative, memoryless forward process that induces independent data-noise coupling. We propose Adjoint Schrödinger Bridge Matching (ASBM), a generative modeling framework that recovers optimal trajectories in high dimensions via two stages. First, we view the Schrödinger Bridge (SB) forward dynamic as a coupling construction problem and learn it through a data-to-energy sampling perspective that transports data to an energy-defined prior. Then, we learn the backward generative dynamic with a simple matching loss supervised by the induced optimal coupling. By operating in a non-memoryless regime, ASBM produces significantly straighter and more efficient sampling paths. Compared to prior works, ASBM scales to high-dimensional data with notably improved stability and efficiency. Extensive experiments on image generation show that ASBM improves fidelity with fewer sampling steps. We further showcase the effectiveness of our optimal trajectory via distillation to a one-step generator.
Figures & tables
| Method | OC | No PT | FB | FID |
|---|---|---|---|---|
| Refinement method | ||||
| DOT ( Tanaka, 2019 ) | ✓ | ✗ | – | 15.78 |
| DGFLOW ( Ansari et al., 2021 ) | ✓ | ✗ | – | 9.63 |
| Flow-based method | ||||
| FM ( Lipman et al., 2023 ) | ✗ | ✓ | ✓ | 6.35 |
| Rectified Flow ( Liu et al., 2023b ) | ✓ | ✓ | ✗ | 6.01 |
| NFE | 25 | 50 | 100 | 250 | 500 | 1000 |
| Score SDE | 52.08 | 19.02 | 9.84 | 7.79 | 6.88 | 6.63 |
| ASBM (Ours) | 8.85 | 7.64 | 6.85 | 6.47 | 6.38 | 6.27 |
| Method | Score SDE | SB-FBSDE | DSBM | ASBM |
| FID | 6.72 | 285.77 | 39.84 | 3.74 |
| Method | FID | Recall | Precision |
| SDS ( Poole et al., 2023 ) | 9.36 | 0.504 | 0.706 |
| DMD ( Yin et al., 2024b ) | 8.25 | 0.513 | 0.715 |
| Ours | 6.68 | 0.542 | 0.702 |
| Forward | Backward NFE | |||||
| NFE | 25 | 50 | 100 | 250 | 500 | 1000 |
| 10 | 23.62 | 8.03 | 3.58 | 3.40 | 3.28 | 3.05 |
| 20 | 20.83 | 5.39 | 3.05 | 2.91 | 2.87 | 2.74 |
| 50 | 20.73 | 5.87 | 3.16 | 3.01 | 2.94 | 2.77 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Scalar (mean, var) | (mean, var) | Eigenvalues (min, max) | |
| Gaussian reference | |||
| ASBM (learned forward) |