Natural images are often conjectured to lie on a low-dimensional manifold within the high-dimensional pixel space. Recent work leverages this to build self-contained pixel-space diffusion models without specialized machinery or pretrained components. A plain Transformer on raw image patches suffices, provided it predicts the clean image rather than the noise and compresses each patch through an aggressive bottleneck. The mixing operator, however, has remained softmax attention, inherited from sequence modeling rather than derived from denoising. For Gaussian noise, the optimal denoiser admits a canonical expansion in polynomial functionals of the observation, the Wiener--Volterra series. We prove that softmax attention, and any normalized mixing rule (including linear attention), cannot realize any polynomial map beyond an affine one. In contrast, Volterra layers realize this class directly and, on a data manifold, achieve approximation rates governed by the manifold dimension rather than the ambient pixel dimension. We therefore propose the architecture these results prescribe; raw image patches passed through a bottleneck embedding, followed by cascaded low-rank Volterra layers, which carry no activation function because each layer is nonlinear in its own right. To our knowledge this is the first pixel-space diffusion architecture whose mixing operators are Volterra layers throughout, with no attention, no convolution, no pretrained components, and no activation function on the residual path. On ImageNet 256×256 and 512×512, the resulting model is competitive with self-contained pixel-space diffusion at matched parameter and FLOP budgets.
Figures & tables
Figure 1: The PoD architecture. (a) pixel pipeline; (b) block, both Transformer sublayers replaced by Volterra mixers; (c) the primitive they share, equation 6 .
Figure 2: The manifold picture in a controlled setting. (a) Samples from a dM=1 spiral in RD (grey) for three targets and three architectures. (b) Mean distance to the manifold d(M) against D .
Figure 3: Class-conditional samples from PoD-G/16 on ImageNet 256×256 .
pre-training
Method
token
perc.
self-sup.
params
GFLOPs
FID ↓
IS ↑
Latent-space diffusion
DiT-XL/2 ( Peebles and Xie, 2023 )
SD-VAE
VGG
–
675+49M
119
2.27
278.2
REPA, SiT-XL/2 ( Yu et al., 2025 )
SD-VAE
VGG
DINOv2
675+49M
119
1.42
305.7
LightningDiT-XL/2 ( Yao et al., 2025 )
VA-VAE
VGG
DINOv2
675+49M
119
1.35
295.3
DDT-XL/2 ( Wang et al., 2026b )
SD-VAE
VGG
DINOv2
675+49M
119
1.26
310.6
Table 1: ImageNet 256×256 , FID and IS on 50K samples. Pre-training columns list the external models each method needs, and parameters include the tokenizer decoder where used.
Figure 4: Quality against compute on ImageNet 256×256 . PoD and JiT at scales B–G, which differ only in the mixing operator, and other pixel-space diffusion models.
Configuration
Token mixer
Channel mixer
FID-50K ↓
JiT baseline
Self-attention
FFN
3.66
Polynomial token only
Volterra k=2
FFN
3.54
Full polynomial
Volterra k=2
Volterra k=2
3.41
Table 2: Architecture ablation on ImageNet 256×256 at B/16 scale.
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
Symbol
Meaning
Dimensions and indices
D=Dp
ambient dimension of the theory, the per-patch pixel dimension
Dp=3p2
ambient dimension of one p×p RGB patch ( Dp∈{768,3072} )
p
patch side length ( p=16 at 256×256 , p=32 at 512×512 )
dM
intrinsic dimension of the data manifold M , with dM≪D
d′
per-token bottleneck dimension ( d′∈{128,256} ); 2dM+1 suffices in Proposition 1 , and the trained value is deliberately larger (Appendix C )
Appendix
Table 3: Summary of notation.
Table 3 , continued.
Symbol
Meaning
Architecture
P
per-layer parameter budget in the function-class statements of Section 3 (distinct from the factor P )
VL,P
depth- L stacks of low-rank Volterra mixers with at most P parameters per layer (Proposition 2 ); P0 is the attainment threshold
Appendix
Table 8
Regime
σ/t
Why the bound is controlled
Constrains
Early
≫τ
target nearly affine
—
Intermediate
∼τ
tangent span; analyticity and depth
width, degree
Late
≪τ
posterior concentrated; compression cost vanishes
—
Appendix
Table 4: The three regimes of the sampling schedule, in the order sampling visits them.
At order k
Transformer block (one head), smooth φ
Low-rank Volterra layer
Kernel
ck[∑a(W2)ca(W1)a⋅⊗k]⊗Ai⋅⊗k
W(k) of equation 6 , rank at most hR
Slots
the same A in every slot; token rank one ( ≤nh with nh heads)
independent Qq(m) per slot
Across orders
one shared W1A ; ck fixed by φ
independent kernels
Wider sublayer
buys channel rank, never token rank
—
Appendix
Table 5: What each operator can parametrize at order k . The feed-forward sublayer does produce cross-token polynomial terms, but as a k -fold power of the attention matrix, scaled by a coefficient the architecture cannot choose. Shown for one head. With nh heads each slot draws from the same nh matrices.
Figure 5: Why a low-dimensional projection suffices (schematic). Noised inputs z lie in a tube of radius δ about the scaled data manifold tM . The clean signals consistent with z differ by moving along the manifold (tangent direction), not by leaving it, so the denoiser ft varies along the tangent direction and is nearly flat along the normal one. The bottleneck π keeps a d′ -dimensional image of the input. It sends z and x⋆ to the same point; this costs little, since ft takes nearly the same value at both. Further, it keeps x⋆ and x′ apart; this is essential, since ft takes different values at them.
pre-training
Method
token
perc.
self-sup.
params
GFLOPs
FID ↓
IS ↑
Latent-space diffusion
DiT-XL/2 ( Peebles and Xie, 2023 )
SD-VAE
VGG
–
675+49M
525
3.04
240.8
SiT-XL/2 ( Ma et al., 2024 )
SD-VAE
VGG
–
675+49M
525
2.62
252.2
REPA, SiT-XL/2 ( Yu et al., 2025 )
SD-VAE
VGG
DINOv2
675+49M
525
2.08
274.6
DDT-XL/2 ( Wang et al., 2026b )
SD-VAE
VGG
DINOv2
675+49M
525
1.28
305.1
Appendix
Table 6: Reference results on ImageNet 512×512 . Notation as in Table 1 . At this resolution the patch dimension is Dp=3072 , exceeding the hidden width of every model listed, so the bottleneck embedding is compressing by a larger factor than at 256 . Baseline numbers are as reported by Li and He (2026) .
Figure 6: Uncurated samples from PoD-G/16 on ImageNet 256×256 , mammals. Each row shows two classes, four samples each, with the ImageNet class index in parentheses. From the top, the rows show Chihuahua (151) and beagle (162); golden retriever (207) and cocker spaniel (219); Old English sheepdog (229) and boxer (242); Siberian husky (250) and Pomeranian (259); tabby (281) and Persian cat (283); Egyptian cat (285) and lion (291); tiger (292) and hyena (276); hare (331) and zebra (340).
Figure 7: Uncurated samples from PoD-G/16 on ImageNet 256×256 , birds, reptiles and other animals. Each row shows two classes, four samples each, with the ImageNet class index in parentheses. From the top, the rows show hen (8) and vulture (23); peacock (84) and macaw (88); goose (99) and black swan (100); flamingo (130) and pelican (144); vine snake (59) and boa constrictor (61); Indian cobra (63) and triceratops (51); jellyfish (107) and snail (113); king crab (121) and coral reef (973).
Figure 8: Uncurated samples from PoD-G/16 on ImageNet 256×256 , objects, food and nature. Each row shows two classes, four samples each, with the ImageNet class index in parentheses. From the top, the rows show castle (483) and dome (538); fountain (562) and space shuttle (812); cannon (471) and tractor (866); pizza (963) and bell pepper (945); espresso (967) and potpie (964); cliff (972) and rapeseed (984); yellow lady’s slipper (986) and mushroom (947); earthstar (995) and acorn (988).
Figure 9: Uncurated samples from PoD-G/32 on ImageNet 512×512 , animals. Each row shows two classes, four samples each, with the ImageNet class index in parentheses. From the top, the rows show goldfish (1) and cock (7); ostrich (9) and kite (21); vulture (23) and king snake (56); macaw (88) and flamingo (130); Sussex spaniel (220) and miniature poodle (266); jaguar (290) and cheetah (293); American black bear (295) and ice bear (296); hare (331) and marmoset (377).
Figure 10: Uncurated samples from PoD-G/32 on ImageNet 512×512 , objects, food and scenes. Each row shows two classes, four samples each, with the ImageNet class index in parentheses. From the top, the rows show cannon (471) and cliff dwelling (500); fountain (562) and fig (952); chocolate sauce (960) and pizza (963); burrito (965) and alp (970); coral reef (973) and valley (979); volcano (980) and daisy (985).