JEPAs often regularize one-view embeddings toward an isotropic Gaussian, implicitly baking Euclidean symmetry into the representation. We show that this is not merely a benign default. For a known structured downstream geometry
H≻0, the minimax and maximum-entropy covariance under a Hamiltonian energy budget is
(c/d)H−1, and Euclidean isotropy incurs a closed-form price of isotropy. More importantly, when the downstream geometry is unknown, no geometry-independent fixed marginal target is canonical: every fixed covariance shape can be maximally misaligned for some structured geometry. We further show that even oracle one-view marginals do not identify the JEPA view-to-view predictive coupling. Within continuous linear phase-space flows, stationarity of the lifted oracle law, momentum reversal, and fixed-unit kinematics uniquely select Hamiltonian dynamics. These results suggest that the structural bias in JEPAs should enter the cross-view coupling rather than a fixed encoder marginal. We instantiate this principle with
HamJEPA, which encodes each view as a phase-space state
(q,p) and predicts view-to-view transitions with a learned Hamiltonian leapfrog map, while non-isotropic scale and spectral floors discourage collapse. In a deliberately headless token protocol, HamJEPA improves over SIGReg on CIFAR-100 by
+4.89 kNN@20 and
+3.52 linear-probe points at 30 epochs, and, over two training seeds at 80 epochs, by
+7.24 kNN@20 and
+9.67 linear-probe points relative to the full 2048-dimensional SIGReg representation. Matched non-symplectic and non-reversible controls retain the gain, so the experiments do not identify either property as individually necessary. On ImageNet-100, HamJEPA-
q improves by
+4.82 kNN@20 and
+7.52 linear-probe points at 45 epochs.