cs.CVNov 13, 2026

JVT: Just Video Transformer makes pixel-space video diffusion simple

Authors: Jianjun Zhou, Hua Geng, Haoyu Guo

Organizations: Zhejiang University · Shanghai Innovation Institute · Shanghai AI Laboratory

Abstract

Direct diffusion modeling of high-dimensional raw video data is challenging, and existing pixel-space methods often rely on specialized architectures. We introduce JVT (Just Video Transformer), a simple large-patch DiT-style Transformer for pixel-space video diffusion, without a pretrained autoencoder, auxiliary detailers, cascaded stages, or U-Net-style skip connections. We systematically examine video patch embeddings, register tokens, and adaptive layer normalization to identify design choices that balance generation quality and computational efficiency. The resulting JVT design achieves generation quality competitive with latent diffusion baselines in both class-conditioned and unconditional settings. The pixel-space formulation of JVT also naturally supports joint generation of pixel-aligned modalities. We demonstrate this capability through camera-conditioned RGB-disparity generation, which improves camera following relative to RGB-only baselines and yields explicit scene geometry without an additional reconstruction model at inference. These results highlight the potential of simple DiT-style Transformers for pixel-space video diffusion, and we hope our findings offer useful insights and practical guidance for future research.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Pixel-space video generation with U-JiT

    Nov 3, 2026Théophane Vallaeys, Jakob Verbeek, Matthieu CordHigh-Resolution Video Generation

  2. Pixel-Space Diffusion Transformers

    Jul 20, 2026Renye Yan, Jikang Cheng, You Wu +8Diffusion TransformerPixel-Space Diffusion Models

  3. Back to Pixels: Lifting Latent Video Diffusion into Pixel Space

    Nov 12, 2026Yanke Song, Shuo Chen, Chris Rockwell +9Video Diffusion ModelsHigh-Resolution Video Generation