cs.CVNov 19, 2026

Zero to Four Views: Unified Panorama Generation and Preference RL for Unobserved Regions

Authors: Rui Hong, Xugang Ye, Jana Košecká, Kai Fan

Organizations: George Mason University · Independent Researcher

Abstract

Panoramas can serve as shared scene backgrounds for multi-shot video generation, but most existing panorama generators take text alone or a single input image. We present a single model that generates a full equirectangular panorama from a text caption and K in {0,...,4} perspective conditioning views taken by a four-camera rig at one viewpoint. We fine-tune a pretrained text-to-image rectified-flow transformer in two stages. In the first stage, each conditioning view is appended to the token sequence together with the ID of its camera slot, and the number of views varies during training, so one set of weights serves every input setting. In the second stage, we improve the region not covered by any conditioning view. Supervised training computes its loss on noisy latents of the ground truth and never scores a panorama the model has generated and decoded, so we propose Uncovered-Region GRPO (UR-GRPO), a reinforcement-learning recipe that rewards the candidates a vision-language model prefers in pairwise comparisons on crops around this region. Because the slot ID alone does not tell the model which way the rig points, we also offer an optional variant that writes each view's camera direction into its position encoding, which lets the user decide where each view appears in the output. With one conditioning view, our model outperforms the previous state of the art, 360Anything, trained on the same data and evaluated with the same code, on Laval Indoor and gives mixed results on an indoor subset of SUN360; the second stage improves the results for every number of conditioning views.

Figures & tables

Explore similar work

CardsList
  1. SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE

    Jun 30, 2026Or Hirschorn, Aaron Olender, Eli Alshan +3Video-Reference Video GenerationRotary Positional Embeddings

  2. Enhancing In-context Panoramic Generation via Geometric-aware Pretraining

    Jul 9, 2026Haoran Feng, Ruiyang Zhang, Longyi Zhang +2Conditional Image GenerationImage Generation