Squaring-the-Sphere: Distortion-Free and Seamless Panorama Generation via CubeAtlas
Organizations: Tencent
Abstract
Generating 360-degree panoramas requires both local perspective fidelity and global spherical continuity. Existing representations face a trade-off: equirectangular projection (ERP) enables seamless panorama modeling but suffers from severe distortion and a domain gap to pre-trained image generators, whereas cubemaps preserve perspective geometry but often produce inconsistent faces and visible seams. We present Squaring-the-Sphere, a panoramic image generation framework built on a novel representation CubeAtlas, which unfolds all cubemap faces into a single compact canvas. By arranging orientation-aligned, rotated polar regions alongside the equatorial faces, this representation preserves the perspective geometry of cubemaps while organizing the cross-face relationships required for seamless panorama assembly. It further enables a pretrained diffusion transformer to model the complete panorama jointly in a single pass, without altering the backbone architecture or positional encoding. While CubeAtlas has a token count comparable to ERP, its structured layout makes many dense attention interactions unnecessary. We therefore introduce a layout-aware sparse attention mask that preserves the interactions required for panorama continuity while removing geometrically irrelevant token pairs. As a result, CubeAtlas achieves better quality than ERP modeling with lower attention computation. Furthermore, we introduce a training-free super-resolution technique and a fusion scheme that enhance fine details in distortion-free perspective space before achieving the final ERP panorama. Experiments on various benchmarks demonstrate that our method improves geometric fidelity, cross-view consistency, and high-resolution visual quality over previous methods.
Figures & tables
| Method | FID | KID | CLIP-FID | Seam | Seam | Eq-IQ | Eq-Aes | Eq-GI | Pole-IQ | Pole-GI | TextAdh |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Self-Collected | |||||||||||
| CubeDiff | - | - | - | 0.0126 | 0.0361 | 3.685 | 3.565 | 3.465 | 3.780 | 3.725 | 4.100 |
| DreamCube | - | - | - | 0.0279 | 0.0445 | 2.730 | 2.605 | 2.607 | 2.870 | 2.935 | 3.490 |
| HunyuanPano | - | - | - | 0.0154 | - | 4.475 | 4.247 | 4.468 | 4.495 | 4.120 | 4.300 |
| HY-Pano-2.0 | - | - | - | 0.0199 | - | 4.580 | 4.355 | 4.480 | 4.705 | 4.685 | 4.470 |
| Ours | - | - | - | 0.0142 | 0.0132 | 4.690 | 4.402 | 4.782 | 4.675 | 4.730 | 4.640 |
| Computational Profile | Quality and Continuity | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Variant | Tokens | Time | Eq-IQ | Eq-Aes | Eq-GI | Pole-IQ | Pole-GI | TextAdh | ||
| ERP | 0.0209 | – | 4.607 | 4.370 | 4.575 | 4.690 | 4.660 | 4.550 | ||
| Cubemap | 0.0147 | 0.0260 | 4.428 | 4.270 | 4.332 | 4.490 | 4.455 | 4.560 | ||
| CubeAtlas | 0.0103 | 0.0143 | 4.697 | 4.353 | 4.690 | 4.705 | 4.705 | 4.640 | ||
| + Sparse Attn. | 0.0142 | 0.0132 | 4.690 | 4.402 | 4.782 | 4.675 | 4.730 | 4.640 | ||
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
| Metric | Eq-IQ | Eq-Aes | Pole-IQ | Eq-GI | Pole-GI | TextAdh |
|---|---|---|---|---|---|---|
| Spearman | 0.9358 | 0.8820 | 0.8757 | 0.9281 | 0.7698 | 0.8804 |
| Computational Profile | Quality and Continuity | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Variant | Tokens | Time | Seam | Seam | Eq-IQ | Eq-Aes | Eq-GI | Pole-IQ | Pole-GI | TextAdh |
| Half-polar | 0.0103 | 0.0143 | 4.697 | 4.353 | 4.690 | 4.705 | 4.705 | 4.640 | ||
| + Sparse Attn. | 0.0142 | 0.0132 | 4.690 | 4.402 | 4.782 | 4.675 | 4.730 | 4.640 | ||
| Full-polar | 0.0106 | 0.0134 | 4.610 | 4.410 | 4.670 | 4.660 | 4.710 | 4.580 | ||
| + Sparse Attn. | 0.0103 | 0.0136 | 4.620 | 4.410 | 4.720 | 4.660 | 4.680 | 4.620 | ||
Image Generation
Image generation studies models that create or edit images from text, examples, layouts, and other structured controls.
See all 463 papers