Streaming-AAA: Streaming AAA Game Video Generation at High Resolution, High Frame Rate, and Low Latency
Organizations: Tencent AIPD
Abstract
Controllable streaming video generation offers a promising route toward interactive game simulation, yet existing methods remain far from practical gameplay. They often fail to jointly achieve high visual fidelity, high frame rates, and low interaction latency, resulting in poor responsiveness and degraded user experience. We present Streaming-AAA, a new paradigm for controllable infinite generation of AAA-quality game videos. Our system generates 1080p gameplay videos at 43 FPS with 198 ms end-to-end latency interaction on merely NVIDIA A800 GPUs, while supporting long-horizon play without severe temporal degradation or collapse. Streaming-AAA is built upon three key designs. First, we redesign the VAE architecture for efficient high-resolution decoding, enabling real-time synthesis at 1080p. Second, we pretrain the diffusion model using diffusion forcing and significantly extend the temporal training horizon, allowing the model to capture long-term dependencies and maintain persistent memory. Third, we perform post-training distillation and memory compression to improve inference efficiency while retaining visual quality and temporal consistency. Experiments show that Streaming-AAA substantially improves visual fidelity, frame rate, latency, and long-term stability over prior controllable video generation approaches, enabling a significantly more playable experience for interactive AAA game video generation.
Figures & tables
| Dataset Overview | |
| Total Videos | K |
| Video Duration | 1 min |
| Total Frames | M |
| Resolution | |
| Frame Rate | 30 |
| Coverage Area | > 5 KM 2 |
| Generation Quality | Efficiency | |||||||
| Method | Subject Consist. | Background Consist. | Motion Smooth. | Imaging Quality | Average | Resolution | Frame Rate ( ) | Latency ( ) |
| Lingbot | 0.689 | 0.876 | 0.983 | 0.438 | 0.747 | 720p | 2.6 FPS (8GPUs) | 8200 ms |
| YUME | 0.716 | 0.860 | 0.985 | 0.639 | 0.800 | 720p | 6.7 FPS | 6600 ms |
| Matrix Game 3.0 | 0.690 | 0.887 | 0.987 | 0.666 | 0.807 | 720p | 6.1 FPS | 9800 ms |
| HY-World1.5 | 0.755 | 0.906 | 0.988 | 0.589 | 0.810 | 480p | 2.1 FPS | 11300 ms |
| Ours | 0.761 | 0.910 | 0.982 | 0.677 | 0.832 | 1080p | 43.0 FPS | 198 ms |
Video Generation
Video generation studies models that create and edit moving images from text, images, audio, and structured controls.
See all 397 papers