Streaming across viewing conditions - The effect of viewing distance and display luminance on video quality
Organizations: University of Cambridge, Cambridge, UK · Netflix, Inc., Los Gatos, CA, USA
Abstract
The visibility of streamed video distortions is affected by the user's display and viewing conditions, such as their display's luminance or the viewing distance. Distortions become less visible at lower luminance levels or farther viewing distances. However, most image and video quality metrics assume fixed optimal display and viewing conditions, making them insensitive to the viewing conditions. In this work, we demonstrate how existing metrics can be adapted to account for both factors and compare such an adaptation with the metrics that natively model viewing conditions. First, we collected a new video quality dataset, HDR-VDC, which contains streaming distortions in 4K HDR videos. The dataset consists of 12 4K and 4 FHD HDR source video content, each distorted with AV1 encoding and Lanczos upscaling from a lower resolution. The quality loss due to the distortions was measured at two viewing distances, corresponding to 60 and 120 pixels per visual degree, and two display mean luminance levels, varying by a factor of 8 in terms of luminance. Next, we developed a pre-processing framework that lets us adapt many quality metrics so that they can evaluate content across the viewing distances and luminance levels. The framework employs a display model and perceptually uniform encoding, PU21, to account for the effect of display luminance, and perspective projection scaling (PPS) to account for the effect of viewing distance. We used the framework to compare the performance of 35 state-of-the-art metrics. This allowed us to identify a selection of existing quality metrics that can be effectively adapted to account for the viewing conditions.
Figures & tables
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Video Content | HDR Content | Compression Distortions | Upscaling Distortions | Account for Viewing Distance | Account for Display Luminance | Publicly Available | Test Methodology |
|---|---|---|---|---|---|---|---|---|
| Liu et al. (2014) | No | No | Yes | No | Yes | No | Yes | ACR |
| Amirpour et al. (2021) | Yes | No | Yes | No | Yes | No | Yes | ACR |
| Sugito et al. (2022) | Yes | No | Yes | Yes | Yes | No | No | ACR |
| Kufa and Kratochvil (2019) | Yes | No | Yes | Yes | Yes | No | Yes | PC |
| Čadík et al. (2011) | Yes | Yes | Yes | No | No | No | Yes | DRM |
| Azimi et al. (2014) | Yes | Yes | Yes | No | No | No | No | DSIS |
| Source sequence index | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| High-quality encoding CRF | 7 | 9 | 9 | 5 | 9 | 9 | 9 | 9 | 7 | 7 | 11 | 7 | 9 | 7 | 7 | 7 |
| Medium-quality encoding CRF | 43 | 37 | 43 | 33 | 35 | 41 | 49 | 37 | 43 | 33 | 45 | 27 | 37 | 37 | 36 | 55 |
| Low-quality encoding CRF | 61 | 58 | 62 | 62 | 53 | 59 | 62 | 60 | 60 | 51 | 59 | 55 | 58 | 56 | 52 | 62 |
| Dataset | Content Type | Test Methodology | Viewing Distance [ ppd ] | Viewing Distance Effect Size | Display Luminance [ cd/m 2 ] | Display Luminance Effect Size |
|---|---|---|---|---|---|---|
| CID:IQ ( Liu et al., 2014 ) | SDR Images | ACR | 31.5 63 | 0.035 | - | - |
| VCIP21 ( Amirpour et al., 2021 ) | SDR Videos | ACR | 60 92 128 | 0.063 | - | - |
| VLIC ( Mikhailiuk et al., 2021b ) | SDR Images | 4AFC & QUEST | 30 60 | 0.109 | 220 10 | 0.305 |
| HDR-VDC | HDR Videos | Pairwise Comparison | 60 120 | 0.101 | 700 600 | 0.015 |
Video Quality Assessment
Video quality assessment measures perceived visual and temporal fidelity in captured, compressed, streamed, and generated videos.
See all 56 papers