Seeing Beyond 8bits: Subjective and Objective Quality Assessment of HDR-UGC Videos
Organizations: Laboratory for Image and Video Engineering (LIVE), UT Austin. · Google/YouTube
Abstract
High Dynamic Range (HDR) user-generated (UGC) videos are rapidly proliferating across social platforms, yet most perceptual video quality assessment (VQA) systems remain tailored to Standard Dynamic Range (SDR). HDR has a higher bit depth, wide color gamut, and elevated luminance range, exposing distortions such as near-black crushing, highlight clipping, banding, and exposure flicker that amplify UGC artifacts and challenge SDR models. To catalyze progress, we curate Beyond8Bits, a large-scale subjective dataset of 44K videos from 6.5K sources with over 1.5M crowd ratings, spanning diverse scenes, capture conditions, and compression settings. We further introduce HDR-Q, the first Multimodal Large Language Model (MLLM) for HDR-UGC VQA. We propose (i) a novel HDR-aware vision encoder to produce HDR-sensitive embeddings, and (ii) HDR-Aware Policy Optimization (HAPO), an RL finetuning framework that anchors reasoning to HDR cues. HAPO augments GRPO via an HDR-SDR contrastive KL that encourages token reliance on HDR inputs and a Gaussian weighted regression reward for fine-grained MOS calibration. Across Beyond8Bits and public HDR-VQA benchmarks, HDR-Q delivers state-of-the-art performance.
Figures & tables
| Model | LIVE-HDR | SFV+HDR | ||||||
| SROCC( ) | PLCC( ) | RMSE( ) | KRCC( ) | SROCC( ) | PLCC( ) | RMSE( ) | KRCC( ) | |
| DL models | ||||||||
| BRISQUE ( Mittal et al., 2012 ) | 0.7251 | 0.7139 | 12.6404 | 0.3424 | 0.4664 | 0.4186 | 0.3811 | 0.3165 |
| CONTRIQUE ( Madhusudana et al., 2022 ) | 0.8170 | 0.7875 | 11.2514 | 0.5876 | 0.5901 | 0.5959 | 0.3368 | 0.4204 |
| RE-IQA ( Saha et al., 2023 ) | 0.7196 | 0.6883 | 15.1653 | 0.5197 | 0.5822 | 0.5998 | 0.3072 | 0.4145 |
| VBLIINDS ( Saad et al., 2014 ) | 0.7483 | 0.7193 | 12.7794 | 0.2541 | 0.3335 | 0.2713 | 0.3988 | 0.2300 |
| Variant | HDR-Enc. | HAPO | HDR–SDR KL | Dual Ent. | HEW | Self-R. | PLCC | SRCC | RMSE | KRCC | CoT len | Tok. |
| GRPO baseline | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | 0.79 | 0.81 | 10.73 | 0.56 | 168 | 0.20 |
| GRPO + HDR-Enc. | ✓ | ✗ | ✗ | ✗ | ✗ | ✗ | 0.81 | 0.83 | 8.96 | 0.61 | 161 | 0.24 |
| HAPO w/o HDR–SDR KL | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | 0.84 | 0.86 | 7.10 | 0.64 | 142 | 0.29 |
| HAPO w/o Dual Ent. | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | 0.89 | 0.91 | 5.82 | 0.71 | 148 | 0.26 |
| HAPO w/o HEW | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | 0.87 | 0.88 | 6.11 | 0.68 | 155 | 0.27 |
| HAPO w/o Self-Reward | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | 0.90 | 0.92 | 5.22 | 0.71 | 140 | 0.31 |
Video Quality Assessment
Video quality assessment measures perceived visual and temporal fidelity in captured, compressed, streamed, and generated videos.
See all 52 papers