cs.CVOct 27, 2026

Explicit Regional Representations For Video Quality Assessment

Authors: Fuyi Yang, Lei Yang, Andrew Liu, Chenyu Wei, Xiaoyi Guo, Ming Kai Hsu

Organizations: University of California, Los Angeles · Transtreams Technologies, Inc. · University of Southern California · University of Wisconsin–Madison · 

Abstract

End-to-end video quality assessment (VQA) methods leave the regional evidence underlying their predictions largely implicit. We introduce an explicit pixel-level regional representation for VQA, instantiated as a Quality-Relevance Heatmap (QRH) that combines localized degradation evidence with perceptual priors under vision-language model guidance, without requiring pixel-level annotations. We apply QRH to existing VQA models through two deterministic fragment-sampling strategies: distribution-preserving sampling approximates the original sampler's QRH-score distribution without retraining, while quality-aware sampling prioritizes regions with high QRH scores and is paired with fine-tuning. Experiments with DOVER on multiple benchmarks show that the former closely approximates predictions averaged over random samples, while the latter improves most evaluated metrics across popular VQA benchmarks. These results support explicit regional representations as a useful interface for downstream VQA.

Figures & tables

Explore similar work

CardsList
  1. VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessment

    May 20, 2026Shibei Meng, Binxin Yang, Yuan Liu +4Pairwise ComparisonLearning to Rank

  2. High-Fidelity Video Quality Assessment with VQA-Specific Saliency

    Sep 15, 2026Hakan Emre Gedik, Shashank Gupta, Alan BovikVideo Quality Assessment

  3. DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment

    Apr 14, 2026Xinyue Li, Shubo Xu, Zhichao Zhang +3Video Quality AssessmentVLM Calibration