cs.CVNov 18, 2026

FlyVQA: Seeing Video Frame Interpolation Quality through Fly Eyes

Authors: Baoliang Chen, Lingyu Zhu, Zhiwei Zhong, Shiqi Wang

Organizations: City University of Hong Kong

Abstract

The ultimate ambition of visual quality assessment is to reproduce the neural computations of human vision and thereby achieve full alignment with human perception. However, the immense complexity of human visual circuitry makes this goal difficult to realize. Recently released fly visual connectomes provide a tractable biological starting point. Despite differences between fly and human vision, the fly's well-characterized motion pathways motivate us to investigate their potential for assessing the perceptual impact of temporal distortions. In this paper, we use a shared, frozen fly visual circuit to perform full-reference quality assessment of frame-interpolated videos, whose artifacts can disrupt temporal consistency. Specifically, compound-eye sampling maps reference and distorted sequences into the circuit, while a connectome-aware readout quantifies discrepancies in cell-type-specific activity and excitatory--inhibitory synaptic dynamics. Reference-guided temporal pooling and a lightweight regression head integrate these differences into a quality score. Experiments across multiple interpolation methods demonstrate better agreement with human ratings than CNN, RNN, and Transformer baselines with comparable parameters, supporting a biologically grounded approach to perceptual quality modeling.

Figures & tables

Explore similar work

CardsList
  1. Pioneering Perceptual Video Fluency Assessment: A Novel Task with Benchmark Dataset and Baseline

    Mar 27, 2026Qizhi Xie, Kun Yuan, Yunpeng Qu +3

  2. Measuring Robustness and Efficiency in a Connectome-Constrained Fly Visual System Model: Linking an Adversarial and a Perceptual Illusion

    Nov 10, 2026Alexandre Garcia-Duran, Alejandro Rodriguez-Garcia, Manuel Molano-Mazón +3Neural Network RobustnessAdversarial Robustness

  3. Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment

    Apr 18, 2026Minghao Zou, Gen Liu, Guanghui Yue +5Video Quality AssessmentVideo Generation Evaluation