cs.CVAug 3, 2024

Graph Unfolding and Sampling for Transitory Video Keyframe Selection via Gershgorin Disc Alignment

Authors: Sadid Sahami, Gene Cheung, Chia-Wen Lin

Organizations: Institute of Communications Engineering, National Tsing Hua University, Hsinchu, Taiwan · York University, Toronto, Canada · Department of Electrical Engineering and the Institute of Communications Engineering, National Tsing Hua University, Hsinchu, Taiwan

Abstract

User-generated videos (UGVs) uploaded from mobile phones to social media sites like YouTube and TikTok are short and non-repetitive. We summarize a transitory UGV into several keyframes in linear-time via fast graph sampling based on Gershgorin disc alignment (GDA). Specifically, we first model a sequence of NN frames in a UGV as an MM-hop path graph \cGo\cG^o for M≪NM \ll N, where the similarity between two frames within MM time instants is encoded as a positive edge based on feature similarity. Towards efficient sampling, we then ``unfold'' \cGo\cG^o to a 11-hop path graph \cG\cG, specified by a generalized graph Laplacian matrix \cL\cL, via one of two graph unfolding procedures with provable performance bounds. We show that maximizing the smallest eigenvalue λmin⁡(\B)λ_{\min}(\B) of a coefficient matrix \B=\diag\h+μ\cL\B = \diag{\h} + μ\cL, where \h\h is the binary keyframe selection vector, is equivalent to minimizing a worst-case signal reconstruction error. We maximize instead the Gershgorin circle theorem (GCT) lower bound λmin⁡−(\B)λ^-_{\min}(\B) by choosing \h\h via a new fast graph sampling algorithm that iteratively aligns left-ends of Gershgorin discs for all graph nodes (frames). Experiments on multiple short video datasets show that our algorithm achieves comparable or better keyframe selection performance compared to state-of-the-art methods, at a substantially reduced complexity.

Explore similar work

CardsList
  1. Swift Sampling: Selecting Temporal Surprises via Taylor Series

    May 21, 2026Dahye Kim, Bhuvan Sachdeva, Karan Uppal +3SurprisalCoefficients