Contrastive learning for video reuse detection
Abstract
The incorporation of footage from other sources has long been a concern from a copyright perspective, as such usage can harm the interests of rights holders. Recent trends in the ``remixing'' of social media content and the development of bespoke stock libraries for specialist causes mean that methods to identify content reuse will have a range of applications. In this paper, we develop a framework based on a Siamese network fine tuned using contrastive learning to identify potential sources for key frames in a given video. This framework makes two contributions to analysis of large video datasets. Firstly, we demonstrate its utility at reducing complex video data to a set of key visuals typically less than 10% of the size of the full set. Secondly, we show that these reduced sets allow for efficient and effective identification of component footage. We test this method over a set of videos compiled from a stock footage library and demonstrate its effectiveness for constituent video identification with average accuracy greater than 0.95.
Figures & tables
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Video URL | Search term |
|---|---|
| https://pixabay.com/videos/people-walking-sun-sky-traffic-197531/ | people |
| https://pixabay.com/videos/human-person-walk-the-crowd-women-95193/ | people |
| https://pixabay.com/videos/boys-girls-group-friends-young-51337/ | people |
| https://pixabay.com/videos/hug-friends-talk-nature-people-159243/ | people |
| https://pixabay.com/videos/dance-music-to-dance-club-disco-1670/ | people |
| https://pixabay.com/videos/charity-village-people-help-ethnic-139400/ | people |
| Video URL | Search term |
|---|---|
| https://pixabay.com/videos/trees-forest-autumn-scenic-4k-185726/ | landscape |
| https://pixabay.com/videos/beach-sea-ocean-sand-drone-aerial-186115/ | landscape |
| https://pixabay.com/videos/ocean-waves-rocks-sand-coast-213026/ | landscape |
| https://pixabay.com/videos/beach-coastline-travel-tourism-161045/ | landscape |
| https://pixabay.com/videos/ocean-beach-sunset-waves-dawn-183960/ | landscape |
| https://pixabay.com/videos/bird-seagull-boat-ocean-sea-223461/ | landscape |
| Video URL | Search term |
|---|---|
| https://pixabay.com/videos/frog-reeds-green-113403/ | wildlife |
| https://pixabay.com/videos/mountains-forest-nature-sky-clouds-168787/ | wildlife |
| https://pixabay.com/videos/sea-ocean-seagulls-birds-sunset-140111/ | wildlife |
| https://pixabay.com/videos/snail-mollusk-creeping-animal-169471/ | wildlife |
| https://pixabay.com/videos/flower-bee-anemone-pink-insect-178826/ | wildlife |
| https://pixabay.com/videos/flower-peony-bee-insect-pollinate-165065/ | wildlife |
Video Representation Learning
Video representation learning develops features that capture appearance, motion, and temporal structure for recognition, prediction, and control.
See all 143 papers