OpenSAL360: Open-Source Crowdsourcing Platform for Omnidirectional Video Saliency Collection
Organizations: AI Center, Lomonosov Moscow State University MSU Institute for Artificial Intelligence Moscow, Russia · AI Center, Lomonosov Moscow State University MSU Institute for Artificial Intelligence, FusionBrain Lab Moscow, Russia · Lomonosov Moscow State University Moscow, Russia · MSU Institute for Artificial Intelligence Moscow, Russia
Abstract
Omnidirectional video saliency prediction plays an important role in many immersive multimedia applications, including viewport-adaptive streaming and compression, foveated rendering, mesh simplification, perceptual quality assessment. Yet progress in this area remains constrained by the cost and complexity of collecting eye-tracking data with VR headsets, which makes large-scale dataset creation difficult to extend. We present OpenSAL360, the first open-source platform for scalable, low-cost 360° video saliency collection. Unlike conventional VR-based protocols, it requires only a standard screen, mouse, and internet connection, enabling parallel saliency data collection from common crowdsourcing assessors without specialized hardware. We validate our collection protocol against seven well-established VR eye-tracking datasets and conduct ablation studies on key interface, pre-, and post-processing parameters. To demonstrate the effectiveness and scalability of the proposed methodology, we collect and publicly release a saliency dataset covering 500 omnidirectional videos annotated by 2,000+ crowdsourcing assessors, making it, to the best of our knowledge, the largest dataset in this field. We make OpenSAL360 publicly available at https://github.com/msu-video-group/OpenSAL360.
Figures & tables
| Dataset (Year) | Video Sources | Tracking Sources | Unique Videos | Duration (s) | Participants All/Per Video | Resolution | Audio |
|---|---|---|---|---|---|---|---|
| PVS-HMEM (2018) ( Xu et al., 2018a ) | YouTube/VRCun | HTC Vive/aGlass2 | 76 | 10–80 | 58 / 58 | 3K–8K | ✗ |
| Salient360! (2018) ( David et al., 2018 ) | YouTube | HTC Vive/SMI | 19 | 20 | 57 / 57 | 3840 1920 | ✗ |
| VR-EyeTracking (2018) ( Xu et al., 2018b ) | YouTube | HTC Vive/aGlass | 208 | 20–60 | 45 / 31 | 4K | ✓ |
| VQA-ODV (2018) ( Li et al., 2018 ) | YouTube | HTC Vive/aGlass | 60 | 10–23 | 221 / 23 | 4K–8K | ✓ |
| SD360 (2018) ( Zhang et al., 2018 ) | Sports-360 | HTC Vive/aGlass | 104 | 20–60 | 27 / 20 | 4K | ✗ |
| 360_EM (2019) ( Agtzidis et al., 2019 ) | YouTube | FOVE VR headset | 15 | 38–60 | 13 / 13 | 1K–4K | ✓ |
| Method | ||||||
| PAVER ( Yun et al., 2022 ) | 0.2238 | 0.2267 | 1.0675 | |||
| ATSal ( Dahou et al., 2021 ) | 0.2337 | 0.2564 | 1.5945 | |||
| SST-Sal ( Bernal-Berdun et al., 2022 ) | 0.3213 | 0.3157 | 2.0526 | |||
| ViNet ( Jain et al., 2021 ) (ERP) | 0.3848 | 0.3373 | 2.0240 | |||
| SVGC-AVA ( Yang et al., 2023 ) | 0.4288 | 0.3717 | 2.2341 | |||
| SalFoM ( Moradi et al., 2024 ) (ERP) | 0.4309 | 0.3624 | 2.3717 | |||
Visual Saliency
Visual saliency studies which image and video regions attract attention or matter for a task, and how to predict or explain that importance.
See all 29 papers