CAMotion: A High-Quality Benchmark for Camouflaged Moving Object Detection in the Wild
Organizations: School of CyberScience and Technology, Sun Yat-sen University, Shenzhen Campus, Shenzhen 518107, China. · the College of Computing and Data Science, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798. · School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China.
Abstract
Discovering camouflaged objects is a challenging task in computer vision due to the high similarity between camouflaged objects and their surroundings. While the problem of camouflaged object detection over sequential video frames has received increasing attention, the scale and diversity of existing video camouflaged object detection (VCOD) datasets are greatly limited, which hinders the deeper analysis and broader evaluation of recent deep learning-based algorithms with data-hungry training strategy. To break this bottleneck, in this paper, we construct CAMotion, a high-quality benchmark covers a wide range of species for camouflaged moving object detection in the wild. CAMotion comprises various sequences with multiple challenging attributes such as uncertain edge, occlusion, motion blur, and shape complexity, etc. The sequence annotation details and statistical distribution are presented from various perspectives, allowing CAMotion to provide in-depth analyses on the camouflaged object's motion characteristics in different challenging scenarios. Additionally, we conduct a comprehensive evaluation of existing SOTA models on CAMotion, and discuss the major challenges in VCOD task. The benchmark is available at https://www.camotion.focuslab.net.cn, we hope that our CAMotion can lead to further advancements in the research community.
Figures & tables
| Dataset | Year | Publication | Type | #Img. | #Ann. Img. | #Species | Bbox. GT | Mask GT |
| CAD [ 5 ] | 2016 | ECCV | Video | 839 | 181 | 6 | ✗ | ✓ |
| CHAMELEON [ 2 ] | 2018 | - | Image | 76 | 76 | 27 ∗ | ✗ | ✓ |
| CAMO [ 1 ] | 2019 | CVIU | Image | 2,500 | 1,250 | 97 ∗ | ✗ | ✓ |
| COD10K [ 3 ] | 2020 | CVPR | Image | 10,000 | 5,066 | 69 | ✓ | ✓ |
| MoCA [ 7 ] | 2020 | ACCV | Video | 37,250 | 7,617 | 67 | ✓ | ✗ |
| CAMO++ [ 8 ] | 2021 | TIP | Image | 5,500 | 5,500 | 93 | ✓ | ✓ |
| Attr | Description |
| MO | Multiple Objects : image contains at least two objects. |
| BO | Big Object : ratio between object area and image area 0.15. |
| SO | Small Object : ratio between object area and image area 0.02. |
| UE | Uncertain Edge : the foreground and background areas around object have similar colors and textures. |
| OC | Occlusion : the object is partially occluded. |
| SC | Shape Complexity : object contains thin parts (e.g., animal foot). |
| Methods | Publications | CAMotion | MoCA-Mask | ||||||||||
| MGL-R [ 15 ] | CVPR’21 | 0.542 | 0.176 | 0.604 | 0.078 | 0.195 | 0.129 | 0.493 | 0.034 | 0.519 | 0.059 | 0.048 | 0.033 |
| PFNet [ 80 ] | CVPR’21 | 0.669 | 0.425 | 0.780 | 0.050 | 0.463 | 0.359 | 0.558 | 0.142 | 0.633 | 0.026 | 0.172 | 0.118 |
| UGTR [ 81 ] | ICCV’21 | 0.687 | 0.403 | 0.720 | 0.048 | 0.440 | 0.342 | 0.493 | 0.048 | 0.459 | 0.088 | 0.078 | 0.049 |
| SegMaR [ 76 ] | CVPR’22 | 0.645 | 0.377 | 0.695 | 0.049 | 0.402 | 0.311 | 0.542 | 0.129 | 0.544 | 0.024 | 0.139 | 0.093 |
| ZoomNet [ 13 ] | CVPR’22 | 0.675 | 0.440 | 0.693 | 0.044 | 0.456 | 0.365 | 0.582 | 0.201 | 0.682 | 0.026 | 0.236 | 0.197 |
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.