As the Internet of Things (IoT) becomes deeply embedded in daily life, users are increasingly concerned about privacy leakage, especially from video data. Since frame-by-frame protection in large-scale video analytics (e.g., smart communities) introduces significant latency, a more efficient solution is to selectively protect frames containing privacy objects (e.g., faces). Existing object detectors require fully decoded videos or per-frame processing in compressed videos, leading to decoding overhead or reduced accuracy. Therefore, we propose ComPrivDet, an efficient method for detecting privacy objects in compressed video by reusing I-frame inference results. By identifying the presence of new objects through compressed-domain cues, ComPrivDet either skips P- and B-frame detections or efficiently refines them with a lightweight detector. ComPrivDet maintains 99.75% accuracy in private face detection and 96.83% in private license plate detection while skipping over 80% of inferences. It averages 9.84% higher accuracy with 75.95% lower latency than existing compressed-domain detection methods.
Figures & tables
Fig. 1: The System Overview of ComPrivDet.
Fig. 2: Examples of Accumulated Motion Vectors and Accumulated Residuals.
τab
4e-3
8e-3
1.2e-2
1.6e-2
2e-2
τconf
Acc
RR
Lat
Acc
RR
Lat
Acc
RR
Lat
Acc
RR
Lat
Acc
RR
Lat
0.1
0.9569
63.87
0.9661
53.82
0.9811
40.16
0.9894
27.83
0.9975
23.55
0.2
0.9564
61.44
0.9656
54.02
0.9750
39.60
0.9811
26.81
0.9889
23.45
0.3
0.9564
26.22%
59.24
0.9656
41.58%
52.14
0.9750
65.06%
36.48
0.9811
77.83%
24.43
0.9889
84.75%
21.31
0.4
0.9564
57.98
0.9656
50.56
0.9750
35.63
0.9811
24.35
0.9889
20.38
0.5
0.9561
56.63
0.9644
46.62
0.9689
32.76
0.9731
24.59
0.9806
19.55
TABLE I: Evaluation of Accuracy, Reuse Ratio, Latency (ms) under Different τconf - τab Settings for Private Face Detection.
τab
4e-3
8e-3
1.2e-2
1.6e-2
2e-2
τconf
Acc
RR
Lat
Acc
RR
Lat
Acc
RR
Lat
Acc
RR
Lat
Acc
RR
Lat
0.1
0.9172
61.18
0.9219
55.92
0.9256
36.16
0.9442
27.74
0.9600
23.09
0.2
0.9256
61.16
0.9303
51.77
0.9339
36.53
0.9525
26.99
0.9683
21.62
0.3
0.9250
26.22%
59.67
0.9264
41.58%
48.29
0.9300
65.06%
35.58
0.9442
77.83%
25.91
0.9600
84.75%
22.28
0.4
0.9167
58.07
0.9181
48.42
0.9217
35.71
0.9358
25.47
0.9517
19.22
0.5
0.9167
56.03
0.9181
47.34
0.9217
33.57
0.9358
25.49
0.9517
19.93
TABLE II: Evaluation of Accuracy, Reuse Ratio, Latency (ms) under Different τconf - τab Settings for Private License Plate Detection.
Fig. 3: Evaluation of Abnormality Determination Latency Ratio.
Fig. 4: Comparison with Existing Pixel-Domain Detectors
Fig. 5: Comparison with Existing Compressed-Domain Frame-Level Detectors
Fig. 6: Comparison with Existing Compressed-Domain GOP-Level Detectors
Video anomaly detection (VAD) systems are increasingly deployed in safety critical environments and require a large amount of data for accurate detection. However, such data may contain personally identifiable information (PII), including facial cues and sensitive demographic attributes, creating compliance challenges under the EU General Data Protection Regulation (GDPR). In particular, GDPR requires that personal data be limited to what is strictly necessary for a specified processing purpose. To address this, we introduce Only What's Necessary, a privacy-by-design framework for VAD that explicitly controls the amount and type of visual information exposed to the detection pipeline. The framework combines breadth based and depth based data minimization mechanisms to suppress PII while preserving cues relevant to anomaly detection. We evaluate a range of minimization configurations by feeding the minimized videos to both a VAD model and a privacy inference model. We employ two ranking based methods, along with Pareto analysis, to characterize the resulting trade off between privacy and utility. From the non-dominated frontier, we identify sweet spot operating points that minimize personal data exposure with limited degradation in detection performance. Extensive experiments on publicly available datasets demonstrate the effectiveness of the proposed framework.
Deploying modern video trackers at scale is bottlenecked by the computational cost of RGB-based object detectors. To this end, we present MVTrack, an ultrafast tracker for moving objects that operates directly on H.264 bitstreams. MVTrack combines MVDet, a lightweight detector for motion vector fields, with MVLink, a minimalist kinematic association module. On VIRAT, MVTrack outperforms YOLO26n while using 60× fewer parameters, requiring 40× fewer FLOPs, and reducing CPU latency by 8.6×. These results demonstrate that compressed video data alone can enable accurate and scalable surveillance tracking, thereby bypassing the need for pixel reconstruction.
Iñaki Erregue, Kamal Nasrollahi, Sergio Escalera
Universitat de Barcelona · Computer Vision Center · Milestone Systems +1
Video anomaly detection (VAD) systems often prioritize accuracy while overlooking privacy concerns, limiting their suitability for real-world deployment. We propose the Orthogonal Projection Layer (OPL), a lightweight module that removes task-irrelevant variations to produce representations focused on anomaly-relevant cues. To address privacy risks in human-centered scenarios, we introduce Guided OPL (G-OPL), which suppresses facial attributes using weak supervision from face-presence signals while preserving non-identifying features such as pose and motion. A cosine alignment objective enforces consistent capture and removal of facial information without identity labels or adversarial training. We further present a privacy-aware evaluation framework that jointly assesses detection performance and privacy preservation, and enables analysis of how sensitive information is filtered. Experiments show that embedding privacy constraints into model design reduces sensitive information while maintaining or improving detection accuracy, supporting projection-based architectures as a principled approach for privacy-aware VAD.
Lei Wang, Wenxiang Diao, Andrew Busch +2
School of Engineering and Built Environment, Griffith University · Data61/CSIRO · School of Computer Science and Engineering, University of New South Wales +1