BR-MoE: Budgeted Semantic Release for Privacy-Preserving Traffic Analytics
Organizations: Department of Computer Science, Texas A&M University–Corpus Christi, Corpus Christi, TX 78412, USA
Abstract
Traffic cameras support useful analysis, but their outputs can reveal private information. Replacing images with text reduces direct visual exposure. It does not place a formal bound on disclosure. The published reinforcement learning and mixture-of-experts framework refines scene descriptions through relevance, coverage, and brevity rewards. It does not account for repeated releases under a fixed privacy budget. This paper proposes budgeted semantic release as an extension of that framework. Four scene experts first process isolated video chunks. Their outputs are mapped to a fixed, bounded semantic schema. A reinforcement learning controller selects which expert summaries to release and how much privacy budget to spend. The controller uses public task requests and previous private releases. A separate privacy filter enforces the total budget. Calibrated noise is added before the summaries are converted to text. Under explicit chunk isolation and bounded-event assumptions, the complete release transcript satisfies an event-level differential privacy bound. The design also supports reuse of previous summaries without new disclosure. An evaluation protocol covers traffic utility, privacy attacks, release freshness, and computational cost. Illustrative tables show the intended reporting format. They do not establish empirical gains. The proposed contribution is a task-aware release interface with auditable privacy accounting for repeated traffic descriptions.
Figures & tables
| Work | Main output or objective | Privacy scope | Relation to this study |
|---|---|---|---|
| RL-MoE [ 3 ] | Refined scene descriptions | Empirical privacy evaluation | Source architecture; lacks a release accountant. |
| VTPM [ 7 ] | Pedestrian activity reports | Identity-related information removal | Relevant semantic-report baseline. |
| DP-Cap [ 5 ] | Learned visual representations | Training image–caption records | Does not sanitize new inference inputs. |
| SPTI [ 9 ] | Synthetic images via text | Entries in a private dataset | Batch synthesis; not a live-caption benchmark. |
| Privid [ 12 ] | Aggregate video query answers | Bounded-duration events | Foundation for isolated chunk processing. |
| GeoPrivd [ 13 ] | Geospatial traffic query answers | Trajectory-level influence control | Closely related analytics system; different release objective. |
| Expert | Components | ||
|---|---|---|---|
| Traffic | Moving; stopped vehicles | 2 | 20 |
| Pedestrian | Walking; waiting pedestrians | 2 | 6 |
| Signs | Stop; speed-limit; other sign; no sign | 4 | 1 |
| Environment | Clear; rain; fog; other weather | 4 | 1 |
| Source | Intended role | Labels needed | Split and scope control |
|---|---|---|---|
| CityFlow [ 25 ] | Main fixed-camera traffic stream; vehicle attack audit | Occupancy and motion; existing vehicle identities where available | Sequence and identity separation; report camera coverage. |
| BDD100K [ 26 ] | Perception and domain-shift evaluation | Pedestrian states and coarse signs; available scene labels | Keep official sequence separation; use actual clip lengths. |
| MINT-V2X [ 18 ] | Public simulation for controller stress tests | Task targets derived from documented simulation fields | Split complete runs or contiguous periods; no visual-privacy claim. |
| New annotated subset | Joint four-expert evaluation | All twelve schema components and task labels | Publish selected sequences and annotations; no invented sample size. |
| Parameter | Starting value |
|---|---|
| Chunk duration; fixed frame sampling | 2 s; 2 frames/s |
| Main window; report cadence | 60 s; 60 s |
| Benchmark episode | 10 min; 10 report slots |
| Protected changed chunks | 2; test 5 and 10 |
| Episode budget | 4; test 2 and 8 |
| Release amount | 0, 0.1, 0.2, 0.4, 0.8 |
| Method | Vehicle MAE | Ped. MAE | Sign macro-F1 | Event AUC | Coverage (%) | P95 time (s) |
|---|---|---|---|---|---|---|
| Original-image release reference | 0.80 | 0.35 | 0.91 | 0.90 | 100 | 1.2 |
| RL-MoE, re-run protocol | 1.40 | 0.70 | 0.85 | 0.79 | 100 | 4.8 |
| RL-MoE + field removal | 1.70 | 0.90 | 0.82 | 0.72 | 100 | 4.9 |
| Uniform-DP | 7.20 | 2.80 | 0.44 | 0.55 | 100 | 3.1 |
| Task-DP | 6.10 | 2.40 | 0.51 | 0.56 | 100 | 3.2 |
| Periodic-DP + reuse | 5.80 | 2.20 | 0.55 | 0.57 | 90 | 3.0 |
| Variant | Utility | Age (s) | Valid |
|---|---|---|---|
| BR-MoE (proposed) | 0.61 | 42 | Yes |
| Fixed task schedule | 0.57 | 0 | Yes |
| No reuse (return missing) | 0.49 | 0 | Yes |
| No task conditioning | 0.53 | 48 | Yes |
| Raw-feature gate (unsafe) | 0.68 | 30 | No |
| Utility | Event AUC | Coverage (%) | ||
|---|---|---|---|---|
| 2 | 2 | 0.48 | 0.53 | 65 |
| 2 | 4 | 0.61 | 0.56 | 80 |
| 2 | 8 | 0.69 | 0.61 | 95 |
| 5 | 4 | 0.43 | 0.54 | 72 |
| 10 | 4 | 0.30 | 0.52 | 60 |
| Allocation | ||||
|---|---|---|---|---|
| Uniform four experts | 2 | 0.8 | 0.1 | 8.0 |
| Pedestrian only | 2 | 0.8 | 0.4 | 2.0 |
| Uniform four experts | 5 | 2.0 | 0.1 | 20.0 |
| Pedestrian only | 5 | 2.0 | 0.4 | 5.0 |
Privacy-Preserving ML
Privacy-preserving machine learning develops methods to learn, share, and run models while limiting exposure of sensitive data.
See all 433 papersDifferentially Private Semantic Plans for Aggregate Insight Generation
URANIA provides end-to-end differential privacy (DP) for summaries of data-dependent clusters. However, its cluster--keyword release does not directly provide collection-wide aggregates for semantic concepts defined independently of the protected corpus. Records may express several concepts, records expressing the same concept may be assigned to different clusters, and cluster identities need not correspond across analyses. Consequently, cluster-level statistics do not directly provide comparable measurements of predefined concepts across collections or repeated analyses. We introduce DP-SPIN, a trusted-curator framework for aggregate measurement and summarization over semantic concepts fixed independently of the protected target records. Each record is mapped to a bounded sparse nonnegative vector over these concepts, whose sum forms a semantic sketch. A differentially private mechanism releases a semantic plan containing admitted concepts and noisy masses; normalized semantic-support values and support bins are obtained by post-processing. For user-level privacy, each user's aggregate contribution is clipped to a fixed bound. The language model receives only the plan and fixed decoding instructions, while a public verifier checks concept mentions, reported values, comparisons, and rank claims against the released plan. The final summary is differentially private by post-processing. We establish record- and user-level DP guarantees under add/drop and replacement adjacency. We evaluate DP-SPIN under record-level privacy on CFPB complaint narratives, Amazon All Beauty reviews, and Yelp restaurant reviews, and under user-level privacy on Amazon and Yelp. We compare DP-SPIN with non-private plan and summary references, DP keyword and category histogram baselines, and a URANIA-style baseline with a fixed public keyword vocabulary.