Communication-Efficient Private Federated Reinforcement Learning with Post-Quantum Authentication for Vehicular Networks
Authors: Hojat Allah Salehi, Devrim Aras, Md Jueal Mia, M. Hadi Amini, Imtiaz Karim, Mashrur Chowdhury, Bhavani Thuraisingham
Organizations: Knight Foundation School of Computing and Information Sciences, Florida International University, Miami, FL 33199, USA · Security, Optimization, and Learning for Interdependent Networks Lab (solid lab), Miami, FL 33199, USA · Department of Computer Science, The University of Texas at Dallas, Richardson, TX 75080, USA · Glenn Department of Civil Engineering, Clemson University, Clemson, SC 29634, USA
Federated reinforcement learning supports cooperative vehicular routing without centralizing trajectory data, but model updates may reveal private information and incur communication overhead over intermittent vehicle-to-infrastructure links, particularly when post-quantum authentication is required. We study correlated private quantization, using complementary shared randomness between paired vehicles to reduce aggregation mean squared error while preserving the marginal parameter-level local differential privacy and one-bit communication cost of independent quantization. A tunable extension mixes shared and independent randomness to bound privacy leakage given paired outputs and shared-randomness side information. For this extension, Rényi differential privacy accounting establishes vector-level local differential privacy for one model upload even when pairings are revealed. Under matched vector-level privacy and identical local and global parameters, the extension yields 16.5% lower analytical aggregation mean squared error than independent quantization. We evaluate cooperative routing by coupling traffic simulation with packet-level simulation of post-quantum-authenticated vehicle-to-infrastructure communication. Compared to full-precision updates, one-bit uploads reduce authenticated uplink size by 92.4% and increase mean verified updates aggregated per round from 19.6 to 26.5. Under mobility-constrained communication at a parameter-level privacy budget of 1, correlated private quantization reduces mean travel time by 14.3% relative to independent quantization at the same budget and communication cost. At a parameter-level privacy budget of 0.3, a vehicle-origin inference attack trained on independent simulations reaches 30% accuracy with correlated private quantization and 22% with independent quantization after 100 rounds, versus 91% without privacy and 10% for random guessing.
Figures & tables
Figure 1: Architecture of the proposed privacy-preserving and post-quantum-authenticated vehicular FRL framework. SUMO trajectories drive ns-3 V2I communication, with signed full-precision global-model downlinks and privacy-protected, signed model-update uplinks.
Mechanism
Calibration
MSE formula
MSE ↓
Bits/ weight
LDP-FL
s0=0.001185
A(s0)2/K
22.79
1
CPQ- λ
s=0.001010
(1−λ2)A(s)2/K
19.03
1
Gaussian
σ=33.76
σ2/K
22.79
32
Laplace
β=33.75
2β2/K
45.55
32
Table 1: Analytical FedAvg MSE under matched vector-level privacy.
Figure 2: Evolution of mean evaluation travel time across privacy budgets during federated training.
Mechanism
ϵp=0.3
ϵp=0.5
ϵp=1
ϵp=2
ϵp=5
A. Mean evaluation travel time (s) ↓
CPQ
165.3 ± 21.4
137.9 ± 59.7
144.7 ± 26.5
118.6 ± 23.1
125.7 ± 24.5
CPQ- λ ( λ=0.75 )
191.0 ± 36.4
178.8 ± 42.7
152.8 ± 17.5
141.1 ± 41.7
127.8 ± 11.9
LDP-FL
206.6 ± 33.2
199.5 ± 21.8
187.7 ± 25.3
126.7 ± 45.5
138.3 ± 38.3
Gaussian
412.8 ± 30.5
323.8 ± 56.4
226.2 ± 41.8
186.1 ± 30.9
164.6 ± 43.1
Laplace
257.1 ± 19.7
215.1 ± 19.6
196.9 ± 37.8
148.4 ± 15.9
121.5 ± 20.0
Table 2: Privacy–utility performance of federated routing across privacy budgets.
λ
ϵS
ϵC
MSE ( 10−5 )
Travel time (s)
Arrival (%)
LDP-FL
1.00
1.00
3.717±0.003
184±27
79±6
0.25
1.06
1.38
3.497±0.002
149±28
87±6
0.50
1.25
1.86
2.825±0.005
145±28
87±5
0.75
1.75
2.63
1.708±0.007
142±16
90±5
0.90
2.54
3.59
0.828±0.011
153±19
84±5
1
∞
∞
0.145±0.015
138±21
89±6
Table 3: CPQ- λ ablation at ϵp=1 .
Figure 3: Authenticated V2I communication under mobility-dependent connectivity using ML-DSA-44. Panels show wireless traffic, distance-dependent uplink attempt success, and successful-uplink latency.
Scheme
Update
UL size (KB)
Attempt success (%)
UL delivery (%)
ML-DSA-44
FP
113.60
32.2
74.7
CPQ
8.65
97.0
99.8
Falcon-512
FP
111.90
33.3
78.1
CPQ
6.89
99.4
99.8
SLH-DSA-SHA2-128f
FP
128.40
29.9
74.8
CPQ
23.34
48.2
93.1
Table 4: Signature-scheme sensitivity of V2I uplinks. FP denotes full-precision model updates.
Figure 8
Method
Travel (s) ↓
Arrival (%) ↑
DL reach (%) ↑
UL delivery (%) ↑
Updates per round ↑
ΔT (s)
No privacy
152.6±20.2
80.4±8.1
51.8±2.0
75.7±1.3
19.6±0.9
+40.8±56.4
CPQ
167.0±33.5
79.8±8.8
53.3±1.1
99.4±0.2
26.5±0.6
+22.4±35.8
CPQ- λ ( λ=0.75 )
177.2±41.5
75.8±9.2
52.4±0.3
99.5±0.3
26.1±0.2
+24.4±54.9
LDP-FL
194.9±53.0
72.8±11.0
53.4±1.2
99.4±0.3
26.5±0.5
+7.2±64.7
Gaussian
290.3±28.3
51.8±6.9
55.6±1.8
74.0±1.1
20.6±0.9
+64.1±48.7
Laplace
218.4±33.3
66.4±9.0
53.8±2.2
75.9±2.3
20.4±1.4
+21.5±50.1
Table 5: Routing performance and participation under mobility-constrained V2I communication.
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
Mechanism
One-bit configuration and equivalence conditions
Duchi et al. (2018)
Scalar case d=1 , with the input mapped to the common clipping interval [c−r,c+r] .
1BitMean ( Ding et al., 2017 )
Counter range [0,m] , with m=2r and input mapping u=x+r .
PBM ( Chen et al., 2022 )
One Bernoulli trial ( m=1 ), C=r , and θ=21tanh(ϵp/2) . The original constraint θ≤1/4 requires ϵp≤ln3 .
RQM ( Youn et al., 2023 )
Two output levels ( m=2 ), C=r , and Δ=2r/(eϵp−1) , using exact local-privacy calibration.
MVU ( Chaudhuri et al., 2022 )
One output bit, pure- ϵp -LDP, hard unbiasedness, and exact optimization on a grid containing the clipping endpoints. The unique optimum yields the LDP-FL reconstruction levels.
β -StoSign ( Xiang and Su, 2023 )
Centered input x=w−c , clipping bound r , and β=2r/(eϵp−1) . Reconstruction uses c±(r+β) , followed by arithmetic-mean aggregation.
Appendix
Table A.1: One-bit mechanisms equivalent to LDP-FL under specified configurations.
Figure F.1: Topology of the synthetic road network implemented in the SUMO environment. The network comprises 10 junctions (J0–J6 and J10–J12) and 30 directed edges (15 bidirectional corridors) covering a total distance of 5.37 km.
Parameter
Symbol
Value
State dimension
3M+4
94
Action space size
∣Amax∣
3
Network architecture
—
94–150–100–3
Optimizer
—
Adam
Learning rate
η
10−3
Discount factor
γ
0.99
Appendix
Table G.1: FLDQN configuration for the privacy–utility experiment.
Parameter
Symbol
Value
Chunk payload size
Lchunk
1200 B
Chunk header size
44 B
Initial window
W0
32 chunks
Maximum window
Wmax
128 chunks
Retransmission timeout
τrto
120 ms
Per-chunk retry cap
Rmax
8
Appendix
Table G.2: SR-ARQ transport parameters used in ns-3.
Component
Tool
Version
Traffic simulator
SUMO
1.26
Network simulator
ns-3
3.46
DQN training
TensorFlow (Keras)
2.x
Privacy processing
NumPy
1.x
FL coordination
Flower ( flwr )
1.x
PQC signatures and ML-KEM
liboqs / liboqs-python
0.15.0 / 0.14.1
Appendix
Table G.3: Software components and reported versions.
Algorithm
Basis
PK (B)
Sig. (B)
Keygen (ms)
Sign (ms)
Verify (ms)
ML-DSA-44
MLWE/MSIS
1312
2420
0.037±0.009
0.105±0.063
0.045±0.009
Falcon-512
NTRU/SIS
897
655.1
5.771±1.285
0.210±0.027
0.059±0.012
SLH-DSA-SHA2-128f
Hash
32
17088
0.989±0.086
23.078±1.377
1.412±0.110
SLH-DSA-SHA2-128s
Hash
32
7856
61.707±2.624
469.949±4.877
0.491±0.030
RSA-2048-PSS-SHA256
IFP
256
256
38.741±24.430
0.799±0.025
0.048±0.003
ECDSA-P256-SHA256
ECDLP
65
71.0
0.022±0.004
0.053±0.006
0.084±0.008
Appendix
Table H.1: Controlled signature microbenchmark on the evaluation workstation. Timing values are mean ± standard deviation in milliseconds over N=200 measured trials using 4096-byte messages.
Figure I.1: Distance-dependent uplink transfer-attempt success under IEEE 802.11p communication for three post-quantum signature schemes: (a) full-precision updates and (b) one-bit CPQ updates. Each point represents the percentage of successful uplink transfer attempts within the corresponding vehicle-to-RSU distance interval at transfer initiation ( ϵp=1 ).
Figure J.1: Seed-paired routing-performance differences between CPQ and LDP-FL.
K
Travel-time gain (s) ↑
Arrival-rate gain (pp) ↑
Faster seeds
10
42.0±142.0
8.6±31.1
3/5
25
61.8±43.5
10.8±10.0
5/5
50
43.1±26.5
8.8±12.4
5/5
Appendix
Table J.1: Population sensitivity at ϵp=1 .
Figure J.2: Seed-paired travel-time differences for CPQ- λ .
Figure J.3: Seed-level variability of late-round travel time and arrival rate across privacy budgets.
Figure J.4: Secondary routing-delay measures across privacy mechanisms and privacy budgets.
Figure K.1: Authenticated CPQ group-establishment progress across post-quantum signature schemes. All 49 recipients verified SETUP_OK after 7 (Falcon-512), 9 (ML-DSA-44), or 19 (SLH-DSA-SHA2-128f) communication drives. The vertical line marks the 20-drive setup limit.
In federated learning (FL), secure aggregation enables a server to compute the sum of local model updates of N clients, without revealing any information on the individual model updates to the server, beyond their sum. Different clients may be subject to heterogeneous bandwidth constraints, and consequently may choose different numbers of quantization levels to represent the information they send. Most secure aggregation works require the clients to project the values of their update parameters to a common finite group (or field), which does not directly accommodate heterogeneous precision constraints on their transmitted masked updates. Existing approaches of secure aggregation with heterogeneous quantization levels reveal partial aggregates of model-updates, and can reveal segments of individual model updates, under certain dropout and client-server collusion patterns. To prevent this privacy breach, we propose an information-theoretic secure aggregation scheme that tolerates client drop-outs, and up to T semi-honest clients that collude with each other and with the server, under heterogeneous quantization at clients. Our protocol utilizes the (T+1,N) threshold black-box secret sharing construction, where secret shares of the client updates, despite belonging to distinct algebraic groups owing to different quantization, are generated from identical linear integer systems.
Shreya Meel, Sennur Ulukus, Itzhak Tamo
Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA · Department of Electrical Engineering, Tel Aviv University, Tel Aviv, Israel
Federated Learning (FL) has become a foundational paradigm for privacy-preserving distributed intelligence, yet its scalability remains fundamentally constrained by communication bottlenecks, device heterogeneity, and the challenges of training under statistically non-IID data. Quantization is one of the most effective mechanisms for mitigating these limitations, reducing both uplink/downlink payloads and on-device computation. This paper provides the first FL-centric systematic review of quantization, introducing a novel taxonomy organized around FL-specific dimensions, including client heterogeneity, aggregation consistency, communication-scheduling adaptation, non-IID robustness, privacy/security integration, and hardware/energy co-optimization. Beyond cataloging existing methods, we analyze how quantization interacts with core FL behaviors such as client drift, partial participation, convergence stability, secure aggregation, and differential privacy. We further identify cross-method insights, open research gaps, and design guidelines for practitioners deploying quantized FL on mobile, IoT, and edge platforms. This survey thus establishes quantization not merely as a compression technique, but as a fundamental systems component shaping the performance, robustness, and practicality of modern FL.
As vehicular networks move toward 5G/6G edge intelligence, federated learning (FL) is widely promoted as a privacy-preserving way for vehicles and infrastructure to train shared models without exposing raw sensor data. Yet the updates clients transmit still leak enough information to identify who sent them, which threatens the anonymity that safety-critical V2X applications assume and adds to existing concerns over adversarial ML, model poisoning, and backdoor attacks. We study server-side client identity inference from transmitted weight deltas using inertial (IMU) measurements, evaluated on the UCI Human Activity Recognition (HAR) benchmark as an accessible proxy for the IMU streams produced onboard connected vehicles. Across five attack classifiers and five non-IID partitions, an honest-but-curious server recovers client identity with near-perfect accuracy (approximately 1.000) from undefended updates, confirming a concrete identifiability risk. We then quantify the privacy-utility trade-off of a lightweight clip-then-noise defense by sweeping Gaussian noise (sigma in {0.00, 0.05, 0.10, 0.20, 0.50, 1.00}) at fixed clipping (C=1.0), and report formal (epsilon, delta)-DP budgets through Renyi accounting. A practical region (sigma in [0.1, 0.2]) drives attack accuracy to near-random while costing under 5% relative FL accuracy. Ensemble FL supplies complementary structural privacy with a 1/K anonymity-set bound and no noise penalty. Results are supported by cryptographic (SHA-256) train/evaluation gradient disjointness, three seeds, and a count-normalized attacker-advantage metric. We position HAR explicitly as a proxy and discuss what validation on true vehicular telemetry would require.
Ali Akarma, Toqeer Ali Syed, Muhammad Khan +2
Islamic University of Madinah, Madinah, Saudi Arabia · King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia · AI Center, Faculty of Computer and Information Systems Islamic University of Madinah, Madinah 42351, Saudi Arabia +2