LR-V2X: Loss-Resilient Collaborative Perception under Low-Bandwidth Communication
Organizations: Renmin University of China · The Hong Kong University of Science and Technology (HKUST) · Hebei Key Laboratory of Real-virtual Integrated Autonomous Systems (RIAS)
Abstract
Given the inherent unpredictability of packet loss in vehicular wireless communications, V2X collaborative perception can yield practical benefits only if agents can achieve reliable collaboration under lossy and low-bandwidth communication conditions. Existing dense BEV feature fusion methods depend on redundant BEV feature exchange, which is infeasible in low-bandwidth scenarios, while compact-communication methods aggressively compress messages but can hardly recover the missing feature content after packet loss. In this paper, we present LR-V2X, a loss-resilient, latent-space reconstruction framework that converts corrupted received latents (even under severe 90% packet loss) into a spatial prior and then reconstructs the missing BEV information from this informative prior and using ego context as condition. Notably, the model can be trained under complete communication conditions and can be directly applied to lossy conditions at test time, eliminating the need for training under numerous lossy conditions. Experiments on DAIR-V2X and V2XREAL show that LR-V2X delivers the strongest robustness under severe packet loss and preserves reliable collaboration as communication quality degrades. And it reduces communication overhead by compared to dense BEV feature fusion baselines. Code will be released at https://github.com/sidiangongyuan/LR-V2X.
Figures & tables
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| Models | Short | Middle | Long | mAP (%) | Comm | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.3 | 0.5 | 0.7 | 0.3 | 0.5 | 0.7 | 0.3 | 0.5 | 0.7 | 0.3 | 0.5 | 0.7 | ||
| F-Cooper | 79.15 | 76.03 | 65.84 | 76.34 | 71.05 | 56.56 | 55.91 | 50.68 | 37.78 | 69.88 | 65.08 | 52.12 | 8MB |
| CodeFilling | 78.02 | 76.29 | 66.81 | 71.36 | 68.42 | 55.72 | 50.26 | 47.19 | 36.63 | 65.36 | 62.62 | 51.48 | 128KB |
| LR-V2X | 79.96 | 77.53 | 66.97 | 74.15 | 70.22 | 56.38 | 52.70 | 48.75 | 36.99 | 67.83 | 64.21 | 51.93 | 128KB |
| Method class | Bandwidth | Retained ( ) | Rel. retained |
|---|---|---|---|
| Dense BEV feature fusion (e.g., F-Cooper) | 8 MB | 819.2 KB | |
| Medium compression ( 2) | 2 MB | 204.8 KB | |
| Our default ( 8) | 128 KB | 12.8 KB | |
| Aggressive ( 16) | 32 KB | 3.2 KB |
| Method | Dense Native (8 MB) | Budget-Matched (128 KB) | |||||||
|---|---|---|---|---|---|---|---|---|---|
| [email protected] | [email protected] | [email protected] | FPS | [email protected] | [email protected] | [email protected] | FPS | [email protected] | |
| Attn | 66.87 | 66.20 | 52.56 | 6.67 | 62.99 | 60.25 | 48.65 | 6.91 | -5.95 |
| F-Cooper | 67.89 | 65.90 | 52.87 | 5.39 | 63.24 | 61.67 | 48.67 | 9.30 | -4.23 |
| CoBEVT | 68.83 | 63.55 | 44.47 | 4.92 | 67.73 | 62.85 | 52.99 | 5.30 | -0.70 |
| V2X-VIT | 68.78 | 64.33 | 50.97 | 4.70 | 64.69 | 60.53 | 49.21 | 5.32 | -3.80 |
| HEAL | 64.43 | 61.68 | 50.50 | 7.24 | 60.81 | 58.08 | 47.25 | 10.00 | -3.60 |
| Condition | mAP (%) | ||||
|---|---|---|---|---|---|
| Ego feat. | Trans. mat. | Latent feat. | [email protected] | [email protected] | [email protected] |
| 67.28 | 63.71 | 52.01 | |||
| ✓ | 78.90 | 74.15 | 55.77 | ||
| ✓ | ✓ | 79.69 | 75.34 | 56.56 | |
| ✓ | 67.30 | 63.75 | 52.04 | ||
| ✓ | ✓ | 68.30 | 64.74 | 53.04 | |
| Downsample | [email protected] | [email protected] | [email protected] | Comm |
|---|---|---|---|---|
| 2 | 82.55 | 77.64 | 59.42 | 2MB |
| 4 | 81.52 | 76.79 | 58.52 | 512KB |
| 8 | 81.03 | 76.16 | 57.74 | 128KB |
| 16 | 79.58 | 73.51 | 54.52 | 32KB |
| Method | [email protected] | [email protected] | [email protected] |
|---|---|---|---|
| No-noise reconstructor | 62.19 | 59.68 | 49.14 |
| LR-V2X ( ) | 69.35 | 66.90 | 53.37 |