Route-Time Conflict Maps for Cooperative End-to-End Autonomous Driving
Organizations: University of Georgia
Abstract
Existing cooperative end-to-end driving works at Class A (status-sharing) of the SAE J3216 classes of cooperative driving automation (CDA): vehicles exchange what they perceive, not what they intend, so each plans alone when to go, which limits cooperation and leads to deadlock when both vehicles yield or to collisions when both go. We present When2Go, a cooperative end-to-end driving system that learns when to go by sharing intent under CDA Class B or higher. Each vehicle broadcasts its LiDAR detections with forecast motion as instance tokens, together with its plan and intended trajectory. The receiver draws the fused detections, forecasts and partner plans into a route-time conflict map, the occupancy along its route over the planning horizon, on which a planner scores candidate speed profiles. Where two intended trajectories conflict, an order gate, a precedence network distilled from a right-of-way rule, decides who goes first; both vehicles evaluate it on the same messages and so reach the same order. When2Go imitates the rule-based expert of V2Xverse, which sees the simulator's ground truth; stops that When2Go cannot observe within its 2 s planning horizon are relabelled, so that it does not learn to wait without an observable cause. For our runs only, the benchmarks' PID controller steers by When2Go's waypoints instead of the route, and its forced push of long-waiting vehicles is off. With one model, When2Go sets the state of the art on three closed-loop CARLA benchmarks: 97.8 and 90.7 driving score on InterDrive without and with traffic (best published 90.1 and 78.9), 70.0 on the public V2Xverse protocol (best of sixteen rerun methods 59.1) and 88.2 on MDrive (best rerun 85.1), with 95.0% of its vehicles collision-free (87.7%).
Figures & tables
| Variant | V2Xverse | InterDrive DS | |
| DS | no traffic | traffic | |
| When2Go, repetition 3 | 72.24 | 97.79 | 90.24 |
| Route-time conflict map | |||
| w/o map (tokens only) | |||
| w/o partner plans in the map | |||
| w/o forecasts in the map | |||
| Order | Learned | Decides | Acyclic | DS | RC | SR |
| None | ✗ | ✗ | ✗ | 93.64 | 94.63 | 0.83 |
| Map channel | ✓ | ✗ | ✗ | 92.94 | 95.23 | 0.80 |
| Pairwise | ✓ | ✓ | ✗ | 96.53 | 97.74 | 0.89 |
| Gate (When2Go) | ✓ | ✓ | ✓ | 97.79 | 98.99 | 0.89 |
| Priority rule | hand-written | 97.43 | 98.45 | 0.89 | ||
| no traffic | traffic | |||||
| Method | IC | LM | LC | IC | LM | LC |
| CoLMIN [ 34 ] | 90.71 | 98.75 | 67.20 | 66.47 | 94.11 | 67.45 |
| No fusion ∗ | 61.80 | 96.80 | 37.39 | 40.56 | 83.14 | 35.73 |
| Early fusion | 60.07 | 93.60 | 23.71 | 45.61 | 69.81 | 12.22 |
| Late fusion | 51.81 | 96.17 | 46.24 | 48.14 | 81.84 | 52.19 |
| F-Cooper | 70.30 | 75.79 | 29.48 | 46.55 | 66.95 | 36.75 |
| Control | V2Xverse | InterDrive | MDrive | |
| DS | no traffic | traffic | Avg | |
| Steering target | ||||
| Benchmark route point | 65.40 | 97.81 | 89.94 | 88.43 |
| Own plan (When2Go) | 70.00 | 97.79 | 90.70 | 88.16 |
| Benchmark’s forced push switched on | ||||
| DS, paired | ||||
| Channel | DS | RC | SR | DS |
| Ideal | 97.79 | 98.99 | 0.89 | – |
| Latency | ||||
| ms | 94.63 | 97.77 | 0.83 | |
| ms | 91.35 | 96.11 | 0.78 | |
| ms | 90.22 | 93.44 | 0.76 | |
| Message loss | ||||
| Channel | runs | pair-steps | disagree (%) | both go / both yield | one-sided (%) | flips (%) | cycles | stalls | cleared | roles (%) |
| Ideal, no traffic | 46 | 8,036 | 0.00 | 0 / 0 | 9.5 | 1.7 | 51 (9) | 4 (3) | 1 | 96.8 |
| Ideal, with traffic | 138 | 34,753 | 0.00 | 0 / 0 | 9.6 | 1.7 | 312 (24) | 80 (24) | 35 | 98.4 |
| ms | 46 | 9,806 | 2.24 | 201 / 19 | 13.0 | 1.9 | 129 (10) | 16 (5) | 8 | 97.4 |
| ms | 46 | 9,817 | 4.26 | 377 / 41 | 12.8 | 1.9 | 86 (13) | 15 (8) | 7 | 98.6 |
| ms | 46 | 11,488 | 5.74 | 589 / 70 | 15.2 | 2.0 | 165 (12) | 34 (8) | 10 | 98.9 |
| loss, independent | 46 | 2,821 | 0.28 | 4 / 4 | 67.6 | 0.8 | 47 (9) | 13 (2) | 3 | 97.8 |
| V2Xverse | InterDrive | MDrive | |
| CARLA | 0.9.10.1 | 0.9.10.1 | 0.9.12 |
| Tests | 85 runs in 5 parts | 46 (IC 18, LM 20, LC 8), in 2 traffic settings | 225 scenarios in 3 buckets (46, 112, 67) |
| Vehicles | 1 | 2 to 8 | 1 to 8 |
| Traffic | 55 to 120 vehicles, 60 to 120 pedestrians, 60 to 120 bicycles | none; or 50 vehicles, 50 pedestrians, 50 bicycles | placed by each scenario |
| DS of a test | RC IS | mean RC product of IS over its vehicles | mean of RC IS over its vehicles |
| Reported | mean over runs | mean over tests, per setting | mean of the 3 bucket means |
| InterDrive, no traffic | InterDrive, traffic | MDrive | |||||
| Method | DS | SR | DS | SR | DS | No coll. | Kept |
| Every test and scenario (as in Tab. 1 ) | |||||||
| CoLMDriver | 72.12 | 0.63 | 69.18 | 0.54 | 69.11 | 0.74 | / / |
| Rule-based ∗∗ | 76.55 | 0.70 | 70.78 | 0.57 | 73.23 | 0.81 | / / |
| When2Go | 97.79 | 0.89 | 90.70 | 0.75 | 88.16 | 0.95 | / / |
| Without livelocked tests and scenarios scored at a second stall | |||||||
| InterDrive | V2Xverse, repetition 3 | |||
| Training seed | DS | DS | IS | blocked |
| 0 (reported) | 97.79 | 72.24 | 0.787 | 15 |
| 1 | 95.78 | 65.41 | 0.802 | 38 |
| 2 | 94.89 | 71.72 | 0.859 | 35 |
| Mean | 96.15 | 69.79 | 0.816 | 29 |
| runs | with a push | vehicle collisions s after a push | pushed runs completed | |
| V2Xverse, baselines as released (the runs of Tab. 1 ) | ||||
| No fusion ∗ | 255 | 14 % | 2 of 226 | 6 % |
| Early fusion | 85 | 16 % | 2 of 80 | 14 % |
| Late fusion | 85 | 19 % | 6 of 55 | 31 % |
| F-Cooper | 85 | 14 % | 0 of 71 | 0 % |
| V2X-ViT | 85 | 16 % | 0 of 61 | 0 % |
| runs per 100 with | ||||||||||
| Method | DS | rep. DS | SR | IS | RC | vehicle collision | pedestrian collision | layout collision | blocked | runs |
| WOR [ 9 ] | 55.85 | 12.05 | 0.27 | 0.710 | 80.4 | 31 | 27 | 0 | 21 | 85 |
| LAV [ 8 ] | 46.55 | 38.27 | 0.18 | 0.739 | 68.0 | 24 | 26 | 6 | 13 | 85 |
| TransFuser [ 12 ] | 57.59 | 30.23 | 0.28 | 0.706 | 84.9 | 24 | 32 | 4 | 29 | 85 |
| InterFuser [ 63 ] | 45.28 | 40.31 | 0.13 | 0.487 | 91.9 | 64 | 28 | 12 | 15 | 85 |
| TCP [ 79 ] | 53.53 | 47.48 | 0.18 | 0.805 | 68.4 | 16 | 19 | 2 | 65 | 85 |
| InterDrive, no traffic | InterDrive, with traffic | |||||||
| Method | DS | SR | IS | RC | DS | SR | IS | RC |
| Published | ||||||||
| TCP [ 79 ] | 73.68 | 0.50 | 0.82 | 90.54 | 74.18 | 0.48 | 0.82 | 91.21 |
| VAD [ 35 ] | 25.37 | 0.02 | 0.33 | 75.00 | 25.18 | 0.02 | 0.31 | 75.66 |
| UniAD [ 32 ] | 35.17 | 0.11 | 0.38 | 88.30 | 37.13 | 0.11 | 0.41 | 88.71 |
| LMDrive [ 64 ] | 48.83 | 0.20 | 0.85 | 58.02 | 49.95 | 0.13 | 0.84 | 61.61 |
| InterDrive (ID) | Interaction (Int.) | V2X-PnP (PnP) | Avg | |||||||||
| Method | No coll. | DS | SR | No coll. | DS | SR | No coll. | DS | SR | No coll. | DS | SR |
| TCP [ 79 ] | – | 83.55 | 67.80 | – | 75.80 | 55.25 | – | 71.02 | 58.70 | – | 76.79 | 60.58 |
| UniAD [ 32 ] | – | 57.48 | 26.40 | – | 53.08 | 31.10 | – | 72.55 | 68.48 | – | 61.04 | 41.99 |
| VAD [ 35 ] | – | 57.49 | 23.30 | – | 48.83 | 27.14 | – | 67.20 | 66.30 | – | 57.84 | 38.91 |
| LMDrive [ 64 ] | – | 56.74 | 27.10 | – | 57.45 | 29.08 | – | 71.56 | 69.57 | – | 61.92 | 41.92 |
| CoDriving [ 49 ] | – | 83.99 | 66.10 | – | 79.06 | 70.53 | – | 84.97 | 82.84 | – | 82.67 | 73.16 |
| no traffic | traffic | |||||||
| Method | IC | LM | LC | all | IC | LM | LC | all |
| Rule-based expert | 73.43 | 100.0 | 67.15 | 83.89 | 69.70 | 89.62 | 70.04 | 78.42 |
| CoLMIN [ 34 ] | 90.71 | 98.75 | 67.20 | 90.12 | 66.47 | 94.11 | 67.45 | 78.93 |
| When2Go | 95.12 | 100.0 | 98.25 | 97.79 | 80.30 | 97.59 | 96.84 | 90.70 |
| InterDrive, no traffic | InterDrive, with traffic | |||||||||||
| controlled vehicles | town | controlled vehicles | town | |||||||||
| Method | 2 | 3–4 | 6–8 | 05 ∘ | 06 | 07 ∘ | 2 | 3–4 | 6–8 | 05 ∘ | 06 | 07 ∘ |
| No fusion ∗ | 91.3 | 63.6 | 40.3 | 67.8 | 85.3 | 68.0 | 75.1 | 45.8 | 36.8 | 44.2 | 85.3 | 62.8 |
| Early fusion | 84.0 | 69.6 | 22.8 | 65.6 | 75.5 | 64.9 | 71.0 | 39.2 | 15.6 | 37.3 | 66.1 | 74.9 |
| Late fusion | 84.5 | 61.2 | 48.4 | 60.2 | 88.4 | 75.3 | 73.2 | 55.2 | 53.4 | 51.6 | 88.4 | 63.3 |
| F-Cooper | 79.9 | 60.3 | 36.6 | 57.3 | 73.6 | 85.5 | 64.1 | 46.2 | 40.1 | 36.7 | 83.1 | 66.4 |
| V2Xverse | InterDrive, no traffic | InterDrive, traffic | ||||
| Variant | DS | interval | DS | interval | DS | interval |
| Route-time conflict map | ||||||
| w/o map (tokens only) | ||||||
| w/o partner plans in the map | ||||||
| w/o forecasts in the map | ||||||
| one class channel | ||||||
Autonomous Driving
Autonomous driving develops vehicles that perceive road scenes, predict interactions, and plan and control safe movement with limited or no human input.
See all 576 papers