ObjectGuidedMap: An Object-Aware Model for Robust Bird's Eye View Map Prediction in High-Occlusion Scenarios
Organizations: University of Wuppertal Germany · Aptiv Germany
Abstract
Accurate BEV map prediction is a critical component of autonomous driving systems, enabling downstream planning and control. Recent approaches such as Mask2Map achieve strong performance by predicting vectorized, instance-level map elements directly from multi-view images. However, existing BEV map prediction models operate largely independently of object-level scene understanding, despite the fact that traffic participants frequently occlude or implicitly encode information about road geometry. In this work, we propose a multitask architecture that jointly predicts BEV maps and 3D objects, explicitly enabling information exchange between the two tasks. Building upon Mask2Map, we introduce an object detection branch and incorporate cross-task feature fusion at both the BEV feature level and the instance-query level via deformable attention and cross-attention mechanisms. This design allows map instances to leverage object context while remaining robust to occlusions caused by traffic participants. Experimental results on the nuScenes and Argoverse 2 datasets demonstrate that our approach consistently improves BEV map prediction accuracy, with particularly significant gains of 21% mAP in scenes containing heavy object occlusion.
Figures & tables
| Lane Line AP | Crosswalk AP | Curb AP | mAP | NDS | |
|---|---|---|---|---|---|
| MapTR [ 33 ] | 0.463 | 0.515 | 0.531 | 0.503 | |
| MapVR [ 66 ] | 0.477 | 0.544 | 0.514 | 0.512 | |
| PivotNet [ 8 ] | 0.562 | 0.565 | 0.601 | 0.576 | |
| BeMapNet [ 47 ] | 0.577 | 0.623 | 0.594 | 0.598 | |
| MapTRv2 [ 34 ] | 0.598 | 0.624 | 0.624 | 0.615 | |
| Mask2Map* [ 6 ] |
| Lane Line AP | Crosswalk AP | Curb AP | mAP | |
|---|---|---|---|---|
| Ours w/o Cross-Task-Attn, DLF | 0.5082 | 0.3709 | 0.5405 | 0.4732 |
| Ours w/o DLF | 0.5289 (+4.07%) | 0.3794 (+2.29%) | 0.5679 (+5.07%) | 0.4921 (+3.99%) |
| ObjectGuidedMap (Ours) | 0.5339 (+5.06%) | 0.4123 (+11.16%) | 0.5808 (+7.46%) | 0.5090 (+7.57%) |
| Lane Line AP | Crosswalk AP | Curb AP | mAP | ||
|---|---|---|---|---|---|
| Full Dataset (100%) | Mask2Map [ 6 ] | 0.6273 | 0.5864 | 0.6737 | 0.6291 |
| ObjectGuidedMap | 0.6553 (+4.47%) | 0.6273 (+6.97%) | 0.6989 (+3.74%) | 0.6605 (+4.99%) | |
| Low Occlusion (9.57%) | Mask2Map [ 6 ] | 0.5324 | 0.3614 | 0.6003 | 0.4980 |
| ObjectGuidedMap | 0.5403 (+1.48%) | 0.3549 (-1.80%) | 0.6375 (+6.20%) | 0.5109 (+2.59%) | |
| High Occlusion (5.50%) | Mask2Map [ 6 ] | 0.3142 | 0.4918 | 0.4090 | 0.4050 |
| ObjectGuidedMap | 0.3581 (+13.97%) | 0.5762 (+17.16%) | 0.5361 (+31.08%) | 0.4901 (+21.01%) |
| Lane Line AP | Crosswalk AP | Curb AP | mAP | ||
|---|---|---|---|---|---|
| Full Dataset | M2M [ 6 ] | 0.6273 | 0.5864 | 0.6737 | 0.6291 |
| (100%) | Ours | 0.6553 (+4.47%) | 0.6273 (+6.97%) | 0.6989 (+3.74%) | 0.6605 (+4.99%) |
| Rain/Wet Only | M2M [ 6 ] | 0.5522 | 0.4265 | 0.5067 | 0.4951 |
| (18.08%) | Ours | 0.6231 (+12.84%) | 0.4868 (+14.14%) | 0.5405 (+6.67%) | 0.5501 (+11.11%) |
| Night Only | M2M [ 6 ] | 0.3767 | 0.1704 | 0.5777 | 0.3749 |
| (10.00%) | Ours | 0.4259 (+13.06%) | 0.3144 (+84.51%) | 0.6183 (+7.03%) | 0.4529 (+20.81%) |
| SB | DLF | CTA | AF | Lane Line AP | Crosswalk AP | Curb AP | mAP |
|---|---|---|---|---|---|---|---|
| - | - | - | - | 0.6273 | 0.5864 | 0.6737 | 0.6291 |
| ✓ | - | - | - | 0.6134 (-2.21%) | 0.5507 (-6.09%) | 0.6675 (-0.92%) | 0.6105 (-2.96%) |
| ✓ | - | ✓ | ✓ | 0.6511 (+3.80%) | 0.6083 (+3.73%) | 0.6833 (+1.42%) | 0.6475 (+2.92%) |
| ✓ | ✓ | ✓ | - | 0.6552 (+4.46%) | 0.6190 (+5.56%) | 0.6796 (+0.87%) | 0.6513 (+3.53%) |
| ✓ | ✓ | - | ✓ | 0.6535 (+4.18%) | 0.6202 (+5.76%) | 0.6823 (+1.27%) | 0.6520 (+3.64%) |
| ✓ | ✓ | ✓ | ✓ | 0.6553 (+4.47%) | 0.6273 (+6.97%) | 0.6989 (+3.74%) | 0.6605 (+4.99%) |
| Lane Line AP | Lane Line AP | Lane Line AP | Lane Line AP | Crosswalk AP | Crosswalk AP | Crosswalk AP | Crosswalk AP | Curb AP | Curb AP | Curb AP | Curb AP | mAP | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Full Dataset | Mask2Map [ 6 ] | 0.503 | 0.658 | 0.721 | 0.627 | 0.392 | 0.633 | 0.734 | 0.586 | 0.493 | 0.724 | 0.805 | 0.674 | 0.629 |
| ObjectGuidedMap | 0.545 | 0.683 | 0.738 | 0.655 | 0.435 | 0.679 | 0.768 | 0.627 | 0.521 | 0.752 | 0.823 | 0.699 | 0.661 | |
| Points* | Mask2Map [ 6 ] | 0.403 | 0.560 | 0.634 | 0.532 | 0.192 | 0.382 | 0.510 | 0.361 | 0.409 | 0.644 | 0.748 | 0.600 | 0.498 |
| ObjectGuidedMap | 0.423 | 0.564 | 0.634 | 0.540 | 0.179 | 0.363 | 0.522 | 0.355 | 0.470 | 0.672 | 0.771 | 0.638 | 0.511 | |
| Points | Mask2Map [ 6 ] | 0.464 | 0.606 | 0.676 | 0.582 | 0.434 | 0.664 | 0.739 | 0.613 | 0.466 | 0.700 | 0.785 | 0.650 | 0.615 |
| ObjectGuidedMap | 0.522 | 0.657 | 0.708 | 0.629 | 0.505 | 0.729 | 0.804 | 0.680 | 0.546 | 0.766 | 0.832 | 0.715 | 0.674 |
| Lane Line AP | Lane Line AP | Lane Line AP | Lane Line AP | Crosswalk AP | Crosswalk AP | Crosswalk AP | Crosswalk AP | Curb AP | Curb AP | Curb AP | Curb AP | mAP | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Full Dataset | Mask2Map [ 6 ] | 0.503 | 0.658 | 0.721 | 0.627 | 0.392 | 0.633 | 0.734 | 0.586 | 0.493 | 0.724 | 0.805 | 0.674 | 0.629 |
| ObjectGuidedMap | 0.545 | 0.683 | 0.738 | 0.655 | 0.435 | 0.679 | 0.768 | 0.627 | 0.521 | 0.752 | 0.823 | 0.699 | 0.661 | |
| Rain/Wet Only | Mask2Map [ 6 ] | 0.419 | 0.580 | 0.657 | 0.552 | 0.193 | 0.460 | 0.626 | 0.427 | 0.298 | 0.557 | 0.665 | 0.507 | 0.495 |
| ObjectGuidedMap | 0.487 | 0.652 | 0.730 | 0.623 | 0.243 | 0.543 | 0.674 | 0.487 | 0.353 | 0.587 | 0.681 | 0.541 | 0.550 | |
| Night Only | Mask2Map [ 6 ] | 0.217 | 0.403 | 0.510 | 0.377 | 0.036 | 0.198 | 0.278 | 0.170 | 0.351 | 0.636 | 0.746 | 0.578 | 0.375 |
| ObjectGuidedMap | 0.255 | 0.461 | 0.562 | 0.426 | 0.131 | 0.301 | 0.511 | 0.314 | 0.393 | 0.686 | 0.776 | 0.618 | 0.453 |
| Lane Line AP | Lane Line AP | Lane Line AP | Lane Line AP | Crosswalk AP | Crosswalk AP | Crosswalk AP | Crosswalk AP | Curb AP | Curb AP | Curb AP | Curb AP | mAP | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ObjectGuidedMap w/o Cross-Task-Attn., DLF | 0.377 | 0.533 | 0.614 | 0.508 | 0.056 | 0.420 | 0.637 | 0.371 | 0.260 | 0.604 | 0.759 | 0.541 | 0.473 |
| ObjectGuidedMap w/o DLF | 0.398 | 0.557 | 0.632 | 0.529 | 0.069 | 0.422 | 0.648 | 0.379 | 0.294 | 0.634 | 0.777 | 0.568 | 0.492 |
| ObjectGuidedMap | 0.407 | 0.557 | 0.637 | 0.534 | 0.095 | 0.463 | 0.678 | 0.412 | 0.307 | 0.645 | 0.790 | 0.581 | 0.509 |
| ObjectGuidedMap | Mask2Map | ||
|---|---|---|---|
| Image Backbone | 23.5M | Image Backbone | 23.5M |
| Image Neck (FPN) | 1.1M | Image Neck (FPN) | 1.1M |
| Map Prediction Branch | 35.8M | Map Prediction Branch | 35.8M |
| Object Detection Branch | 14.0M | - | - |
| Deformable Latent Fusion | 0.2M | - | - |
| Cross-Task Attention | 3.2M | - | - |
Autonomous Driving Perception
Autonomous driving perception enables vehicles to detect and interpret road users, drivable space, and hazards using onboard and shared sensors.
See all 402 papers