cs.CVOct 28, 2025

MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detection

Authors: Yun Zhang, Zhaoliang Zheng, Johnson Liu, Zhiyu Huang, Zewei Zhou, Zonglin Meng, Tianhui Cai, Jiaqi Ma

Organizations: All authors are with the University of California, Los Angeles (UCLA), CA 90095, USA.

Abstract

Infrastructure-based perception plays a crucial role in intelligent transportation systems by providing global situational awareness and enabling cooperative autonomy. However, camera-based 3D object detection remains challenging under multi-view infrastructure setups, heterogeneous camera configurations, degraded sensing conditions, diverse road layouts, and adverse environmental conditions. We introduce MIC-BEV, a Transformer-based bird's-eye-view (BEV) perception framework for infrastructure-based multi-camera 3D object detection. MIC-BEV supports a variable number of cameras with heterogeneous intrinsic and extrinsic parameters and uses a graph-enhanced fusion module to adaptively integrate multi-view image features by modeling geometric relationships between cameras and the BEV grid. To support training and evaluation, we introduce M2I, a synthetic dataset featuring diverse camera layouts, road geometries, environmental conditions, and sensor-degradation cases. Experiments on the simulated M2I dataset and the real-world RoScenes dataset show that MIC-BEV achieves strong 3D detection performance and improved robustness under challenging conditions. Ablation studies validate the effectiveness of its key design choices, while weight analyses show that the learned fusion weights are associated with view-reliability factors and adapt to degraded camera inputs. We further report computational cost and deployment-related factors, providing additional evidence of practical feasibility and real-world deployment potential. These results indicate that MIC-BEV is a promising framework for infrastructure-based perception. The dataset and source code are available at: https://github.com/HandsomeYun/MIC-BEV.

Figures & tables

Explore similar work

Oct 13, 2026

MonoMIP: Multi-Height Inverse Perspective Mapping for Monocular 3D Object Detection

Monocular 3D object detection methods increasingly rely on depth-guided transformers, but they operate entirely in the perspective image plane where spatial relationships are distorted by foreshortening. We propose MonoMIP, a dual-decoder framework that adds complementary 3D geometric reasoning through Bird's-Eye View (BEV) features constructed via Multi-Height Inverse Perspective Mapping. We perform IPM at K elevation planes spanning ground to rooftop, producing an ordered stack of height-conditioned metric BEV features that reduces above-ground misprojection and exposes depth-dependent appearance variation across planes. A BEV decoder with multi-scale deformable attention aggregates this multi-height evidence per query, while a depth-guided 3D decoder provides complementary perspective-space predictions. Without extra training data, MonoMIP attains 25.84% Moderate AP3D|R40 on KITTI val and 21.66% on the official test set for Car, outperforming recent published monocular methods on both the KITTI and Waymo benchmarks.
May 3, 2026

SimPB++: Simultaneously Detecting 2D and 3D Objects from Multiple Cameras

Simultaneous perception of 2D objects in perspective view and 3D objects in Bird's Eye View (BEV) is challenging for multi-camera autonomous driving. Existing two-stage pipelines use 2D results only as a one-time cue for 3D detection. We propose SimPB++, which simultaneously detects 2D objects in perspective and 3D objects in BEV from multiple cameras. It unifies both tasks into an end-to-end model with a hybrid decoder architecture, coupling multi-view 2D and 3D decoders interactively. Two novel modules enable deep interaction: Dynamic Query Allocation adaptively assigns 2D queries to 3D candidates, and Adaptive Query Aggregation refines 3D representations using multi-view 2D features, forming a cyclic 3D-2D-3D refinement. For multi-view 2D detection, we use Query-group Attention for intra-group communication. We also design a Crop-and-Scale strategy for long-range perception and a Propagating Denoising strategy with an auxiliary RoI detector. SimPB++ supports mixed supervision with 2D-only and fully annotated data, reducing reliance on expensive 3D labels. Experiments show state-of-the-art performance on nuScenes for both tasks and strong long-range detection (up to 150m) on Argoverse2.
Jun 10, 2026

Understanding Cross-Sensor Feature Variations for Generalizable 3D Perception

Radar-camera BEV perception often suffers from degraded performance when evaluated across datasets, as changes in driving scenes, sensor configurations, and environmental conditions can alter both the input observations and the internal fused representations. This work studies this issue from the perspective of source-domain variation modeling, aiming to improve the robustness of BEV-based 3D detectors without relying on target-domain samples. We introduce a framework that characterizes visual scene variations in the frequency domain and uses them to synthesize diverse source-domain views. By comparing the resulting fused BEV representations, the framework further captures how image-level variations influence multi-modal BEV features. These variation patterns are then used to regularize the detector, encouraging the learned fusion space to remain stable under latent scene changes. The proposed method is applied only during training and leaves the inference pipeline unchanged. Experiments on cross-dataset radar-camera 3D detection between View-of-Delft and TJ4DRadSet demonstrate consistent improvements over multiple BEV fusion backbones, and the gains remain effective when a small amount of target-domain data is available.