This report summarizes the work submitted by team arnav007 (submission ID 1054222) for the UrbanTwin Sim2Real LiDAR Challenge (V2X-Real track) at the IEEE BigData Cup 2026. The primary objective is to train 3D detectors for vehicles, pedestrians, and trucks using only synthetic roadside LiDAR data, and to generate synthetic scans that are realistic enough to be indistinguishable from real ones. A CARLA based pipeline is developed and calibrated to the fixed sensor site, accurately modeling the range image, including no-return beams, based on unlabelled real development scans. A combined inference detector, using multiple 3D detectors (VoxelNeXt, PV-RCNN, and SECOND) trained exclusively on synthetic data, is also proposed. Each scan is aligned to the synthetic ground plane and processed through the detectors at multiple ground heights. The resulting bounding boxes are fused using bird's-eye view (BEV) clustering, followed by class-specific post-processing to refine heading, box size, and filter low-confidence detections. The final submission achieved a combined score of 0.8947. The ablation study shows that per-scan ground leveling more than doubled the real-scan mAP, while fusing boxes across different heights and models further improved performance.
Figures & tables
Dataset
Frames
Use
Canonical synthetic scenes
10,800
Training
Site-calibrated twin scenes
5,000
Training
Small-truck twin scenes
3,000
Training
Merged synthetic set a
18,800
Training
Size-varied pedestrian twin scenes
5,000
Training b
Long-low truck twin scenes
4,000
Training b
TABLE I: Data used for detector training and evaluation
Fig. 1: Overview of the proposed pipeline, from site calibration and synthetic data generation to detector training and evaluation on real roadside LiDAR scans.
SECOND
VoxelNeXt
PV-RCNN
Voxel size (m)
0.2×0.2×0.25
0.1×0.1×0.2
0.05×0.05×0.25
Learning rate
0.003
0.001
0.002
Batch size
4
2–4
4
Epochs
12
12–20 a
4–6
TABLE II: Hyperparameter settings of the three detector families
Entry
Combined Score
Vehicle
Pedestrian
Truck
mAP 0.7
Real
Ours: fusion, calibration
0.7997
63.76
31.30
52.92
0.2104
0.9423
+ truck rule, ped. TTA
0.8475
69.07
35.99
59.66
0.2329
0.9423
+ heading, de-dup.
0.8600
74.30
35.20
59.58
0.2104
0.9423
+ ped. hedging
0.8732
74.25
39.66
59.79
0.2166
0.9423
+ PV-RCNN, scans
0.8853
75.49
41.51
59.75
0.2288
0.9507
+ ped. specialists, per-scan levelling
0.8875
75.59
43.68
59.06
0.2628
0.9449
TABLE III: Submissions and leaderboard entries (AP in %, IoU 0.5, R40; leaderboard rows are public entries as of Nov. 15 at 9:00 PM EST
Component
Metric
150 frames
350 frames
Per-scan ground levelling a
mAP
15.8 → 37.2
Multi-height + multi-model fusion a
mAP
49.3 → 56.3
Averaged vehicle heading
Vehicle AP
75.4 → 80.0
75.4 → 79.7
Truck de-duplication
Genuine-truck AP
66.2 → 71.0
63.7 → 68.4
Pedestrian hedging
Pedestrian AP
38.5 → 42.4
37.1 → 41.3
PV-RCNN voters
Vehicle AP
82.5 → 83.5
82.4 → 83.5
TABLE IV: Effect of each component on the development sets (150 / 350 frames; AP in %, realism on the 0–1 scale)
Lidar-based 3D object detection locates and classifies objects in point clouds, supporting perception for autonomous vehicles, robots, and other mobile systems.