Rethinking Pre-Training and Augmentation for Zero-Shot Cross-City Object Detection
Authors: Long Hoang Pham, Quoc Pham-Nam Ho, Huy-Hung Nguyen, Duong Nguyen-Ngoc Tran, Ngoc Doan-Minh Huynh, Cu Quoc Le, Hoang-Khang Nguyen, Hyung-Min Jeon, Chi Dai Tran, Son Hong Phan, Duong Khac Vu, Trinh Le Ba Khanh, Jae Wook Jeon
Organizations: Automation Lab, Department of Electrical and Computer Engineering, Sungkyunkwan University, South Korea
Real-world deployment of traffic surveillance systems is bottlenecked by geographic domain shift, in which models trained in one city underperform when applied to an unseen target city. Conventional domain adaptation relies on hyperparameter-sensitive architectures or direct profiling of target data. Both are fundamentally precluded in privacy-conscious ecosystems that require completely blind training and evaluation loops. In this setting, we explore the effects of pre-training and augmentation in addressing the domain shift problem. Specifically, we propose a new modular training pipeline for object detection structured around two core orthogonal pillars: (1) a multi-dataset pre-training strategy featuring a class-agnostic objectness distillation to decouple structural vehicle geometry from semantic taxonomies, and (2) a domain-resilient augmentation stream featuring a novel Grayworld transformation that forces global attention heads to strip volatile chromatic shortcuts in favor of robust shape priors. When evaluated with the real-time transformer-based detector RF-DETR, our framework bridges cross-city distribution gaps while using limited GPU memory (16GB). Our optimized variants, RF-DETR-HR and RF-DETR-Grayworld, deliver a substantial empirical gain of +24.29 over the baseline, achieving 1st place (47.53 mAP) on the AI City Challenge Track 6 leaderboard. Code and data are available at: SKKUAutoLab/aic26_cross_city.
Figures & tables
Figure 1: Overview of the proposed pre-training and Grayworld augmentation framework.
Dataset
Viewpoint
Images
Labels
Classes
Resolution
Characteristics
Hafnia [ 21 ]
Coarse → Fine
27.8K
151K
10
720–3648p
Cross-city domain shift
TSBOW [ 14 ]
Coarse → Fine
48K
1.1M
8
720p
Weather, time-of-day
TrafficCAM [ 12 ]
Medium
4.3K
84.2K
10
288–1080p
Complex traffic flow
FishEye8K [ 13 ]
Medium
8K
157K
5
1080–1280p
Distortion, omnidirection
VisDrone [ 46 ]
Coarse
8.6K
2.6M
10
2160p
Small objects
MOT20 [ 11 ]
Medium, Fine
13K
2.2M
1
1080p
Pedestrian
Table 1: Comparison of traffic surveillance datasets.
Figure 2: Visual comparisons of raw pre-training dataset images alongside their corresponding Grayworld-augmented variants. By neutralizing sensor-specific white-balance variances and volatile RGB distributions, the Grayworld transformation effectively bridges color and style discrepancies across disparate source domains.
Figure 3: Compositions and performance comparison of auxiliary pre-training datasets ( DS ). Performance is evaluated on a 50% subset of the hidden test set under identical inference configurations.
Figure 4: Illustration of augmentation strategies structured around order-specific sequential operations.
Figure 5: Impact of training resolution ( RT ) and inference resolution ( RI ) calibration on object detection performance. Performance is evaluated on the full hidden test set.
Figure 6: Incremental mAP performance contributions of each hyperparameter for RF-DETR-HR and RF-DETR-Grayworld relative to the COCO pre-trained RF-DETR-2XLarge baseline. Axes are arranged in counter-clockwise order.
#
Model ( F )
DS
E
A
RT
RI
τc
mAP
mAP50
mAP75
0
RF-DETR-Nano (Baseline)
COCO
8
-
384
384
0.05
23.24
33.77
24.13
1
RF-DETR-Nano
COCO
1
-
384
384
0.05
26.72
38.10
27.11
2
RF-DETR-Large
COCO
1
-
704
704
0.05
30.77
44.92
32.24
3
RF-DETR-XLarge
COCO
1
-
704
704
0.05
31.06
43.39
33.00
4
RF-DETR-2XLarge
COCO
1
-
880
880
0.05
34.31
46.99
36.61
5
RF-DETR-2XLarge
COCO
5
AL
880
880
0.05
39.30
53.18
41.31
Table 2: Experimental results on the full test set of AIC2026-Track 6 [ 3 ] . The best and the second-best results are in bold and underline , respectively.
Rank
Team ID
Team Name
Model
mAP
mAP50
mAP75
1
34
SKKU-AL-T1
RF-DETR-HR
47.53
62.07
50.31
RF-DETR-Grayworld
46.63
59.46
49.96
2
256
BIT-ODL
detr
42.81
55.39
45.68
3
152
Chisinau
RF-DETR Large
41.76
57.27
45.21
4
261
BK2TheFuture
RFDETR2XLarge
41.69
52.89
44.07
5
162
S2 Detection
RF-DETR
41.14
54.47
44.14
Table 3: Official public leaderboard for AIC2026-Track 6 [ 3 ] . Our team, SKKU-AL-T1 (Team ID 34), secures 1st place with an absolute mAP margin of +4.72 over the second-place entry.
Deep learning-based object detectors are fundamental to intelligent transportation systems, enabling traffic monitoring, vehicle analytics, and infrastructure management. However, achieving both fine-grained vehicle recognition and robust cross-city domain generalization remains challenging. We present the Domain-Robust Asymmetric Fusion Ensemble (DRAFE), which combines independently trained LW-DETR and RF-DETR detectors for cross-city fine-grained traffic object detection. DRAFE employs a two-stage training strategy that first pretrains complementary detectors on diverse public traffic datasets using pseudo-label expansion and human-in-the-loop annotation refinement, producing a curated corpus of 6,049 images and 203,619 annotations, before challenge-compliant fine-tuning on the Project Hafnia Track 6 dataset. At inference, DRAFE applies anchor-conditioned class-consistent matching, reliability-weighted coordinate fusion, agreement-aware confidence recalibration, and complementary hypothesis recovery. On AI City Challenge 2026 Track 6, DRAFE achieves 0.4022 mAP, ranks sixth among 25 participating teams, and improves by 0.0553 mAP over a preliminary ensemble evaluated under identical benchmark conditions.
Divine Yao Agbobli, Geoffery Eyram Agorku, Israel Afriyie +6
Iowa State University, Ames, IA, USA · University of Arkansas, Fayetteville, AR, USA · Parsons Corporation, USA +3
Cross-city object detection requires a detector trained in one city to generalize to an unlabeled target city. In AI City Challenge 2026 Track 6, we analyze archived configurations of a single RF-DETR-Large detector inside an air-gapped Training-as-a-Service platform whose server returns only an aggregate COCO-style AP over a hidden mixture of source- and target-city images. Frozen 1120 x 1120 inference of a checkpoint trained at 704 x 704 achieved the highest aggregate AP among the evaluated configurations (0.3272 -> 0.3654, +0.0382) without any parameter update, with the largest relative gain on small objects and the largest absolute gain on medium objects, at 2.53x the input pixels. A warm-start 1120px fine-tuning recipe reached 0.3470 while its in-domain validation AP rose (0.767 -> 0.789), a caution that in-domain validation is an unreliable model-selection signal under aggregate-only cross-city feedback. Because that run's evaluation used a higher confidence threshold than the inference-only runs (0.05 vs. 0.01), we treat its score as a descriptive archived outcome rather than a controlled verdict on fine-tuning. Gray-world normalization did not meaningfully change the frozen-1120 result, and a rectangular run was found by audit to have used an unintended portrait orientation. We release verbatim platform commands, configuration snapshots, and an explicit evidence boundary for every claim. Each configuration was submitted once and the best was selected on the hidden server, so these are exploratory, audited findings about the aggregate mixture; they do not establish target-city-specific improvement.
Although recent Open-Vocabulary Object Detection architectures, such as Grounding DINO, demonstrate strong zero-shot capabilities, their performance degrades significantly under domain shifts. Moreover, many domains of practical interest, such as nighttime or foggy scenes, lack large annotated datasets, preventing direct fine-tuning. In this paper, we introduce Aligned Basis Relocation for Adaptation(ABRA), a method that transfers class-specific detection knowledge from a labeled source domain to a target domain where no training images containing these classes are accessible. ABRA formulates this adaptation as a geometric transport problem in the weight space of a pretrained detector, aligning source and target domain experts to transport class-specific knowledge. Extensive experiments across challenging domain shifts demonstrate that ABRA successfully teleports class-level specialization under multiple adverse conditions. Our code will be made public upon acceptance.