Efficient neural architecture search (NAS) requires accurate performance estimation under limited evaluation budgets. Existing zero-cost proxies (ZCPs) provide fast training-free signals, but each proxy usually captures only a partial property of an architecture, leading to unstable rankings across datasets and search spaces. In contrast, GNN-based predictors can improve accuracy, but often depend on labeled architectures, graph encoders, and costly representation learning, which makes them less suitable for extreme few-shot settings. We propose FENAS, a topology-agnostic few-shot prediction framework that turns complementary initialization priors into robust ranking signals. Its core component, CAST, is a feature pipeline that combines copula alignment and synergy transformation. CAST maps heterogeneous ZCPs into a compact feature manifold, enabling lightweight meta-learners to produce reliable rankings from scarce supervision. On NAS-Bench-201, with only 0.5% labeled samples, FENAS achieves a Kendall's Tau (τ) of 0.70, outperforming representative topology-based few-shot predictors in this low-label regime. In closed-domain search, FENAS evaluates the NAS-Bench-201 space in approximately 1138 seconds and achieves competitive test accuracy. By providing a fast, reliable, and structurally simple evaluation mechanism, FENAS supports the design of automated neural architectures under limited evaluation budgets.
Figures & tables
Figure 1: The overall framework of FENAS. The pipeline consists of three decoupled stages: (1) Feature Extraction: raw zero-cost proxy scores are extracted from complementary physical dimensions. (2) CAST Feature Engineering: heterogeneous proxy scores are aligned and transformed into a compact feature manifold. (3) Meta-predictor: a lightweight meta-learner uses extremely few-shot labels to output accurate performance rankings.
Method
Backbone
NB201-C10 ( τ )
NB101 ( τ )
0.5%
1%
3%
0.02%
0.04%
0.1%
1%
NP [ 8 ]
GCN
0.343
0.413
0.584
-
-
-
-
NAO [ 19 ]
LSTM
0.467
0.493
0.470
-
-
-
-
Arch2Vec [ 33 ]
GIN
0.542
0.573
0.601
0.435
0.511
0.561
0.596
NPENAS [ 29 ]
GCN
0.565
0.594
0.642
-
-
-
-
TNASP [ 17 ]
Trans.
-
-
-
0.600
0.669
0.752
0.820
Table 1: Ranking results (Kendall’s τ ) of few-shot predictors.
Method
NB101
NB201-C10
NB201-C100
NB201-IMG16
τ
ρ
τ
ρ
τ
ρ
τ
Fisher ∗ [ 1 ]
-0.190
0.477
0.346
0.527
0.381
0.474
0.344
SynFlow ∗ [ 27 ]
0.250
0.700
0.516
0.703
0.524
0.645
0.474
#Params ∗
0.300
0.753
0.578
0.728
0.553
0.692
0.520
NASWOT ∗ [ 21 ]
0.174
0.600
0.433
0.605
0.435
0.654
0.475
NEAR [ 10 ]
0.520
0.880
0.700
0.870
0.690
0.840
0.660
Table 2: Zero-cost ranking performance. FENAS is trained with 424 labels on NB101 and 156 labels on NB201; other ZCPs are training-free. ∗ marks FENAS base features.
Method
Cost
CF10 Test
CF100 Test
IN16 Test
(s)
(%)
(%)
(%)
REA [ 26 ]
∼ 12000
93.92 ± 0.30
71.84 ± 0.99
45.15 ± 0.89
Arch2Vec-BO [ 33 ]
∼ 12000
94.18 ± 0.24
73.37 ± 0.30
46.27 ± 0.37
TNASP [ 17 ]
∼ 4500
94.22 ± 0.18
73.35 ± 0.21
46.31 ± 0.25
PINAT [ 16 ]
∼ 3800
94.09 ± 0.14
73.26 ± 0.19
46.55 ± 0.72
CAP [ 11 ]
15.65
94.34 ± 0.06
73.41 ± 0.22
46.44 ± 0.36
Table 3: End-to-end search results on NAS-Bench-201 [ 7 ] . FENAS uses 50 labeled samples to rank the full space; test accuracy (%) is reported for the best architecture among the top-50 candidates.
Method
Params
Best Acc
Average Acc
Search Cost
(M)
(%)
(%)
(GPU Days)
DARTS [ 15 ]
3.3
-
97.24 ± 0.09
4.0
Arch2Vec-BO [ 33 ]
3.6
97.52
97.44 ± 0.05
100
BANANAS [ 30 ]
3.6
-
97.33 ± 0.07
11.8
CTNAS [ 4 ]
3.6
-
97.41 ± 0.04
0.3
PINAT [ 16 ]
3.6
97.58
97.46 ± 0.08
0.3
Table 4: Search-and-retrain results in the DARTS [ 15 ] open domain on CIFAR-10.
Figure 2: Complementarity and adaptive collaboration among ZCPs on NAS-Bench-201.
Cumulative Features
CIFAR-10 ( τ )
CIFAR-100 ( τ )
ImageNet16-120 ( τ )
zT
0.598
0.611
0.581
zT+zE
0.604
0.613
0.585
zT+zE+zC
0.656
0.682
0.669
zT+zE+zC+zP
0.731
0.730
0.716
Table 5: Ranking performance ( τ ) of cumulative combinations of the four physical proxy dimensions on NAS-Bench-201.
Feature Strategy
LR
RF
τ
ρ
τ
ρ
S1 (no CAST)
0.491
0.686
0.718
0.887
S2 (ECDF only)
0.545
0.735
0.729
0.895
S3 (Synergy only)
0.515
0.695
0.733
0.896
S4 (full CAST)
0.560
0.750
0.731
0.904
Table 6: Ablation of CAST on NAS-Bench-201/CIFAR-10 with 1% labels.