cs.LGOct 11, 2026

FENAS: A Few-Shot Meta-Ensembling Framework for Efficient Neural Architecture Search with Synergized Zero-Cost Proxies

Authors: Yifeng Mao, Yuze Feng, Yutong Shen, Liyang Gao, Zhixiang He

Organizations: Beijing University of Technology, Beijing, China

Abstract

Efficient neural architecture search (NAS) requires accurate performance estimation under limited evaluation budgets. Existing zero-cost proxies (ZCPs) provide fast training-free signals, but each proxy usually captures only a partial property of an architecture, leading to unstable rankings across datasets and search spaces. In contrast, GNN-based predictors can improve accuracy, but often depend on labeled architectures, graph encoders, and costly representation learning, which makes them less suitable for extreme few-shot settings. We propose FENAS, a topology-agnostic few-shot prediction framework that turns complementary initialization priors into robust ranking signals. Its core component, CAST, is a feature pipeline that combines copula alignment and synergy transformation. CAST maps heterogeneous ZCPs into a compact feature manifold, enabling lightweight meta-learners to produce reliable rankings from scarce supervision. On NAS-Bench-201, with only 0.5% labeled samples, FENAS achieves a Kendall's Tau (ττ) of 0.70, outperforming representative topology-based few-shot predictors in this low-label regime. In closed-domain search, FENAS evaluates the NAS-Bench-201 space in approximately 1138 seconds and achieves competitive test accuracy. By providing a fast, reliable, and structurally simple evaluation mechanism, FENAS supports the design of automated neural architectures under limited evaluation budgets.

Figures & tables

Explore similar work

CardsList
  1. Prediction-powered Neural Architecture Search

    Oct 1, 2026Pascal Janetzky, Yuxin Wang, Michael Klar +1Neural Architecture SearchPrediction-Powered Inference

  2. ZAPS: Zero-Cost Active Proxy Search for Neural Architecture Search

    Sep 12, 2026Hassan Touayouch, Rabie Najem, Mohammed BenjellounNeural Architecture SearchSurrogate-Assisted Optimization

  3. LESS: Lightweight Evolutionary Supernet Search in Minutes

    Oct 1, 2026Aviral Gandhi, Jinglue Xu, Jialong Li +1Evolutionary OptimizationCovariance Matrix Adaptation Evolution Strategy