cs.NENov 17, 2026

TabDAG: Structured Evolutionary Search for Tabular Feature Engineering

Authors: Anastasia Volkova, Andrey Kuznetsov, Ivan Oseledets, Valentin Khrulkov

Organizations: FusionBrain Lab · AXXX

Abstract

Feature engineering can improve tabular prediction, but useful transformations are compositional, data-dependent, and subject to leakage constraints. We present TabDAG, a framework that combines evolutionary search with a graph representation of feature-engineering programs. Nodes implement row-wise or data-fitted transformations; edges encode dependencies among raw variables, intermediate values, and final features. The representation supports interactions, statistical encodings, clustering- and neighborhood-based features, and multi-stage compositions in a single executable program. Mutations are structured edits constrained by a parent-specific schema and checked before evaluation. In our experiments, no structurally invalid program reached evaluation, although proposals could be rejected and valid graphs could still fail at runtime. Across ten regression and classification datasets and three tabular model families, evolved features improve predictive performance over raw inputs. TabDAG and its combination with OpenFE achieve the two best mean ranks among the compared methods; pairwise rank differences between feature-engineering methods do not survive multiple-testing correction. The LLM-based searches use the same backbone and candidate-evaluation budget. A controlled ablation compares free-form Python, whole-graph JSON, and constrained graph edits with the search engine, budget, and backbone held fixed. Constrained edits yield fewer failed evaluations than either rewrite baseline. The resulting graphs expose the transformations and dependencies selected by search, enabling feature-level analysis of the observed gains.

Figures & tables

Appendix figures & tables16 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Evolutionary Feature Engineering for Structured Data

    Jul 2, 2026Ege Onur Taga, Yilin Zhuang, M. Emrullah Ildiz +4Large Language Model-Guided OptimizationTime Series Forecasting

  2. TabPrep: Closing the Feature Engineering Gap in Tabular Benchmarks

    Jun 1, 2026Andrej Tschalzev, Nick Erickson, Yuyang Wang +4Tabular MLAutomated Feature Engineering

  3. Adaptive Graph-of-Islands Evolution for Automatic Feature Engineering with LLMs

    Jul 25, 2026Sha Li, Naren RamakrishnanEvolutionary OptimizationLarge Language Model-Guided Optimization