DAGAF: A directed acyclic generative adversarial framework for joint structure learning and tabular data synthesis

Synthetic tabular data generation addresses data scarcity and privacy constraints in a variety of domains. Tabular Prior-Data Fitted Network (TabPFN), a recent foundation model for tabular data, has been shown capable of generating high-quality synthetic tabular data. However, TabPFN is autoregressive: features are generated sequentially by conditioning on the previous ones, depending on the order in which they appear in the input data. We demonstrate that when the feature order conflicts with causal structure, the model produces spurious correlations that impair its ability to generate synthetic data and preserve causal effects. We address this limitation by integrating causal structure into TabPFN's generation process through two complementary approaches: Directed Acyclic Graph (DAG)-aware conditioning, which samples each variable given its causal parents, and a partially directed acyclic graph (PDAG)-based strategy for scenarios with partial causal knowledge. We evaluate these approaches on controlled benchmarks and six CSuite datasets, assessing structural fidelity, distributional quality, and Average Treatment Effect (ATE) preservation. Across most settings, DAG-aware conditioning improves the quality and stability of synthetic data relative to vanilla TabPFN. Under partial causal knowledge, the oracle partially directed acyclic graph (oracle-PDAG), which orients only the edges into the colliders, shows moderate gains, while the benefit of a Completed Partially Directed Acyclic Graph (CPDAG) discovered from data depends on how well the causal structure is recovered. These results indicate that reliable causal structure, even partial, can be injected into TabPFN at inference time, without parameter updates, to improve synthetic data quality.

Existing tabular data generation methods primarily focus on matching statistical distributions between real and synthetic data, often overlooking the preservation of underlying causal relationships. As a result, generated samples may appear realistic while failing to maintain the causal structure required for reliable downstream analysis. We propose CA-GAN, a causal-aware generative framework for tabular data synthesis that explicitly incorporates causal knowledge into both the training and generation processes. CA-GAN first extracts a causal graph from real data to provide structural prior knowledge, then employs a graph-conditioned Conditional WGAN-GP whose sub-generators model variables according to their causal dependencies. More importantly, we introduce a reinforcement learning-based objective that treats causal graph discrepancy between real and synthetic data as a reward signal, enabling causal consistency to become an explicit optimization target during training rather than an implicit consequence of sampling order. Extensive experiments on 14 synthetic and real-world datasets demonstrate that CA-GAN consistently outperforms seven state-of-the-art baselines in causal preservation while achieving strong downstream utility, privacy preservation, and data quality. These results show that CA-GAN provides an effective and practical solution for generating high-quality synthetic tabular data that better respects underlying causal mechanisms.

Existing evaluations of tabular synthesis models rely primarily on low-order statistics and downstream task performance, leaving multivariate causal relationships that go beyond pairwise correlations largely unmeasured. We argue that a systematic evaluation on high-order structural information is a crucial first step in addressing this issue in tabular data synthesis. In this paper, we present high-order structural causal information as a natural form of prior knowledge and introduce a benchmark framework to evaluate tabular synthesis models. This framework allows us to generate benchmark datasets through a flexible range of data generation processes, allowing for the training of tabular synthesis models using these datasets for further evaluation. We propose multiple benchmark tasks, high-order metrics, and causal inference tasks as downstream tasks for evaluating the quality of synthetic data generated by the trained models. Our experiments demonstrate the effectiveness of the benchmark framework in evaluating the model's ability to capture high-order structural causal information. Furthermore, our benchmarking results provide an initial assessment of state-of-the-art tabular synthesis models. These results reveal significant gaps between ideal and actual performance and highlight how baseline methods differ. We position the framework as a controlled diagnostic benchmark for causal fidelity, complementing existing low-order and downstream evaluations. We open source the benchmark framework, including both code and data along with documentation, to support further research in this area.