Bayesian Generative Adversarial Networks via Gaussian Approximation for Tabular Data Synthesis
Organizations: Department of Social Statistics, The University of Manchester, Oxford Rd, Manchester, M13 9PL, UK. · Alliance Manchester Business School, The University of Manchester, Booth Street West, Manchester, M15 6PB, UK.
Abstract
Generative Adversarial Networks (GAN) have been used in many studies to synthesise mixed tabular data. Conditional tabular GAN (CTGAN) have been the most popular variant but struggle to effectively navigate the risk-utility trade-off. Bayesian GAN have received less attention for tabular data, but have been explored with unstructured data such as images and text. The most used technique employed in Bayesian GAN is Markov Chain Monte Carlo (MCMC), but it is computationally intensive, particularly in terms of weight storage. In this paper, we introduce Gaussian Approximation of CTGAN (GACTGAN), an integration of the Bayesian posterior approximation technique using Stochastic Weight Averaging-Gaussian (SWAG) within the CTGAN generator to synthesise tabular data, reducing computational overhead after the training phase. We demonstrate that GACTGAN yields better synthetic data compared to CTGAN, achieving better preservation of tabular structure and inferential statistics with less privacy risk. These results highlight GACTGAN as a simpler, effective implementation of Bayesian tabular synthesis.
Figures & tables
| Acronym | Dataset Name | Year | #Observations | #Numerical | #Categorical |
|---|---|---|---|---|---|
| Variables | Variables | ||||
| UK | UK Census | 1991 | 104267 | 0 | 15 |
| ID | Indonesia Census | 2010 | 177429 | 0 | 13 |
| CA | Canada Census | 2011 | 32149 | 3 | 22 |
| FI | Fiji Census | 2007 | 84323 | 0 | 19 |
| RW | Rwanda Census | 2012 | 31455 | 0 | 13 |
| Model | Parameter | Size |
| CTGAN | layer size | (256, 256) |
| Noise dimensions | 128 | |
| Dropout (for ) | 0.5 | |
| Number of epochs | 200 | |
| Batch size | 500 | |
| Pac | 10 |
| Covariance Rank | = 0.75 | = 1 | ||||||
|---|---|---|---|---|---|---|---|---|
| Vanilla | Wasserstein | Vanilla | Wasserstein | |||||
| Utility ( ) | Risk ( ) | Utility ( ) | Risk ( ) | Utility ( ) | Risk ( ) | Utility ( ) | Risk ( ) | |
| Diagonal | 4.21 | 1.30 | 3.24 | 0.78 | 4.63 | 4.29 | 3.63 | 5.15 |
| 30 | 4.86 | -4.12 | 3.57 | -4.89 | 6.18 | 1.29 | 5.73 | 4.59 |
| 100 | 5.93 | -1.57 | 4.74 | -2.22 | 6.53 | 1.57 | 6.08 | 2.69 |
| 150 | 5.89 | -0.41 | 6.03 | -1.02 | 6.46 | 4.08 | 6.95 | 4.29 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Year | Continuous columns | Categorical Columns |
|---|---|---|---|
| UK | 1991 | - | AREAP, AGE, COBIRTH, ECONPRIM, ETHGROUP, FAMTYPE, HOURS, LTILL, MSTATUS, QUALNUM, RELAT, SEX, SOCLASS, TRANWORK, TENURE |
| ID | 2010 | - | OWNERSHIP, LANDOWN, AGE, RELATE, SEX, MARST, HOMEFEM, HOMEMALE, RELIGION, SCHOOL, LIT, EDATTAIND, DISABLED |
| FI | 2007 | - | PROV, TENURE, RELATE, SEX, AGE, ETHNIC, MARST, RELIGION, BPLPROV, RESPROV, RESSTAT, SCHOOL, EDATTAIN, TRAVEL, WORKTYPE, OCC1, IND2, CLASSWKR, MIG5YR |
| RW | 2012 | - | AGE, STATUS, SEX, URBAN, REGBTH, WKSECTOR, MARST, NSPOUSE, CLASSWK, OWNERSH, DISAB2, DISAB1, EDCERT, RELATE, RELIG, OCC, HINS, NATION, LIT, IND1, BPL |
| AD | - | age, fnlwgt, capital-gain, capital-loss, hours-per-week | workclass, education, education-num, marital-status, occupation, relationship, race, sex, native-country, income |
| CH | - | CreditScore, Age, Balance, EstimatedSalary | Geography, Gender, Tenure, NumOfProducts, HasCrCard, IsActiveMember, Exited |
Synthetic Tabular Data Generation
Synthetic tabular data generation creates artificial records that preserve useful feature relationships while limiting exposure of sensitive data.
See all 98 papers