Synthetic Data Evaluation

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 100% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 154

All topics

On Privacy Leakage in Tabular Diffusion Models: Influential Factors, Attacker Knowledge, and Metrics
May 7, 2026Masoumeh Shafieinejad, D. B. Emerson, Behnoosh Zamanlooy +5Data Leakage Membership Inference Attacks
Vector Institute · McMaster University · University of Toronto +1
Mind the Gap? A Distributional Comparison of Real and Synthetic Priors for Tabular Foundation Models
May 7, 2026Alex O. Davies, Telmo de Menezes e Silva Filho, Nirav AjmeriSynthetic Data Pretraining Synthetic-to-Real Domain Adaptation
School of Geographical Sciences University of Bristol, UK · School of Engineering Mathematics and Technology University of Bristol, UK · School of Computer Science University of Bristol, UK
Does Synthetic Data Help? Empirical Evidence from Deep Learning Time Series Forecasters
May 7, 2026Hugo Cazaux, Eyjólfur Ingi Ásgeirsson, Hlynur StefánssonSynthetic Data Augmentation Synthetic Data Generation
Department of Engineering Reykjavík University Iceland, Menntavegur 1, 102
iTRIALSPACE: Programmable Virtual Lesion Trials for Controlled Evaluation of Lung CT Models
May 7, 2026Fakrul Islam Tushar, Umme Hafsa Momy, Joseph Y. Lo +1VLM Evaluation Radiology VLMs
Department of Radiology and Imaging Sciences, University of Arizona · Department of Biomedical Engineering, Florida International University · Center for Virtual Imaging Trials, Department of Radiology, Duke University Medical Center
Practical validation of synthetic pre-crash scenarios
May 6, 2026Jian Wu, Ulrich Sander, Carol Flannagan +1Autonomous Driving Safety Evaluation Autonomous Driving Simulation
Safety Center, Volvo Cars, 41878 Göteborg, Sweden · Department of Mechanics and Maritime Sciences, Chalmers University of Technology, 41756 Göteborg, Sweden · University of Michigan Transportation Research Institute, Ann Arbor, Michigan 48109, USA
Cross-Domain Adversarial Augmentation: Stabilizing GANs for Medical and Handwriting Data Scarcity
May 3, 2026Md. Sohanuzzaman Soad, Mahady Al Hady, S M Rafiuddin Rifat +1Synthetic Data Augmentation Medical Image Synthesis
Department of Computer Science and Engineering University of Asia Pacific Dhaka, Bangladesh
Fidelity, Diversity, and Privacy: A Multi-Dimensional LLM Evaluation for Clinical Data Augmentation
Apr 29, 2026Guillermo Iglesias, Gema Bello-Orgaz, María Navas-Loro +3Synthetic Data Augmentation Synthetic Data Generation
Departamento de Sistemas Informáticos, Escuela Técnica Superior de Ingeniería de Sistemas Informáticos, Universidad Politécnica de Madrid, Spain · Department of Psychiatry, University Hospital Rey Juan Carlos, Mostoles, Spain · Department of Psychiatry, University Hospital Jimenez Diaz Foundation, Madrid, Spain +5
Accurate and Robust Generative Approach for Overcoming Data Sparsity and Imbalance in Landslide Modeling with A Tabular Foundation Model
Apr 28, 2026Kaixuan Shao, Gang Mei, Yinghan Wu +2Class-Imbalanced Learning Synthetic Tabular Data Generation
School of Engineering and Technology, China University of Geosciences (Beijing), 100083, Beijing, China · School of Geological Engineering and Geomatics, Chang’an University, 710064, Xi’an, China
STELLAR-E: a Synthetic, Tailored, End-to-end LLM Application Rigorous Evaluator
Apr 27, 2026Alessio Sordo, Lingxiao Du, Meeka-Hanna Lenisa +2LLM Evaluation Synthetic Data Generation
1Deutsche Bank, Berlin Technology Center, Berlin, Germany
Generative Synthetic Data for Causal Inference: Pitfalls, Remedies, and Opportunities
Apr 26, 2026Yichen XuCausal Effect Estimation Synthetic Data Generation
University of California, Berkeley
Evaluation of image simulation open source solutions for simulation of synthetic images in lunar environment
Apr 24, 2026Jai G Singla, Hinal B Patel, Nitant DubeImage Generation Evaluation Synthetic Data Evaluation
Space Applications centre Indian Space Research Organization Ahmedabad, India
Using Zero-Shot LLM-Generated Survey Data for Geographically Explicit Population Synthesis
Apr 23, 2026Taylor Anderson, Sara Von Hoene, Orhan Yagizer Cinar +4Synthetic Data Generation Synthetic Data Evaluation
Dept. of Geography and Geoinformation Science, George Mason University, Fairfax, VA, USA · Dept. of Computer Science, George Mason University, Fairfax, VA, USA · College of Public Health, George Mason University, Fairfax, VA, USA +2
SemanticAgent: A Semantics-Aware Framework for Text-to-SQL Data Synthesis
Apr 23, 2026Qiang Gao, Zhenping Li, Anqi Zhuo +3Synthetic Data Generation Text-to-SQL
Center of Information Research, Academy of Military Science, Beijing 100142, China · School of Mathematics and Physics, University of Science and Technology Beijing, Beijing 100083, China
Synthetic Data in Education: Empirical Insights from Traditional Resampling and Deep Generative Models
Apr 22, 2026Tapiwa Amion Chinodakufa, Ashfaq Ali Shafin, Khandaker Mamun AhmedSynthetic Data Generation Educational Technology
The Beacom College of Computer & Cyber Sciences, Dakota State University · Knight Foundation School of Computing & Information Sciences, Florida International University
Graph2Counsel: Clinically Grounded Synthetic Counseling Dialogue Generation from Client Psychological Graphs
Apr 22, 2026Aishik Mandal, Hiba Arnaout, Clarissa W. Ong +5Mental Health Counseling Mental Health
UKP Lab, Department of Computer Science and Hessian Center for AI (hessian.AI), Technische Universität Darmstadt · Zuse School · National Research Center for Applied Cybersecurity ATHENE +4
Synthetic Flight Data Generation Using Generative Models
Apr 22, 2026Karim Aly, Alexei SharpanskykhSynthetic Data Generation Synthetic Tabular Data Generation
Faculty of Aerospace Engineering · Delft University of Technology (TU Delft) · Delft, The Netherlands
A Dual Perspective on Synthetic Trajectory Generators: Utility Framework and Privacy Vulnerabilities
Apr 21, 2026Aya Cherigui, Florent Guépin, Arnaud Legendre +1Membership Inference Attacks Synthetic Data Generation
Orange Research, Belfort, France · Université Marie et Louis Pasteur, CNRS, institut FEMTO-ST (UMR 6174), F-25000 Besançon, France
A Benchmark Construction and Evaluation Framework for Specialist Domains: Case Study on Defense-related Documents
Apr 20, 2026Bao Gia Doan, Aditya Joshi, Pantelis Elinas +4Synthetic Benchmark Generation RAG Evaluation
UNSW Sydney, Australia · Cyndr AI, Australia
Evaluating quality in synthetic data generation for large tabular health datasets
Apr 17, 2026Jean-Baptiste Escudié, Benjamin Barnes, Stefan Meisegeier +3Healthcare Synthetic Tabular Data Generation
Centre for Artificial Intelligence in Public Health Research, Robert Koch Institute · German Centre for Cancer Registry Data, Robert Koch Institute · Medical Informatics, Berlin Institute of Health at Charité - Universitätsmedizin Berlin
Evaluating LLM Simulators as Differentially Private Data Generators
Apr 16, 2026Nassima M. Bouzid, Dehao Yuan, Nam H. Nguyen +1Synthetic Data Generation Differential Privacy
Capital One
Improving Machine Learning Performance with Synthetic Augmentation
Apr 16, 2026Mel Sohm, Charles Dezons, Sami Sellami +2Synthetic Data Augmentation Quantitative Finance
University of California, Berkeley
Synthesizing real-world distributions from high-dimensional Gaussian Noise with Fully Connected Neural Network
Apr 10, 2026Joanna KomorniczakSynthetic Tabular Data Generation Generative Modeling
Department of Systems and Computer Networks, Wrocław University of Science and Technology
QAQ: Bidirectional Semantic Coherence for Selecting High-Quality Synthetic Code Instructions
Mar 12, 2026Jiayin Lei, Ming Ma, Yunxi Duan +2Instruction-Tuning Data Selection Code Generation
Beijing University of Technology, Beijing, 100124, China · Institute of Neuroscience, State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China · University of Chinese Academy of Sciences, Beijing, 100049, China +1
When Pretty Isn't Useful: Investigating Why Modern Text-to-Image Models Fail as Reliable Training Data Generators
Feb 23, 2026Krzysztof Adamkiewicz, Brian Bernhard Moser, Stanislav Frolov +3Synthetic-to-Real Domain Adaptation Distribution Shift
1RPTU University Kaiserslautern-Landau, Kaiserslautern, Germany · 2German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
SynthSAEBench: Evaluating Sparse Autoencoders on Scalable Realistic Synthetic Data
Feb 16, 2026David Chanin, Adrià Garriga-AlonsoSparse Autoencoders Synthetic Benchmark Generation
University College London · 2MATS · 3Decode Research
Stochastic Parrots or Singing in Harmony? Testing Five Leading LLMs for their Ability to Replicate a Human Survey with Synthetic Data
Feb 10, 2026Jason Miklian, Kristian Hoelscher, John E. KatsosHuman Behavior Simulation Synthetic Data Generation
University of Oslo · Peace Research Institute Oslo · American University of Sharjah
Synthetic Time Series Generation via Complex Networks
Jan 30, 2026Jaime Vale, Vanessa Freitas Silva, Maria Eduarda Silva +1Time Series Generation Synthetic Data Evaluation
Faculdade de Ciˆencias, Universidade do Porto · INESC TEC-CRACS · Faculdade de Economia, Universidade do Porto +1
Interpretable Similarity of Synthetic Image Utility
Dec 18, 2025Panagiota Gatoula, George Dimas, Dimitris K. IakovidisMedical Image Synthesis Synthetic Data Evaluation
University of Thessaly, Department of Computer Science and Biomedical Informatics, Lamia 35131 Greece
Escaping Model Collapse via Synthetic Data Verification: Near-term Improvements and Long-term Convergence
Oct 18, 2025Bingji Yi, Qiyuan Liu, Yuwei Cheng +1Synthetic Data Pretraining Model Collapse
Independent Researcher. Work done while visiting UChicago CS. · Work done while visiting UChicago CS. · Department of Statistics, University of Chicago. +1
Generating Individual Travel Diaries Using Large Language Models Informed by Census and Land-Use Data
Sep 7, 2025Sepehr Golrokh Amin, Devin Rhoads, Fatemeh Fakhrmoosavi +2Synthetic Data Generation Synthetic Data Evaluation
School of Civil and Environmental Engineering, University of Connecticut, United States

May 7, 2026, cs.LGJ/K move · Enter open · S save

On Privacy Leakage in Tabular Diffusion Models: Influential Factors, Attacker Knowledge, and Metrics

Masoumeh Shafieinejad, D. B. Emerson, Behnoosh Zamanlooy, Elaheh Bassak+4

Vector Institute · McMaster University · University of Toronto+1

Data Leakage Membership Inference Attacks Tabular Diffusion Models Tabular Data Synthesis Synthetic Data Evaluation Diffusion Models

Open paper AskPDF arXiv

Tabular data plays an important role in many fields and industries, including those with elevated privacy considerations and risks. As such, there is a rising interest in generating high-quality synthetic proxies for real tabular data as a means of reducing privacy risk and proprietary data exposure. With tabular diffusion models (TDMs) demonstrating leading performance in synthesizing such data, understanding and measuring the privacy risks associated with these models is imperative. Leveraging state-of-the-art membership inference attacks for TDMs in both black- and white-box settings, this work quantifies the impact of training setup, synthesis choices, and attacker knowledge on privacy leakage. Moreover, the results demonstrate that adversaries need not have perfect knowledge of the training setup, identical data distributions, or massive compute resources to construct successful attacks. Finally, the pitfalls associated with applying heuristic privacy metrics, such as distance-to-closest record, are revealed.

Momentum

Related topics

Latest papers 154