Overview

Synthetic data evaluation asks whether generated examples are realistic and suitable for their intended use, such as model training, scientific inference, or benchmarking. Researchers combine distributional and dependence metrics with train-on-synthetic, test-on-real experiments, human or expert review, domain-specific checks, and privacy attacks. Controlled benchmarks with known structure can test whether methods preserve causal, temporal, subgroup, or task-relevant properties that ordinary summary statistics may miss. A central open challenge is that no single fidelity score reliably predicts utility or privacy: results depend on the task, data domain, and evaluation protocol.

Latest papers

CardsList

255 papers20 papers in the last four weeks, down 35% on the four weeks before. 0.2% of all new papers.

  1. UnrealEvent: Synthetic Dataset Generation and Annotation for Event-Based Vision

    Nov 17, 2026Yentel Schoovaerts, Zijie Ning, Patrick VandewalleSynthetic Data GenerationEvent-Based Vision

  2. Exploring the link between predictive uncertainty and the sim-to-real gap in deep learning models utilizing synthetic data

    Nov 16, 2026Alexander Moriz, Lukas Krebs, Amon Göppert +1Learning with Distribution ShiftSynthetic-to-Real Domain Adaptation

  3. Evidence-Conditioned Completion and Synthesis of Electronic Health Records

    Nov 14, 2026Sicheng Shu, Parker Knight, Huitao Li +5Synthetic Clinical Data GenerationElectronic Health Records

  4. Human or Synthetic? What a Fixed Budget Buys for Post-Training

    Nov 12, 2026Shourik Banerjee, Ethan Mendes, Mohit Raghavendra +2LLM Post-TrainingPreference Learning for LLMs

  5. Shaping Useful Noise: Energy Distributions Predict Visual Pretraining Quality

    Nov 9, 2026Ching Lam Choi, Antonio Torralba, Phillip Isola +1Synthetic Data PretrainingSynthetic Data Evaluation

  6. Can General-Purpose Generative AI Supply Training Data for Medical Vision Models? A Multimodal Retrospective Study

    Nov 7, 2026Jiachuan Peng, Kyle Lam, Jierui Qu +10Synthetic Data EvaluationSynthetic Data Augmentation

  7. GSynPEF: A Privacy Evaluation Framework for Synthetic Graphs

    Nov 6, 2026Yu Duan, Luca Baldesi, Carter T. Butts +1Synthetic Data EvaluationSynthetic Data Generation

  8. Composable Causality: A Toolkit for Systematic Time-Series Causal Discovery and Treatment-Effect Benchmarking

    Nov 6, 2026Muhammad Hasan Ferdous, Md Osman GaniTime-Series Causal DiscoveryTime Series Generation

  9. Synthesis of Ovarian Cancer Multi-Omics Datasets: A Biology-Informed Evaluation Framework

    Nov 5, 2026Déborah Boyenval, Alina Malyutina, Jaana Oikkonen +2Synthetic Data GenerationSynthetic Data Evaluation

  10. Dreams Are Cheaper Than Flights: Curated World-Model Data Improves Aerial Detection

    Oct 29, 2026Rugved Katole, Vedant Patil, Jenna Kline +1Synthetic Data AugmentationSynthetic Data Evaluation

  11. Trajeform: Embedding Crowd Data

    Oct 29, 2026Marilena Lemonari, Panayiotis Charalambous, Yiorgos ChrysanthouSynthetic Data EvaluationHuman Behavior Simulation

  12. Seeing Is Not Enough: Knowledge-Grounded Active Inquiry from Uncertain Visual Evidence

    Oct 28, 2026Yucheng Liu, Everett X. WangMultimodal ClassificationClinical Decision-Making

  13. Synthetic Child-Adult Interactions Are Not Developmentally Plausible

    Oct 26, 2026Bastian Bunzeck, Francesca PadovaniLanguage ModelingSynthetic Data Evaluation

  14. Silicon Samples Match the Answers but Not the Respondents

    Oct 22, 2026Yusuke Kumagae, Masahiro KanekoSynthetic Population GenerationSynthetic Data Evaluation

  15. OSynth: A Longitudinal, Context-Sensitive Evaluation of Meeting Understanding

    Oct 21, 2026Ian Porada, Suraj Tripathi, Chaitanya Animesh +8Synthetic Data GenerationSynthetic Data Evaluation

  16. Not All Similarity Is Leakage: Distribution-Aware Identity Leakage Assessment in Synthetic Face Datasets

    Oct 19, 2026Paweł Borsukiewicz, Daniele Lunghi, Wendkûuni C. Ouédraogo +3Data LeakageSynthetic Data Evaluation

  17. FinSafeGuard: A Quality-Driven Synthetic Dataset for Financial AI Safety

    Oct 19, 2026Joseph Thomas Thacil, Reetu Raj Harsh, Krati Saxena +2Synthetic Data GenerationSynthetic Data Evaluation

  18. Exploring The Empirical Privacy Landscape of Synthetic Data

    Oct 15, 2026Zihao Zhao, Avi Schwarzschild, Casey Meehan +3Privacy Leakage in Language ModelsPrivacy-Preserving Language Models

  19. GRADS: Graph-Regulated Agentic Data Synthesis with Controllable Difficulty

    Oct 15, 2026Gaocheng Yang, Ruijie Tao, Kai Ye +3Synthetic Data Generation for LLM AgentsSynthetic Data Generation for Language Models

  20. LURE: a Phase-Labelled Synthetic Corpus of Online-Grooming Exchanges

    Oct 11, 2026Emanuele Florindi, Valentina Franzoni, Ludovico Guercio +2Synthetic Data GenerationSynthetic Data Evaluation

  21. CoverSynth: Coverage-Guided Generation of Retrieval Evaluation Sets

    Oct 11, 2026Anahita Sharma, Apaar Shanker, Rishav Chakravarti +6Synthetic Benchmark GenerationIR Evaluation

  22. Probable but Not Valid: A Psychometric Audit of Decision Models as Synthetic Survey Respondents

    Oct 10, 2026Mantas Lukauskas, Viktorija ŠarkauskaitėSynthetic Data GenerationSynthetic Data Evaluation

  23. Can Synthetic UAV Benchmarks Be Trusted? Real-Synthetic Validation for UAV Model Selection

    Oct 10, 2026Yuyi Zhi, Min Du, Bill Shi +4Synthetic Data EvaluationUAV Remote Sensing

  24. MagicBeanStalk: Escaping the RLVR Zero Advantage Trap with Recursive Data Synthesis

    Oct 8, 2026Ximing Lu, Aviral Kumar, Jan Kautz +2Reinforcement Learning with Verifiable RewardsSynthetic Data Generation for Language Models