Synthetic Data Evaluation

Ask about this topic

Momentum

22 papers in the last four weeks, up 100% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 149

All topics
CardsList

  1. Invent a Dataset: Measuring dataset generation abilities with zero seed

    Oct 1, 2026Shivalika Singh, Andrija Djurisic, Gbemileke Onilude +2Synthetic Data GenerationSynthetic Data Generation for Language Models

    Adaption

  2. Generation Provenance Before Behavior Attribution: Auditing Synthetic Speech Research Objects

    Oct 1, 2026Sidi Chang, Peiying ZhuData ProvenanceTraining Data Attribution

    Blossom AI Labs Blossom AI Tokyo, Japan

  3. Source Identification Is Not Fitness Testing: Measuring the Limits of Synthetic-Data Attribution

    Sep 30, 2026Joss ArmstrongModel CollapseTraining Data Attribution

    Ericsson, Athlone, Ireland

  4. Synthetic Data Characterization via Training Dynamics

    Sep 30, 2026Irene Lago, Ana Ezquerro, David VilaresSynthetic Data Generation for Language ModelsSynthetic Data Evaluation

    Universidade da Coruña, CITIC, Spain · Graz University of Technology, IML, Austria

  5. SimTrace: Grounded Multimodal User Trajectories Generation for Online User Modeling

    Sep 29, 2026Yunan Lu, Shuang Xie, Meghna Allamudi +4Synthetic Data GenerationUser Modeling

    Shopify · Columbia University

  6. AutoDataBench: Can Agents Write the Data That Feeds the Self-Improvement Loop?

    Sep 28, 2026Haotian Luo, Haoyu Wang, Zeyu Qin +5AI Agent BenchmarksSynthetic Benchmark Generation

    HKUST · SLAI · NTU

  7. StatD2GAN: When Calibration Masks Generator Quality in Held-Out Evaluation of Synthetic Weather Sequences

    Sep 27, 2026Mustafa Ozaytac, Ozge Karadag AtasTime Series GenerationModel Calibration

    Department of Statistics, Graduate School of Science and Engineering, Hacettepe University, Ankara, 06800, Turkey · Department of Statistics, Faculty of Science, Hacettepe University, Ankara, 06800, Turkey

  8. Artificial Societies Benchmark: A Validation Framework for Synthetic Research

    Sep 24, 2026Edoardo Chidichimo, Min Jun Jung, Felix P. S. Wallis +1Benchmark DesignComputational Social Science

    Artificial Societies University of Oxford, UK

  9. Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark

    Sep 24, 2026Christine Park, Valerie Chen, Tim DettmersSynthetic Benchmark GenerationClinical Language Model Evaluation

    Carnegie Mellon University

  10. Augur: A Synthetic Decision Lab for Rehearsing Reactions to Product and Policy Changes

    Sep 24, 2026Rahul Khedar, Mayank Malhotra, Avinash KarnLLM EvaluationLLM Decision-Making

    PayPal AI

  11. Consequential Behaviour and Representational Fairness in the Validation of Synthetic Research

    Sep 23, 2026Florian Kutzner, Celina Kacperski, Laura de Molière +4Algorithmic FairnessLarge Language Model-Based Social Simulation

    decision-context. · Seeburg Castle University, Seekirchen am Wallersee, Austria. · Artificial Societies Ltd., London, United Kingdom. +1

  12. Concept Drift from a Causal Perspective

    Sep 21, 2026Eduardo V. L. Barboza, Jean Paul Barddal, Robert Sabourin +1Concept DriftDrifting Models

    LIVIA, École de Technologie Supérieure · Graduate Program in Informatics (PPGIa), Pontifícia Universidade Católica do Paraná (PUCPR)

  13. A paired synthetic construction-site image dataset for robust computer vision under adverse conditions

    Sep 21, 2026Viet Huy Duong, Ruoxin Xiong, Md Abdullah Al Forhad +1Synthetic Data GenerationSynthetic Benchmark Generation

    Department of Computer Science, College of Arts and Sciences, Kent State University, Kent, Ohio, United States. · Assistant Professor, Construction Management Program, College of Architecture and Environmental Design, Kent State University, Kent, Ohio, United States. · Department of Computer Science and Engineering, University of North Texas, Denton, Texas, United States. +1

  14. Error-Supervised Synthetic Learner Writing for Automated Essay Scoring

    Sep 20, 2026Duy Anh NguyenAutomated Essay ScoringSynthetic Data Generation for Language Models

    University of Greenwich, London, United Kingdom · FPT University, Can Tho, Vietnam

  15. Beyond Pixel Similarity: Task-Aware Evaluation of GAN-Based Synthetic Sonar Data for Robotic Perception

    Sep 16, 2026Hannan Ejaz Keen, Muhammad Moazam Fraz, Karsten BernsSynthetic Data Generation for RoboticsRobotic Perception

    XITASO GmbH IT & Software Solutions, Augsburg, Germany · School of Electrical Engineering and Computer Science at National University of Sciences and Technology (NUST), Islamabad, Pakistan · Department of Computer Science at Technical University of Kaiserslautern, Kaiserslautern, Germany

  16. Synthetic Electric Vehicle Charging Session Generation Using a Conditional Variational Autoencoder

    Sep 15, 2026Graeme Kelly, Emilio J. Palacios-Garcia, Barry P. HayesSynthetic Data GenerationElectric Vehicle Charging

    School of Engineering and Architecture, University College Cork, Cork, Ireland · MaREI Centre, Sustainability Institute, University College Cork, Cork, Ireland

  17. Four Ledgers, Not One Score: Responsible Communication of LLM-Judge Calibration in Biomedical ML

    Sep 14, 2026Sidi Chang, Peiying ZhuLLM-as-a-JudgeLLM Auditing

    Blossom AI San Francisco, CA, USA

  18. Meddies-PII: A Multilingual Framework for Personally Identifiable Information Extraction in Clinical De-identification

    Sep 14, 2026Linh Uyen Le, Christian Hoang, Huy Hoang HaSynthetic Data GenerationClinical Information Extraction

    Meddies AI, Vietnam

  19. CausalArena: Benchmarking Causal Discovery in the Foundation Model Era

    Sep 10, 2026Zi-Rong Li, Si-Yang Liu, Tian-Zuo Wang +1Causal Foundation ModelsStructural Causal Models

    School of Artificial Intelligence, Nanjing University

  20. Generating a Consistent Enterprise: Synthesis and Reference-Free Evaluation of Multi-System Business Data

    Sep 10, 2026Benjamin Gruenbaum, Doron Porat, Assaf Natanzon +4Synthetic Data GenerationSynthetic Benchmark Generation

    Eon

  21. Subgroup Membership Inference Audits of Differentially Private Synthetic Text

    Sep 9, 2026Yidan Sun, Viktor Schlegel, Srinivasan Nandakumar +2Privacy AuditingMembership Inference Attacks

    Imperial College London, Imperial Global Singapore · Nanyang Technological University, Singapore · Imperial College London, United Kingdom

  22. Marginal Fidelity Does Not Establish User Simulation in Demographic Synthetic Survey Panels: Response Contracts, Support Collapse and Conditioning Failure

    Sep 7, 2026Alexander DoudkinUser SimulationTabular Data Synthesis

    Minds AI Labs, Inc.

  23. MiDShip: Multimodal Dataset of Ship Cargo Hold Structures for Engineering Design

    Sep 4, 2026Noah J. Bagazinski, Md. Ferdous Alam, Jaya Manideep Rebbagondla +1Synthetic Data GenerationSynthetic Data Evaluation

    Department of Mechanical Engineering, Massachusetts Institute of Technology Cambridge, MA 02139 · George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology Atlanta, GA 30318

  24. Portable Causal Fairness Across Synthetic Data Generator Families

    Sep 2, 2026Steven Golob, Sikha Pentyala, Martine De CockAlgorithmic FairnessSynthetic Tabular Data Generation

    University of Washington Tacoma

  25. IDSPACE: A Novel Document Generator for Reliable Evaluation of Digital Identity Verification Systems [Extended Technical Report]

    Sep 2, 2026Lulu Xie, Yancheng Wang, Kanchan Chowdhury +3Synthetic Data GenerationImage Generation

    Arizona State University · Marquette University

  26. Position: Privacy Is a Claim, Not a Property of Synthetic Data

    Sep 1, 2026Jiachen Zhao, Antonia Januszewicz, Taeho JungPrivacy AuditingPrivacy-Preserving ML

    Department of Computer Science Engineering, University of Notre Dame, Notre Dame, United States.

  27. A Network Science Perspective on Evaluating Deep Graph Generative Models

    Sep 1, 2026Tianrui Mao, Abele Malan, Megha Khosla +2Synthetic Data GenerationGenerative Modeling

    Delft University of Technology, the Netherlands · University of Neuchˆatel, Switzerland

  28. RailSyn: Diagnosis-Guided Image Generation for Traceable Data Completion in Railway Foreign Object Detection

    Aug 31, 2026Quan Hao, Chenxi Zhang, Ziyang Tao +6Synthetic Data AugmentationSynthetic Data Generation

    1The School of Information Science and Technology, Beijing University of Technology · 2Pratt School of Engineering, Duke University · 3Academy of Mathematics and Systems Science, Chinese Academy of Sciences +3

  29. Creation begins with understanding: LLMs as strategy designers for privacy-preserving tabular data synthesis

    Aug 30, 2026Jinmeng Li, Quan Zhang, Hangting Ye +4Synthetic Tabular Data GenerationPrivacy-Preserving ML

    School of Artificial Intelligence, Jilin University, Changchun, China · Broad College of Business, Michigan State University, East Lansing, USA · Commonwealth Scientific and Industrial Research Organisation (CSIRO), Australia +2

  30. LOB-ID: Evaluating Synthetic Market Data by Inception Distances

    Aug 13, 2026Andreea Bacalum, Zhuohan Wang, Ollie Olby +2Quantitative FinanceSynthetic Data Evaluation

    Simudyne · King's College London, United Kingdom

  31. CoMedBench: A Multi-Source Benchmark of Synthetic Medical Data Fidelity and Downstream Utility

    Aug 13, 2026Akanta Das, Al Amin Farhad, Mrinmoy Sarkar Anto +3Benchmark DesignSynthetic Data Generation

    Bangladesh University of Engineering and Technology, Dhaka, Bangladesh · School of Medicine, Stanford University, Stanford, California, United States

  32. Benchmarking Time Series Generation Methods for Privacy-Preserving Forecasting

    Aug 11, 2026Luis Amorim, Vitor Cerqueira, Moises Santos +2Synthetic Data GenerationTime Series Forecasting

    Faculdade de Engenharia da Universidade do Porto, Porto, Portugal · University of Coimbra, Coimbra, Portugal · Laboratory for Artificial Intelligence and Computer Science (LIACC), Portugal +3

  33. Compositional Benchmark Synthesis for Hierarchical Human Action Recognition

    Aug 11, 2026Farnaz Soleimani, Abdelghani Chibani, Yacine Amirat +1Human Activity RecognitionSynthetic Benchmark Generation

    LISSI

  34. Privacy-Preserving Data Drift Detection and Recovery for Large-Scale LLM Applications via Proxy Representations

    Aug 8, 2026Michael Levit, Josh Ledgard, Haoyu Dong +5LLM EvaluationSynthetic Data Generation

    Microsoft Corporation

  35. Improving the Realism of Synthetic Clinical Benchmarks Under Utility Constraints

    Aug 6, 2026Omid Bazgir, Md Nasir, Jacob Hoffman +6Synthetic Benchmark GenerationBenchmark Validity

    Oracle Health and Life Sciences United States

  36. Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation

    Aug 4, 2026Seyed Kahaki, Shijie Li, Weijie Chen +1Medical Image SynthesisImage Generation Evaluation

    Division of Imaging, Diagnostics, and Software Reliability, U.S. Food and Drug Administration (FDA)

  37. Impact of Dataset Composition on Embedded Real-Time UAV Wildfire Detection Using Compact YOLO Models

    Aug 1, 2026Eduardo de los Santos, Andre S. Kelbouscas, Ricardo B. Grando +1Synthetic Data AugmentationWildfire Detection

    Robotics and AI Lab, Technological University of Uruguay, Rivera, Uruguay

  38. When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses

    Jul 28, 2026Zihan Chen, Di Zhu, Lei Nico ZhengLLM EvaluationLarge Language Model-Based Social Simulation

    Stevens Institute of Technology Hoboken, NJ, USA · University of Massachusetts Boston Boston, MA, USA

  39. On the Use of Synthetic Data for Threshold Calibration in Face Recognition: Performance and Security Implications for Border Control Systems

    Jul 27, 2026Arto ApilaBiometric IdentificationFace Recognition

    Faculty of Information Technology and Electrical Engineering, University of Oulu, Finland

  40. Distributional Validity of a Korean Synthetic Persona Panel: Evidence From the Korea Media Panel Survey

    Jul 23, 2026Howard Kim, Keuntae ChoPersona-Conditioned GenerationSynthetic Data Evaluation

    College of AI Convergence, Seoul Cyber University, Seoul 01133, South Korea · Department of Management of Technology, Graduate School, Sungkyunkwan University, Suwon 16419, South Korea · Department of Systems Management Engineering, Sungkyunkwan University, Suwon 16419, South Korea

  41. Synthetic minority data is redundant or invalid: a data-dependent validity theory and a de-biased test

    Jul 22, 2026Ahmad B. Hassanat, Ahmad S. Tarawneh, Ghada A. AltarawnehClass-Imbalanced LearningSynthetic Data Generation

    Faculty of Information Technology, Mutah University, Karak, Jordan · Department of Accounting, Mutah University, Karak, Jordan

  42. Measuring the Dependency Gap: Diagnosing Inter-Column Fidelity in Tabular Generative Models

    Jul 20, 2026Jie ZhangTwo-Sample TestingSynthetic Tabular Data Generation

    Accenture, Tokyo 107-8672, Japan

  43. Seq2Synth: Benchmarking Temporal Fidelity in Synthetic Sequential Tabular Data

    Jul 17, 2026Kiwan Kwon, Kangmin Kim, Hojin Lee +5Synthetic Data Evaluation

    UNIST · HUFS · JP Morgan AI Research +1

  44. Demographically-Conditioned Synthetic Medical Images for Bias Mitigation and Bias Detection in Disease Classifiers

    Jul 16, 2026Mahmoud Ibrahim, Bart Elen, Chang Sun +2Synthetic Data PretrainingAlgorithmic Fairness

    Institute of Data Science, Faculty of Science and Engineering, Maastricht University, Maastricht, The Netherlands · Department of Advanced Computing Sciences, Faculty of Science and Engineering, Maastricht University, Maastricht, The Netherlands · VITO, Belgium

  45. Benchmarking Face Recognition without Real Faces

    Jul 16, 2026Paweł Borsukiewicz, Daniele Lunghi, Wendkûuni C. Ouédraogo +2Privacy-Preserving MLFace Recognition

    University of Luxembourg · Luxembourg

  46. Metric-Guided Synthetic Image Data Rendering for Deep Learning compatible with Agentic AI

    Jul 14, 2026Martina Radoynova, Samuel Pantze, Trina De +2Synthetic-to-Real Domain AdaptationSynthetic Data Generation

    Center for Advanced Systems Understanding (CASUS), Görlitz, Germany · Helmholtz-Zentrum Dresden-Rossendorf e. V. (HZDR), Dresden, Germany · Institute of Computer Science, University of Wrocław, Wrocław, Poland +1

  47. Data Safety: Synthetic Data Quality Analysis Using CIFAKE Dataset

    Jul 13, 2026Kuniko Paxton, Amila Akagić, Koorosh Aslansefat +2Synthetic Data AugmentationSynthetic Data Evaluation

    School of Digital and Physical Science, University of Hull, Cottingham Road, Hull, HU6 7RX, United Kingdom · Faculty of Electrical Engineering, University of Sarajevo, Zmaja od Bosne bb, Sarajevo, 71000, Bosnia and Herzegovina

  48. Trustworthy synthetic data for campaign decision support: strategy simulation fidelity and the PolicySynth framework

    Jul 13, 2026Tung Dang, The Hung Phung, Son Lam Nguyen +1AI-Assisted Decision MakingSynthetic Data Generation

    aGraduate School of Science, The University of Tokyo, 7-3-1 Hongo Bunkyo-ku, Tokyo, 113-0033, Japan · bFaculty of Human Resource Management, Trade Union University, 169 Tay Son, Kim Lien, Hanoi, Vietnam · cInstitute for Business Management Development, Academy Of Finance, 58 Le Van Hien Street, Dong Ngac Ward, Hanoi, Vietnam +1

  49. AU-Guided Synthetic Video Generation for Micro-Expression Recognition

    Jul 12, 2026Pei-Sze Tan, Sailaja Rajanala, Yee-Fan Tan +2Synthetic Data GenerationFacial Expression Recognition

    CyPhi AI Lab, Monash University Malaysia

  50. Where to Intervene? Benchmarking Fairness-Aware Learning on Differentially Private Synthetic Tabular Data

    Jul 8, 2026Vinícius Gabriel Angelozzi, Héber H. ArcoleziAlgorithmic FairnessGroup Fairness

    Centre Inria de l’Université Grenoble Alpes · ÉTS Montréal, Inria Grenoble

  51. SynthAVE: Scalable Synthetic Labeling for E-Commerce with LLM-Arena Validation

    Jul 8, 2026Andrea Scarinci, Virginia Negri, Brayan Impata +3LLM-as-a-JudgeLLM-Assisted Annotation

    Amazon

  52. Property-Driven Synthetic Data Engineering for Data-Scarce Software Systems: Reflections from the Breast Cancer Domain

    Jul 7, 2026Aurora Francesca Zanenga, Andrea Bombarda, Marsha Chechik +4Synthetic Data GenerationAutomated Software Engineering

    University of Bergamo Bergamo, Italy · University of Toronto Toronto, Canada · Humanitas Clinical and Research Center, IRCCS Rozzano, Italy +2

  53. Faithful or Findable? Evaluating LLM-Generated Metadata for RDF Dataset Search

    Jul 7, 2026Riccardo Terrenzi, Serkan AyvazIR EvaluationSynthetic Data Evaluation

    University of Southern Denmark Sønderborg, Denmark

  54. Synthetic Consumer Insight Generation with Large Language Models

    Jul 7, 2026Stephen L. France, Pia. A. AlbinssonLLM PromptingSynthetic Data Generation

    Mississippi State University Mailstop 9582, Mississippi State, MS 39762

  55. Fidelity-Diversity Metrics for Text

    Jul 6, 2026Amanda Wang, Tudor Manole, Florentina Bunea +1Synthetic Data Evaluation

    Department of Computer Science, Cornell University · Statistics and Data Science Center, Massachusetts Institute of Technology · Department of Statistics, Cornell University

  56. Signal or Noise? Understanding Generative Models for Real-World Sensor Time Series

    Jul 5, 2026Zitao Shuai, Zongzhe Xu, Yuntian Wu +3Flow MatchingSynthetic Data Generation

    University of California, Los Angeles · 2Carnegie Mellon University · 3Massachusetts Institute of Technology

  57. TabQueryBench: A Query-Centric Benchmark for Synthetic Tabular Data

    Jul 4, 2026Jialin Zhang, Fenghao Dong, Yajie Zhou +2Benchmark DesignSynthetic Tabular Data Generation

    †University of Hong Kong ¶Tongji University · ‡Carnegie Mellon University · §University of Maryland, College Park

  58. Forensic-Oriented Intrusion Detection Using Synthetic Network Traffic Data and Explainable Artificial Intelligence

    Jul 1, 2026Jose Luis Vela Alonso, Carmen PellicerSynthetic Data GenerationNetwork Intrusion Detection

    CESTE, University Center, Zaragoza, Spain

  59. A Filtered Mixture-of-Generators for Fully Synthetic Survival Training

    Jun 30, 2026Niccolò Maria Rizzi, Eugenio Lomurno, Alberto Archetti +1Survival AnalysisSynthetic Data Generation

    Politecnico di Milano, Milan, Italy

  60. Towards Inclusive Mobility Modeling: Characterizing and Evaluating Elderly Trajectory Patterns in Urban Systems

    Jun 30, 2026Zhengxuan Wang, Haohan He, Mengying ZhouSynthetic Data Evaluation

    School of Computing and Artificial Intelligence, Shanghai University of Finance and Economics, Shanghai, China · MOE Key Laboratory of Interdisciplinary Research of Computation and Economics, Shanghai University of Finance and Economics, Shanghai, China · Center for Data Science, New York University, New York, USA