Generative AI Evaluation

Ask about this topic

Momentum

29 papers in the last four weeks, up 142% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 211

All topics
CardsList

  1. Spreadsheet Modeling Experiments Using GPTs on Small Problem Statements and the Wall Task

    Apr 28, 2026Thomas A. Grossman, Yuan Chen, Sopiko DatuashviliML ReproducibilitySpreadsheet Automation

    University of San Francisco 2130 Fulton St. San Francisco, CA 94117 USA

  2. Geographic Bias and Diversity in AI Evaluation

    Apr 28, 2026Zilong Liu, Krzysztof Janowicz, Gengchen Mai +2Algorithmic BiasLanguage Model Bias Evaluation

    University of Vienna, Austria · University of Texas at Austin, USA · University of Wisconsin-Madison, USA +1

  3. MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model and Data Card Generation

    Apr 26, 2026Haoxuan Zhang, Ruochi Li, Yang Zhang +4Automated EvaluationGenerative AI Evaluation

    University of North Texas, Denton, TX, USA · North Carolina State University, Raleigh, NC, USA

  4. ProEval: Proactive Failure Discovery and Efficient Performance Estimation for Generative AI Evaluation

    Apr 25, 2026Yizheng Huang, Wenjun Zeng, Aditi Kumaresan +1Active LearningAI Safety Evaluation

    Google DeepMind

  5. Ethics Testing: Proactive Identification of Generative AI System Harms

    Apr 23, 2026Shin Hwei Tan, Haibo Wang, Heng LiAI Safety EvaluationAutomated Test Generation

    Concordia University, Montreal, Canada · Polytechnique Montreal, Montreal, Canada

  6. SpeechParaling-Bench: A Comprehensive Benchmark for Paralinguistic-Aware Speech Generation

    Apr 22, 2026Ruohan Liu, Shukang Yin, Tao Wang +6Audio-Language Model EvaluationLLM Evaluation

    1Nanjing University · 2Xiaomi

  7. Measuring the Machine: Evaluating Generative AI as Pluralist Sociotechical Systems

    Apr 22, 2026Rebecca L. JohnsonAI GovernanceGenerative AI Evaluation

    The School of History and Philosophy of Science, Faculty of Science The University of Sydney

  8. What Makes a Good AI Review? Concern-Level Diagnostics for AI Peer Review

    Apr 21, 2026Ming JinAutomated Peer ReviewGenerative AI Evaluation

    Bradley Department of Electrical & Computer Engineering Virginia Tech

  9. Learning from AVA: Early Lessons from a Curated and Trustworthy Generative AI for Policy and Development Research

    Apr 20, 2026Nimisha Karnatak, Mohamad Chatila, Daniel Alejandro Pinzón Hernández +3Retrieval-Augmented GenerationEvidence-Grounded Generation

    University of Oxford · The World Bank Group · Nouswise, Inc.

  10. Spotlights and Blindspots: Evaluating Machine-Generated Text Detection

    Apr 17, 2026Kevin Stowe, Kailash PatilAI-Generated Text DetectionLanguage Model Generation Evaluation

    Pindrop

  11. SongBench: A Fine-Grained Multi-Aspect Benchmark for Song Quality Assessment

    Apr 16, 2026Dapeng Wu, Shun Lei, Wei Tan +5Text-to-Music GenerationMusic Generation Evaluation

    Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Tencent

  12. Continuous Knowledge Metabolism: Generating Scientific Hypotheses from Evolving Literature

    Apr 14, 2026Jinkai Tao, Yubo Wang, Xiaoyu Liu +1Scientific DiscoveryScientific Hypothesis Generation

    TsingyuAI, Beijing, China · School of Information, Central University of Finance and Economics, Beijing, China · Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China +1

  13. Artificial Intelligence Index Report 2026

    Apr 14, 2026Sha Sajadieh, Loredana Fattorini, Raymond Perrault +20AI for ScienceAI Governance

    Stanford Institute for Human-Centered Artificial Intelligence (HAI)

  14. When Perplexity Lies: Generation-Focused Distillation of Hybrid Sequence Models

    Mar 27, 2026Juan Gabriel Kostelec, Qinghai GuoLLM Inference EfficiencyLLM Evaluation

    Huawei Switzerland · ACS Lab, Huawei Technologies

  15. Overreliance on AI in Information-seeking from Video Content

    Mar 20, 2026Anders Giovanni Møller, Elisa Bassignana, Francesco Pierri +1Video QATrust in AI

    IT University of Copenhagen · Bocconi University · Politecnico di Milano +1

  16. Adaptive Contracts for Cost-Effective AI Delegation

    Mar 17, 2026Eden Saig, Tamar Garbuz, Ariel D. Procaccia +2Generative AI Evaluation

    Technion – Israel Institute of Technology · California Institute of Technology · Tel Aviv University +2

  17. Evaluating Prompt Robustness in Text-to-Audio Systems for Adaptive Virtual Agents and Game Soundtracks

    Mar 14, 2026Jiahui Wu, Mei SiMusic Generation EvaluationText-to-Audio Generation

    Rensselaer Polytechnic Institute Troy, New York, USA

  18. Quantifying the Effect of Test Set Contamination on Generative Evaluations

    Jan 7, 2026Rylan Schaeffer, Joshua Kazdan, Baber Abbasi +8Language Model Generation EvaluationBenchmark Contamination

    Stanford Computer Science · Stanford Statistics · EleutherAI +3

  19. Developing an LLM-Based Feedback System Grounded in Evidence-Centered Design to Support Physics Problem Solving

    Dec 11, 2025Holger Maus, Fabian Kieser, Stefan Petersen +2Educational TechnologyGenerative AI in Education

    Department of Physics Education, Leibniz Institute for Science and Mathematics Education Kiel, Germany · Department of Physics Education Research, Free University of Berlin Berlin, Germany · Department of Physics and Physics Education Research, Ludwigsburg University of Education Ludwigsburg, Germany

  20. Generalized Design Choices for Deepfake Detectors

    Nov 26, 2025Lorenzo Pellegrini, Serafino Pandolfini, Davide Maltoni +3Deep Learning OptimizationDeepfake Detection

    Department of Computer Science and Engineering (DISI) University of Bologna, Italy · IdentifAI, Italy

  21. Generative AI Purpose-built for Social and Mental Health: A Real-World Pilot

    Nov 12, 2025Thomas D. Hull, Lizhe Zhang, Caitlin A. Stamatis +2HealthcareMental Health

    Slingshot AI · CREATIV Lab, Department of Psychiatry and Behavioral Sciences, University of Washington · Department of Psychiatry, NYU School of Medicine +1

  22. AtomBench: A Benchmarking Framework for Generative Crystal Reconstruction Models in Conventional Superconductors

    Oct 17, 2025Charles Rhys Campbell, Aldo H. Romero, Kamal ChoudharyMaterials ScienceGenerative Modeling

    Department of Physics and Astronomy, West Virginia University, Morgantown, WV 26506, USA · Department of Materials Science and Engineering, Whiting School of Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA · Department of Electrical and Computer Engineering, Whiting School of Engineering, The Johns Hopkins University, Baltimore, MD 21218, USA

  23. Generative AI and Sales Productivity: Field Experiments in Online Retail

    Oct 14, 2025Lu Fang, Zhe Yuan, Kaifu Zhang +2Generative AI Evaluation

    †School of Management, Zhejiang University of Finance & Economics; Laboratory for Human-AI Collaboration and Digital Intelligence Innovation, Zhejiang University · ‡Corresponding author. Center for Research of Private Economy, School of Economics, Future Regional Development Laboratory, and Academy of Financial Research, Zhejiang University · §Partner Company +2

  24. Generative AI performance in core undergraduate mathematics: a curriculum-level case study

    Sep 15, 2025Benjamin J. Walker, Nikoleta Kalaydzhieva, Beatriz Navarro Lameda +1Educational AssessmentGenerative AI in Education

    Department of Mathematics, University College London, Gordon Street, WC1H 0AY, London, UK

  25. Towards AI-Assisted Research Writing: Benchmarking LLMs for AI/ML Introduction Generation

    Aug 19, 2025Krishna Garg, Firoz Shaik, Sambaran Bandyopadhyay +1LLM EvaluationLanguage Model Generation Evaluation

    University of Illinois Chicago · Adobe Research

  26. Evaluating Style-Personalized Text Generation: Challenges and Directions

    Aug 8, 2025Anubhav Jangra, Bahareh Sarrafzadeh, Silviu Cucerzan +2LLM-as-a-JudgeLanguage Model Generation Evaluation

    Columbia University, USA · Microsoft, USA · The University of York, UK

  27. Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaders

    May 27, 2024Xuemei Gu, Mario KrennAI-Assisted Scientific ResearchScientific Hypothesis Generation

    Max Planck Institute for the Science of Light, Staudtstrasse 2, 91058 Erlangen, Germany

  28. PQMass: Probabilistic Assessment of the Quality of Generative Models using Probability Mass Estimation

    Feb 6, 2024Pablo Lemos, Sammy Sharief, Esmeralda S. Whitammer +4Two-Sample TestingGenerative AI Evaluation

    1Mila – Québec Artificial Intelligence Institute · 2Ciela Institute · 3Université de Montréal +3

  29. Consistent Distributed Ranking of Generative Models via Kernel Distances

    Oct 18, 2023Zixiao Wang, Farzan Farnia, Zhenghao Lin +2Kernel MethodsImage Generation Evaluation

  30. LLAMA LIMA: A Living Meta-Analysis on the Effects of Generative AI on Learning Mathematics

    Date pendingAnselm Strohmaier, Samira Bödefeld, Oliver Straser +1Generative AI in EducationGenerative AI Evaluation

    University of Education Freiburg, Institute of Mathematics Education