Generative AI Evaluation

Ask about this topic

Momentum

29 papers in the last four weeks, up 142% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 211

All topics
CardsList

  1. GameCommBench: A Unified Benchmark and Type-Aware Evaluation for AI-Generated Game Commentary

    Oct 8, 2026Qirui Zheng, Zhengteng Lin, Yunyi Xiao +7Generative AI Evaluation

    Peking University · South China University of Technology

  2. Do Generative Priors Align with Human Naturalness Perception?

    Oct 7, 2026Taiki FukiageGenerative ModelingGenerative AI Evaluation

    Communication Science Laboratories, NTT, Inc.

  3. Structured pre-generation elicitation versus single-shot prompting in AI-assisted enterprise decision-making: a randomised online experiment

    Oct 7, 2026William Scott-JacksonAI-Assisted Decision MakingGenerative AI Evaluation

    Oxford Centre for Impact Research

  4. Sample-Optimal Estimation of the Fréchet Inception Distance

    Oct 5, 2026Ziyun Chen, Jerry Li, Kevin Tian +1Generative AI Evaluation

    University of Washington · University of Texas at Austin

  5. The GenAI4IDN Benchmark 3.0 - a Public Tool to Assess Generative AI Tools for the Design of Interactive Digital Narratives

    Oct 4, 2026Hartmut Koenitz, Jonathan Barbara, Mirjam Palosaari EladhariInteractive StorytellingGenerative AI Evaluation

    Södertörn University, Alfred Nobels allé 7, 141 89 Huddinge, Sweden · Saint Martin’s Institute of Higher Education, Hamrun, Malta · Stockholm University, SE-106 91 Stockholm, Sweden

  6. More Claims, Less Evidence: Bounded Verification of AI-Generated Digital Knowledge Artifacts

    Oct 4, 2026Feliks Bańka, Jarosław A. ChudziakClaim VerificationAutomated Fact-Checking

    Institute of Computer Science, Warsaw University of Technology, Warsaw, Poland

  7. When Verifiable Counts Depend on Wording: Auditing Wording Robustness in Instruction Following

    Oct 4, 2026Qishi Zhan, Seoyeon Jang, Zihan Dong +3LLM EvaluationInstruction Following

    Marquette University · University of California, San Diego · Georgia Tech +3

  8. Verifiable, Articulable, and Tacit Components of Preference

    Oct 2, 2026Alexander Spangher, Sheldon S. Huang, Andreas Haupt +4Human Preference ModelingPreference Learning

    Stanford University · University of Toronto

  9. Evaluating Physical Consistency and Plausibility in Generative Scenario Models for Autonomous Driving

    Oct 1, 2026Manasa Mariam Mammen, Zafer Kayatas, Stefan WagnerAutonomous Driving Safety EvaluationAutonomous Driving Scenario Generation

    Technical University of Munich, Heilbronn, Germany · Mercedes Benz AG, Sindelfingen, Germany

  10. Science or Slop?: Benchmarking and Mitigating Scientific Slop in AI-Generated Papers

    Sep 30, 2026Yerim Oh, Young-Jun Lee, Jaewoo Ahn +2AI-Generated Text DetectionScientific Reasoning in Language Models

    Seoul National University · University of Minnesota

  11. A Shared Taste for Model-Written Text: The Generator-by-Selector Matrices of "AI-AI Bias" Show No Detectable Own-Model Premium

    Sep 30, 2026Dmitrij ŻatuchinLLM EvaluationLanguage Model Bias Evaluation

    Department of Information Technologies, Estonian Entrepreneurship University of Applied Sciences (EUAS), Tallinn, Estonia. · Rankfor.AI, Wroc law, Poland; Tallinn, Estonia.

  12. Can Generative AI Automate Data Extraction for Meta-Analysis? A Case Study on Intercropping Research

    Sep 28, 2026Zehao Lu, Xingguo Xiong, Wopke van der Werf +2Multi-Agent LLM SystemsLLM Information Extraction

    Wageningen University & Research, Wageningen, the Netherlands · Zhejiang Academy of Agricultural Sciences

  13. Investigating Human--AI Discrepancies via Multiple-Solution Problems

    Sep 28, 2026Zihao Wang, Francesco Insulla, Andrea MontanariGenerative AI EvaluationLLM Reasoning

    Department of Mathematics, Stanford University · Institute of Computational and Mathematical Engineering, Stanford University · Department of Statistics and Department of Mathematics, Stanford University

  14. Coherence-Aware Distributional Evaluation of Open-Ended Text Generation

    Sep 28, 2026Jinnuo Liu, Junhao Zhu, Weifeng Jiang +2Language Model Generation EvaluationGenerative AI Evaluation

    New York University · Center for Data Science, NYU Shanghai · Georgia Institute of Technology

  15. SlopBench: How Well Can We Rank Language Models by Slop? A Multi-Domain Benchmark of Repetitive AI Writing

    Sep 27, 2026Dhruv Roongta, Harsha Gaddipati, Anh Tuan HuynhLLM EvaluationLanguage Model Generation Evaluation

    Slashy, San Francisco, California, USA

  16. Reference-Based Analysis of Coherence and Diversity in Open-Ended Text Generation

    Sep 23, 2026Esteban Garcés AriasOpen-Ended GenerationLanguage Model Generation Evaluation

    Department of Statistics, LMU Munich Munich Center for Machine Learning (MCML)

  17. Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflows

    Sep 22, 2026Remy Stewart, Olabode Anise, Andrew Hogan +1Human-AI CollaborationHuman-AI Co-Creation

    Figma, San Francisco, California, USA

  18. A Semiotics-Aware Framework for Evaluating Fidelity and Coverage in Natural Language Generation

    Sep 22, 2026Lorenzo Zangari, Davide PiccaLLM EvaluationLanguage Model Generation Evaluation

    University of Lausanne Lausanne, Switzerland

  19. Seeing Is Not Perceiving: When Synthetic Consumers Can and Cannot Pretest Visual Marketing

    Sep 22, 2026Yi-Lin Tsai, Yung-Hsiu, LaiHuman Oversight of AIGenerative AI Evaluation

    Arvin · Department of Management and Marketing, The University of Melbourne

  20. A Latent Distribution Perspective on Evaluating and Improving Latent Generative Models

    Sep 21, 2026Xianghong Fang, Wenjie Shu, Tongda Xu +3Distribution ShiftGenerative AI Evaluation

    University of Toronto · Independent · Vijil

  21. EnterpriseVal: Quantifying the Efficacy, Reliability and Value of Generative AI in the Enterprise

    Sep 18, 2026Abbas Raza Ali, Muhammad Ajmal Siddiqui, Moona ZahidHuman-in-the-Loop EvaluationLLM Reliability

    Citigrounp, Inc, London, United Kingdom · Ernst & Young LLP, London, United Kingdom · NVIDIA Corporation, London, United Kingdom

  22. Edustories: A Collection of Real-world Case Studies from Classroom Practices

    Sep 17, 2026Michal Štefánik, Jan Nehyba, Jirina Karasova +4AI in EducationEducational Data Mining

    Faculty of Education, Masaryk University, Czechia · R&D Center for Large Language Models, National Institute of Informatics, Japan

  23. Reporting Practice Matters: The Impact of Reference Choice on Chest X-ray Report Evaluation

    Sep 16, 2026Daniel P. Jeong, Charles Q. Li, Hossein Hosseiny +5Radiology Report GenerationGenerative AI Evaluation

    Machine Learning Department, Carnegie Mellon University · Department of Radiology and Imaging Sciences, Allegheny Health Network · Data Science R&D, Highmark Health Enterprise Data & Analytics +1

  24. "If I Had to Buy Just ONE: Galaxy S26 Ultra": Auditing AI-Generated Product Recommendations

    Sep 16, 2026Lucas G. Uberti-Bona Marin, Thales Bertaglia, Giovanni Astante +5Language Model Bias EvaluationLarge Language Model-Based Recommendation

    Law & Tech Lab, Maastricht University · Utrecht University · Social Computing Group, Department of Informatics, University of Zurich

  25. I code or AI code: A comparative evaluation of AI-rated scores in classroom observations

    Sep 16, 2026Y. Fong, J. Xiang, T. Y. D. Chan +2LLM-as-a-JudgeEducational Assessment

    Department of Early Childhood Education, The Education University of Hong Kong, 10 Lo Ping Road, Tai Po, Hong Kong SAR, China · Yew Chung College of Early Childhood Education, 2 Tin Wan Hill Road, Tin Wan, Hong Kong SAR, China

  26. Beyond AI Literacy: A Structured Review and Exploratory Meta-Analysis of Measures for Competent Generative-AI Use

    Sep 14, 2026Daniele Veri'Tool-Use EvaluationGenerative AI Evaluation

  27. Issue Bias in Generative AI Writing Assistance: Political Issues and LLMs in the Swedish 2026 Election

    Sep 14, 2026Bastiaan Bruinsma, Annika Fredén, Paul Röttger +2Political Discourse AnalysisPolitical Bias in Language Models

    Chalmers University of Technology · University of Gothenburg · Lund University +1

  28. ChatGPT Images 2.5 in the Wild: A Launch-Period Dataset and Detector Evaluation

    Sep 14, 2026Dennis Ng, Xingyu Shen, Ankit Raj +6AI-Generated Image DetectionGenerative AI Evaluation

  29. Watermarks Without Verification: AI Text Watermarking After the EU AI Act

    Sep 10, 2026Alexander Nemecek, Vipin Chaudhary, Erman AydayText WatermarkingAI Accountability

    Case Western Reserve University

  30. IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier

    Sep 9, 2026Blake Stenstrom, Charangan Vasantharajan, Brian SathianathanAI Agent ReliabilityBenchmark Auditing