Generative AI Evaluation

Ask about this topic

Momentum

29 papers in the last four weeks, up 142% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 211

All topics
CardsList

  1. Context operations to architecture modelling output from large language models and evaluation criteria for their use in systems engineering design

    Sep 9, 2026Vinicius Kaster Marini, Petter KrusSoftware EngineeringModel-Based Systems Engineering

    Department of Mechanical Engineering Centre of Technology Federal University of Santa Maria Santa Maria/RS, BR 97105-900, Brazil · Section for Fluid Power and Mechatronics Department of Management and Engineering Linköping University SE 581 83, Linköping, Sweden

  2. A Systematic Evaluation of Molecule Generation Models for De Novo Drug Design: From Benchmarks to Practical Insights

    Sep 9, 2026Xinrui Xu, Xueer Wang, Dan Luo +2Structure-Based Drug DesignMolecular Generation

    School of Computer Science, Xiangtan University, Xiangtan 411105, China · College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China · School of Chinese Medicine, Hong Kong Baptist University, 15 Baptist University Road, Kowloon Tong 999077, Kowloon, Hong Kong SAR, China

  3. When Victorian Becomes a Prompt: Literary Periodization as a Generative Constraint in 100 AI-Generated Novels

    Sep 8, 2026Mehdy Sedaghat PayamComputational Literary StudiesControllable Text Generation

    Independent Scholar

  4. Does task decomposition improve automatic NLG evaluation?

    Sep 1, 2026Sebastian Steindl, Nikos Voskarides, Alberto Gasparin +1LLM EvaluationLLM-as-a-Judge

    Amazon, Barcelona, Spain · Amazon, Berlin, Germany

  5. Sources of Truth: A Multi-Platform, Multilingual Audit of Citations in AI Mental Health Information Queries

    Aug 31, 2026Phuong Anh Nguyen, Jill Noorily, Matthew Flathers +7LLM EvaluationLLM Auditing

    Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA 02446, USA · Psychiatry and Mental Health Department, School of Medicine, Pontificia Universidad Javeriana, Bogotá 110231, Colombia · Tufts University School of Medicine, Tufts University, Boston, MA 02111, USA

  6. Autoresearch for Marketplace Catalogs: From Legacy Forms to AI-Native Matching

    Aug 31, 2026Kartik Ravisankar, Hojat Abdolanezhad, Daniel Capo +3User Preference ModelingGenerative AI Evaluation

    Thumbtack · San Francisco, CA, USA

  7. ReDeck: Step-Level Render-Grounded Refinement for Document-to-Slide Generation

    Aug 31, 2026Muzhao Tian, Zezi Zeng, Yifan Yang +14LLM Self-RefinementGenerative AI Evaluation

    Fudan University · Work done during an internship at Microsoft. · Xi’an Jiaotong University +2

  8. Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment

    Aug 31, 2026Deepak Pandita, Christopher M. HomanAI AlignmentAutomated Evaluation

    Rochester Institute of Technology

  9. EvoGenUI-Bench: Evaluating LLMs as Multi-Turn Generative UI Assistants

    Aug 29, 2026Yue Peng, Lanke Xia, Zihan Wang +3Web Application GenerationAI Agent Benchmarks

    New York University Shanghai

  10. Process-Constituted Intelligence: A Shared Criterion for Humans and Machines

    Aug 17, 2026Michael J. Richardson, Ayeh Alhasan, Cassandra Crone +5Human-Centered AIGenerative AI Evaluation

    School of Psychological Sciences, Macquarie University, Sydney, NSW 2109, Australia · Performance and Expertise Research Centre, Macquarie University · Frontier AI Research Centre, Macquarie University +3

  11. LOB-ID: Evaluating Synthetic Market Data by Inception Distances

    Aug 13, 2026Andreea Bacalum, Zhuohan Wang, Ollie Olby +2Quantitative FinanceSynthetic Data Evaluation

    Simudyne · King's College London, United Kingdom

  12. DashArena: Benchmarking LLMs on Interactive Analytic Dashboard Generation

    Aug 11, 2026Xiaotong Wang, Dazhen DengData VisualizationLLM-as-a-Judge

    State Key Lab of CAD&CG, Zhejiang University, China · School of Software Technology, Zhejiang University, China

  13. Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Models

    Aug 10, 2026Shulin Tian, Ziqi Huang, Fan Zhang +3Tool-Augmented Language Model AgentsAI Agent Evaluation

    Shanghai Artificial Intelligence Laboratory

  14. UNSPECIFIC: General Constraint Synthesis for Breaking Copy-and-Paste Shortcut in LLM Instruction Following

    Aug 10, 2026Jeet Sharma, Balpreet Kaur, Jeremiah Hong +2Instruction FollowingConstraint Satisfaction

    University of Massachusetts, Amherst, USA

  15. How People Evaluate AI-, Expert-, and Peer-Style Financial Advice

    Aug 10, 2026Aryan Ramchandra Kapadia, Eshwar Chandrasekharan, Koustuv SahaHuman-AI InteractionHuman-AI Decision Making

    University of Illinois Urbana-Champaign, USA

  16. AI Evaluation Should Measure Verification Cost, Not Correctness Alone

    Aug 9, 2026Viviana Crescitelli, Generoso Immediato, Fabio Persia +1Language Model Generation EvaluationGenerative AI Evaluation

    Hitachi, Ltd., Tokyo, Japan · Hitachi Rail, Naples, Italy · Department of Information Engineering, Computer Science and Mathematics, University of L’Aquila, Italy

  17. Recipes for Creativity: Iterative Generation and Evaluation in Large Language Models

    Aug 7, 2026Rens Anderson, Tessa Verhoef, Amirhossein ZohrehvandCreativity AssessmentLLM Evaluation

    LIACS Leiden University Einsteinweg 55 2333 CC Leiden The Netherlands

  18. MMAG: A Multi-Control Mixed Audio Generation Benchmark

    Aug 7, 2026Zihao Zheng, Xuenan Xu, Jiahao Mei +5Speech Generation EvaluationAudio Generation

    MoE Key Lab of Artificial Intelligence, X-LANCE Lab, Shanghai Jiao Tong University, China · Shanghai AI Lab, China

  19. Schema-Guided Hierarchical Information Extraction and Semantic Evaluation Using Generative AI

    Aug 6, 2026Modhurita Mitra, Jan-Willem Versteeg, Maarten D. Schermer +3Document Information ExtractionAutomated Evaluation

    Research Engineering Team, Information and Technology Services, Utrecht University, Utrecht, The Netherlands · Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, The Netherlands

  20. Epistemic Trustworthiness in Generative AI: A Normative Framework for Warranted Reliance in High-Stakes Workflows

    Aug 6, 2026Nimisha Karnatak, Max Van Kleek, Nigel ShadboltTrust in AIResponsible AI

    Department of Computer Science, University of Oxford, Wolfson Building, Parks Road, Oxford OX1 3QD, United Kingdom

  21. Kathleen Writes: Autoregressive Generation and Data Scaling Without Attention

    Aug 5, 2026George FountzoulasLanguage Model Generation EvaluationAutoregressive Language Modeling

    Department of Computer Engineering & Informatics · Frederick University, Nicosia, Cyprus

  22. InvFlowFD: Reference-Free and Background-Set-Free Perceptual Music Quality Metric with Flow Matching Inversion

    Aug 4, 2026Alon Ziv, Harel Pogoda, Yossi AdiMusic Generation EvaluationMusic Generation

    School of Computer Science and Engineering The Hebrew University of Jerusalem, Israel

  23. AI-Assisted Peer Review Across Research Communities: From Reviewer AI Policies to LLM Review Quality

    Aug 4, 2026Alexander M. Fichtl, Lukas Ellinger, Josefin Kelber +2LLM EvaluationScholarly Peer Review

    Social Computing Research Group Technical University of Munich Boltzmannstraße 3, 85748, Garching, Germany

  24. Cross-cultural evaluation of taste-sound correspondences in AI-generated music

    Aug 4, 2026Matteo Spanio, Massimiliano Zampini, Luisa Torri +5Text-to-Music GenerationGenerative AI Evaluation

    University of Padova, Padova, Italy · University of Trento, Trento, Italy · University of Gastronomic Sciences, Pollenzo, Italy +2

  25. Who Should Be Generated? Justifying Demographic Targets in Open-Ended Generation

    Aug 3, 2026Zeshen Zheng, Yujia He, Qianmian Lin +2Language Model Bias EvaluationDemographic Bias in Language Models

    Sun Yat-sen University, China

  26. CraftAlign: Feature-Grounded Evaluation and Revision Guidance for AI Stories

    Aug 2, 2026Yang Yang, Boyun Xu, Shaofeng Liang +5AI-Generated Text DetectionLanguage Model Generation Evaluation

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511400, China · Institute of Deep Perception Technology, JITRI, Wuxi 214000, China

  27. Beyond Prompt Adherence: Auditing Attribute-Level Voice Control in Speech Generation

    Aug 1, 2026Xianhao Zhou, Jianghao WuSpeech Generation EvaluationTTS Evaluation

    School of Mechanical and Electrical Engineering, UESTC, Chengdu, China · Faculty of Information Technology, Monash University, Melbourne, Australia

  28. Beyond a Single Judge: The Evidence-Grounded, Social-Weighted Persona Panel for Generative UI Evaluation

    Jul 30, 2026Zheng Wu, Yibo Luo, Pu Zhang +2Human Preference EvaluationLLM-as-a-Judge

    School of Computer Science, Shanghai Jiao Tong University · 2ByteDance Inc

  29. AI and Authenticity in Islamic Research: A Critical Evaluation of Generative AI Reliability, Hallucination, and Source Fidelity in Quranic, Hadith, and Fiqh Knowledge

    Jul 30, 2026Muhammad Sajjad AkbarQuestion AnsweringLLM Reliability

    School of Computer Science, The University of Sydney, Australia

  30. Evaluating and Pricing Advertisements in AI-Generated Responses

    Jul 30, 2026John L. Turner-Smith, Zimeng Huang, Yuhan Fu +2Mechanism DesignOnline Advertising

    Carnegie Mellon University, Pittsburgh, PA, USA · College of AI, Tsinghua University, Beijing, China