Creativity Assessment

Follow this topic Ask about this topic

Momentum

2 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 31

All topics

Design Creativity Bench: Measuring creativity in LLM-Generated UI
Oct 8, 2026Aman Rusia, Abhijit Bhole, Prashank Gupta +1Creativity Assessment Language Model Generation Evaluation
Kombai Inc.
PainterBench: A Figural Divergent-Thinking Benchmark for Tool-Using Language Models
Sep 28, 2026Shane K. A. Dalumura Hettige, Jonas OppenlaenderCreativity Assessment Agentic Image Generation
Computer Science and Engineering University of Oulu Oulu, Finland · Centre for Applied Computing University of Oulu Oulu, Finland
Measuring the Creativity of Frontier LLMs in Automated Research
Sep 12, 2026Yiheng Zhao, Mengzhuo Chen, Chengming Hu +3Creativity Assessment LLM Evaluation
Concordia University, Montreal, Canada · Independent Researcher · Mcgill University, Montreal, Canada +2
Decoupled Analysis-Judging: An Automated Creativity Evaluator Using LLMs in Complex Multi-step Creativity Tasks
Sep 3, 2026Xiangyu Wang, Jin Wu, Xiaoyu Li +2Creativity Assessment LLM-as-a-Judge
Department of Educational Psychology, East China Normal University · 2Shanghai Institute of Artificial Intelligence for Education, East China Normal University · School of Computer Science and Technology, East China Normal University +2
CLIN: an Objective Framework for Evaluating Creativity in Short Persian Literary Text
Aug 31, 2026Mohammad Reza Modarres, Armin Tourajmehr, Yadollah Yaghoobzadeh +1Creativity Assessment LLM Evaluation
School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran · Tehran Institute for Advanced Studies, Khatam University, Iran · Cardiff University, United Kingdom
Can LLM Agents Discover? Evaluating Creativity on ML Engineering Tasks
Aug 30, 2026Shitanshu Bhushan, Yunxiang Zhang, Lu WangCreativity Assessment LLM Agent Evaluation
Computer Science and Engineering University of Michigan Ann Arbor, MI, USA
Recipes for Creativity: Iterative Generation and Evaluation in Large Language Models
Aug 7, 2026Rens Anderson, Tessa Verhoef, Amirhossein ZohrehvandCreativity Assessment LLM Evaluation
LIACS Leiden University Einsteinweg 55 2333 CC Leiden The Netherlands
Can Language Models Imagine Without Seeing? Ekphrasis: Measuring Visual Creative Ideation in Text-Only LLMs
Aug 7, 2026Hongyu Luo, He Wang, Huihao Jing +6Creativity Assessment LLM Evaluation
The Hong Kong University of Science and Technology, Hong Kong SAR, China
Can MLLMs Decode the Creative Leap? Introducing C4 for Cross-Concept Understanding
Aug 6, 2026Ming Wang, Yuqing Zhang, Tingna Xie +5Creativity Assessment Multimodal Large Language Models
School of Computer Science and Engineering, Northeastern University, Liaoning, China · School of Computing and Information Systems, Singapore Management University, Singapore · School of Computer Science and Engineering, Shandong University of Science and Technology, Shandong, China
Why Large Language Models and Humans Converge and Diverge in Evaluating Creativity
Jul 24, 2026Pengzhao Lyu, Yeun Joon Kim, Hanlin Xiao +1Creativity Assessment LLM Evaluation
Judge Business School, University of Cambridge, Cambridge, CB2 1AG, United Kingdom · Institute of Metabolic Science, School of Clinical Medicine, University of Cambridge, CB2 0QQ, United Kingdom · Department of Computer Science, University of Manchester, M13 9PL, United Kingdom +2
AGC-Bench: Measuring Artificial General Creativity
Jul 1, 2026Roger Beaty, Vijeta Deshpande, Clin K. Y. Lai +9Creativity Assessment LLM Evaluation
1Pennsylvania State University · University of Massachusetts Lowell · University of Amsterdam +2
The Human Creativity Benchmark
Jun 29, 2026Aspen Hopkins, Allison Nulty, Alexandria Minetti +2Human Preference Evaluation Creativity Assessment
Massachusetts Institute of Technology Cambridge, MA, USA · Contra New York, New York, USA
How LLMs See Creativity: Zero-Shot Scoring of Visual Creativity with Interpretable Reasoning
Jun 29, 2026William Orwig, Roger E. BeatyCreativity Assessment LLM-as-a-Judge
Harvard University, Department of Psychology, Cambridge, MA, USA · Pennsylvania State University, Department of Psychology, University Park, PA, USA
Creative Integration: A Decidable Criterion of Creativity
Jun 11, 2026Yoshinori NomuraCreativity Assessment Computational Creativity
Mirage Mountain Technologies
IntElicit: Eliciting and Assessing Contextualized Creativity via Dialogue Policy Optimization
Jun 10, 2026Mingjia Li, Jin Wu, Hong Qian +7Creativity Assessment Policy Optimization
East China Normal University · Shanghai Innovation Institute
Automated Creativity Evaluation of Language Models Across Open-Ended Tasks
Jun 10, 2026Min Sen Tan, Zachary Kit Chun Choy, Syed Ali Redha Alsagoff +4Creativity Assessment LLM Evaluation
1Raffles Institution · College of Computing and Data Science, Nanyang Technological University · 3Lee Kong Chian School of Medicine, Nanyang Technological University +1
Introducing multiplex semantic networks as multifaceted representations of creative associative knowledge across multilingual samples
Jun 8, 2026Edith Haim, Kurt Haim, Roger E. Beaty +2Creativity Assessment Cognitive Modeling
CogNosco Lab, Department of Psychology and Cognitive Science, University of Trento, Rovereto, Trento · Department of Science Education, University of Education Upper Austria, Linz, Austria · Department of Psychology, The Pennsylvania State University, Pennsylvania, USA +1
DEFINED: A Data-Efficient Computational Framework for Fine-Grained Creativity Assessment in Debate Scenarios
Jun 5, 2026Tongzhou Yu, Mingjia Li, Hong Qian +6Creativity Assessment Computational Creativity
Nanjing University Nanjing, China · Shanghai Innovation Institute Shanghai, China · East China Normal University Shanghai, China
Before and After Temperature: A Distributional View of Creative LLM Generation
May 31, 2026V. S. Raghu Parupudi, Harsha Ponnada, Aditi Kaushal +3Open-Ended Generation Creativity Assessment
University of California, San Diego · Indian Institute of Technology, Kharagpur · Delhi Technological University +3
IDEAFix: Evaluation Framework for Creative Defixation Prompting in LLMs
May 30, 2026F. Carichon, S. Sharma, M. Girard +2Creativity Assessment LLM Evaluation
McGill University, Montreal, Canada · Mila, Montreal, Canada · Concordia University, Montreal, Canada
QUIET: A Multi-Blank Cascaded Story Cloze Benchmark for LLM Creative Generation Capability
May 25, 2026Bo Zou, Chao XuOpen-Ended Generation Creativity Assessment
When Reasoning Supervision Hurts: TTCW-Based Long-Form Literary Review Generation
May 19, 2026Jinlong Liu, Mohammed Bahja, Mark LeeSupervised Fine-Tuning Creativity Assessment
School of Computer Science, University of Birmingham, United Kingdom
Creativity Bias: How Machine Evaluation Struggles with Creativity in Literary Translations
May 13, 2026Kyo Gerrits, Rik van Noord, Ana Guerberof ArenasCreativity Assessment LLM-as-a-Judge
Centre for Language and Cognition, University of Groningen
Assessing the Creativity of Large Language Models: Testing, Limits, and New Frontiers
May 13, 2026Samuel Schapiro, Alexi Gladstone, Jonah Black +1Creativity Assessment LLM Evaluation
University of Illinois Urbana-Champaign
LLM Jaggedness Unlocks Scientific Creativity
May 11, 2026Shray Mathur, J. Anibal Boscoboinik, Esther H. R. Tsai +1Creativity Assessment LLM Evaluation
Center for Functional Nanomaterials, Brookhaven National Laboratory Upton, NY 11973, USA
Calibrated Surprise: An Information-Theoretic Account of Creative Quality
Apr 29, 2026Bo Zou, Chao XuCreativity Assessment Computational Creativity
The Effect of Idea Elaboration on the Automatic Assessment of Idea Originality
Apr 22, 2026Umberto Domanti, Moritz Mock, Sergio Agnoli +1Creativity Assessment LLM-as-a-Judge
Free University of Bozen-Bolzano · University of Trieste · Marconi Institute for Creativity
AlphaContext: An Evolutionary Tree-based Psychometric Context Generator for Creativity Assessment
Apr 20, 2026Yixuan Wang, Yue Huang, Hong Qian +7Creativity Assessment Computational Creativity
East China Normal University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China
Beyond Reproduction: A Paired-Task Framework for Assessing LLM Comprehension and Creativity in Literary Translation
Apr 20, 2026Ran Zhang, Steffen Eger, Arda Tezcan +3Creativity Assessment LLM Evaluation
University of Mannheim, Data and Web Science Group · University of Technology Nuremberg (UTN), Department Engineering · 5Natural Language Learning and Generation (NLLG) Lab +2
How Creative Are Large Language Models in Generating Molecules?
Apr 20, 2026Wen Tao, Yiwei Wang, Peng Zhou +6Creativity Assessment LLM Evaluation
Nanyang Technological University · University of California, Merced · Hunan University +1

Oct 8, 2026, cs.HCJ/K move · Enter open · S save

Design Creativity Bench: Measuring creativity in LLM-Generated UI

Aman Rusia, Abhijit Bhole, Prashank Gupta, Dipanjan Dey

Kombai Inc.

Creativity Assessment Language Model Generation Evaluation Generative AI Evaluation Computational Creativity

Open paper AskPDF arXiv

As leading LLMs improve on capability evaluations, their limitations in producing creative outputs on design tasks remain insufficiently characterised. Our work introduces Design Creativity Bench, a benchmark that evaluates diversity and appropriateness in UI designs. It measures distinctiveness among models on the same prompt (originality), how much a model's designs change between two prompts for the same UI goal in different product domains (creative range), and the share of a brief's acceptance criteria each design meets (appropriateness). Originality is 0.592 for same-prompt design pairs from different models (95% CI [0.582, 0.602]), far below the 0.764 for same-prompt human-model pairs (95% CI [0.751, 0.778]). Creative range is 0.581 across models (95% CI [0.567, 0.597]), against 0.902 for human designs (95% CI [0.884, 0.919]). Appropriateness is above 90% for every model, and the best model reaches 99.2%, slightly above the 98.0% for human designs. Our work shows that the default output of LLMs, though generally appropriate, is substantially more repetitive than the human baseline. This calls for strong measures to address the issue.

Momentum

Related topics

Latest papers 31