cs.SDNov 10, 2026

Evaluating AI Musical Creativity: Towards a Quantitative Multi-Dimensional Framework Based on Value, Novelty, and Surprise

Authors: Hindy Rossignol, Giorgio Franceschelli, Mirco Musolesi

Organizations: Department of Arts and Sciences, University College London, Malet Place, London, WC1E 7JG, United Kingdom. · Department of Computer Science and Engineering, University of Bologna, Viale del Risorgimento, 2, Bologna, 40136, Italy. · Centre for Artificial Intelligence, Department of Computer Science, University College London, 66-72 Gower Street, London, WC1E 6EA, United Kingdom.

Abstract

Despite the increasing sophistication of generative Artificial Intelligence (AI), research on the evaluation of AI-generated musical creativity remains limited. To address this gap, this paper proposes a quantitative framework for the formalization and evaluation of AI musical creativity. Building on Margaret Boden's theory, which conceptualizes creativity in terms of value, novelty, and surprise, the framework adapts and operationalizes these three dimensions for the musical domain. On the hypothesis that certain aspects of musical creativity can be assessed with a degree of objectivity, a domain-specific set of quantitative metrics for evaluating the creativity of AI-generated music is introduced. Rather than reducing musical creativity to a single unifying measure, this article proposes an ensemble of complementary metrics that capture its different dimensions, recognizing the complexity of musical artifacts and the difficulty of defining meaningful multi-objective compositional criteria. The framework has two implications. First, it gives researchers and developers a principled methodology and quantitative tools for empirically evaluating creative outputs, enabling more informed model development and reducing unnecessary computational costs. Second, it lays the groundwork for future generative models to optimize directly for creativity by adopting these metrics as learning objectives.

Figures & tables

Explore similar work

CardsList
  1. Towards Defining, Measuring, and Leveraging Creativity in AI Applications

    Oct 9, 2026Jingyi Yang, Alexander TuzhilinCreativity AssessmentComputational Creativity

  2. The Human Creativity Benchmark

    Jun 29, 2026Aspen Hopkins, Allison Nulty, Alexandria Minetti +2Human Preference EvaluationCreativity Assessment