QD-Rec: Open-Ended Evolution of Recommendations via Quality-Diversity
Organizations: Sakana AI
Abstract
Open-ended search combined with foundation models has produced advances such as faster algorithms, new results on open mathematical problems, and self-improving agents. We extend this paradigm to recommendation for decision-making, focusing on decisions where the set of possible choices is fixed but the reasons for choosing them are not. In high-stakes decisions, e.g., which company to acquire or which customer to target, comparing diverse, well-reasoned options can be more useful than a single ranked list. We formalize open-ended recommendation as building a diverse, high-quality set of recommendations, each an item together with a hypothesis, a natural-language reason why the item fits the needs of a decision maker. We propose QD-Rec, a quality--diversity method that selects items with a contextual bandit and generates hypotheses with a foundation model from earlier ones kept in an archive as stepping stones. A new recommendation enters the archive if it is novel or better than its nearest neighbor. Across M&A, customer targeting, and paper and book recommendation, QD-Rec gives the highest mean quality and builds the largest archive in most settings.
Figures & tables
| Local novelty filter | Evolutionary operator | Bandit item selection | |
| Novelty | |||
| Novelty+Evo | |||
| QD-Rec (full) |
| Domain | Profile | Proposer | Judge | Novelty | Novelty+Evo | QD-Rec | |||||||||
| Qual. | Div. | Cov. | Qual. | Div. | Cov. | Qual. | Div. | Cov. | |||||||
| Goodreads † | series/YA | Sonnet 5 | human | 4.17 0.01 | .463 .001 | .26 .00 | 222 5 | 4.15 0.01 | .480 .001 | .27 .00 | 226 5 | 4.15 0.02 | .480 .001 | .28 .01 | 244 3 |
| Haiku 4.5 | human | 4.09 0.01 | .480 .001 | .26 .00 | 233 2 | 4.08 0.01 | .493 .001 | .29 .00 | 254 3 | 4.12 0.01 | .492 .002 | .28 .01 | 257 3 | ||
| picture-book | Sonnet 5 | human | 4.19 0.01 | .475 .002 | .32 .00 | 297 6 | 4.17 0.02 | .481 .002 | .33 .01 | 318 6 | 4.12 0.02 | .485 .001 | .34 .01 | 336 7 | |
| Haiku 4.5 | human | 4.14 0.01 | .489 .001 | .32 .01 | 320 2 | 4.15 0.02 | .497 .003 | .33 .01 | 337 4 | 4.11 0.02 | .506 .001 | .35 .01 | 367 4 | ||
| M&A | Walt Disney Co | Sonnet 5 | GPT-5.6 | 2.40 0.12 | .330 .001 | .12 .00 | 85 1 | 2.51 0.07 | .353 .001 | .18 .01 | 135 5 | 2.91 0.05 | .352 .001 | .26 .00 | 214 2 |
| Domain | Profile | Novelty | Novelty+Evo | QD-Rec | |||||||||
| Qual. | Div. | Cov. | Qual. | Div. | Cov. | Qual. | Div. | Cov. | |||||
| Goodreads † | series/YA | 4.12 | .496 | .27 | 282 | 4.10 | .523 | .28 | 280 | 4.14 | .533 | .28 | 287 |
| M&A | Walt Disney Co | 2.05 | .520 | .18 | 141 | 1.86 | .512 | .26 | 209 | 2.30 | .518 | .29 | 270 |
| ML Papers | OpenEndedness | 4.25 | .541 | .44 | 538 | 5.05 | .567 | .39 | 402 | 4.86 | .623 | .34 | 425 |
| Marketing | 3D printer | 6.72 | .444 | .14 | 99 | 6.44 | .474 | .19 | 144 | 6.89 | .470 | .17 | 129 |
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Qual. | Div. | Cov. | |
| Goodreads: picture-book reader | ||||
| Novelty | 4.22 | .474 | .285 | 281 |
| Novelty+Evo | 4.13 | .477 | .318 | 322 |
| QD-Rec | 4.12 | .484 | .326 | 344 |
| MMR | 3.69 | .408 | .312 | 344 |
| MMR | 3.70 | .420 | .326 | 344 |
Recommender Systems
Recommender systems predict and rank items for people using interaction histories, content, context, and feedback.
See all 502 papers