LifeVal: Evaluating AI Model Performance on Personalized Agentic Consumer Tasks
Organizations: OpenAI
Abstract
We introduce LifeVal, a benchmark evaluating AI model performance on personalized agentic consumer tasks. LifeVal covers the most valuable life tasks that a personalized digital superassistant could automate, representing over 1.7 trillion US dollars in annual willingness-to-pay across 148 consumer task categories (e.g., managing finances, moving apartments, searching for a job, finding childcare). To construct our activity distribution, we conducted a new survey of willingness-to-pay for a digital superassistant across a demographically representative sample of over 3,800 consumers, cross-referencing our results against the American Time Use Survey (Bureau of Labor Statistics, 2025) and the Multinational Time Use Study (Fisher et al., 2025). For the most valuable consumer activities, we recruited task creators to create AI evaluation tasks personalized using real ChatGPT conversations and memories, reference files, and personal context. Task creators had to pass our expertise threshold (including personally completing the task multiple times and seeing the results through in their real lives for over a year) and also write a rubric, ensuring that our evaluation measured the best personalized completion for that task. All tasks had to pass at least three rounds of human quality-control before acceptance into our final evaluation sets.
Figures & tables
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Grader | Mean rubric grade |
|---|---|
| Human | 83.61% |
| GPT-5.6 | 84.20% |
| Tier 1 activity category | Sample of Tier 3 activities | Annual WTP per respondent (US$, sum) | US annual WTP (US$ billions) |
|---|---|---|---|
| Household activities and services | Financial management; Using home maint/repair/decor/construction svcs; Exterior repair, improvements, & decoration | $1,811.7 | $505 |
| Caring for and helping others | Home schooling of children; Looking after adult (as a primary activity); Activities related to child’s education, n.e.c.* | $1,289.4 | $329 |
| Personal care | Activities rel. to purchasing/selling real estate; Using health and care services outside the home; Banking | $856.3 | $239 |
| Education | Research/homework for class for degree, certification, or licensure; Research/homework n.e.c.*; Taking class for degree, certification, or licensure | $653.7 | $190 |
| Volunteer activities | Volunteer - Computer use; Volunteer - Teaching, leading, counseling, mentoring; Volunteer - Telephone calls (except hotline counseling) | $385.5 | $100 |
| Consumer purchases | Shopping, except groceries, food and gas; Grocery shopping; Comparison shopping | $266.9 | $81 |
AI Agent Evaluation
AI agent evaluation measures whether tool-using systems complete tasks reliably, safely, and efficiently across interactive settings.
See all 561 papers