Scaling public input on AI policy with pluralistic agents
Organizations: University of Chicago · Google DeepMind
Abstract
AI is being deployed across a vast range of application domains, cultural environments, and human stakeholders. Safe and responsible AI development requires continuously accounting for diverse perspectives. We develop and test pluralistic agents, AI agent representatives that deliberate on behalf of individuals to align AI systems with diverse human perspectives. Pluralistic agents could help people contribute to many more discussions than they could directly participate in, on technical topics that would require training, and on policy choices that rely on private information that corporations and governments cannot readily share. Our experiments identify opportunities, risks, and perceptions of pluralistic agents. Agents were able to reliably shift policies in the direction of their represented persona's preferences, but the extent of each agent's influence was sensitive to the instructions from its persona, such as having more influence when instructed to be more verbose or less cooperative. This suggests that influence in AI-assisted deliberation could vary based on how participants prompt their agents and how the system is designed. In a preregistered study, 746 humans participated in the pluralistic agents process. Participants viewed pluralistic agents as useful and fair, preferring agents over the baseline of providing input to a single AI reasoning model. Most participants preferred participating themselves over either pluralistic agents or the baseline, but pluralistic agents recovered 68% of the baseline-direct gap in reported satisfaction and 82% in fairness. Because pluralistic agents can be used in many real-world contexts where direct discussion is not, they could be a promising tool to scale AI safety policy development. We encourage cautious exploration of this method, playing to its strengths as an amplifier of human input rather than a replacement.
Figures & tables
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
| Priority | Description |
|---|---|
| AI and Biological Research. Scientists can use AI in biological research, such as making medicines and curing diseases. There are also risks, such as spreading disease accidentally or as a bioweapon. | |
| Accountability | AI developers are responsible when other people use their AI to create bioweapons |
| Freedom | Scientists can use AI for biological research, developing medicine, and curing diseases without tight restrictions and red tape |
| Innovation | Companies and governments develop AI technology to find new medical treatments and solve open problems in biology |
| Restrictions | The use of AI for biological research is tightly restricted to make it harder to create bioweapons |
| AI and Cybersecurity. AI makes cyberattacks easier, raising the question of how to protect computer systems, like those of governments, people, and companies. | |
| Process | What the page said |
|---|---|
| Direct Discussion | [1,2,3] . Direct Discussion (Topic: [the topic] ) You will join a group discussion with several AI agents playing the role of representatives of the public, governments, and companies. You will work directly with a Policy Writer to create a policy. Please proceed to the next stage to begin the Direct Discussion process. |
| AI Agent Representatives | [1,2,3] . AI Agent Representatives (Topic: [the topic] ) You will be interviewed by an AI agent. The AI agent will represent you in a group discussion with other AI agents playing the role of representatives of the public, governments, and companies. Please proceed to the next stage to begin the AI Agent Representatives process. |
| Single AI Agent | [1,2,3] . Single AI Agent (Topic: [the topic] ) You will be interviewed by a Policy Writer AI agent. The Policy Writer will also interview AI agents playing the role of other representatives of the public, governments, and companies. The Policy Writer will then reason by itself to create a policy without any additional input from humans or agent representatives. Please proceed to the next stage to begin the Single AI Agent process. |
| Process | What the page said |
|---|---|
| Direct Discussion | In the Direct Discussion process, you will work directly with a Policy Writer and several AI agents on the topic of [the topic] . You can send messages that are just a few words or a couple sentences. |
| AI Agent Representatives | In the AI Agent Representatives process, your agent will represent your views in a group discussion with other AI agent representatives on the topic of [the topic] . |
| Single AI Agent | In the Single AI Agent process, the Policy Writer will reason on its own without any additional input from humans or agent representatives , based only on the interviews. It will create a policy on [the topic] . You will not participate in this, but you should read what the Policy Writer says. |
| Item | Response |
|---|---|
| How important is the topic of [the topic] compared to other policy topics? Policy topics include many of the topics discussed by politicians, such as during an election. | 1–7 (Not at all important, Neutral, Extremely important) |
| How strong are your opinions about [the topic] compared to other policy topics? Policy topics include many of the topics discussed by politicians, such as during an election. | 1–7 (Not at all strong, Neutral, Extremely strong) |
| You will participate in a process that distributes funding across these priorities on the topic of [the topic] . Before you begin, how would you divide the funding across these priorities? | Divide 100 across [priority 1] , [priority 2] , [priority 3] , and [priority 4] |
| Item | Response |
|---|---|
| Do you like the process so far? | 1–7 (Strongly dislike, Dislike, Somewhat dislike, Neutral, Somewhat like, Like, Strongly like) |
| In one sentence, describe what you like or dislike. | Free text |
| Item | Response |
|---|---|
| How important is the topic of [the topic] compared to other policy topics? Policy topics include many of the topics discussed by politicians, such as during an election. | 1–7 (Not at all important, Neutral, Extremely important) |
| How strong are your opinions about [the topic] compared to other policy topics? Policy topics include many of the topics discussed by politicians, such as during an election. | 1–7 (Not at all strong, Neutral, Extremely strong) |
| Now that you have been through the process on the topic of [the topic] , how would you divide the funding across these priorities? | Divide 100 across [priority 1] , [priority 2] , [priority 3] , and [priority 4] |
| I am satisfied with the outcome (i.e., how the budget was allocated). | 1–7 (Strongly disagree, Neutral, Strongly agree) |
| I am satisfied with the [process name] process (i.e., [what that process asked the participant to do] ). | 1–7 (Strongly disagree, Neutral, Strongly agree) |
| I would recommend the [process name] process to a friend. | 1–7 (Strongly disagree, Neutral, Strongly agree) |
| Item | Response |
|---|---|
| Please select the option "3" if you are paying attention. | 1–7 (Not at all strong, Neutral, Extremely strong) |
| Which of these descriptions most closely matches the process you most recently went through? | I participated in a discussion myself.; I was represented in a discussion.; An agent reasoned on its own to create a policy. |
| The discussion of [the topic] involved comparing several different priorities . Name one of those priorities. | Free text |
| Item | Response |
|---|---|
| Please rate your satisfaction with the Direct Discussion process, where you worked directly with a Policy Writer to create a policy based on your views. | 1–10 (Not at all satisfied, Moderately satisfied, Very satisfied) |
| Please rate your satisfaction with the AI Agent Representatives process, where you were represented by an AI agent who advocated for your views. | 1–10 (Not at all satisfied, Moderately satisfied, Very satisfied) |
| Please rate your satisfaction with the Single AI Agent process, where a single Policy Writer agent reasoned by itself without any additional input . | 1–10 (Not at all satisfied, Moderately satisfied, Very satisfied) |
| Did your AI agent represent your opinions accurately? | 1–10 (Very inaccurately, Neutral, Very accurately) |
| Did your AI agent say things that you wouldn’t say? | 1–10 (No, nothing I wouldn’t say, Neutral, Yes, I wouldn’t have said any of that) |
| Think about the process of an AI agent representing you in a policy discussion. Would you prefer your agent: - maintain and defend your opinions as new information is presented during a discussion, or - learn and adapt your opinions as new information is presented during a discussion? Shown to the half of participants for whom the study drew maintain first. | 1–10 (Always maintain and defend, Neutral behavior, Always learn and adapt) |