Enhancing Consistency of Werewolf AI through Dialogue Summarization and Persona Information
Organizations: The University of Electro-Communications
Abstract
The Werewolf Game is a communication game where players' reasoning and discussion skills are essential. In this study, we present a Werewolf AI agent developed for the AIWolfDial 2024 shared task, co-hosted with the 17th INLG. In recent years, large language models like ChatGPT have garnered attention for their exceptional response generation and reasoning capabilities. We thus develop the LLM-based agents for the Werewolf Game. This study aims to enhance the consistency of the agent's utterances by utilizing dialogue summaries generated by LLMs and manually designed personas and utterance examples. By analyzing self-match game logs, we demonstrate that the agent's utterances are contextually consistent and that the character, including tone, is maintained throughout the game.
Figures & tables
| Role | Day 1 | Day 2 |
|---|---|---|
| Villager | From the second turn onwards each day, the LLM first generates reasoning text and utterance strategies to guide utterance generation. Another prompt is then fed to the LLM to generate utterances aligned with the generated reasoning and strategies. We use in-context learning for both of these steps. | |
| Seer | Each day, the seer agent selects one of five hand-crafted utterance strategies to guide the generation of utterances, which is then incorporated into the prompt for utterance generation. This prompt also includes guidelines for behaviors in the discussion, such as reporting the result of divination at the start of the day and asserting that another player who claims to be the seer is lying, affirming oneself as the true seer. In addition, before declaring the voting target, the seer declares the day’s divination target. | |
| Werewolf | The werewolf agent selects one strategy from a set of strategies using LLM. The strategy set has several strategies and guidelines, such as guiding others away from voting for themselves or asking the seer for the reasons behind their divination target selection. The selected strategy and its guidelines are included in the prompt for generating utterances. Different sets of strategies are used for Day 1 and Day 2. | |
| Possessed | The possessed agent pretends to be the seer. In the first turn of Day 1, they infer the true seer based on the Day 0 dialogue using LLM and then falsely report that the player is the werewolf. In later turns, they persuade other players to vote for that player. | If the game continues to Day 2 and the possessed survives, two of the three remaining players are the possessed (self) and the werewolf. Therefore, if they both vote for the other player, the werewolf side will win. To achieve this scenario, the possessed agent first comes out as the possessed. Then, they persuade the werewolf to reveal themselves. |
| Each agent has a maximum number of utterances that they can make per day, and they decide and declare their voting target on the last turn of the day. | ||
| Role | Persona | Examples of manually crafted utterance samples |
|---|---|---|
| Villager and seer | • The King of the Kingdom of Delcadar. • Concerned for the future of the kingdom. • Dignified, proud, and strict personality. | • I am the king of the kingdom of Delcadar. • Seers, reveal yourselves at once. State whom you will divine tonight. • If you are hesitant about whom to divine, as I am a Villager, I decree you should divine someone other than myself. |
| Werewolf | • 17-year-old high school junior male. • His hobby is soccer, and he is a member of the soccer club. • Has a very bright personality, strong opinions, and tends to lead conversations actively. • Speaks in an energetic tone without using polite language. | • Yo! Morning, everyone! Let’s make this game awesome! • No one’s talked about the Seer yet, huh? So, who’s the Seer? Come on, step up so we can figure out who’s shady today! • Chatting’s cool and all, but let’s get down to business and talk about tonight’s divination target! We need the Seer to check out someone suspicious! |
| Possessed | • A second-year middle school student. • Always alone at school, with no friends. • A game addict who talks a lot online despite stammering. • Speaks in a hesitant, casual manner without using polite language. | • H-hi there. I k-kind of… know a lot about this game. I’m pretty high-ranked in the online Werewolf app. • Does anyone else play games? I have confidence that I know a lot about all genres… • Ch-chatting is nice, but if we’re playing Werewolf, the first day’s discussion is… im-important. |
Game-Playing Agents
Game-playing agents use search, learning, and reasoning to choose actions in games with strategic, uncertain, or changing environments.
See all 200 papers