Interplay: Training Independent Simulators for Reference-Free Conversational Recommendation
Organizations: University College London, London, UK · University of Sheffield, Sheffield, UK · Missouri University of Science and Technology, Rolla, USA
Abstract
Training conversational recommender systems (CRS) requires extensive dialogue data, which is challenging to collect at scale. To address this, researchers have used simulated user-recommender conversations. Traditional simulation approaches often utilize a single large language model (LLM) that generates entire conversations with prior knowledge of the target items, leading to scripted and artificial dialogues. We propose a reference-free simulation framework that trains two independent LLMs, one as the user and one as the conversational recommender. These models interact in real-time without access to predetermined target items, but preference summaries and target attributes, enabling the recommender to genuinely infer user preferences through dialogue. This approach produces more realistic and diverse conversations that closely mirror authentic human-AI interactions. Our reference-free simulators match or exceed existing methods in quality, while offering a scalable solution for generating high-quality conversational recommendation data without constraining conversations to pre-defined target items. We conduct both quantitative and human evaluations to confirm the effectiveness of our reference-free approach.
Figures & tables
| Multi-Turn | Single-Turn | |||||
|---|---|---|---|---|---|---|
| Model | SR | ET | FR | BertScore | Dist-4 | # Words |
| UserSim-Llama 8B | 0.9265 | 0.0498 | 0.0237 | 0.9364 | 0.3023 | 31.2219 |
| UserSim-Qwen 8B | 0.9531 | 0.0232 | 0.0237 | 0.9373 | 0.3093 | 30.7637 |
| Llama3.1 70B | 0.3615 | 0.0033 | 0.6351 | 0.8870 | 0.2786 | 43.4067 |
| Qwen3 32B | 0.7772 | 0.0097 | 0.2131 | 0.8921 | 0.3409 | 31.6797 |
| Model | Recall@1 | Match Score | Dist-4 | # Words |
|---|---|---|---|---|
| RecSim-Llama8B | 0.0193 | 0.9323 | 0.5243 | 37.42 |
| RecSim-Qwen8B | 0.0217 | 0.9333 | 0.5358 | 37.30 |
| Qwen3 32B | 0.0014 | 0.4745 | 0.4630 | 42.21 |
| UniCRS | 0.0119 | 0.9129 | 0.2147 | 29.69 |
| Dialogue A ( Interplay ) | Dialogue B ( PEARL ) |
| Initial user preference is established… | |
| Turn 3 - User: I really enjoy watching movies with strong character development and intense chase/fight scenes. I also appreciate well-written scripts and great performances… | Turn 3 - User: I’m looking for something with action and adventure. I enjoy movies with thrilling chase and fight scenes, as well as strong performances… |
| …after several exchanges and rejected recommendations… | |
| Turn 7 - User: I appreciate the suggestion, but I found Superman Returns to be lacking in intensity… the pacing felt off… I’m hoping for something with a little more edge and excitement. | Turn 7 - User: I appreciate the recommendation, but I’m not a big fan of Live and Let Die … I found the villains to be a bit too over-the-top… I tend to prefer movies with a more serious tone… |
| Turn 8 - Rec: How about giving The Bourne Identity (2002) a try? It has everything you’re looking for - strong character development, intense chase and fight scenes, a well-written script, and excellent acting performances. | Turn 8 - Rec: How about watching Quantum of Solace (2008) ? It’s a James Bond film that has thrilling chase and fight scenes, as well as incredibly well-written plot. |
| Turn 9 - User: That sounds perfect! I haven’t watched The Bourne Identity yet, so I’ll definitely check it out. Thanks for the recommendation! | Turn 9 - User: That sounds perfect! I haven’t seen Quantum of Solace before, so I’ll definitely give it a watch. Thanks for the recommendation! |
Recommender Systems
Recommender systems predict and rank items for people using interaction histories, content, context, and feedback.
See all 502 papers