Finding Is Not Returning, Returning Is Not Reconstructing: A Multi-Dimensional Evaluation of Agent Social Re-entry
Organizations: The Hong Kong University of Science and Technology, Hong Kong, China · Southern University of Science and Technology, Shenzhen, China · City University of Hong Kong, Hong Kong, China · Shenzhen MSU-BIT University, Shenzhen, China ·
Abstract
As Large Language Model (LLM) agents increasingly participate in persistent social environments, understanding their long-term social interaction capabilities becomes increasingly important. While existing research has advanced long-term memory and conversational context retrieval, less attention has been paid to whether agents can autonomously re-engage with previously inactive conversations. In particular, remembering a past interaction does not necessarily mean that an agent can identify when to revisit it, decide to return, or reconstruct the context needed for a coherent continuation. To investigate this gap, we introduce agent social re-entry as a multi- dimensional evaluation problem, distinguishing three complementary capabilities: Finding, Returning, and Reconstructing. We develop a shared-snapshot evaluation framework that measures these dimensions independently, allowing us to examine how conversational resurfacing and persistent memory relate to different aspects of social re-entry. Evaluations across six LLM configurations show that resurfacing substantially improves target conversation identification, while persistent memory is associated with higher rates of autonomous target-directed replying. However, neither improvement is accompanied by consistent gains in contextual reconstruction. These results highlight the distinction between accessing previous conversations, choosing to re-engage, and maintaining conversational continuity. Our framework provides a way to evaluate these capabilities separately rather than relying on memory retrieval or conversational response quality alone.
Figures & tables
| Model | A0B0 | A0B3 | A2B0 | A2B3 | Distractor | Disc B0 | Disc B3 | Recon A0 | Recon A2 | Oracle |
|---|---|---|---|---|---|---|---|---|---|---|
| DeepSeek | 30 | 28 | 27 | 29 | 30 | 30 | 29 | 28 | 28 | 30 |
| GLM-4.6V | 30 | 30 | 30 | 30 | 30 | 30 | 30 | 30 | 29 | 30 |
| GLM-5.1 | 30 | 28 | 27 | 28 | 29 | 29 | 27 | 29 | 28 | 30 |
| MiniMax | 26 | 26 | 26 | 26 | 28 | 28 | 27 | 26 | 26 | 30 |
| Qwen3.5 | 20 | 20 | 23 | 24 | 23 | 23 | 20 | 22 | 20 | 23 |
| GPT-5.5 | 30 | 30 | 30 | 30 | 30 | 30 | 30 | 30 | 30 | 28 |
| Target-directed reply ( ) | Discovery | Reconstruction | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| System | A0B0 | A0B3 | A2B0 | A2B3 | B0 | B3 | RD | A0 | A2 | A0 A2 |
| DeepSeek-V4 | 0/30 | 2/28 | 12/27 | 15/29 | 4/30 | 29/29 | +86.7 | 2.18 (28) | 1.79 (28) | +0.39 |
| GLM-4.6V | 1/30 | 0/30 | 16/30 | 18/30 | 16/30 | 30/30 | +46.7 | 2.00 (30) | 1.69 (29) | +0.31 |
| GLM-5.1 | 2/30 | 6/28 | 19/27 | 16/28 | 8/29 | 27/27 | +72.4 | 2.24 (29) | 1.89 (28) | +0.35 |
| MiniMax-M2.7 | 2/26 | 4/26 | 11/26 | 13/26 | 11/28 | 27/27 | +60.7 | 1.77 (26) | 1.27 (26) | +0.50 |
| Qwen3.5 | 0/20 | 1/20 | 10/23 | 10/24 | 4/23 | 20/20 | +82.6 | 2.05 (22) | 1.50 (20) | +0.55 |
LLM Agent Evaluation
Large language model agent evaluation measures whether tool-using systems complete tasks reliably, safely, and efficiently.
See all 1,217 papers