Organizations: Institute for Artificial Intelligence Research and Development of Serbia; Address of correspondence: 1 Frukogorska 1, 21000 Novi Sad, Serbia · University of Belgrade, Institute for Philosophy and Social Theory, Digital Society Lab; Address of correspondence: Kraljice Natalije 45, 11000 Belgrade, Serbia · Complexity Science Hub, Vienna, Austria; Address of correspondence: Metternichgasse 8, 1030 Vienna, Austria · University of Belgrade, Faculty of Political Sciences, Kragujevac, Serbia; Address of correspondence: Jove Ilica 165, 11000 Belgrade, Serbia · University of Vienna, Faculty of Social Sciences, Department of Communication; Address of correspondence: Währinger Straße 29 (R. 7.47), 1090 Vienna, Austria · Universitas Negeri Padang, Faculty of Engineering, Padang, Indonesia; Address of correspondence: 482X+WQ West Air Tawar, Padang City, West Sumatra, Indonesia · University of Novi Sad, Faculty of Philosophy, Novi Sad, Serbia; Address of correspondence: Dr Zorana Đinđića 2, 21102 Novi Sad, Serbia · Nanyang Technological University, School of Social Sciences, Singapore; Address of correspondence: 50 Nanyang Ave, 639798 Singapore
Platform policies are increasingly tested on artificial users, making agent fidelity important. Yet convincing fake profiles could also manipulate perceived public opinion before elections. Validation has concentrated on agreement with human behaviour and has paid little attention to whether an agent behaves in line with the profile it was given. The present study profiled eight Serbian participants through a questionnaire, a deep interview, and a written self-presentation, recorded their reactions to sixty-eight social media posts, and asked four language models to predict those reactions under five prompt conditions varying profile content and instruction style. Attitudinal content improved prediction over demographic backstories by a wide margin. Agents matched their stated profiles more closely than participants matched their own survey answers, and consistency proved unrelated to fidelity once profile information was present. Instructing models to respond intuitively and immediately rather than analytically gave the highest fidelity of any condition and cut the compression of individual differences from seven times the human level to three. The advantage held on posts about topics the questionnaire never raised, where that condition reached the highest fidelity of any setup and beat a crowd baseline by a wide margin, which suggests that agents prompted this way could serve as general-purpose simulated users rather than specialists on the topics they were profiled for. Results may bear implications for the development of language models, because intuition-based setups appear better suited to some tasks than reasoning-based ones.
Institute for Artificial Intelligence Research and Development of Serbia · University of Belgrade, Institute for Philosophy and Social Theory, Digital Society Lab · Complexity Science Hub, Vienna, Austria +4
1Computer Science Department, Stanford University; Stanford, CA, 94305, USA. · Department of Communication Studies, Northwestern University; Evanston, IL 60208, USA. · 7CDSP and CEE, Sciences Po; Paris, 75007, France. +4