cs.AISep 24, 2026

Thinking Less to Simulate Better: Intuitive Prompting Improves LLM Agents Simulating Individual Social Media Reactions, Including Unfamiliar Content

Authors: Ljubisa Bojic, Tijana Stanic, Joerg Matthes, Agariadne Dwinggo Samala, Bojana Dinic, Jue Wang

Organizations: Institute for Artificial Intelligence Research and Development of Serbia; Address of correspondence: 1 Frukogorska 1, 21000 Novi Sad, Serbia · University of Belgrade, Institute for Philosophy and Social Theory, Digital Society Lab; Address of correspondence: Kraljice Natalije 45, 11000 Belgrade, Serbia · Complexity Science Hub, Vienna, Austria; Address of correspondence: Metternichgasse 8, 1030 Vienna, Austria · University of Belgrade, Faculty of Political Sciences, Kragujevac, Serbia; Address of correspondence: Jove Ilica 165, 11000 Belgrade, Serbia · University of Vienna, Faculty of Social Sciences, Department of Communication; Address of correspondence: Währinger Straße 29 (R. 7.47), 1090 Vienna, Austria · Universitas Negeri Padang, Faculty of Engineering, Padang, Indonesia; Address of correspondence: 482X+WQ West Air Tawar, Padang City, West Sumatra, Indonesia · University of Novi Sad, Faculty of Philosophy, Novi Sad, Serbia; Address of correspondence: Dr Zorana Đinđića 2, 21102 Novi Sad, Serbia · Nanyang Technological University, School of Social Sciences, Singapore; Address of correspondence: 50 Nanyang Ave, 639798 Singapore

Abstract

Platform policies are increasingly tested on artificial users, making agent fidelity important. Yet convincing fake profiles could also manipulate perceived public opinion before elections. Validation has concentrated on agreement with human behaviour and has paid little attention to whether an agent behaves in line with the profile it was given. The present study profiled eight Serbian participants through a questionnaire, a deep interview, and a written self-presentation, recorded their reactions to sixty-eight social media posts, and asked four language models to predict those reactions under five prompt conditions varying profile content and instruction style. Attitudinal content improved prediction over demographic backstories by a wide margin. Agents matched their stated profiles more closely than participants matched their own survey answers, and consistency proved unrelated to fidelity once profile information was present. Instructing models to respond intuitively and immediately rather than analytically gave the highest fidelity of any condition and cut the compression of individual differences from seven times the human level to three. The advantage held on posts about topics the questionnaire never raised, where that condition reached the highest fidelity of any setup and beat a crowd baseline by a wide margin, which suggests that agents prompted this way could serve as general-purpose simulated users rather than specialists on the topics they were profiled for. Results may bear implications for the development of language models, because intuition-based setups appear better suited to some tasks than reasoning-based ones.

Explore similar work

CardsList
  1. LLM Agents Predict Social Media Reactions but Do Not Outperform Text Classifiers: Benchmarking Simulation Accuracy Using 120K+ Personas of 1511 Humans

    Mar 31, 2026Ljubisa Bojic, Alexander Felfernig, Bojana Dinic +4LLM Agent EvaluationHuman Behavior Simulation

  2. LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals

    Nov 15, 2024Joon Sung Park, Carolyn Q. Zou, Jonne Kamphorst +8Personality Modeling in Language ModelsHuman Behavior Simulation

  3. Towards Simulating Social Media Users with LLMs: Evaluating the Operational Validity of Conditioned Comment Prediction

    Feb 26, 2026Nils Schwager, Simon Münker, Alistair Plum +1Large Language Model-Based Social SimulationLanguage Model Generation Evaluation