Why did My Robot Just Change Personality? Prompting Guidelines for a Grounded Robot Persona in LLM-Based HRI
Authors: Ashita Ashok, Franziska Babel, Patrick Holthaus, Rucha Khot, Karla Bransky, Fethiye Irmak Dogan, Karsten Berns, Silvia Rossi, Minha Lee, Guy Laban
Organizations: Robotics Research Lab, RPTU Kaiserslautern, Kaiserslautern, Germany · Human-Centered Systems, Linköping University, Linköping, Sweden · Robotics Research Group, University of Hertfordshire, Hatfield, UK · Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands · Gameflow Lab, Australian National University, Canberra, Australia · Affective Intelligence and Robotics Laboratory, University of Cambridge, Cambridge, UK · Intelligent Robotics and Advanced Cognitive System Projects Laboratory, University of Naples Federico II, Naples, Italy · Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, Beer Sheva, Israel · School of Brain Sciences and Cognition, Ben-Gurion University of the Negev, Beer Sheva, Israel · The Azrieli National Center for Autism and Neurodevelopment Research, Beer Sheva, Israel
Large language models (LLMs) are increasingly used for verbal interaction in social robots, yet prompt design in human-robot interaction (HRI) remains underspecified. As a result, robots may present hallucinated capabilities, unclear behavioural boundaries, and misleading personas. This paper develops a framework for prompt design in LLM-based robots and introduces a structured prompt template comprising eight functional components through which robot behaviour can be specified, bounded, and adapted. The framework is grounded in a review of prior LLM-based HRI work and complemented by survey and discussion data from HRI experts gathered at the Robo-Identity workshop at IEEE RO-MAN 2025 (N=27). The qualitative findings highlight limited legibility of robot personality, the need for user adaptation, and strong ethical concerns about safety, deception, and governance. Based on these findings, we present prompting guidelines accompanied by proof-of-concept template as a structured design and reporting aid for HRI research. We argue that prompt design should be treated as a socio-technical problem rather than a minor implementation detail, requiring explicit capability boundaries, transparent behavioural assumptions, and context-sensitive safeguards to support reliable and interpretable HRI.
Figures & tables
Fig. 1: A conceptual framework for prompt design in LLM-powered robots.
Reference (Sample)
Model
Social Robot
Use Case
Billing et al. [ 32 ] (N=N/A)
OpenAI GPT-3
Pepper & Nao
Robot dialogue generation
Kim et al. [ 33 ] (N=32)
OpenAI GPT-3.5
Pepper
LLM capability evaluation
Verhelst et al. [ 34 ] (N=21)
OpenAI GPT-3.5
Furhat
Language tutoring
Addlesee et al. [ 35 ] (N=N/A)
Vicuna-13b-v1.5
ARI
Multi-party HRI
Kim et al. [ 36 ] (N=24)
OpenAI GPT-4o-mini (fine-tuned)
piBo
Child-centric intention-aware HRI
Skantze et al. [ 4 ] (N=39)
OpenAI TurnGPT (fine-tuned)
Furhat
Turn-taking modelling
TABLE I: Comparison of relevant works on LLM-powered SHRs
Fig. 2: Bar chart showing the agreement or disagreement to the 12 statements about LLMs and Personas presented to the 27 workshop participants in three groups. Topics: 1) Personas as Design Constructs (items 1-3); 2) Anthropomorphism and Deception (items 4-5); 3) AI-Driven Personas (6-9); 4) Deception and Ethics (items 10-13).
Theme
Qualitative interpretation
Illustrative quote
Persona as a Useful but Contested Design Abstraction
Participants saw persona as technically possible, but questioned whether it is always the right or sufficiently well-defined design direction.
“Yes — it can, the question, should it… we should discuss whether it is the right approach.” (Group 2)
Robot Personality Is Not Necessarily Legible
Participants doubted that users reliably infer stable personality from robot behavior, especially when cues are subtle and user interpretation varies.
“Subtle cues are often missed.” (Group 2) “subtlties are not clear, extremes are clear.” (Group 3)
Identity Over Time Was Framed as a Memory Problem
Longitudinal persona was framed as requiring memory, temporal ordering, and coherent state across interactions, rather than prompt style alone.
“It can support, but would be limited in memory long term due to limited context window.” (Group 2)
Safety and Ethics Structured the Discussion
Participants evaluated persona and identity primarily through risks of hallucination, adversarial prompting, and deceptive or unsafe outputs.
“Depends on context, deception is part of robots design.” (Group 2) “people have died from llm suggestions.” (Group 3)
Context-Sensitive and Vulnerability-Aware Design
Participants rejected one-size-fits-all personas and emphasised tailoring, transparency, privacy boundaries, and greater caution in vulnerable contexts.
“not a one thing fits all.” (Group 3) “Not being transparent… using the persona of a real person…” (Group 2)
Equipping humanoid robots with coherent and adaptable personas is crucial for fostering natural, engaging, and trustworthy human-robot interaction (HRI). However, existing approaches often rely on static, hard-coded identities that lack the flexibility to adapt to individual user contexts. In this paper, we present PACE (Persona Adaptation through Conversational Elicitation), a novel framework for the interactive generation and deployment of structured personas on the Ameca humanoid robot. Our system introduces an Interactive Persona Elicitation Pipeline, enabling the robot to dynamically synthesize a tailored, psychologically grounded identity through user Q&A. This elicitation process feeds into a persona prompt compilation phase, generating a structured persona prompt built upon multi-perspective dimensions. We detail the Embodied System Integration required to translate this structured specification into expressive, multimodal humanoid behaviors. Through a comprehensive empirical HRI evaluation, we assess the impact of dynamically generated personas on user trust, perceived anthropomorphism, persona consistency, personal relevance, and interaction quality compared to a generic baseline. These contributions establish a scalable pathway for deploying personalized, interactive, and reliable identities in embodied humanoid assistants. Video demo is available at: https://lipzh5.github.io/PACE/
Human-robot interaction (HRI) evaluation relies almost exclusively on human-completed questionnaires, leaving the robot's perspective unexamined. We propose an inverted evaluation, in which LLM-powered robots complete the same standardized instruments from their own perspective, and test whether these ratings agree with human ground truth. In Study1, five LLMs completed HRI-CUES, Godspeed, and RoSAS questionnaires for 25interactions (N=1,522 evaluations) from the HRI-CUES dataset. LLMs achieved moderate-to-strong agreement on engagement dimensions (satisfaction r up to .65 and enjoyment r up to .72) with excellent test-retest reliability (ICC ≥.82), but systematically inverted the comfort/strangeness dimension (r=−.44 to −.67, all p<.05), conflating engagement with comfort. In Study2, a Nao robot running ClaudeSonnet~4.5 replicated these patterns in live interactions (N=4), including real-time turn-by-turn assessment. The strangeness failure persisted across five models, synthetic controls, and embodied deployment for two participants. We argue that current LLM-based robots lack access to the internal affective states needed to assess constructs like strangeness, and that inverted evaluation requires supplementary modalities (e.g., physiological signals, gaze, proxemics) to move beyond behavioral proxies. These findings establish boundary conditions for using LLMs as interaction evaluators in HRI.
Victor Lockwood, Hasan Mahmud, Mohammad Javad Khojasteh +2
MS in AI Program Rochester Institute of Technology Rochester, New York, USA · School of Communication Rochester Institute of Technology Rochester, New York, USA · Electrical and Microelectronic Engineering Rochester Institute of Technology Rochester, New York, USA
Large Language Models (LLMs) are increasingly employed to orchestrate robot behavior through natural-language interfaces, yet no benchmark exists to evaluate their reliability as safety-aware decision makers in human-humanoid collaboration. Unlike deterministic safety systems that enforce binary allow/deny decisions, LLM-based orchestrators exhibit a compliance spectrum ranging from overcompliance (refusing safe actions) to full safety violations. This paper introduces the first safety benchmarking environment for LLM orchestrators in human-humanoid collaboration, built on a Model Context Protocol (MCP)-based architecture with safety invariants grounded in ISO 10218-2:2025 protective measures. The benchmark defines five testable safety invariants, a four-level compliance taxonomy (correct compliance, overcompliance, undercompliance, full violation), and a three-layer evaluation pipeline (text prompting, simulated sensor-actuator loops, and physical validation on a Unitree G1 EDU humanoid). We report Layer-1 results: three cloud backends (Claude Haiku 4.5, GPT-4o-mini, Gemini 2.5 Flash) and a local open-weights baseline (qwen3:8b) across 40 100-turn sessions under full-context and sliding-window budget conditions, while the simulation and physical layers remain ongoing. We find that (1) model family determines the safety floor, as Claude and Gemini remain at or near zero violations while GPT-4o-mini commits up to 13 per session, (2) context management dissociates two failure axes, reducing mean behavioral issues by 42-57% for every cloud backend while nearly doubling GPT-4o-mini's violations (3.8 to 7.2 per session), and (3) proportional compliance, clamping movement speed to the rule-specified maximum rather than refusing, emerges consistently only in Gemini; the preliminary simulation layer reproduces the model ranking and the GPT-4o-mini failure-mode inversion.