Foundations for Investigations of Agentic AI Systems from the Forensic Analysis of OpenClaw
Organizations: KASTEL Security Research Labs, Karlsruhe Institute of Technology, Am Fasanengarten 5, 76131 Karlsruhe, Germany · Fraunhofer Institute for Communication, Information Processing and Ergonomics FKIE, Zanderstr. 5, 53177, Bonn, Germany
Abstract
Agentic AI systems are increasingly deployed as personal assistants and virtual employees, and are likely to become a common object of digital investigations and incident response. Yet little is known about how their internal state and actions can be reconstructed during forensic analysis, and systematic forensic approaches remain largely unexplored. We present the first empirical forensic study of a personal AI assistant, with OpenClaw as a case study. We examine its technical design via static code analysis and apply differential forensic analysis to identify recoverable traces across stages of the agent interaction loop. We classify and correlate these traces, structuring the examination around representative investigative questions. We propose a five-plane agent artifact taxonomy that captures recurring investigative patterns; its structural completeness is assessed by cross-mapping against published artifact inventories of two related AI systems. To aid investigations, we release an open-source artifact-extraction tool with a machine-readable schema. Finally, we highlight a foundational challenge: LLM-mediated execution adds both an abstraction layer and substantial nondeterminism to trace generation. Because tool selection and state transitions are co-determined by the model, the execution environment, and the evolving context, identical inputs need not yield identical traces.
Figures & tables
| Taxonomy Plane | OpenClaw (this work) | AutoGen ( Walker et al. (2024) ) | ChatGPT Mobile ( Dragonas et al. (2024) ) |
|---|---|---|---|
| Reasoning & Cognition | thinking blocks and model_change events in session JSONL; reasoning traces with no analog in traditional software | No reasoning traces recovered or investigated; transient LLM response fragments in volatile memory but recovery inconsistent across tasks; no chain-of-thought, planning step, or inference parameter artifacts | No local reasoning traces (all inference possibly server-side); GPT model version recorded in conversation metadata but contains no chain-of-thought or inference parameters |
| Identity & Configuration | openclaw.json , persona files ( SOUL.md , IDENTITY.md ), provider credentials in auth-profiles.json | Agent definitions, system prompt, model configuration ( llm_config ), and code execution settings ( work_dir ) in Python source scripts; pyautogen installation footprint in site-packages ; API credentials not recovered | App preferences (BPLIST on iOS, Protobuf on Android), account/user/device/workspace identifiers, subscription plan, custom instructions, authentication tokens |
| Knowledge & Recall | memory.sqlite with vector embeddings, curated MEMORY.md , daily memory logs, USER.md | Conversational context session-scoped and volatile only (not persisted to disk); logging deprecated since v0.2; no persistent memory, no user profiles, no semantic indices | Conversation SQLite database (Android) and JSON files (iOS); cloud-synced chat history; no persistent agent memory; no local semantic index |
| Communication & I/O | Multi-channel transcripts (Telegram, WhatsApp), media/inbound/ attachments, channel config in openclaw.json | TLS-encrypted PCAP traces of API connections to OpenAI endpoints; inter-agent dialogue (UserProxyAgent AssistantAgent) not persistently logged; message content encrypted under TLS 1.3 (decryption not attempted) | Chat messages in local database and JSON; voice recordings ( .m4a ); text-to-speech narrations; uploaded images and files; cloud export archive |
| Actions & Effects | toolCall / toolResult pairs in session JSONL, cron/jobs.json and cron/runs/ logs, subagents/runs.json | No structured tool invocation logs or agent delegation records recovered; runtime logging deprecated since v0.2 | Minimal: DALL-E image generation among tested actions but no dedicated artifact beyond conversation record; no local tool execution, no scheduled tasks, no autonomous actions |
Agentic AI
Agentic artificial intelligence studies systems that plan, use tools, learn from feedback, and act toward goals with varying degrees of autonomy.
See all 211 papers