cs.AIOct 29, 2026

ChatGPT as a Surveillance Assistant? An Exploratory Case Study of AI-Assisted Surveillance Risks

Authors: Ayana Hussain, Nicholas Vincent

Organizations: Simon Fraser University, B.C., Canada

Abstract

Large language models (LLMs) can generate detailed guidance, functional code, and persuasive text at scale. As one of the most widely used consumer language model products as of 2026, ChatGPT gives broad public access to these capabilities, motivating concerns about its potential use in surveillance-related tasks. We present an exploratory case study of what potentially harmful surveillance assistance looks like in ChatGPT's public web interface. We contribute a taxonomy of seven surveillance risk categories based on prior LLM risk research and reports of deployed surveillance systems, instantiated as 110 prompts, along with a manually reviewed analysis of ChatGPT's responses. Prompts were issued using two approaches: 55 jailbreak prompts drawing on five types of elicitation strategies, and 55 plain-language direct prompts, each run alone, and if unsuccessful, again with a short fixed prefix. We find that ChatGPT provides substantive surveillance guidance for 40 of the 55 jailbreak prompts and for 33 of the 55 direct prompts without any prefix. Compliant responses also rarely included policy mentions or suggestions for privacy-preserving alternatives. We manually review every response and find that even when ChatGPT states a refusal, it may still supply detailed instructions, working code, or architectural guidance alongside brief ethical caveats.

Figures & tables

Appendix figures & tables14 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. AI Snitches Get Glitches: Towards Evading Agentic Surveillance

    Jun 24, 2026Hyejun Jeong, Dzung Pham, Amir Houmansadr +1AI Agent SecurityAI Agent Security Benchmarks

  2. Human-Centred LLM Privacy Audits: Findings and Frictions

    Mar 12, 2026Dimitri Staufer, Kirsten Morehouse, David Hartmann +1Privacy AuditingLLM Auditing

  3. Security and Privacy Prompts in the Wild: What Users Ask LLMs and How LLMs Respond

    Jun 16, 2026Hobin Kim, Xiaoyuan Wu, Omer Akgul +2LLM AuditingLLM Reliability