LLM Security

LLM: Large Language Model

Overview

LLM security examines how models and the systems around them can be manipulated, made to leak information, or induced to take unsafe actions. Attacks include prompt injection and jailbreaks, poisoned training data and backdoors, model extraction, side channels in shared serving systems, and vulnerabilities in generated code or tool-using agents. Defenses range from safer training and fine-tuning to runtime detectors, access controls, secure serving, and application-level isolation; evaluations increasingly use adaptive attacks and realistic agent, coding, and deployment benchmarks. A central tension is that model-level safeguards can fail under new inputs or system interactions, while stronger controls may reduce utility, privacy, or efficiency, making end-to-end testing and clear threat models essential.

Latest papers

CardsList

344 papers26 papers in the last four weeks, down 38% on the four weeks before. 0.2% of all new papers.

  1. PSM: Prompt Sensitivity Minimization via LLM-Guided Black-Box Optimization

    Nov 20, 2025Hussein Jawad, Nicolas J-B BrunelLLM SecurityPrivacy Leakage in Language Models

  2. SoK: Systematizing LLM Prompt Security: Taxonomies, Datasets, and Unified Evaluation of Attacks and Defenses

    Oct 17, 2025Hanbin Hong, Shuang Wu, Shuya Feng +6LLM SecurityLLM Jailbreak Attacks

  3. Rethinking Reasoning: A Survey on Reasoning-based Backdoors in LLMs

    Oct 9, 2025Man Hu, Xinyi Wu, Zhufeng Suo +5LLM Backdoor AttacksLLM Security

  4. From Construction to Injection: Edit-Based Fingerprints for Large Language Models

    Sep 3, 2025Yue Li, Xin Yi, Dongsheng Shi +3Model Ownership VerificationLanguage Model Fingerprinting

  5. Data Security in Large Language Models: Risks, Defense, and Directions

    Aug 4, 2025Kang Chen, Xiuze Zhou, Yuanhui Yu +4Adversarial Attacks on LLMsLLM Security

  6. GPT, But Backwards: Exactly Inverting Language Model Outputs

    Jul 2, 2025Adrians Skapars, Edoardo Manino, Youcheng Sun +1Privacy Leakage in Language ModelsLLM Security

  7. How Safe Are AI-Generated Patches? A Large-scale Study on Security Risks in LLM and Agentic Automated Program Repair on SWE-bench

    Jun 30, 2025Amirali Sajadi, Kostadin Damevski, Preetha ChatterjeeLLM Agent SecurityLLM Security

  8. LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challenge

    Jun 11, 2025Sahar Abdelnabi, Aideen Fay, Ahmed Salem +22LLM SecurityIndirect Prompt Injection

  9. Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks

    Apr 24, 2025Yang Liu, Kejia Zhang, Bingjie Yan +11Privacy-Preserving Language ModelsLLM Fine-Tuning

  10. The Challenge of Identifying the Origin of Black-Box Large Language Models

    Mar 6, 2025Ziqing Yang, Yixin Wu, Yun Shen +3Language Model FingerprintingLLM Security

  11. UniGuardian: A Unified Defense for Detecting Prompt Injection, Backdoor Attacks and Adversarial Attacks in Large Language Models

    Feb 18, 2025Huawei Lin, Yingjie Lao, Tony Geng +2LLM Backdoor AttacksAdversarial Attacks on LLMs

  12. BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

    Jun 3, 2024Jiaqi Xue, Mengxin Zheng, Yebowen Hu +3LLM Backdoor AttacksRAG Poisoning Attacks