LLM Security

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

25 papers in the last four weeks, up 127% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 200

All topics

Patcher: Post-Hoc Patching of Backdoored Large Language Models
Jun 2, 2026Anjun Gao, Yueyang Quan, Yufei Xia +2LLM Backdoor Attacks Backdoor Attacks
University of Louisville · University of North Texas
Gate AI: LLM Security Benchmark Evaluation Methodology and Results
Jun 1, 2026Ryle Goehausen, Marcus SousaLLM Safety Benchmarks Language Model Safety Evaluation
Which Defense Closes Which Threat? Attributing OWASP-LLM-Top-10 Coverage and Its Brittleness Under Paraphrasing
Jun 1, 2026Alexandre Cristovão MaioranoLLM Red Teaming AI Agent Security Benchmarks
Lumytics
Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion
May 29, 2026Stine Lyngsø Beltoft, William Brach, Federico Torrielli +5LLM Security LLM Safety
University of Southern Denmark · 2Slovak University of Technology in Bratislava · University of Turin +1
Send a SCOUT First: Pre-hoc Reasoning for Adaptive Detector Allocation in Prompt-Injection Defense
May 29, 2026Shuhao Zhang, Jiarui Li, Qi Cao +2AI Agent Security Benchmarks LLM Security
UC San Diego · University of Illinois Urbana-Champaign
CacheProbe: Auditing Prompt Cache Isolation in Gateway APIs
May 28, 2026Ryan FaheyKV Caching LLM Auditing
Khoury College of Computer Sciences Northeastern University Boston, MA, USA
Evaluating using Mock Tool Calls to Quarantine Untrusted Prompt Inputs
May 28, 2026David Gros, Adam GleaveLanguage Model Safety Evaluation Adversarial Attacks on LLMs
Fingerprinting Inference Systems of Large Language Models
May 28, 2026Anna Wimbauer, Jonas Möller, Erik Imgrund +1LLM Inference Language Model Fingerprinting
BIFOLD & TU Berlin
Measuring Real-World Prompt Injection Attacks in LLM-based Resume Screening
May 27, 2026Mohan Zhang, Yuqi Jia, Zhen Tan +4LLM Security Indirect Prompt Injection
University of North Carolina at Chapel Hill · Duke University · Arizona State University +2
Blind PRNG Hijacking: An Undetectable Integrity-Preserving Attack Against LLM Watermarking
May 27, 2026Ziyang You, Huilong He, Xiaoke Yang +1LLM Security LLM Watermarking
Fujian Provincial Key Laboratory of Automotive Electronics and Electric Drive, School of Electronic, Electrical and Physics, Fujian University of Technology, Fuzhou 350118, China · School of Humanities, Fujian University of Technology, Fuzhou 350118, China · Institute of Applied Physics and Materials Engineering, University of Macau, Macau 999078, China
Position: Retire the "Positive Backdoor" Label -- Secret Alignment Requires Strict and Systematic Evaluation
May 27, 2026Jianwei Li, Jung-Eun KimLLM Backdoor Attacks Language Model Safety Evaluation
Department of Computer Science, North Carolina State University, Raleigh, USA.
Disentangling Adversarial Prompts: A Semantic-Graph Defense for Robust LLM Security
May 27, 2026Xiang Fang, Wanlong FangLLM Security Prompt Injection Defense
School of Software Engineering, Huazhong University of Science and Technology · Nanyang Technological University, Singapore
Conceptual Steganography
May 26, 2026Zhejian Zhou, Jonathan MayCoT Reasoning LLM Security
University of Southern California · Information Sciences Institute
Security in the Fine-Tuning Lifecycle of Large Language Models: Threats, Defenses,Evaluation, and Future Directions
May 24, 2026Wenjuan Li, Yitao Liu, Runze Chen +1LLM Backdoor Attacks LLM Fine-Tuning
Hangzhou Normal University, No. 2318, Yuhangtang Rd, Hangzhou, 311121, Zhejiang, China · Zhejiang University, No. 866 Yuhangtang Rd, Hangzhou, 2026 310058, Zhejiang, China · China Mobile (Zhejiang) Innovation Research Institute Co., Ltd., No. 77 Gaoxin 7th Rd, China Mobile Zhejiang Information and Communication Industrial Park, Hangzhou, 311200, Zhejiang, China +1
Enhancing Reliability in LLM-Based Secure Code Generation
May 22, 2026Mohammed F. Kharma, Mohammad Alkhanafseh, Ahmed Sabbah +1LLM Evaluation CoT Reasoning
the Department of Computer Science, Birzeit University, Ramallah, Palestine · the Department of Computer Science, University of Central Florida, Orlando, FL 32816 USA
An Empirical Evaluation of LLM-Generated Code Security Across Prompting Methods
May 22, 2026Mohammed Kharma, Ahmed Sabbah, Mohammad Alkhanafseh +2LLM Prompting LLM Security
Department of Computer Science, Birzeit University, Birzeit, Palestine · King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia · University of Central Florida, Orlando, FL, USA
PoisonForge: Task-Level Targeted Poisoning Benchmark for Instruction-Tuned LLMs
May 22, 2026Luze Sun, Anshuman Suri, Harsh Chaudhari +2LLM Safety Benchmarks LLM Backdoor Attacks
Department of Computer Science Northeastern University · DatologyAI
Security of LLM-generated Code: A Comparative Analysis
May 21, 2026Srivathsan G Morkonda, Mahmoud Selim, Hala AssalSoftware Security LLM Security
Carleton University, Ottawa, ON, Canada
Trusted Weights, Treacherous Optimizations? Optimization-Triggered Backdoor Attacks on LLMs
May 20, 2026Yifei Wang, Yida Yang, Tianlin Li +3LLM Backdoor Attacks Backdoor Attacks
Shanghai Jiao Tong University · Tongji University · Beihang University +1
Be Kind, Rewrite: Benign Projections via Rewriting Defend Against LLM Data Poisoning Attacks
May 18, 2026John T. Halloran, Noopur S. BhattLLM Backdoor Attacks Training Data Curation
Leidos · University of Pennsylvania
When Efficiency Backfires: Cascading LLMs Trigger Cascade Failure under Adversarial Attack
May 17, 2026Zehan Sun, Dingfan Chen, Songze LiAdversarial Attacks on LLMs LLM Security
1Southeast · 2Max Planck Institute for Intelligent Systems
STRIDE-AI: A Threat Modeling Framework for Generative AI Security Assessment
May 16, 2026Tsafac Nkombong Regine Cyrille, Franziska SchwarzAI Assurance AI Risk Management
SRH University of Applied Sciences Heidelberg School of Technology and Architecture CyberMACS (Applied Cybersecurity) Berlin, Germany · Universidad de Granada Facultad de Ciencias Econ´omicas y Empresariales Granada, Spain
Hidden in Memory: Sleeper Memory Poisoning in LLM Agents
May 14, 2026Sidharth Pulipaka, Stanislau Hlebik, Leonidas Raghav +4Persistent Memory for Language Models LLM Security
1SPAR · 2ELLIS Institute Tübingen, MPI for Intelligent Systems, Tübingen AI Center · 3APTA +1
MetaBackdoor: Exploiting Positional Encoding as a Backdoor Attack Surface in LLMs
May 14, 2026Rui Wen, Mark Russinovich, Andrew Paverd +2LLM Backdoor Attacks Backdoor Attacks
Institute of Science Tokyo · 2Microsoft Azure · 3Microsoft Security Response Center
Talk is (Not) Cheap: A Taxonomy and Benchmark Coverage Audit for LLM Attacks
May 14, 2026Karthik Raghu Iyer, Yazdan Jamshidi, Nicholas Bray +1LLM Safety Benchmarks Benchmark Auditing
Palo Alto Networks
Mistletoe: Stealthy Acceleration-Collapse Attacks on Speculative Decoding
May 13, 2026Shuoyang Sun, Chang Dai, Hao Fang +6Adversarial Attacks on LLMs Speculative Decoding
Harbin Institute of Technology, Shenzhen · South China University of Technology · Tsinghua Shenzhen International Graduate School, Tsinghua University +1
LoREnc: Low-Rank Encryption for Securing Foundation Models and LoRA Adapters
May 13, 2026Beomjin Ahn, Jungmin Kwon, Chanyong Jung +1Low-Rank Adaptation LLM Security
Samsung Research · Amazon Web Services · University of Michigan +1
CoT-Guard: Small Models for Strong Monitoring
May 12, 2026Nirav Diwan, Han Wang, Berkcan Kapusuzoglu +6LLM Auditing Adversarial Attacks on LLMs
†University of Illinois Urbana-Champaign · ♢Capital One
Robust LLM Unlearning Against Relearning Attacks: The Minor Components in Representations Matter
May 12, 2026Zeguan Xiao, Xuanzhe Xu, Yun Chen +4Neural Representation Geometry LLM Security
Shanghai University of Finance and Economics · Southern University of Science and Technology · Alibaba Group +1
Natural Language based Specification and Verification
May 11, 2026Zhaorui Li, Chengyu SongFormal Verification LLM Security
University of California Riverside

Jun 2, 2026, cs.CRJ/K move · Enter open · S save

Patcher: Post-Hoc Patching of Backdoored Large Language Models

Anjun Gao, Yueyang Quan, Yufei Xia, Zhuqing Liu+1

University of Louisville · University of North Texas

LLM Backdoor Attacks Backdoor Attacks Backdoor Defense in LLMs LLM Security Backdoor Defense

Open paper AskPDF arXiv

Large language models remain vulnerable to jailbreak backdoor attacks, where adversaries poison safety alignment data to embed hidden triggers that bypass safety mechanisms. Existing defenses often require comprehensive attack information or multiple triggered examples, making them impractical when defenders only observe a single reported failure case without knowing whether it stems from a backdoor attack or a natural alignment bug. This paper presents Patcher, a post-hoc defense framework that repairs backdoored language models using only a single reported failure case and the model parameters. Patcher operates in two stages. First, it localizes backdoor triggers by computing response-conditioned gradient-based saliency scores and applying adaptive clustering to separate triggers from benign context. Second, it patches the model through a constrained fine-tuning objective that breaks the trigger-response association while preserving benign-task utility and robustness to non-triggered jailbreak attacks through KL-divergence constraints. We conduct extensive evaluations across multiple backdoor attack strategies and demonstrate that Patcher successfully localizes triggers and neutralizes backdoors while maintaining model utility. We further show robustness against adaptive attacks designed to evade our defense. This work represents a significant step toward practical defenses against training-time attacks in deployed language models.

Momentum

Related topics

Latest papers 200