LLM Defense Mechanisms

Ask about this topic

Momentum

32 papers in the last four weeks, up 256% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 258

All topics
CardsList

  1. AI Agents May Always Fall for Prompt Injections

    May 17, 2026Sahar Abdelnabi, Eugene BagdasarianArtificial Intelligence SafetyArtificial Intelligence Agents

    ELLIS Institute Tübingen & MPI-IS & Tübingen AI Center · University of Massachusetts Amherst

  2. Asking Back: Interaction-Layer Antidistillation Watermarks

    May 15, 2026Guang Yang, Amir Ghasemian, Fengchen Liu +3WatermarksLLM Defense Mechanisms

    University of California, Los Angeles · Lawrence Berkeley National Laboratory · Meta

  3. EntropyScan: Towards Model-level Backdoor Detection in LVLMs via Visual Attention Entropy

    May 15, 2026Xuanyu Ge, Zhongqi Wang, Jie Zhang +2Clean Label Backdoor AttackLarge Language Model Backbones

    China University of Geosciences · University of the Chinese Academy of Sciences · Institute of Computing Technology, Chinese Academy of Sciences

  4. A Few Steps Further: Why Defenses Against Malicious Finetuning Erode Under Continued Training

    May 14, 2026Itay Zloczower, Eyal Lenga, Gilad Gressel +1Model-Agnostic DefenseLLM Defense Mechanisms

    Ben-Gurion University of the Negev · Amrita Vishwa Vidyapeetham, Amritapuri

  5. MemLineage: Lineage-Guided Enforcement for LLM Agent Memory

    May 14, 2026Ciyan Ouyang, Rui HouUntrusted ContentLLM Defense Mechanisms

    State Key Laboratory of Cyberspace Security Defense Institute of Information Engineering, CAS Beijing, China

  6. Mitigating Data Scarcity in Psychological Defense Classification with Context-Aware Synthetic Augmentation

    May 14, 2026Hoang-Thuy-Duong Vu, Quoc-Cuong Pham, Huy-Hieu PhamAugmentationLLM Defense Mechanisms

    College of Engineering and Computer Science, VinUniversity, Hanoi, Vietnam · VinUni-Illinois Smart Health Center, VinUniversity, Hanoi, Vietnam · Center for Innovations in Health Sciences, VinUniversity, Hanoi, Vietnam

  7. Inducing Overthink: Hierarchical Genetic Algorithm-based DoS Attack on Black-Box Large Language Reasoning Models

    May 13, 2026Shuqiang Wang, Wei Cao, Jiaqi Weng +4LLM Reasoning StrategiesLarge Reasoning Models

    The State Key Laboratory of Blockchain and Data Security, Zhejiang University · Alibaba Group

  8. Not Just RLHF: Why Alignment Alone Won't Fix Multi-Agent Sycophancy

    May 13, 2026Adarsh Kumarappan, Ananya MujooMulti-Agent Large Language Model SystemsReinforcement Learning From Human Feedback

    1California Institute of Technology · 2Evergreen Valley College

  9. CoT-Guard: Small Models for Strong Monitoring

    May 12, 2026Nirav Diwan, Han Wang, Berkcan Kapusuzoglu +6Realistic Threat ModelLLM Defense Mechanisms

    †University of Illinois Urbana-Champaign · ♢Capital One

  10. Re-Triggering Safeguards within LLMs for Jailbreak Detection

    May 11, 2026Zheng Lin, Zhenxing Niu, Haoxuan Ji +2Large Language Model JailbreaksJailbreak Attacks

    1Xidian University · 2Xi’an Jiaotong University

  11. Guaranteed Jailbreaking Defense via Disrupt-and-Rectify Smoothing

    May 11, 2026Zheng Lin, Zhenxing Niu, Haoxuan Ji +1Large Language Model JailbreaksJailbreak Attacks

    Xidian University · Xi’an Jiaotong University

  12. Acceptance Cards:A Four-Diagnostic Standard for Safe Fine-Tuning Defense Claims

    May 11, 2026Phongsakon Mark Konrad, Toygar Tanyel, Serkan AyvazLarge Language Model SafetyModel Fine-Tuning

    Centre for Industrial Software, University of Southern Denmark, Alsion 2, Sønderborg, 6400, Denmark · ProMake, Newark, DE, USA

  13. UTS at PsyDefDetect: Multi-Agent Councils and Absence-Based Reasoning for Defense Mechanism Classification

    May 10, 2026Dima Galat, Marian-Andrei RizoiuMulti-Agent DebateLLM Defense Mechanisms

    University of Technology Sydney

  14. Strategic commitments shape collective cybersecurity under AI inequality

    May 10, 2026Adeela Bashir, Zia Ush Shamszaman, Zhao Song +2CybersecurityLLM Defense Mechanisms

    School of Computing, Engineering and Digital Technologies, Teesside University · Center for Digital Innovation, Teesside University · Faculty of Natural Sciences and Mathematics, University of Maribor, Maribor, Slovenia +3

  15. NEXUS: Continual Learning of Symbolic Constraints for Safe and Robust Embodied Planning

    May 10, 2026Tiehan Cui, Peipei Liu, Yanxu Mao +3Embodied AgentsEmbodied Artificial Intelligence

    School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, China · School of Software, Henan University, China · Institute of Information Engineering, Chinese Academy of Sciences, China +2

  16. Not All Turns Matter: Credit Assignment for Multi-Turn Jailbreaking

    May 9, 2026Zhida He, Xiaoyu Wen, Han Qi +7Jailbreak AttacksJailbreaks

    Shanghai AI Laboratory · Fudan University · Shanghai Jiao Tong University

  17. Robust Server Defense Against Unreliable Clients in One-Shot Fair Collaborative Machine Learning

    May 9, 2026Chia-Yuan Wu, Frank E. Curtis, Daniel P. RobinsonFederated LearningAlgorithmic Fairness

    Department of Industrial and Systems Engineering, Lehigh University, Bethlehem, PA, USA

  18. Defense effectiveness across architectural layers: a mechanistic evaluation of persistent memory attacks on stateful LLM agents

    May 8, 2026Jun Wen LeongLLM Defense MechanismsRealistic Threat Model

  19. The Attacker in the Mirror: Breaking Self-Consistency in Safety via Anchored Bipolicy Self-Play

    May 8, 2026Gabriele La Malfa, Emanuele La Malfa, Saar Cohen +4Self-PlayArtificial Intelligence Safety

    Department of Informatics, King’s College London · Department of Computer Science, University of Oxford · Institute for Decentralized AI +1

  20. Seed Hijacking of LLM Sampling and Quantum Random Number Defense

    May 8, 2026Ziyang You, Xiaoke Yang, Zhanling Fan +3Attacker Large Language ModelRandom

    School of Electronic, Electrical and Physics, Fujian University of Technology, Fuzhou 350118, China · School of Humanities, Fujian University of Technology, Fuzhou 350118, China · Department of Investigation, Fujian Police College, Fuzhou 350007, China +1

  21. WebTrap: Stealthy Mid-Task Hijacking of Browser Agents During Navigation

    May 8, 2026Zhichao Liu, Wenbo Pan, Haining Yu +3HijackingBrowser Agent

    Harbin Institute of Technology · City University of Hong Kong · City University of Macau

  22. Fortifying Time Series: DTW-Certified Robust Anomaly Detection

    May 8, 2026Shijie Liu, Tansu Alpcan, Christopher Leckie +1Time-Series Anomaly DetectionTime Series

    Department of Electrical and Electronic Engineering University of Melbourne, Melbourne, Australia · School of Computing and Information Systems University of Melbourne, Melbourne, Australia

  23. Nürnberg NLP at PsyDefDetect: Multi-Axis Voter Ensembles for Psychological Defence Mechanism Classification

    May 8, 2026Philipp Steigerwald, Eric Rudolph, Jens AlbrechtPsychologyNatural Language Processing

    Technische Hochschule Nürnberg Georg Simon Ohm

  24. Beyond Defenses: Manifold-Aligned Regularization for Intrinsic 3D Point Cloud Robustness

    May 8, 2026Pedro Alonso, Chongshou Li, Tianrui LiPoint CloudsRegularization

    School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu, 611756, China · Engineering Research Center of Sustainable Urban Intelligent Transportation, Ministry of Education, Southwest Jiaotong University, Chengdu, 611756, China

  25. MIPIAD: Multilingual Indirect Prompt Injection Attack Defense with Qwen -- TF-IDF Hybrid and Meta-Ensemble Learning

    May 8, 2026Al Muhit Muhtadi, Mostafa Rifat TazwarAttacker Large Language ModelIndirect Prompt Injection

    Bangladesh University of Engineering and Technology

  26. PropGuard: Safeguarding LLM-MAS via Propagation-Aware Exploration and Remediation

    May 8, 2026Bingyu Yan, Xiaoming Zhang, Jinyu Hou +4LLM Defense MechanismsRemediation

    Beihang University · Beijing University of Posts and Telecommunications · City University of Hong Kong

  27. Safety Anchor: Defending Harmful Fine-tuning via Geometric Bottlenecks

    May 7, 2026Guoxin Lu, Letian Sha, Qing Wang +4Large Language Model SafetyLarge Language Model Fine-Tuning

    Nanjing University of Posts and Telecommunications, Nanjing, China.

  28. SafeHarbor: Hierarchical Memory-Augmented Guardrail for LLM Agent Safety

    May 7, 2026Zhe Liu, Zonghao Ying, Wenxin Zhang +5Large Language Model SafetyLarge Language Model Agents

    School of Cyber Science and Technology, Beihang University, Beijing, China · Institute of Artificial Intelligence, Beihang University, Beijing, China · University of Chinese Academy of Sciences, Beijing, China +1

  29. One Turn Too Late: Learning When to Intervene Against Multi-Turn Malicious Intent

    May 7, 2026Xinjie Shen, Rongzhe Wei, Peizhi Niu +6AttackerMalicious Agents

    Georgia Institute of Technology · University of Illinois Urbana-Champaign · UCSD +3

  30. Agentic AI and the Industrialization of Cyber Offense: Forecast, Consequences, and Defensive Priorities for Enterprises and the Mittelstand

    May 6, 2026Christopher KochCybersecurityLLM Defense Mechanisms

    Independent Researcher

  31. On the (In-)Security of the Shuffling Defense in the Transformer Secure Inference

    May 6, 2026Zhengyi Li, Yakai Wang, Kang Yang +6Transformer ArchitecturesLLM Defense Mechanisms

    Shanghai Jiao Tong University · State Key Laboratory of Cryptology · Shanghai Qizhi Institute

  32. MEMSAD: Gradient-Coupled Anomaly Detection for Memory Poisoning in Retrieval-Augmented Agents

    May 5, 2026Ishrith GowdaPoisoningLLM Defense Mechanisms

    University of California, Berkeley · Department of Electrical Engineering and Computer Sciences University of California, Berkeley · Work conducted at the Song Lab, Berkeley AI Research, University of California, Berkeley.

  33. Cryptographic Registry Provenance: Structural Defense Against Dependency Confusion in AI Package Ecosystems

    May 5, 2026Alan L. McCannOn-Chain AttestationsOnline Signature Verification

    Mashin, Inc.

  34. Safeguarding LLM Agents against Long-Horizon Threats via Shadow Memory

    May 4, 2026Yuhui Wang, Tanqiu Jiang, Jiacheng Liang +2Multi-Llm AgentsLarge Language Model Agents

    Stony Brook University USA · Cisco Systems USA

  35. PIIGuard: Mitigating PII Harvesting under Adversarial Sanitization

    May 4, 2026Mingshuo Liu, Yiwei Zha, Min ChenAttacker Large Language ModelData Leakage

    Vrije Universiteit Amsterdam

  36. Tenability and Weak Semantics: Modeling Non-uniform Defense -- Extended Version

    May 3, 2026Uri Andrews, Luca San Mauro, John SpoerlArgumentation FrameworksLLM Defense Mechanisms

    Department of Mathematics, University of Wisconsin–Madison · Dipartimento di Ricerca e Innovazione Umanistica, University of Bari, Italy

  37. Catching the Infection Before It Spreads: Foresight-Guided Defense in Multi-Agent Systems

    May 3, 2026Yue Ma, Ziyuan Yang, Yi ZhangModel-Based Multi-Agent SystemsLLM Defense Mechanisms

    Sichuan University · Nanyang Technological University

  38. When Embedding-Based Defenses Fail: Rethinking Safety in LLM-Based Multi-Agent Systems

    May 1, 2026Lingxi Zhang, Guangtao Zheng, Hanjie ChenMulti-Agent Large Language Model SystemsModel-Agnostic Defense

    1Rice University · University of Virginia

  39. A Theoretical Game of Attacks via Compositional Skills

    May 1, 2026Xinbo Wu, Huan Zhang, Abhishek Umrawal +1Attacker Large Language ModelAdversarial Prompts

    University of Illinois Urbana-Champaign, Urbana, IL, USA · Stony Brook University, Stony Brook, NY, USA.

  40. Controlled Steering-Based State Preparation for Adversarial-Robust Quantum Machine Learning

    Apr 30, 2026Sahan Sanjaya, Hari Krishna Parvatham, Emma Andrews +1Quantum Machine LearningQuantum Error Correction

    University of Florida, Gainesville, FL, USA

  41. TwinGate: Stateful Defense against Decompositional Jailbreaks in Untraceable Traffic via Asymmetric Contrastive Learning

    Apr 30, 2026Bowen Sun, Chaozhuo Li, Yaodong Yang +2Large Language Model JailbreaksJailbreak Success Rates

    Johns Hopkins University · Microsoft Research Asia · Peking University +1

  42. Security Attack and Defense Strategies for Autonomous Agent Frameworks: A Layered Review with OpenClaw as a Case Study

    Apr 30, 2026Luyao Xu, Xiang ChenOpenclawSecurity

    School of Artificial Intelligence and Computer Science, Nantong University, Nantong, China · State Key Lab. for Novel Software Technology, Nanjing University, Nanjing, China

  43. AdaBFL: Multi-Layer Defensive Adaptive Aggregation for Bzantine-Robust Federated Learning

    Apr 30, 2026Zehui Tang, Yuchen Liu, Feihu HuangFederated LearningByzantine Attacks

    College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China · MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, Nanjing, China.

  44. Benchmarking the Safety of Large Language Models for Robotic Health Attendant Control

    Apr 29, 2026Mahiro Nakao, Kazuhiro TakemotoLarge Language Model SafetyLLM Defense Mechanisms

    Kyushu Institute of Technology Iizuka, Fukuoka, Japan

  45. The Unseen Adversaries: Robust and Generalized Defense Against Adversarial Patches

    Apr 29, 2026Vishesh Kumar, Akshay AgarwalAdversarial TrainingOut-Of-Distribution Detection

    Trustworthy BiometraVision Lab, Indian Institute of Science Education and Research Bhopal, India

  46. SnapGuard: Lightweight Prompt Injection Detection for Screenshot-Based Web Agents

    Apr 28, 2026Mengyao Du, Han Fang, Haokai Ma +4Prompt-Injection DetectorsIndirect Prompt Injection

    1National University of Defense Technology · University of Science and Technology of China · 3National University of Singapore +1

  47. GAMMAF: A Common Framework for Graph-Based Anomaly Monitoring Benchmarking in LLM Multi-Agent Systems

    Apr 27, 2026Pablo Mateo-Torrejón, Alfonso Sánchez-MaciánGeneralist Graph Anomaly DetectionInterpretable Anomaly Detection

    University Carlos III of Madrid · Leganés, Spain

  48. Defusing the Trigger: Plug-and-Play Defense for Backdoored LLMs via Tail-Risk Intrinsic Geometric Smoothing

    Apr 27, 2026Kaisheng Fan, Weizhe Zhang, Yishu Gao +2Inference-Time DefenseLLM Defense Mechanisms

    School of Cyber Science and Technology Harbin Institute of Technology Harbin, China · Department of New Networks Peng Cheng Laboratory Shenzhen, China · SnT University of Luxembourg Luxembourg City, Luxembourg

  49. Evaluation of Prompt Injection Defenses in Large Language Models

    Apr 26, 2026Priyal Deep, Shane Emmons, Amy Fox +4Attacker Large Language ModelLLM Defense Mechanisms

    Swept AI[1] · University of Michigan

  50. Do Protective Perturbations Really Protect Portrait Privacy under Real-world Image Transformations?

    Apr 26, 2026Ruiqing Sun, Xingshan Yao, Zhijing Wu +6Model-Agnostic DefensePortraits

    Beijing Institute of Technology

  51. Breaking the Secret: Economic Interventions for Combating Collusion in Embodied Multi-Agent Systems

    Apr 26, 2026Qi Liu, Xiaohui Chen, Zhihui Zhao +5Model-Based Multi-Agent SystemsCollusion

    College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, China, 030024 · State Key Laboratory of Internet Architecture, Tsinghua University, Beijing, China, 100084 · China Mobile Research Institute, Beijing, China, 100053 +3

  52. UNSEEN: A Cross-Stack LLM Unlearning Defense against AR-LLM Social Engineering Attacks

    Apr 25, 2026Tianlong Yu, Yang Yang, Xiao Luo +6Attacker Large Language ModelLLM Defense Mechanisms

    Hubei University, Wuhan, China · University of Southern California, Los Angeles, USA · Huazhong University of Science and Technology, Wuhan, China

  53. Stealthy Backdoor Attacks against LLMs Based on Natural Style Triggers

    Apr 23, 2026Jiali Wei, Ming Fan, Guoheng Sun +3Attacker Large Language ModelClean Label Backdoor Attack

    School of Cyber Science and Engineering, Xi’an Jiaotong University, Xi’an 710049, China · Ministry of Education Key Lab for Intelligent Networks and Network Security, Xi’an Jiaotong University, Xi’an 710049, China

  54. Escaping the Agreement Trap: Defensibility Signals for Evaluating Rule-Governed AI

    Apr 22, 2026Michael O'Herlihy, Rosa CatalàContent ModerationAgreement

    Reddit, Inc.

  55. Adaptive Defense Orchestration for RAG: A Sentinel-Strategist Architecture against Multi-Vector Attacks

    Apr 22, 2026Pranav Pallerla, Wilson Naik Bhukya, Bharath Vemula +1Model-Agnostic DefenseLLM Defense Mechanisms

    School of Computer and Information Sciences University of Hyderabad Hyderabad, Telangana, India · Purdue University West Lafayette, USA

  56. SafeRedirect: Defeating Internal Safety Collapse via Task-Completion Redirection in Frontier LLMs

    Apr 22, 2026Chao Pan, Yu Wu, Xin YaoLarge Language Model SafetyLLM Defense Mechanisms

    Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen 518055, China · The Hong Kong Polytechnic University, Hong Kong, China · George Washington University +1

  57. Temporal UI State Inconsistency in Desktop GUI Agents: Formalizing and Defending Against TOCTOU Attacks on Computer-Use Agents

    Apr 20, 2026Wenpeng XuGraphical User Interface AgentsCyberattacks

    University of California, San Diego

  58. Adversarial Arena: Crowdsourcing Data Generation through Interactive Competition

    Apr 20, 2026Prasoon Goyal, Sattvik Sahai, Michael Johnston +14Large Language Model GenerationAdversarial Robustness

    Amazon Nova Responsible AI

  59. CASCADE: A Component Ablation and Corpus Audit of a Layered Local Defense for MCP-Based Systems

    Apr 18, 2026İpek Abasıkeleş Turgut, Edip GümüşLLM Defense MechanismsModel Context Protocol

    Department of Computer Engineering, Faculty of Engineering and Natural Sciences, Iskenderun Technical University, Hatay, Türkiye · Department of Computer Engineering, Institute of Graduate Studies, Iskenderun Technical University, Hatay, Türkiye

  60. When Safe Concepts Become Unsafe: Multi-Concept Compositional Vulnerabilities in Text-to-Image Models

    Apr 17, 2026Chaoshuo Zhang, Yibo Liang, Mengke Tian +7Large Language Model SafetyVisual Representations

    School of Cyber Science and Engineering, Xi’an Jiaotong University, Xi’an, China · CISPA Helmholtz Center for Information Security, Saarbrücken, Germany · School of Cyber Science and Engineering, Wuhan University, Wuhan, China