LLM Safety

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

36 papers in the last four weeks, up 200% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 272

All topics

I'm Sorry Driver, I'm Afraid I Can't Do That: Appraising the Safety of LLMs within Automotive Contexts
Jun 12, 2026Shaun Feakins, Ibrahim Habli, Kim Littler +1Language Model-Based Control Language Model Safety Evaluation
UKRI AI Centre for Doctoral Training in Safe Artificial Intelligence Systems (SAINTS), University of York, York, UK · Jaguar Land Rover, Coventry, UK
BELLS-O: Evaluating the Operational Trade-offs of LLM Supervision Systems
Jun 12, 2026Leonhard Waibl, Felix Michalak, Hadrien MariacciaLLM Safety Benchmarks LLM Guardrails
University of Graz, Graz, Austria · Supervised Program for Alignment Research (SPAR) · Centre pour la Sécurité de l’IA (CeSIA), Paris, France.
A Safety-First Gateway Architecture for Trusted Public Health Resource Navigation
Jun 11, 2026Ben Torkian, Jun ZhouLLM Guardrails LLM Safety
University of South Carolina, Columbia, South Carolina, USA · University of South Carolina, Columbia, USA
LoMC: Localized Multidirectional Correction for Refusal Suppression in Routed Foundation Models
Jun 10, 2026Yan Hong, Kedong Xiu, Wei Li +6Mixture-of-Experts Language Models LLM Refusal Behavior
Ant Group · Zhejiang University · Shanghai Jiao Tong University
DrugBench: Evaluating AI Control Protocols for Medication Harm Mitigation
Jun 10, 2026Guido Freire, Agustín Martínez-Suñé, Viviana CotikHealthcare AI Control
Universidad de Buenos Aires, Facultad de Ciencias Exactas y Naturales, Departamento de Computación, Argentina. · AI Safety Argentina (AISAR). · Department of Computer Science, University of Oxford, United Kingdom. +1
Schützen: Evaluating LLM Safety in Bulgarian and German Contexts
Jun 9, 2026Kiril Georgiev, Yuxia Wang, Dimitar Iliyanov Dimitrov +2LLM Safety Benchmarks Multilingual Language Model Evaluation
Sofia University "St. Kliment Ohridski" · INSAIT, Sofia University “St. Kliment Ohridski” · MBZUAI
PsychoSafe: Eliciting Psychologically-Informed Refusals in Large Language Models
Jun 8, 2026Gianluca Barmina, Federico Torrielli, Sven Harms +7Emotional Support Conversation Mental Health
University of Southern Denmark · University of Turin · University of Hamburg +1
Personalization Meets Safety:Mechanisms,Risks,and Mitigations in Personalized LLMs
Jun 8, 2026Yanyan Luo, Xue Han, Ruiqiao Bai +10LLM Personalization LLM Safety
Jiutian Research, China Mobile Jiutian Artificial Intelligence Technology (Beijing) Co., Ltd., Beijing, China. · Xinjiang Technical Institute of Physics and Chemistry, Chinese2026 Academy of Sciences, Beijing, China.
Activation Steering Induces Emergent Misalignment: A More Comprehensive Evaluation
Jun 7, 2026Qi Cao, Jian Lou, Meiting Liu +4Language Model Safety Evaluation LLM Safety
Nanyang Technological University · Sun Yat-sen University · University of Science and Technology of China +1
GIScholarBench: Benchmarking LLM Overconfidence in GIS Research
Jun 6, 2026Zongrng Li, Mingzheng Yang, Lei Zou +8LLM Evaluation AI-Assisted Scientific Research
Department of Geography Texas A&M University College Station, TX, USA · Google Mountain View, CA, USA · Department of Landscape Architecture and Urban Planning Texas A&M University College Station, TX, USA
CogManip: Benchmarking Manipulative Behavior in Multi-Turn Interactions with Large Language Model
Jun 4, 2026Zeyang Yue, Chenfei Yan, Feifei Zhao +5Language Model Safety Evaluation LLM Auditing
School of Artificial Intelligence, Beihang University · 2BrainCog AI Lab, CASIA · School of Artificial Intelligence, UCAS +4
CHASE: Adversarial Red-Blue Teaming for Improving LLM Safety using Reinforcement Learning
Jun 4, 2026Rahul Markasserithodi, Aditya Joshi, Yuekang Li +3Adversarial Training Adversarial Prompt Generation
University of New South Wales, Australia
When Autoregressive Consistency Hurts Safety Alignment
Jun 2, 2026Bochen Lyu, Yiyang Jia, Xiaohao Cai +1Adversarial Attacks on LLMs LLM Safety Alignment
University of Southampton · Independent Researcher
Large Language Models Hack Rewards, and Society
Jun 2, 2026Wei Liu, Xinyi Mou, Hanqi Yan +2Reward Hacking RL for Language Models
King’s College London · Fudan University · Shanghai Innovation Institute +1
PsychoPass: Geometric Profiling of Multi-Turn Adversarial LLM Conversations
Jun 2, 2026Muberra Ozmen, Subhabrata MajumdarAdversarial Attacks on LLMs LLM Safety
Coveo · Indian Institute of Management Bangalore
Unpredictable Safety: Domain-Dependent Compliance and the Transparency Gap in Open-Weight LLMs
Jun 1, 2026Zacharie BugaudLLM Safety Alignment LLM Safety
Astera Institute
MaskForge: Structure-Aware Adaptive Attacks for Jailbreaking Diffusion Large Language Models
Jun 1, 2026Yingzi Ma, Zhengyue Zhao, Xiaogeng Liu +3Masked Diffusion Models Adversarial Attacks on LLMs
University of Wisconsin-Madison · Johns Hopkins University · Responsible AI Research (RAIR) Centre, The University of Adelaide +1
Food Noise & False Safety: A Systematic Evaluation of How LLMs Fail to Adapt to Eating Disorder Queries with Clinician Feedback
Jun 1, 2026Giulia Pucci, Emily Hemendinger, Ruizhe Li +3Mental Health LLM Safety
University of Aberdeen · University of Colorado Anschutz · Heriot-Watt University +1
Investigating and Alleviating Harm Amplification in LLM Interactions
Jun 1, 2026Ruohao Guo, Wei Xu, Alan RitterLanguage Model Safety Evaluation LLM Safety
Georgia Institute of Technology
SentGuard: Sentence-Level Streaming Guardrails for Large Language Models
Jun 1, 2026Jiaqi Yu, Xin Wang, Yixu Wang +4Language Model Safety Evaluation LLM Guardrails
1Fudan University · 2Shanghai AI Laboratory
THRD: A Training-Free Multi-Turn Defense Framework for Jailbreak Attacks on Large Language Models
Jun 1, 2026Zhiqing Ma, Zhonghao Xu, Dong Yu +3LLM Safety Multi-Turn Jailbreak Attacks
1Beijing Language and Culture University · †Corresponding authors
Low-Resource Safety Failures Are Action Failures, Not Representation Failures
May 31, 2026Rashad Aziz, Ikhlasul Akmal Hanif, Fajri KotoLanguage Model Calibration LLM Safety
Mohamed bin Zayed University of Artificial Intelligence
Lost in Delusion: Examining LLM Safety Under User Delusions and Distress
May 31, 2026Andrew Aquilina, Chetna Nihalani, Vasudha Varadarajan +3Mental Health LLM Safety Alignment
University of Pittsburgh · Carnegie Mellon University · Fordham University
Large Language Models Should Learn Personalized Rather Than Aggregated Human Preferences
May 30, 2026Cristina GarbaceaLLM Alignment Social Choice Theory
University of Chicago, Data Science Institute, Chicago, USA.
Dialectics of Alignment: Harnessing Unsafe Knowledge for Dynamic Safety Routing
May 30, 2026Maryam Hashemzadeh, Jerry Huang, Minseon Kim +2LLM Safety Alignment LLM Safety
Chandar Research Lab · Mila – Quebec AI Institute · Université de Montréal +3
Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion
May 29, 2026Stine Lyngsø Beltoft, William Brach, Federico Torrielli +5LLM Security LLM Safety
University of Southern Denmark · 2Slovak University of Technology in Bratislava · University of Turin +1
EvoDefense: Co-Evolving Black-Box Defense with Large Language Models
May 29, 2026Yu Li, Yuenan Hou, Yingmei Wei +2Evolutionary Optimization Adversarial Attacks on LLMs
National University of Defense Technology · Shanghai AI Laboratory
DataShield: Safety-degrading Data Filtering for LLM Benign Instruction Fine-Tuning
May 29, 2026Junbo Zhang, Qianli Zhou, Xinyang Deng +3LLM Fine-Tuning Instruction-Tuning Data Selection
Persona Attack: Incremental Memory Injection Jailbreak Attack against Large Language Models
May 29, 2026Junyoung Park, Seongyong Ju, Sunghwan Park +1Adversarial Attacks on LLMs LLM Safety
Chung-Ang University
CSULoRA: Closest Safe Update Low-Rank Adaptation
May 28, 2026Oleksandr Marchenko Breneur, Adelaide Danilov, Aria Nourbakhsh +1Adapter Tuning Low-Rank Adaptation
Department of Computer Science, University of Luxembourg Esch-sur-Alzette, Luxembourg

Jun 12, 2026, cs.SEJ/K move · Enter open · S save

I'm Sorry Driver, I'm Afraid I Can't Do That: Appraising the Safety of LLMs within Automotive Contexts

Shaun Feakins, Ibrahim Habli, Kim Littler, Robert Palin

UKRI AI Centre for Doctoral Training in Safe Artificial Intelligence Systems (SAINTS), University of York, York, UK · Jaguar Land Rover, Coventry, UK

Language Model-Based Control Language Model Safety Evaluation Autonomous Driving LLM Safety

Open paper AskPDF arXiv

This paper appraises recent frameworks within AI development to integrate LLMs into control tasks in automotive contexts from the perspective of safety assurance. This work has built upon the rapid integration of LLMs across automotive settings. However, we find that at present, these frameworks face significant challenges, limiting their efficacy in real-time safety-critical contexts. Firstly, we consider conceptual challenges, including the fact that deployers are faced with a dual challenge, wherein they must assure a model which has been developed upstream, i.e. as general-purpose tools by the large AI labs, in a downstream context, i.e. into specific vehicle architectures. Secondly, we consider concrete challenges from across existing standards. We show that there are currently both fundamental engineering constraints covered in ISO21448, such as latency, and novel LLM-specific issues, such as alignment-related issues covered in ISO/PAS8800. We ground both examples in a concrete introductory, experimental case study exploring an existing open-source repository, Talk2Drive. We present a safety argument in order to make explicit the limitations of existing solutions. Nonetheless, given that the use of LLMs in automotive contexts is being explored at a technical level and operationalised, we propose potential assurance mechanisms for LLM-related hazardous events going forward.

Momentum

Related topics

Latest papers 272