LLM Safety Alignment

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

25 papers in the last four weeks, up 14% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 236

All topics

SafeMed-R1: Clinician-Audited Safety and Ethics Alignment for Medical Large Language Models
May 27, 2026Chao Ding, Mouxiao Bian, Tianbin Li +12Healthcare LLM Auditing
Shanghai Artificial Intelligence Laboratory, Shanghai, China · Joint Laboratory of Biomedical Artificial Intelligence, Shanghai East Hospital, Tongji University School of Medicine, Shanghai, China · School of Computer Science and Technology, Tongji University, Shanghai, China +5
SPARD: Defending Harmful Fine-Tuning Attack via Safety Projection with Relevance-Diversity Data Selection
May 27, 2026Shuhao Chen, Weisen Jiang, Yeqi Gong +5LLM Fine-Tuning LLM Safety Alignment
Department of Computer Science and Engineering, Southern University of Science and Technology · Department of Computer Science and Engineering, The Hong Kong University of Science and Technology · Department of Computer Science and Engineering, The Chinese University of Hong Kong +2
Position: AI Safety Requires Effective Controllability
May 26, 2026Yige Li, Yunhao Feng, Jun SunLLM Safety Alignment AI Agent Safety
Singapore Management University · Ant Group
When Medical Safety Alignment Fails: A Benchmark for Evaluating LLMs on High-Risk Medical Queries
May 26, 2026Yige Li, Jun Sun, Wei Zhao +5LLM Safety Benchmarks Healthcare
Singapore Management University · Deakin University · The University of Melbourne +2
Algorithmic Fragility and Persona Bias in LLM-Generated Autistic Communication
May 26, 2026Naba Rizvi, Mohammed Rizvi, Harper Strickland +2Autism Spectrum Disorder Social Bias in Language Models
University of California · Georgia Institute of Technology · Cardiff University
Curriculum Learning for Safety Alignment
May 25, 2026Sandeep Kumar, Virginia Smith, Chhavi YadavLLM Alignment Direct Preference Optimization
Carnegie Mellon University · Simons Institute, UC Berkeley
SafeCtrl-RL: Inference-Time Adaptive Behaviour Control for LLM Dialogue via RL-Driven Prompt Optimisation
May 25, 2026Michael Orme, Yanchao Yu, Zhiyuan TanRL for Language Models Language Model-Based Control
School of Computing, Engineering and Building Environment. Edinburgh Napier University Edinburgh, EH10 5DT, UK
Jailbreak to Protect: Buffering and Reinforcing via Temporary Jailbreaking for Safe Fine-Tuning in Large Language Models
May 23, 2026Seokil Ham, Jaehyuk Jang, Wonjun Lee +1LLM Fine-Tuning LLM Safety Alignment
School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea.
JT-SAFE-V2: Safety-by-Design Foundation Model with World-Context Data
May 23, 2026Junlan Feng, Fanyu Meng, Chong Long +12LLM Safety Alignment LLM Safety
JIUTIAN Research
Palette: A Modular, Controllable, and Efficient Framework for On-demand Authorized Safety Alignment Relaxation in LLMs
May 22, 2026Qitao Tan, Xiaoying Song, Arman Akbari +7LLM Safety Alignment Refusal Behavior in Language Models
University of Georgia · University of North Texas · 3Northeastern University
On-Policy Consistency Training Improves LLM Safety with Minimal Capability Degradation
May 20, 2026Andy Han, Kristina Fujimoto, Avidan Shah +5Language Model Safety Evaluation LLM Safety Alignment
1New York University
CR4T: Rewrite-Based Guardrails for Adolescent LLM Safety
May 20, 2026Heajun An, Qi Zhang, Vedanth Achanta +1LLM Guardrails LLM Safety Alignment
Virginia Tech
Towards Context-Invariant Safety Alignment for Large Language Models
May 20, 2026Yixu Wang, Yang Yao, Xin Wang +4RL for Language Models LLM Alignment
Fudan University, Shanghai, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China.
Measuring Safety Alignment Effects in Autonomous Security Agents
May 19, 2026Isaac David, Arthur GervaisLanguage Model Safety Evaluation LLM Safety Alignment
University College London
Alignment Dynamics in LLM Fine-Tuning
May 18, 2026Yuhan Huang, Huanran Chen, Yinpeng DongLLM Alignment LLM Fine-Tuning
Shanghai Qi Zhi Institue & University of Tokyo · College of AI, Tsinghua University · Shanghai Qi Zhi Institue
Propagating Unsafe Actions in LLM Controlled Multi-Robot Collaboration via Single Robot Compromise
May 15, 2026Zhen Huang, Zhihuang Liu, Mengxuan Luo +2Large Language Model-Based Robot Planning Adversarial Attacks on LLMs
College of Computer Science and Technology, National University of Defense Technology
EVA: Editing for Versatile Alignment against Jailbreaks
May 14, 2026Yi Wang, Hongye Qiu, Yue Xu +4VLM Robustness LLM Safety Alignment
Reducing the Safety Tax in LLM Safety Alignment with On-Policy Self-Distillation
May 14, 2026Yu Fu, Longxuan Yu, Haz Sameen Shahgir +4LLM Alignment On-Policy Self-Distillation
1UC Riverside · 2International Computer Science Institute · 3Microsoft,∗ +1
GradShield: Alignment Preserving Finetuning
May 13, 2026Zhanhao Hu, Xiao Huang, Patrick Mendoza +4LLM Fine-Tuning LLM Safety Alignment
University of California, Berkeley · 2HUMAIN · 3King Abdulaziz City for Science and Technology +1
From Descriptive to Prescriptive: Uncover the Social Value Alignment of LLM-based Agents
May 13, 2026Jinxian Qu, Qingqing Gu, Teng Chen +1AI Alignment LLM Safety Alignment
Geely AI Lab
BSO: Safety Alignment Is Density Ratio Matching
May 12, 2026Tien-Phat Nguyen, Truong Nguyen, Thin Nguyen +3Functional Bregman Divergences Direct Preference Optimization
Hanoi University of Science and Technology Hanoi, Vietnam · Deakin University Burwood, VIC 3125, Australia · Max Planck Research School for Intelligent Systems +2
On-Policy Self-Evolution via Failure Trajectories for Agentic Safety Alignment
May 12, 2026Bo Yin, Qi Li, Xinchao WangAgentic RL LLM Safety Alignment
National University of Singapore
SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models
May 12, 2026Xinyi Zeng, Xue Yang, Jingyuan Zhang +5Adversarial Attacks on VLMs Multimodal Robustness
Tsinghua University, Beijing, China · Shanghai Jiao Tong University · Kuaishou Technology, Beijing, China +4
Toward Stable Value Alignment: Introducing Independent Modules for Consistent Value Guidance
May 12, 2026Wenhao Chen, Sirui Sun, Shengyuan Bai +1LLM Alignment LLM Safety Alignment
School of Electronics Engineering and Computer Science, Peking University · Yuanpei College, Peking University · State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University
Explaining and Breaking the Safety-Helpfulness Ceiling via Preference Dimensional Expansion
May 12, 2026ShiYing Huang, Liang Lin, Yuer Li +6LLM Safety Alignment Multi-Objective Language Model Alignment
Huazhong University of Science and Technology · Nanyang Technological University · Tsinghua University +1
Leveraging RAG for Training-Free Alignment of LLMs
May 11, 2026John T. HalloranLLM Alignment LLM Safety Alignment
Leidos
Intrinsic Guardrails: How Semantic Geometry of Personality Interacts with Emergent Misalignment in LLMs
May 11, 2026Krishak Aneja, Manas Mittal, Anmol Goel +2LLM Alignment LLM Interpretability
International Institute of Information Technology, Hyderabad · TU Darmstadt · Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi
CALYREX: Cross-Attention LaYeR EXtended Transformers for System Prompt Anchoring
May 10, 2026Li LixingSelf-Attention Cross-Attention
Cornell University Ithaca, NY 14853
Internalizing Safety Understanding in Large Reasoning Models via Verification
May 9, 2026Yi Zhang, Yuxin Chen, Leheng Sheng +4LLM Safety Alignment LLM Safety
University of Science and Technology of China · National University of Singapore · Shanghai Artificial Intelligence Laboratory
A Single Neuron Is Sufficient to Bypass Safety Alignment in Large Language Models
May 8, 2026Hamid Kazemi, Atoosa Chegini, Maria SafiLLM Interpretability Adversarial Attacks on LLMs
Apple · Work done during an internship at Apple. Present affiliation: University of Maryland, College Park.

May 27, 2026, cs.AIJ/K move · Enter open · S save

SafeMed-R1: Clinician-Audited Safety and Ethics Alignment for Medical Large Language Models

Chao Ding, Mouxiao Bian, Tianbin Li, Minjia Yuan+11

Shanghai Artificial Intelligence Laboratory, Shanghai, China · Joint Laboratory of Biomedical Artificial Intelligence, Shanghai East Hospital, Tongji University School of Medicine, Shanghai, China · School of Computer Science and Technology, Tongji University, Shanghai, China+5

Healthcare LLM Auditing LLM Safety Alignment Adversarial Robustness of Language Models Clinical Language Model Evaluation Medical LLMs

Open paper AskPDF arXiv

Large language models(LLMs) increasingly match expert performance on licensing examinations, yet routine clinical use remains limited because governance requires auditable reasoning, safety and ethics alignment, and resilience to adversarial misuse. Here we present SafeMed-R1, trained with a traceable Clinical Trust Signals(CTS) pipeline that links each reasoning instance to clinician rubric scores and edit histories, and aligned through safety and ethics supervision and red team stress testing. SafeMed-R1 attains a macro-averaged accuracy of 79.6% across clinical benchmarks. Under adversarial safety testing, it shows the lowest aggregated risk and reduces unsafe outputs by about 3 to 5% relative to its baseline. In a paired expert study of 30 medication safety vignettes, SafeMed-R1 matches PGY1 and PGY2 residents on medical correctness and scores higher for medication safety, guideline consistency, and clinical usefulness. Collectively, these results suggest that clinician-audited supervision provenance, together with domain-tailored safety and ethics alignment, can strengthen governance-relevant evidence without relying on inference-time retrieval or citation grounding.

Momentum

Related topics

Latest papers 236