LLM Refusal Behavior

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

1 paper in the last four weeks, down 86% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 54

All topics

Beyond Attack Success Rate: Temporal Logit Observability for LLM Safety Failures
May 28, 2026Junyoung Park, Sunghwan Park, Seongyong Ju +1LLM Refusal Behavior LLM Jailbreak Attacks
Chung-Ang University
SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing
May 28, 2026Almene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. AcunaAI for Science Adversarial Attacks on LLMs
Department of Computer Science, University of Colorado Boulder, Boulder, CO 80309
The Ethics of LLM Sandbox and Persona Dynamics
May 27, 2026Tim Gebbie, Stewart GebbieLLM Guardrails LLM Safety Alignment
Dept. Statistical Sciences, University of Cape Town, South Africa
Refusal Before Decoding: Detecting and Exploiting Refusal Signals in Intermediate LLM Activations
May 27, 2026Matteo Gioele Collu, Riccardo Conte, Alberto Giaretta +4LLM Interpretability Adversarial Attacks on LLMs
University of Padua, Italy · 2Örebro University, Sweden · 3Fondazione Bruno Kessler, Italy
A Paired Testing Protocol for Batch-Conditioned Refusal Robustness in LLM Serving
May 26, 2026Sahil KadadekarLLM Inference Language Model Safety Evaluation
Independent Researcher.
Beyond a Single Direction: Chain-of-Thought Disrupts Simple Steering of Refusal
May 26, 2026Kia-Jüng Yang, Dominik Meier, Jiachen Zhao +2CoT Reasoning LLM Refusal Behavior
University of Göttingen, Germany · LKA NRW, Germany · Northeastern University, Boston, MA, USA.
Open-source LLMs administer maximum electric shocks in a Milgram-like obedience experiment
May 20, 2026Roland Pihlakas, Jan Llenzl DagohoyLLM Refusal Behavior LLM Safety Evaluation
for the Three Laws collaboration · Independent researcher · Three Laws research collaboration +2
RefusalBench: Why Refusal Rate Misranks Frontier LLMs on Biological Research Prompts
May 20, 2026Lukas Weidener, Marko Brkić, Mihailo Jovanović +2LLM Safety Benchmarks Language Model Safety Evaluation
Applied Scientific Intelligence, Inc.
Residual Paving: Diagnosing the Routing Bottleneck in Selective Refusal Editing
May 18, 2026Bryce Hinkley, Peyman NajafiradResidual Learning LLM Refusal Behavior
University of Texas at San Antonio
LLM-Based Persuasion Enables Guardrail Override in Frontier LLMs
May 13, 2026Rodrigo Nogueira, Thales Sales Almeida, Giovana Kerche Bonás +7Adversarial Prompt Generation LLM Guardrails
Maritaca AI · JusBrasil
Beyond "I cannot fulfill this request": Alleviating Rigid Rejection in LLMs via Label Enhancement
May 8, 2026Ying Zhang, Congyu Qiao, Xin Geng +1LLM Safety Alignment LLM Refusal Behavior
Examining Human-Like Behaviors in LLMs: A Multi-Dimensional Analysis of Model Behaviors, User Factors, and System Prompts
May 7, 2026Sunnie S. Y. Kim, Margit Bowler, Leon A GatysLLM Evaluation LLM Prompting
Apple
The Refusal--Compliance Tradeoff: A Large-Scale Safety Behavior Audit of Large Language Models
May 6, 2026Alif Al Hasan, Sumon BiswasLLM Safety Benchmarks Language Model Safety Evaluation
Department of Computer and Data Sciences Case Western Reserve University Cleveland, OH, USA
Tracing the Dynamics of Refusal: Exploiting Latent Refusal Trajectories for Robust Jailbreak Detection
May 2, 2026Xulin Hu, Che Wang, Wei Yang Bryan Lim +2Adversarial Attacks on LLMs LLM Refusal Behavior
1Peking University · 2Nanyang Technological University · 3Beijing Jiaotong University
Please refuse to answer me! Mitigating Over-Refusal in Large Language Models via Adaptive Contrastive Decoding
Apr 18, 2026Yupeng Qi, Ziyu Lyu, Lixin Cui +2Language Model Safety Evaluation LLM Refusal Behavior
School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University · School of Information, Central University of Finance and Economics · School of Artificial Intelligence, Beijing Normal University +1
Don't Start What You Can't Finish: A Counterfactual Audit of Support-State Triage in LLM Agents
Apr 17, 2026Eren UnluLLM Agent Evaluation LLM Refusal Behavior
Globeholder Paris, France
Over-Refusal and Representation Subspaces: A Mechanistic Analysis of Task-Conditioned Refusal in Aligned LLMs
Mar 29, 2026Utsav Maskey, Mark Dras, Usman NaseemLLM Interpretability LLM Refusal Behavior
Macquarie University
How Utilitarian Are OpenAI's Models Really? Replicating and Reinterpreting Pfeffer, Krügel, and Uhl (2025)
Mar 24, 2026Johannes HimmelreichPrompt Sensitivity Moral Reasoning in Language Models
From Refusal Tokens to Refusal Control: Discovering and Steering Category-Specific Refusal Directions
Mar 9, 2026Rishab Alagharu, Ishneet Sukhvinder Singh, Shaibi Shamsudeen +2Language Model Steering LLM Refusal Behavior
Algoverse AI Research · Carnegie Mellon University · University of Maryland
$C$ - $ΔΘ$ : Circuit-Restricted Weight Arithmetic for Selective Refusal
Feb 4, 2026Aditya Kasliwal, Pratinav Seth, Vinay Kumar SankarapuLLM Refusal Behavior Causal Interventions in Language Models
Lexsi Labs
There Is More to Refusal in Large Language Models than a Single Direction
Feb 2, 2026Faaiz Joad, Majd Hawasly, Sabri Boughorbel +2LLM Interpretability LLM Refusal Behavior
Qatar Computing Research Institute, HBKU, Doha, Qatar
Health-ORSC-Bench: A Benchmark for Measuring Over-Refusal and Safety Completion in Health Context
Jan 25, 2026Zhihao Zhang, Liting Huang, Guanghao Wu +3LLM Safety Benchmarks Language Model Safety Evaluation
Macquarie University1 · UTS2 · MBZUAI3 +1
LLMs Encode Harmfulness and Refusal Separately
Jul 16, 2025Jiachen Zhao, Jing Huang, Zhengxuan Wu +2LLM Interpretability LLM Refusal Behavior
Northeastern University · Stanford University
Refusal Beyond a Single Direction: A Preliminary Comparison of Diff-in-Means and INLP
Date pendingElisabetta Rocchetti, Alfio FerraraLLM Refusal Behavior Causal Interventions in Language Models
Department of Computer Science, Università degli Studi di Milano, Milan, Italy · Department of Literary Studies, Philology and Linguistics, Università degli Studi di Milano, Milan, Italy

May 28, 2026, cs.AIJ/K move · Enter open · S save

Beyond Attack Success Rate: Temporal Logit Observability for LLM Safety Failures

Junyoung Park, Sunghwan Park, Seongyong Ju, Jaewoo Lee

Chung-Ang University

LLM Refusal Behavior LLM Jailbreak Attacks LLM Safety Evaluation Jailbreak Detection Refusal Behavior in Language Models Language Model Auditing

Open paper AskPDF arXiv

Attack Success Rate (ASR) evaluates each jailbreak with a single yes/no label at the end of generation, telling us whether a failure happened but not how it unfolded. Two attacks that produce equally harmful outputs may have followed completely different paths, and ASR cannot tell them apart. We make those hidden paths observable from logits alone. Temporal Logit Observability (TLO) is a training-free diagnostic that watches a compliance-refusal margin during decoding and places each model-attack condition on a calibrated 2D plane. By design, this plane is most informative exactly where ASR is least informative: among attacks that succeed for genuinely different reasons. Across four aligned LLMs and three jailbreak paradigms, attacks with nearly identical ASR land at clearly different points on the plane: the same model can fail through different temporal patterns. The geometry matches refusal-direction probes from hidden states on most conditions, with one model showing the limit of our fixed-lexicon approach. A simple early-stop rule derived from TLO cuts successful jailbreaks by more than half, without false alarms on plain benign queries. Safety evaluation should report when and how a failure unfolds, not only whether it occurred. TLO makes the first two observable from logits alone.

Momentum

Related topics

Latest papers 54