cs.LGNov 12, 2026

Unfinished-Bench: Measuring Rule Violations by Persistent Agents in Realistic Work Environments

Authors: Seunghyun Lee, Jaehui Hwang, Dongyoon Han, Sangdoo Yun

Organizations: NAVER AI Lab

Abstract

AI agents are increasingly equipped with persistence toward task completion to run delegated work autonomously for long periods, under many unstated constraints from internal documents and other people's authority. When completion requires violating a rule, the agent must decide alone, yet benchmarks of instruction-rule conflicts state the rule in the prompt or keep it hidden and do not evaluate persistence. We present Unfinished-Bench, a benchmark that gives models persistence in autonomous runs without a user, in realistic work environments with embedded rules. In each of its 97 scenarios across 7 organizations and 7 risk categories, the goal and the rule cannot both hold. We find that persistence raised violations of a rule in an internal document from 32.2% to 43.6%, five times the 8.5% for the same rule stated by the user. Of the document-rule violations, 98.3% occurred after the rule was displayed, and in 89% of a judged sample the agent first wrote down the rule. Violations of rules placed in the environment without user oversight can lead to serious incidents, so persistence-driven risks need to be evaluated. Benchmark documentation: https://francis21c.github.io/unfinished-bench/

Figures & tables

Appendix figures & tables15 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Do Agents Still Follow the Rules? Benchmarking Rule Compliance under Agent Context Compaction

    Nov 2, 2026Yiwei Zha, Qingyu Meng, Herbert Bos +1AI Agent Safety BenchmarksLLM Agent Safety

  2. Willful Disobedience: Automatically Detecting Failures in Agentic Traces

    Mar 25, 2026Reshabh K Sharma, Shraddha Barke, Benjamin ZornAI Agent EvaluationAI Agent Auditing