cs.SENov 18, 2026

DVBench: End-to-End Benchmark for Real-World UVM Design Verification Agents

Authors: Jiaru Qian, Jiawei Li, Xiaolong Hu, Zheng Shen, LiMing Zhao, Xin Zhang, Siyuan Jiang, Yongqiang Wei, 

Organizations: School of Computer Science, Peking University · SiliconMind · Key Laboratory of High Confidence Software Technologies, Peking University, Ministry of Education · aiXcoder · 

Abstract

Design verification (DV) remains a major bottleneck in hardware development, with large-scale verification using the Universal Verification Methodology (UVM) being highly labor-intensive. Recent advances in large language models (LLMs) and agentic systems offer new opportunities for DV automation. However, existing benchmarks primarily construct mutually decoupled subtasks, which deviates from the real-world workflow. In this paper, we present DVBench, the first end-to-end benchmark for Real-World UVM design verification agents. DVBench comprises 95 tasks across 9 functional domains and 5 difficulty levels, covering diverse verification scenarios and design scales. Each task requires agents to independently complete the full verification workflow. DVBench evaluates final testbenches via compilation, coverage, and bug detection, while assessing intermediate artifacts including feature lists, test plans, and reference models. We evaluate frontier LLMs (e.g. Claude Opus 5.5, GPT-6 Astra) and agent frameworks (e.g. Claude Code, Codex, OpenCode). Experimental results show that the best LLM-based agent (Codex & GPT-6 Astra) can only achieve an overall success rate of 21.05%, revealing substantial room for improvement in complex verification tasks.

Figures & tables

Appendix figures & tables21 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. HAVEN: Hybrid Automated Verification ENgine for UVM Testbench Synthesis with LLMs

    Apr 30, 2026Chang-Chih Meng, Yu-Ren Lu, Guan-Yu Lin +3Electronic Design AutomationLLM-Based Program Synthesis

  2. Exploring the Agentic Frontier of Verilog Code Generation

    Mar 19, 2026Patrick Yubeaton, Siddharth Garg, Chinmay HegdeCode GenerationAgentic Code Generation

  3. HWE-Bench: Benchmarking LLM Agents on Real-World Hardware Bug Repair Tasks

    Apr 16, 2026Fan Cui, Hongyuan Hou, Zizhang Luo +2Automated Program RepairElectronic Design Automation