ICLayout-Bench: Benchmarking LLM Agents for Custom Circuit Layout Design
Organizations: University of Science and Technology of China · State Key Lab of Processors, Institute of Computing Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Institute of AI for Industries, Chinese Academy of Sciences
Abstract
Large language model (LLM) agents are being explored for circuit design, but their ability to produce high-quality custom layouts has not been extensively evaluated. ICLayout-Bench is a benchmark in which agents use electronic design automation (EDA) tools to construct and optimize GDSII layouts from transistor-level circuit netlists. These layouts are evaluated using physical verification, parasitic extraction, and post-layout simulation. Layouts that pass the physical and functional checks are scored on electrical performance and area. The benchmark includes 165 tasks across 13 process design kits (PDKs), covering technology nodes from 3 nm to 180 nm. The tasks span analog, mixed-signal, and digital circuits in open-source and commercial EDA flows. The experiments evaluate 22 configurations spanning seven models on 21 public and 19 private tasks. Mean layout scores range from 4.22 to 80.26 on public tasks and from 1.43 to 67.01 on private tasks, on a 100-point scale. Higher reasoning effort does not consistently improve mean scores, and configurations with comparable scores can incur substantially different model costs.
Figures & tables
| Benchmark | Task | Output | Evaluation |
|---|---|---|---|
| Analog Design Bench [ 7 ] | Circuit design | SPICE netlist | Electrical specification compliance |
| SGAnalog [ 8 ] | Transcription / sizing | SPICE netlist | Circuit structure and performance |
| ChipLayoutBench [ 9 ] | Layout understanding | Answers | Geometric and spatial reasoning |
| ICLayout-Bench | Layout construction | GDSII layout | Layout validity, performance, and area |
Electronic Design Automation
Electronic Design Automation uses algorithms and software to design, verify, optimize, and manufacture electronic circuits and systems.
See all 244 papers