cs.AINov 7, 2026

Agentic discrete-event simulation for manufacturing system design: an open 3D simulator, a benchmark and an industrial case

Authors: Javier Pernas-Álvarez, Diego Crespo-Pereira

Organizations: University of A Coruña, CITENI, Grupo Integrado de Ingeniería, Campus Industrial de Ferrol, Campus de Esteiro s/n, Ferrol, 15403, Spain

Abstract

The design of manufacturing systems relies on discrete-event simulation (DES) models that experts still build in tool-specific interfaces. AI agents can now write simulation code, but every model they write from scratch is new, unverified software. We present SimuLean, an open-source 3D DES simulator on the Unity engine designed to be programmed by AI agents: its modelling semantics are verified once, in the platform, and the agent builds and studies one model through domain-level commands, in the 3D scene or headless; physically simulated durations are calibrated for fast headless studies. We evaluated it on 18 manufacturing modelling tasks, from single machines to published production lines. A frontier agent built valid models in 93 of 108 attempts (86%), in about two minutes each; on the benchmark's interface version, two frontier agents built 105 of 108 models through domain commands alone, so that each comes with a record of how it was built. Every residual failure was silent - a model that builds and runs but answers wrongly - and only comparison with reference models revealed them all. In an industrial case, one agent working alone rebuilt, verified and studied a robotised welding workshop from a published study, in SimuLean and in SimPy. Comparing them with the published, expert-built model exposed an error in it; against the corrected model, the agent-built models agree within 1%. One agent can already build complete, realistic and traceable models for the design of manufacturing systems; independent reference models are what make them trustworthy.

Figures & tables

Explore similar work

CardsList
  1. SimuVerity: Benchmarking Agents for Engineering-Grade Simulink Model Generation

    Oct 1, 2026Ruiqi Zhang, Jiahao Wang, Mingxuan Li +9AI Agent BenchmarksLLM Agent Evaluation

  2. SIRIS: Can LLMs Tell When Simulation Errors Matter in AI-Driven Systems Research

    Nov 6, 2026Jinwoo Hwang, Sukmin Cho, Tao Zhang +3LLM Decision-MakingLLM Agent Evaluation