cs.MAApr 13, 2026

SLALOM: Simulation Lifecycle Analysis via Longitudinal Observation Metrics for Social Simulation

Authors: Juhoon Lee, Joseph Seering

Organizations: School of Computing, KAIST, Daejeon, Republic of Korea

Abstract

Large Language Model (LLM) agents offer a potentially-transformative path forward for generative social science but face a critical crisis of validity. Current simulation evaluation methodologies suffer from the "stopped clock" problem: they confirm that a simulation reached the correct final outcome while ignoring whether the trajectory leading to it was sociologically plausible. Because the internal reasoning of LLMs is opaque, verifying the "black box" of social mechanisms remains a persistent challenge. In this paper, we introduce SLALOM (Simulation Lifecycle Analysis via Longitudinal Observation Metrics), a framework that shifts validation from outcome verification to process fidelity. Drawing on Pattern-Oriented Modeling (POM), SLALOM treats social phenomena as multivariate time series that must traverse specific SLALOM gates, or intermediate waypoint constraints representing distinct phases. By utilizing Dynamic Time Warping (DTW) to align simulated trajectories with empirical ground truth, SLALOM offers a quantitative metric to assess structural realism, helping to differentiate plausible social dynamics from stochastic noise and contributing to more robust policy simulation standards.

Figures & tables

Explore similar work

CardsList
  1. Stop Drawing Scientific Claims from LLM Social Simulations Without Robustness Audits

    May 17, 2026Jinyi Ye, Lei Cao, Ding Chen +1Human Behavior SimulationAgent-Based Modeling

  2. From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulation

    Jul 25, 2025Patrick Taillandier, Jean Daniel Zucker, Arnaud Grignard +4Human Behavior SimulationComputational Social Science

  3. AI Agents Alone Are Not (Yet) Sufficient for Social Simulation

    Feb 19, 2026Yiming Li, Dacheng TaoLarge Language Model-Based Social SimulationHuman Behavior Simulation