cs.SENov 13, 2026

Evaluating Feedback-Driven Black-Box Processes via Stochastic Modeling and Simulation

Authors: Mengfan Xu, Zirui Liu, Juan Zhai, Shiqing Ma, Barry Nelson

Organizations: Northwestern University

Abstract

We study feedback-driven black-box processes across software engineering and machine learning. These processes are inherently sequential: policies generate inputs, observe outputs/feedback from systems, and use the feedback to guide the design of subsequent inputs. While many policies are developed under structural assumptions on the underlying systems, many real-world systems operate without such knowledge, necessitating black-box policies that lack a unified evaluation framework. We introduce a stochastic framework that models and evaluates such policies using Markov chains and simulation, thereby connecting empirical practice with theory. We instantiate the framework in mutation-based fuzzing (widely used for discovering software bugs via sequential input mutation), by a novel Markov chain model of fuzzing whose transitions are governed by the mutation strategy and whose feedback is given by program execution. We develop a rigorous evaluation paradigm with new performance measures, sound estimators, and evaluation procedures with provable guarantees. Guided by the theory, we evaluate 9 fuzzers on 18 widely used fuzzing benchmarks and conduct case studies in 4 non-fuzzing domains. These results show that the framework provides a principled basis for evaluation while connecting to practice, with implications beyond fuzzing.

Figures & tables

Appendix figures & tables21 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Greatness of Science Cannot Be Planned: Agentic Auto-Research is Fuzz Testing

    Aug 10, 2026Yifeng He, Jicheng Wang, Yinzhe Zhao +3AI Agents for Scientific DiscoveryAutonomous Experimentation

  2. Seq@K: Evaluating Language Models Under Sequential Feedback

    Oct 27, 2026Thomson Yen, Gilbert Yang, Naimeng Ye +8LLM Evaluation