cs.AIJun 23, 2026

Bayesian control for coding agents

Authors: Theodore PapamarkouVladislav SmirnovViktor MazanovArtem VazhentsevPreslav NakovTimothy BaldwinArtem Shelmanov

Organizations: 1PolyShape · 3MBZUAI

Abstract

Modern coding agents pair LLM generators with various tools, including cheap diagnostics and expensive verifiers. The tool-use decisions are typically governed by orchestrators that often use fixed rules and ignore uncertainty. We formulate orchestration as cost-sensitive sequential hypothesis testing: a Bayesian controller maintains a belief over candidate correctness and dynamically decides whether to gather more evidence, refine the candidate, verify it, or stop. Across six generators and nine coding benchmarks, Bayesian control proves to be most valuable when verification is costly and critics are informative but imperfect. Beyond control, the belief state yields an interpretable correctness score that outperforms token-probability and raw tool-success baselines for uncertainty quantification.

Explore similar work

CardsList
  1. Position: agentic AI orchestration should be Bayes-consistent

    May 1, 2026Theodore Papamarkou, Pierre Alquier, Matthias Bauer +27DecisionsLLM Inference Efficiency

  2. The Verification Horizon: No Silver Bullet for Coding Agent Rewards

    Jun 24, 2026Binghai Wang, Chenlong Zhang, Dayiheng Liu +10VerifierCoding Agents