cs.LGMar 18, 2026

Conflict-Free Policy Languages for Probabilistic ML Predicates: A Framework and Case Study with the Semantic Router DSL

Authors: Xunzhuo Liu, Hao Wu, Huamin Chen, Bowei He, Xue Liu

Organizations: vLLM Semantic Router Project · MBZUAI / McGill University

Abstract

Conflict detection in policy languages is a solved problem -- as long as every rule condition is a crisp Boolean predicate. BDDs, SMT solvers, and NetKAT all exploit that assumption. But a growing class of routing and access-control systems base their decisions on probabilistic ML signals: embedding similarities, domain classifiers, complexity estimators. Two such signals, declared over categories the author intended to be disjoint, can both clear their thresholds on the same query and silently route it to the wrong model. Nothing in the compiler warns about this. We characterize the problem as a three-level decidability hierarchy -- crisp conflicts are decidable via SAT, embedding conflicts reduce to spherical cap intersection, and classifier conflicts are undecidable without distributional knowledge -- and show that for the embedding case, which dominates in practice, replacing independent thresholding with a temperature-scaled softmax partitions the embedding space into Voronoi regions where co-firing is impossible. No model retraining is needed. We implement the detection and prevention mechanisms in the Semantic Router DSL, a production routing language for LLM inference, and discuss how the same ideas apply to semantic RBAC and API gateway policy.

Figures & tables

Explore similar work

CardsList
  1. From Inference Routing to Agent Orchestration: Declarative Policy Compilation with Cross-Layer Verification

    Mar 28, 2026Huamin Chen, Xunzhuo Liu, Bowei He +1LLM RoutingLLM Agent Orchestration

  2. Axis-Aligned Semantics for ODRL: Resolving Dimensional Ambiguity in Policy Constraints

    Feb 23, 2026Daham Mustafa, Diego Collarana, Sabrina Kirrane +5Policy EvaluationAccess Control