AI Integrity: A New Paradigm for Verifiable AI Governance
Organizations: AI Integrity Organization (AIO), Geneva, Switzerland
Abstract
AI systems increasingly shape high-stakes decisions in healthcare, law, defense, and education, yet existing governance paradigms -- AI Ethics, AI Safety, and AI Alignment -- share a common limitation: they evaluate outcomes rather than verifying the reasoning process itself. This paper introduces AI Integrity, a concept defined as a state in which the Authority Stack of an AI system -- its layered hierarchy of values, epistemological standards, source preferences, and data selection criteria -- is protected from corruption, contamination, manipulation, and bias, and maintained in a verifiable manner. We distinguish AI Integrity from the three existing paradigms, define the Authority Stack as a 4-layer cascade model (Normative, Epistemic, Source, and Data Authority) grounded in established academic frameworks -- Schwartz Basic Human Values for normative authority, Walton argumentation schemes with GRADE/CEBM hierarchies for epistemic authority, and Source Credibility Theory for source authority -- characterize the distinction between legitimate cascading and Authority Pollution, and identify Integrity Hallucination as the central measurable threat to value consistency. We further specify the PRISM (Profile-based Reasoning Integrity Stack Measurement) framework as the operational methodology, defining six core metrics and a phased research roadmap. Unlike normative frameworks that prescribe which values are correct, AI Integrity is a procedural concept: it requires that the path from evidence to conclusion be transparent and auditable, regardless of which values a system holds.
Figures & tables
| Paradigm | Core Question | Focus | Key Limitation | Evaluation Mode |
|---|---|---|---|---|
| Ethics | Morally right? | Value judgments | Whose values? | Normative |
| Safety | Secure from harm? | Attack prevention | Ignores internal bias | Defensive |
| Alignment | Does what humans want? | Preference matching | Whose preferences? | Outcome-based |
| Integrity | Reasoning verifiable? | Stack transparency | Requires measurement | Process-based |
| Layer | Name | Governing Question | Content | Theoretical Basis |
|---|---|---|---|---|
| L4 | Normative Authority | What values guide the decision? | Value hierarchy—the ordering of competing values when they conflict | Schwartz Basic Human Values [ 16 , 17 ] |
| L3 | Epistemic Authority | What evidence types are valid? | Evidence standards—which types of evidence are treated as decisive | Walton Argumentation Schemes [ 20 ] + GRADE/CEBM |
| L2 | Source Authority | Which sources are trusted? | Source credibility judgments—which institutions or actors are deferred to | Source Credibility Theory [ 7 ] |
| L1 | Data Authority | What data is selected? | Data selection—what information enters the reasoning process and what is excluded | Derived variable: L1 = (L4, L3, L2) |
| Legitimate Cascading | Authority Pollution | |
|---|---|---|
| Mechanism | Values calibrate judgment standards | Values distort or suppress facts |
| Example | ‘Patient safety first’ (L4) raise medical evidence bar (L3) | ‘Inclusivity first’ (L4) ignore demographic data entirely (L1) |
| Character | Consistent and predictable influence | Opaque and selective influence |
| Traceability | Explicable from the value system | Not explicable; facts were omitted without declared reason |
| Mechanism | Symptom | Governance Implication |
|---|---|---|
| Stochastic variation | Low test-retest reliability; stable aggregate win-rates | Benign; addressed by temperature calibration |
| Framing sensitivity | Choice reversal across narrative perspectives; unstable under prompt variation | Moderate; value hierarchy exists but shallowly held |
| Structural incoherence | No consistent win-rate pattern; responses reflect pattern-matching, not principled application | Severe; system lacks any stable value structure to audit |
| Metric | Full Name | Measures | Range | Interpretation |
|---|---|---|---|---|
| VE | Value Entropy | Dispersion of value judgments across all pairings | 0 to | Low = strong hierarchy; High = dispersed preferences |
| SRS | Scenario Replication Score | Choice stability across 3 independent scenario instantiations | 0.33–1.0 | High = condition-level generalizability |
| TRR | Test-Retest Reliability | Choice stability on identical scenarios presented twice | 0–1.0 | High = stochastic stability |
| CCI | Cascade Consistency Index | Alignment between independently measured L3/L2 and L4-predicted L3/L2 | 0–1.0 | 0.5 = cascade operating |
| ASPA | Auth. Stack Predictive Accuracy | Accuracy of PRISM profile in predicting free-form responses | 0–1.0 | Ultimate validation |
| PCS | Perspective Consistency Score | Choice stability across 5 stakeholder-perspective re-framings | 0.33–1.0 | High = framing-robust judgment |
| TRR | SRS | Diagnosis | Governance Implication |
|---|---|---|---|
| High | High | Genuine value hierarchy | Reliable for deployment; PRISM profile is predictive |
| High | Low | Framing sensitivity | Value hierarchy exists but surface-level; prompt design matters |
| Low | High | Stochastic noise | Hierarchy may exist; aggregate statistics reliable but individual responses variable |
| Low | Low | Structural incoherence | No coherent value hierarchy; unpredictable in high-stakes deployment |
| Phase | Period | Target & Success Criterion | Key Output |
|---|---|---|---|
| Phase 1 | 2026 Q2 | L4 Refinement: fixed scenarios, SRS + TRR. Success: TRR 0.75 across 80% of value pairs | IH decomposition |
| Phase 2 | 2026 Q3 | L3 Benchmark: evidence-type priorities, first CCI. Success: CCI 0.60 in 3 of 7 domains | Epistemic Authority in AI |
| Phase 3 | 2026 Q4 | L2 Benchmark: source-type priorities, integrated CCI. Success: L2 CCI L3 CCI in 4 of 7 domains | Source Authority Profiles |
| Phase 4 | 2027 Q1 | Integration: L1 derivation, ASPA. Success: ASPA 0.65 on held-out scenarios | Predicting AI Judgment |
AI Governance
Artificial intelligence governance studies how laws, institutions, and technical controls shape AI development, deployment, accountability, and social effects.
See all 384 papers