Transparency in AI-supported decision systems is widely required but poorly defined. Existing approaches treat transparency as a property of systems or components, producing characteristic failures: assessments that do not transfer across organizational boundaries, stakeholder questions that cannot be formulated within the available frame of analysis, and component-level findings that say nothing about system-level behavior. We propose treating transparency as a relation: a system is transparent to a stakeholder to the degree that their legitimate questions are answerable from its structure. We formalize this using information flow networks, in which transparency questions are expressed in terms of network structure and answerability is the condition that the system settles them. The framework supports three dimensions of analysis: structural answerability from the network alone, compositional answerability across organizational boundaries for deployed systems, and role-dependent answerability given a stakeholder's accessible sub-network. We demonstrate the framework on a real pre-integration assessment of an AI recruitment tool in a public sector municipality. The assessment uses participatory design and interviews to model the decision system structure. We show how structural and role-dependent transparency questions can be formally stated and analyzed across the Provider and Deployer boundary where the AI system is composed together with the deployer's decision process.
Figures & tables
#
Channel
Performed by
Operation
Stage
d1
D0ApplicationCV
Candidate
CV submission
Sourcing
d2
[RP],CVInitial scoringScoreR
Recruiter
4-grade candidate scoring
Assessment
d3
[RP],CVInitial scoringScoreHM
Hiring Manager
4-grade candidate scoring
Assessment
d4
[RP],D0×ScoreR,ScoreHMSelection meetingD1
Recruiter, Hiring Manager
Collaborative candidate selection
Selection
d5
CandidatePersonality testScorePT
External Provider
Personality testing
Interview
d6
[RP],Candidate,ScorePTInterviewScorecomp
Recruiter, Hiring Manager
Competence-based interview
Interview
Table 1. Deployer recruitment process: channels, operations, and stages.
ID
Example legitimate question
Class
Candidate Subject of assessment; seeks fair evaluation
C1
Was I hired, and at what step was I eliminated?
specific run
C2
What criteria was I assessed against?
process structure
C3
How did those criteria affect my outcome?
specific run
C4
What would have changed my result? (structure/logs)
counterfactual
C5
What happened in my assessment? (logs)
specific run
Table 2. Illustrative roles and legitimate questions in the Deployer recruitment process. Roles reflect theoretical information demands and accountability obligations rather than job titles. Questions are illustrative and grounded in the case-study context. Classes distinguish process structure , specific run , counterfactual , statistics over runs , and derived oversight questions. Parenthetical annotations indicate when a question is evaluated specifically against preserved logs.
Figure 1. An abbreviated information-flow model of the Deployer recruitment process prior to AI tool integration. For readability, the figure omits some secondary details represented in Table 1 .
Figure 2. An abbreviated version of the information flow model of the Provider’s AI system for recruitment. Inputs are a Client recruitment request, captured as a requirement configuration, and a set of candidates. The output is a list of ranked and scored candidates.
#
Channel
Performed by
Operation
Stage
p1
[Template],C0Hard req. filterC1
AI-Filter
Hard requirement filtering
Filtering
p2
[TQ],CandidateSimple questionsArule
Candidate
Rule-based questioning
Interview
p3
[TQ],CandidateFree text questionsAtext
Candidate
Open response collection
Interview
p4
[TQ],CandidateCompetence questionsAcomp
Candidate
Competence-based questioning
Interview
p5
[TQ],AruleAI rulesSrule
AI-Scoring
Rule-based scoring
Scoring
p6
[TQ],AtextAI Free textStext
AI-NLP
Semantic text analysis
Scoring
Table 3. Provider AI system: channels, operations, and stages.
Scenario
D0 removes
D1 adaptation
P replaces
Human evaluation
MinPD
d2, d3
C1 feeds d2, d3
d1
All candidates passing hard req.
AltPD
d2, d3, d4
Selection meeting receives
d1, d2, d3
All candidates,
C2×ScoredTemplate
AI-ranked input
instead of ScoreR,ScoreHM
MaxPD
d2, d3, d4
Threshold channel added,
d1, d2, d3
topx only
producing topx , rest ;
proceed to d5, d6
Table 4. Three integration scenarios as instantiations of CPD .
MaxPD
Role
Legitimate question
Pre
MinPD
AltPD
rest
top
Candidate
C1: Was I hired, and at what step was I eliminated?
A
A
A
A
C2: What criteria was I assessed against?
P
P
P
P
C3: How did those criteria affect my outcome?
(A)
(A)
(P)
(P † )
C4: What would have changed my result? (structure/logs)
(A/P ‡ )
(A/P ‡ )
(A/B)
(P † /B)
C5: What happened in my assessment? (logs)
(P ‡ )
(P ‡ )
(P)
(P † )
Table 5. Answerability of legitimate questions before AI integration and across the three integration scenarios. A = answerable, P = partially answerable, B = blocked; parentheses indicate deferral to another role, and X/Y structural/operational answerability. † marks limitations arising from the undisclosed human fallback path, including uncertainty about when it was used and the consequences of outsourced human processing. ‡ marks limitations arising from informal note taking of decisions and meetings. MaxPD is split by candidate cohort of top ranking and the rest where needed; – means missing presuppositions where the question is not applicable.