Organizations: College of Computing and Information Science, Cornell University, Ithaca, New York, United States · Department of Computer Science, University of Toronto, Toronto, Ontario, Canada · Faculty of Information, University of Toronto, Toronto, Ontario, Canada
An AI inventory is a structured, often public record in which a government or organization lists and describes the AI systems it uses or plans to use. Studies of single AI inventory releases describe what systems do but say little about how they are governed over time. We linked entries across three releases of the US Federal AI Use Case Inventory (2023--2025), compared answers only where both releases required them, and analyzed governance accounts through a dual deductive-inductive approach, guided by the Algorithmic Decision-Making Adapted for the Public Sector (ADMAPS) framework. As the inventory grew from 710 to 3,611 entries from 2023 to 2025, fewer required answers were left blank, but accountability was rewritten through three mechanisms. Each release redrew the scope of the questions; agency-assigned classifications gated what was reported; and answers were also overwritten, with gains and losses concentrated in single agencies and little account of human oversight and judgment. These findings show that each release redraws the boundary of accountability and leaves the public to re-stitch the records, a condition we term palimpsestic accountability. We recommend versioned records, reasons for every reclassification, public files that distinguish kinds of missing answers, and oversight documented as conditions to improve public sector AI accountability.
Figures & tables
Figure 1. A palimpsest is a manuscript scraped and written over, with traces of earlier text still visible. One AI use case reported across three releases (2023–2025) of the US Federal AI Use Case Inventory, where each release writes over the last. Annotations show what changed in the entry from the previous release.
Years
Earlier title
Later title
(Overall, Title, Desc.) similarity
Human review
2024–25
Taxpayer 90 (Palantir prototype)
Taxpayer 90
(0.51, 0.62, 0.00)
Accept
2024–25
Climate Change Assessment Tool
DHS Asset Assessment Tool
(0.48, 0.51, 0.18)
Reject
2023–24
NIH Grants Virtual Assistant
NBS Virtual Assistant
(0.56, 0.64, 0.08)
Uncertain
Table 1. Examples of review decisions on proposed matches. Scores are similarity scores between 0 and 1.
Figure 2. Information about AI use cases’ development routes from the 2024 and 2025 inventories.
Figure 3. AI techniques and commercial AI tasks reported in the inventories.
Figure 5
Figure 5. Mechanisms through which the US Federal AI Use Case Inventory is constructed (left) and construed (right). The government redraws, gates, and overwrites the inventory, and the public has to re-stitch it.
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
2023 (10 fields)
2024 (62 fields)
2025 (36 fields)
Change
Identification and organization
1 Use_Case_ID
–
3 id
Not in the 2024 public file
5 Title
1 Use Case Name
4 use_case_name
Renamed
10 Department
2 Agency
2 agency_name
Renamed
2 Department_Code
3 Agency Abbreviation
1 agency
Renamed
3 Agency
4 Bureau
5 agency_bureau
Renamed
Appendix
Table 3. Fields in each public release of the US Federal AI Use Case Inventory.
Change
What happened
Example
Introduced
A later release asked a question with no earlier counterpart.
2025 asked whether operators of high-impact (HI) uses had been trained.
Removed
An earlier question had no later counterpart.
2024 asked whether a use could act without human involvement; 2025 did not.
Renamed
The same question appeared under a different field name.
2024 Bureau became 2025 agency_bureau .
Split
One question became two or more.
The 2023 summary became separate 2024 questions on purpose and benefits and on outputs; 2025 then split purpose and benefits into the problem addressed and the expected benefits.
Merged
Two or more questions or categories became one.
2024 distinguished rights- and safety-impacting categories; 2025 combined them into a single HI category.
Moved
A question left the use-case file for a separate one.
2024 asked whether each use was a common commercial AI product; 2025 reported such products in the separate COTS inventory.
Appendix
Table 4. How the inventory’s questions changed across releases, with an example of each.
Entry
Question
Why
Label
VA, GE Logiq E10 (VA-24-204), 2025
How the use was procured
Required of pilot and deployed uses; this use was deployed (it answered “Vendor Purchased”).
Required a
Same entry
Whether the use involves PII
Required of pilot and deployed uses; the entry left it blank.
Required a
Same entry
Whether an impact assessment was completed
Required only of deployed high-impact uses; this use was classified as not high-impact.
Not required b
Same entry
Link to public source code
The data dictionary required it of no entry.
Optional c
NASA, Enhanced AutoNav for Perseverance Rover on Mars, 2024
Whether the use involves PII
Required of uses in implementation or operation; the entry’s stage, “In production,” was not one of the inventory’s five stages.
Unspecified d
Commerce, GitHub Copilot for Code Modernization, 2024
Whether the use involves PII
Required of uses in operation unless built solely from a listed commercial product; the entry left the commercial-product question blank, so we could not tell whether it was exempt.
Unspecified d
Appendix
Table 5. Worked examples of how we decided whether an entry had to answer a question.
Deterministic
Candidate review
Panel
Title
Title + bureau
Title prefix
Reviewed
Accepted
Rejected
Uncertain
Total links
2023–2024
210
0
2
44
42
1
1
254
2024–2025
1,126
18
18
186
170
16
0
1,332
2023–2025
187
0
2
43
38
5
0
227
Appendix
Table 6. Deterministic matches by method, candidate-review decisions, and accepted links. We constructed the three panels separately. No deterministic match came from an identifier.
Value
Patterns
Answers (%)
Efficiency
efficien*, productiv*, cost(s), cost sav*, time sav*, time-consuming, workload, streamlin*, faster, quicker, accelerat*; save(s) or saving(s) + time, money, hours, staff, or cost(s); reduc* (the) + time, cost(s), manual, workload, effort, burden, labor, or hours; manual + effort, work, review, process*, labor, or task(s)
Society-Centered AI Lab, Department of Computer Science, School of Data and Information Sciences, University of North Carolina at Chapel Hill, USA · Society-Centered AI Lab, School of Data and Information Sciences, University of North Carolina at Chapel Hill, USA