Palimpsestic Accountability in the US Federal AI Inventories
Organizations: College of Computing and Information Science, Cornell University, Ithaca, New York, United States · Department of Computer Science, University of Toronto, Toronto, Ontario, Canada · Faculty of Information, University of Toronto, Toronto, Ontario, Canada
Abstract
An AI inventory is a structured, often public record in which a government or organization lists and describes the AI systems it uses or plans to use. Studies of single AI inventory releases describe what systems do but say little about how they are governed over time. We linked entries across three releases of the US Federal AI Use Case Inventory (2023--2025), compared answers only where both releases required them, and analyzed governance accounts through a dual deductive-inductive approach, guided by the Algorithmic Decision-Making Adapted for the Public Sector (ADMAPS) framework. As the inventory grew from 710 to 3,611 entries from 2023 to 2025, fewer required answers were left blank, but accountability was rewritten through three mechanisms. Each release redrew the scope of the questions; agency-assigned classifications gated what was reported; and answers were also overwritten, with gains and losses concentrated in single agencies and little account of human oversight and judgment. These findings show that each release redraws the boundary of accountability and leaves the public to re-stitch the records, a condition we term palimpsestic accountability. We recommend versioned records, reasons for every reclassification, public files that distinguish kinds of missing answers, and oversight documented as conditions to improve public sector AI accountability.
Figures & tables
| Years | Earlier title | Later title | (Overall, Title, Desc.) similarity | Human review |
|---|---|---|---|---|
| 2024–25 | Taxpayer 90 (Palantir prototype) | Taxpayer 90 | (0.51, 0.62, 0.00) | Accept |
| 2024–25 | Climate Change Assessment Tool | DHS Asset Assessment Tool | (0.48, 0.51, 0.18) | Reject |
| 2023–24 | NIH Grants Virtual Assistant | NBS Virtual Assistant | (0.56, 0.64, 0.08) | Uncertain |
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
| 2023 (10 fields) | 2024 (62 fields) | 2025 (36 fields) | Change |
|---|---|---|---|
| Identification and organization | |||
| 1 Use_Case_ID | – | 3 id | Not in the 2024 public file |
| 5 Title | 1 Use Case Name | 4 use_case_name | Renamed |
| 10 Department | 2 Agency | 2 agency_name | Renamed |
| 2 Department_Code | 3 Agency Abbreviation | 1 agency | Renamed |
| 3 Agency | 4 Bureau | 5 agency_bureau | Renamed |
| Change | What happened | Example |
|---|---|---|
| Introduced | A later release asked a question with no earlier counterpart. | 2025 asked whether operators of high-impact (HI) uses had been trained. |
| Removed | An earlier question had no later counterpart. | 2024 asked whether a use could act without human involvement; 2025 did not. |
| Renamed | The same question appeared under a different field name. | 2024 Bureau became 2025 agency_bureau . |
| Split | One question became two or more. | The 2023 summary became separate 2024 questions on purpose and benefits and on outputs; 2025 then split purpose and benefits into the problem addressed and the expected benefits. |
| Merged | Two or more questions or categories became one. | 2024 distinguished rights- and safety-impacting categories; 2025 combined them into a single HI category. |
| Moved | A question left the use-case file for a separate one. | 2024 asked whether each use was a common commercial AI product; 2025 reported such products in the separate COTS inventory. |
| Entry | Question | Why | Label |
|---|---|---|---|
| VA, GE Logiq E10 (VA-24-204), 2025 | How the use was procured | Required of pilot and deployed uses; this use was deployed (it answered “Vendor Purchased”). | Required a |
| Same entry | Whether the use involves PII | Required of pilot and deployed uses; the entry left it blank. | Required a |
| Same entry | Whether an impact assessment was completed | Required only of deployed high-impact uses; this use was classified as not high-impact. | Not required b |
| Same entry | Link to public source code | The data dictionary required it of no entry. | Optional c |
| NASA, Enhanced AutoNav for Perseverance Rover on Mars, 2024 | Whether the use involves PII | Required of uses in implementation or operation; the entry’s stage, “In production,” was not one of the inventory’s five stages. | Unspecified d |
| Commerce, GitHub Copilot for Code Modernization, 2024 | Whether the use involves PII | Required of uses in operation unless built solely from a listed commercial product; the entry left the commercial-product question blank, so we could not tell whether it was exempt. | Unspecified d |
| Deterministic | Candidate review | |||||||
|---|---|---|---|---|---|---|---|---|
| Panel | Title | Title + bureau | Title prefix | Reviewed | Accepted | Rejected | Uncertain | Total links |
| 2023–2024 | 210 | 0 | 2 | 44 | 42 | 1 | 1 | 254 |
| 2024–2025 | 1,126 | 18 | 18 | 186 | 170 | 16 | 0 | 1,332 |
| 2023–2025 | 187 | 0 | 2 | 43 | 38 | 5 | 0 | 227 |
| Value | Patterns | Answers (%) |
|---|---|---|
| Efficiency | efficien*, productiv*, cost(s), cost sav*, time sav*, time-consuming, workload, streamlin*, faster, quicker, accelerat*; save(s) or saving(s) + time, money, hours, staff, or cost(s); reduc* (the) + time, cost(s), manual, workload, effort, burden, labor, or hours; manual + effort, work, review, process*, labor, or task(s) | 1,260 (44.7) |
| Accuracy or consistency | accura*, consisten* (not “consistent with”), error(s) | 424 (15.0) |
| Access to services | access to, accessib*, customer service, customer experience, service to the public | 160 (5.7) |
| Safety or security | safety, safer, security | 173 (6.1) |
| Equity or fairness | equit* (not “equity price”), fair* | 13 (0.5) |
| 2025 stage | ||||||
|---|---|---|---|---|---|---|
| 2024 stage | Pre- deployment | Pilot | Deployed | Retired | Unknown/ other | Total |
| Pre-deployment | 269 | 51 | 75 | 128 | 20 | 543 |
| Pilot | 21 | 62 | 51 | 29 | 8 | 171 |
| Deployed | 16 | 5 | 450 | 80 | 33 | 584 |
| Retired | 0 | 1 | 2 | 21 | 2 | 26 |
| Unknown/other | 7 | 0 | 1 | 0 | 0 | 8 |
AI Accountability
AI accountability concerns how responsibility for AI decisions and harms is assigned, evidenced, challenged, and remedied.
See all 173 papers