Terms of Care: Designing for Participation in Data Governance by Disability Communities
Organizations: Columbia University, United States · Georgia Institute of Technology, United States · Microsoft Research, United Kingdom · Microsoft Research, United States
Abstract
Improving disability representation in AI-generated media requires community-specific datasets, yet openly sharing such data can expose communities to misuse, decontextualization, and exploitation. We examine how disability communities can participate in dataset governance through context-sensitive licensing. Working with three disability advocacy organizations, we conducted semi-structured interviews, an educational webinar and modular license activity to promote community participation in data stewardship. Our findings show that governance in these high-context communities relies on organizational memory (especially situated harms); both formal authority and informal relational practices; communication; and resulting trust. The modular license activity made organizational data choices more accessible and values-led, allowing communities to adapt Creative Commons clauses to express permitted uses, sector-specific restrictions, safeguarding requirements, and commitments to respectful representation. Yet, concerns remain about monitoring and enforcing appropriate data use. We contribute (1) an empirical account of governance tensions, (2) a practical modular approach, and (3) design implications for AI data platforms that support relational, context-sensitive governance beyond standardized, one-size-fits-all frameworks.
Figures & tables
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Governance Theme | Sample Interview Question | Participant Responses |
|---|---|---|
| Organizational Values and Governance | • When you think about how your organization represents your community to the broader public, what principles do you strive to center? | P1:“ Positive representation… dwarfism isn’t something to fear, [it’s] a human experience .” |
| • How are decisions about data sharing and technology typically made in your organization? | P3:“ A department which governs data… they make the overall decisions of what is shared .” | |
| Data Practices and Consent | • How does your organization approach consent when it comes to collecting or sharing member data? | P2: “ I will probably share on the WhatsApp group… when people respond with ’consent’, it is typically in the group so others can see .” |
| • What expectations do you think your community members have around being asked before their information is used in new ways? | P3:“ [Whether] their information is being used to benefit them in a direct way…[and] the end result of the project is shared back with them .” | |
| Conflicts, Tensions, and Organizational Learning | • Has the organization faced situations where information sharing has caused tensions or concerns? | P3:“ There was a concern: how do you handle data leaks, especially if it’s a third party handling our data? ” |
| • Were there ever moments when you felt your organization’s values were in tension with a funder, partner, or external party? | P1:“ We had to cut ties with specific vendors based on their stance on [political movements] .” |
| Category | Example Scenarios |
|---|---|
| Purpose-driven uses | • Improving disability representation in media. |
| • Making public spaces more accessible. | |
| • Developing products and services for people with disabilities. | |
| Context-specific uses | • A university research team analyzes dataset diversity. |
| • A disability studies professor uses images in a digital ethics class. | |
| • A non-profit runs a public campaign on access to public spaces. |
| No. | Survey item and response options |
|---|---|
| 1 | The license workshop helped me better understand how to manage data sharing and consent in my organization. |
| Strongly disagree Disagree Unsure Agree Strongly agree | |
| 2 | What part of the worksheet sparked the most discussion or felt most difficult to answer? |
| [Open text response] | |
| 3 | Did any past concerns (e.g., about misuse, power dynamics, or partner pressure) arise again during the licensing process? |
| [Open text response] |
AI Governance
Artificial intelligence governance studies how laws, institutions, and technical controls shape AI development, deployment, accountability, and social effects.
See all 414 papers