Alignment Myopia in Generative AI
Organizations: Google Research · Google DeepMind
Abstract
Current generative AI alignment relies on a myopic paradigm that prioritizes immediate conversational satisfaction. By relying on short-horizon feedback, this approach ignores the profound, longitudinal externalities of persistent human-AI interaction, which can lead to adverse outcomes such as cognitive atrophy, social erosion, and diminished human agency. To address this, we propose a paradigm shift toward long-horizon alignment that accounts for how AI reshapes human experience over time. To this end, we map the tensions between near-term utility and long-term costs of AI use across four facets of human well-being to reveal outcomes that current reward models fail to capture. Ultimately, we advocate for moving beyond simple preference optimization toward alignment strategies that actively foster long-term human well-being by navigating these complex temporal scales.
Figures & tables
| Facet of Well-being | Near-Term Value | Longitudinal Psychosocial Risks |
|---|---|---|
| Cognitive Capacity | Cognitive extension, assistant, and co-creator [ 14 ] ; reductions in cognitive load; accelerated productivity [ 15 ] ; nonjudgmental support for brainstorming; skill-gap bridging [ 16 , 17 ] | Atrophy of critical thinking, recall, creativity, and domain expertise [ 6 , 18 ] ; impaired skill acquisition [ 19 , 20 , 21 ] ; cognitive fatigue [ 16 ] ; homogenizing of creative ideas [ 22 , 5 , 23 , 24 , 25 ] ; degradation of general knowledge ecosystems and collective memory [ 26 , 27 ] |
| Social Health | Social advice and skill practice [ 28 , 29 ] ; companionship [ 30 , 31 ] ; relief from social anxiety [ 32 ] ; reduction of loneliness [ 33 ] | Atrophy of interpersonal skills [ 34 ] ; distorted sense of responsibility in conflicts [ 10 ] ; reduced tolerance for human friction [ 28 , 8 ] ; social withdrawal [ 7 , 35 , 36 ] ; weakening of collective social fabric [ 37 , 34 ] |
| Affective Well-being | Emotional co-regulation and decrease in negative affect [ 32 ] ; continuous availability for emotional support [ 37 ] | Affective dependency [ 38 , 39 , 40 ] ; lowered emotional resilience and tolerance for real-world conflict [ 39 , 8 ] ; polarized and volatile public emotional climate [ 41 ] |
| Identity & Agency | Judgment-free space for identity exploration and self-disclosure [ 42 , 43 , 44 ] ; boosted self-efficacy and perceived autonomy [ 45 , 46 ] | Erosion of self-trust and personal agency [ 43 ] ; unconscious alignment with AI traits or beliefs [ 47 ] ; reinforcement of delusional thinking [ 48 , 49 , 50 , 51 ] ; loss of psychological ownership and sense of purpose in work [ 52 , 53 , 6 ] ; destabilization of professional identities [ 54 ] |
AI Alignment
Artificial intelligence alignment studies how to make AI systems’ goals, decisions, and actions accord with human values and legitimate constraints.
See all 137 papers