AI Alignment

Ask about this topic

Momentum

4 papers in the last four weeks, down 43% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 83

All topics
CardsList

  1. AI Safety Considerations for Agents With Limited Time to Act

    Oct 7, 2026Leo Zeitler, Jack Richings, Victoria NocklesAI Agent SafetyAI Safety

    The Alan Turing Institute 96 Euston Road London, NW1 2DB, United Kingdom

  2. How Could AI Eliminate Humanity? A Failure-Mode Analysis of Civilizational Risk

    Oct 6, 2026Mikołaj Sienicki, Krzysztof SienickiAI SafetyAI Risk Management

    Polish-Japanese Academy of Information Technology, Warsaw, Poland, European Union · NIS, 05-807 Podkowa Leśna, Poland, European Union

  3. SPEAR: Five Principles for Interactive Human-Agent Alignment

    Oct 5, 2026Tao Long, Lydia B. ChiltonAI AlignmentHuman-AI Interaction

    Columbia University New York City, New York, USA

  4. Structural Alignment for Reliable Industrial AI: Bridging Physical Reality, Data, Models, and Human Intent

    Sep 28, 2026Lizhi Xiao, Sihong Wu, Victoria Xiao +5AI AlignmentAI Governance

  5. Math for AI safety: an invitation for mathematicians

    Sep 14, 2026Lionel LevineAI AlignmentAI Safety

  6. Autonomy, Social Norms, and Alignment: Towards a Developmental Framework for Autonomous Artificial Agents

    Sep 12, 2026Marica Notte, Ludovica Marinucci, Vieri Giuliano SantucciAI AlignmentAI Agent Governance

    Institute of Cognitive Sciences and Technologies (ISTC-CNR) · Interdepartmental Center for Research Ethics and Integrity (CID Ethics)

  7. Artificial Id: Drive and Persistent Alignment in Agentic AI

    Sep 12, 2026Yakov Pyotr ShkolnikovAI AlignmentIntrinsic Motivation

    Independent Researcher

  8. Mechanism Design for Alignment and Control

    Sep 1, 2026Dirk Bergemann, Andrew Koh, Stephen MorrisMechanism DesignAI Alignment

    Yale · Columbia · MIT +1

  9. The Constitutional Coverage Trilemma in AI Governance

    Sep 1, 2026Natalija Mitic, Soona Sedahmed A. O., Mamadou Selly Ly +1AI AlignmentAI Governance

    Kera Health Platforms

  10. Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment

    Aug 31, 2026Deepak Pandita, Christopher M. HomanAI AlignmentAutomated Evaluation

    Rochester Institute of Technology

  11. Automated Researchers Can Mitigate Well-characterized Alignment Failures

    Aug 28, 2026Chen Yueh-Han, Jiaxin Wen, Jan Hendrik KirchnerAI AlignmentLLM Safety Alignment

    1Anthropic Fellows Program · 2Anthropic · 3UC Berkeley

  12. AI Alignment through a Game-theoretic Lens: A Survey

    Aug 28, 2026Yanan Cai, Zhongrui Zhao, Zhigang Lu +6LLM AlignmentAI Alignment

    James Cook University · Western Sydney University · Adelaide University +5

  13. Rules or Character? Scaling Laws for AI Safety Design

    Aug 13, 2026Satoshi Takahashi, Nobuji Kouno, Masaaki Komatsu +1AI AlignmentAI Safety

    AI Medical Engineering Team, RIKEN Center for Advanced Intelligence Project, Tokyo, Japan · Division of Medical AI Research and Development, National Cancer Center Research Institute, Tokyo, Japan

  14. Toward a Theory of Value in AI Alignment

    Aug 10, 2026Andrew Smart, Shazeda Ahmed, Jackie Kay +3LLM AlignmentAI Alignment

    1Google Research · 2UCLA · 3Google Deep Mind +2

  15. A Fair Objective for Human-Empowerment-Preserving AI: Desiderata, Design, and Likely Behavioral Consequences

    Aug 8, 2026Jobst Heitzig, Ram PothamAI AlignmentAlgorithmic Fairness

    Potsdam Institute for Climate Impact Research, Potsdam, Germany · Independent

  16. Metanormative Theory for RL-Based Moral Agents

    Aug 8, 2026Aleks Knoks, Marija SlavkovikAI AlignmentMoral Reasoning

    University of Luxembourg, 2, place de l’Université, L-4365, Esch-sur-Alzette, Luxembourg · University of Bergen, Fosswinckelsgt. 6, 5007 Bergen, Norway

  17. AI Alignment and Fiduciary Obligation

    Aug 1, 2026Benjamin LangeAI AlignmentHuman-AI Interaction

    Ludwig-Maximilians-Universität München & Munich Center for Machine Learning

  18. Persistent Convolution: A Topological Framework for AI Alignment Testing and Semantic Space Characterization

    Jul 31, 2026Tyler Ashoff, Jordan RoduAI AlignmentCross-Modal Alignment

    Department of Statistics, University of Virginia. · Department of Statistics, University of Virginia

  19. Fragility of Value under Imperfect Alignment

    Jul 30, 2026Winter CrossAI AlignmentAI Safety

    Dovetail Research

  20. Interactive Alignment

    Jul 27, 2026Sylvain ChassangAI AlignmentAI Agent Governance

    Princeton University

  21. Epistemic Norms for AI Safety and Alignment Research

    Jul 27, 2026Keivan NavaieAI AccountabilityAI Alignment

    Lancaster University, UK

  22. Why Large Language Models and Humans Converge and Diverge in Evaluating Creativity

    Jul 24, 2026Pengzhao Lyu, Yeun Joon Kim, Hanlin Xiao +1Creativity AssessmentLLM Evaluation

    Judge Business School, University of Cambridge, Cambridge, CB2 1AG, United Kingdom · Institute of Metabolic Science, School of Clinical Medicine, University of Cambridge, CB2 0QQ, United Kingdom · Department of Computer Science, University of Manchester, M13 9PL, United Kingdom +2

  23. Position: We Need Practical AI Alignment Methods to Mirror Human Reasoning

    Jul 20, 2026Vijay Keswani, Breanna K. Nguyen, Cyrus Cousins +3Explainable Artificial IntelligenceAI Alignment

    Department of Computer Science and Engineering, IIT Delhi · Department of Philosophy, Duke University · Department of Computer Science, Carnegie Mellon University +1

  24. Alignment of a Total Automation Economy

    Jul 19, 2026David McAllesterAI AlignmentLinear Programming

  25. Moral Attitudes of Sentient ASI towards Humanity and Implications for AGI Development

    Jul 16, 2026Jean-Paul Van BelleAI AlignmentMoral Reasoning

    University of Cape Town, Rondebosch, South Africa

  26. Align AI to Dynamic Human-AI Workflows

    Jul 15, 2026Valerie Chen, Cleotilde Gonzalez, Anita Williams Woolley +4AI AlignmentHuman-AI Interaction

    1Carnegie Mellon University · University of California, Irvine

  27. EvalSafetyGap: A Hybrid Survey and Conceptual Framework for LLM Evaluation-Safety Failures

    Jun 29, 2026Buğra Alperen Uluırmak, Rifat KurbanAI AlignmentLLM Safety Alignment

    Erciyes University, Türkiye. · Abdullah Gül University, Türkiye.

  28. Safety from Honesty in a Disinterested AI Predictor

    Jun 28, 2026Yoshua Bengio, Oliver Richardson, Tomáš Gavenčiak +13AI AlignmentAI Safety

    LawZero · Universit´e de Montr´eal · Mila +6

  29. Agent Safety Is Action Alignment

    Jun 27, 2026Shawn Li, Yue ZhaoLanguage Model Safety EvaluationAI Alignment

    University of Southern California · Los Angeles, California, USA

  30. LLawCo: Learning Laws of Cooperation for Modeling Embodied Multi-Agent Behavior

    Jun 26, 2026Qinhong Zhou, Chuang Gan, Anoop CherianMulti-Agent CoordinationAI Alignment

    University of Massachusetts Amherst, USA. · 2Mitsubishi Electric Research Laboratories (MERL), USA.

  31. The Unfireable Safety Kernel: Execution-Time AI Alignment for AI Agents and Other Escapable AI Systems

    Jun 24, 2026Seth Dobrin, Łukasz ChmielAI AlignmentAI Agent Security

    ARYA Labs PBC

  32. Aligning MusicLLM with Emotion using Instruction Tuning and Feedback-Driven Alignment

    Jun 23, 2026Takuya Hasumi, Welly NaptaliLLM AlignmentAI Alignment

    LY Corporation

  33. Quantifying Theoretical AI Alignment Guarantees: Receiver-Utility Bounds in Bayesian Persuasion

    Jun 20, 2026Eric Yachbes, Eva TardosAI AlignmentInformation Design

    Cornell University, United States

  34. AI Alignment From Social Choice Perspectives

    Jun 19, 2026Daniel Halpern, Evi Micha, Ariel D. Procaccia +3LLM AlignmentAI Alignment

    Google Research · University of Southern California · Harvard University

  35. Architectural Wisdom: A Framework for Governing Optimization in AI Systems

    Jun 15, 2026Edward Y. ChangAgent ReliabilityAI Alignment

    Stanford University

  36. Position: Align AI to Our Aspirations, Not Our Flaws

    Jun 11, 2026Nikita Kazeev, Bui Nhat Huyen PhanAI AlignmentPluralistic Alignment

    1National University of Singapore · 2Shopee Singapore.

  37. Existential Indifference: Self-Nonpreservation as a Necessary Architectural Condition for Aligned Superintelligence (or: The Suicidal AI)

    Jun 10, 2026Sam MaoAgent ReliabilityAI Alignment

    New York University | Interactive Media Arts

  38. Exploring the Design Space of Reward Backpropagation for Flow Matching

    Jun 9, 2026Ruoyu Wang, Boye Niu, Xiangxin Zhou +3Flow MatchingAI Alignment

    1Westlake University · 2Tencent Hunyuan · University of Sydney +1

  39. Position: AI Must Become Planet-Centered, Not Just Human-Centered

    Jun 9, 2026Maria Perez-OrtizAI AlignmentHuman-Centered AI

    Centre for AI, Department of Computer Science, University College London, London, UK.

  40. The Arbiter Agent: Continually Monitoring Multi-Agent Conversations to Detect Emergent Misalignment

    Jun 9, 2026Filippo Tonini, Federico Torrielli, Anton Danholt Lautrup +3AI Agent AuditingLLM Auditing

    University of Southern Denmark Odense, Denmark · University of Turin Turin, Italy · University of Southern Denmark Vejle, Denmark

  41. Emergent alignment and the projectability of ethical personas

    Jun 8, 2026Guillermo Del Pinal, Youngchan Lee, Calum McNamara +1Moral Reasoning in Language ModelsLanguage Model Safety Evaluation

    University of Massachusetts Amherst · Indiana University Bloomington

  42. Agent Economics: An Entropy-Controlled Pluralistic Alignment Framework for Preventing Artificial Hivemind in Autonomous Agents

    Jun 8, 2026Cheonsu JeongAI AlignmentMulti-Agent Systems

    AX Center, SAMSUNG SDS, Seoul, South Korea

  43. Toward Human-Centered Multi-Agent Systems: Integrating Cognition, Culture, Values, and Cooperation in AI Agents

    Jun 6, 2026Safia Baloch, Rahemeen KhanMulti-Agent CoordinationAI Alignment

    GIKI

  44. Staying with the Uncertainty: Uncertainty-Scaffolding Strategies for Artificial Moral Advisors in LLM-to-LLM Simulated Conversations

    Jun 4, 2026Salvatore Greco, Hainiu Xu, Jacopo Domenicucci +2Moral Reasoning in Language ModelsAI Alignment

    Centre for Data Futures, The Dickson Poon School of Law, King’s College London · Department of Informatics, King’s College London · LangAI, Center for Language AI Research, Tohoku University +1

  45. LEVANTE-bench: Multi-Scale Comparison of VLMs to Children Using Cognitive Tasks (or, "Is Your VLM Smarter Than a 5th Grader?")

    Jun 3, 2026Alvin Wei Ming Tan, David Cardinal, Tania Lorido-Botran +3VLM EvaluationAI Alignment

    Stanford University

  46. Agentic Safety is an Epistemic Property, Not a Behavioral One

    Jun 2, 2026Charles L. Wang, Keir Dorchen, Peter JinAI AlignmentAI Agent Safety

    1Columbia University, New York, NY, USA · 2Pelagic Platforms

  47. Structuring the Space of Sociotechnical Alignment

    Jun 2, 2026Esra Dönmez, Agnieszka FalenskaAI AlignmentHuman-Centered AI

    Institute for Natural Language Processing, University of Stuttgart · Interchange Forum for Reflecting on Intelligent Systems, University of Stuttgart

  48. Solipsistic Superintelligence is Unlikely to be Cooperative

    Jun 2, 2026Rakshit S Trivedi, Natasha Jaques, Logan Cross +2AI AlignmentMulti-Agent Collaboration

    Independent Researcher, CA, USA · University of Washington, Seattle, WA, USA · Google Deepmind, London, UK.

  49. Glass Box at Orbit: A Constitutional AI Verification Framework for Trustworthy Autonomous CubeSat Intelligence

    Jun 2, 2026Karthik Barma, Anil Sanneboyina, V C Premchand YadavAI AlignmentAI Agent Safety

    Khoury College of Computer Sciences · Northeastern University · Boston, MA 02115, USA +3

  50. Civilizational Metamaterials: Engineering Coordination Under Capability Gradients and Structural Turbulence

    May 29, 2026David OrbanMulti-Agent CoordinationMechanism Design

    Independent Researcher

  51. Rationalize: Shared Semantic Reasoning for Human-AI Alignment

    May 28, 2026Aritra Dasgupta, Naga Datha Saikiran Battula, Avina Nakarmi +3AI AlignmentHuman-AI Interaction

    New Jersey Institute of Technology Newark, USA

  52. Toward AI That Understands Self and Others: A World-Model Theory of Cognitive Diversity and Alignment

    May 28, 2026Toru TakahashiComputational Cognitive ModelingWorld Model Learning

    Human Informatics and Systems Lab, Doshisha University · Linked Open Data Initiative, NPO · Keio Research Institute at SFC +1

  53. Beyond Recall: Behavioral Specification as an Interpretive Layer for AI Personalization

    May 27, 2026Aarik GulayaLLM PersonalizationAI Alignment

    Base Layer

  54. You Only Align Once: Propagating Cooperative Behaviors in Multi-Agent Systems through Seed Agents

    May 26, 2026Nicole Hsing, Asuka Yuxi Zheng, Yi Zhao +2Social DilemmasAI Alignment

    1Arcarae · University of California, Santa Cruz · 3Northwestern University +1

  55. A Sober Look at Agentic Misalignment in Automated Workflows

    May 22, 2026Wenqian Ye, Bo Yuan, Zhichao Xu +4AI AlignmentAgentic Workflows

    University of Virginia · Georgia Institute of Technology · University of Utah +2

  56. Investigating Concept Alignment Using Implausible Category Members

    May 20, 2026Sunayana Rane, Brenden M. Lake, Thomas L. GriffithsAI Alignment

    Department of Computer Science · Princeton University · Princeton, NJ 08540 +1

  57. Embedding-perturbed Exploration Preference Optimization for Flow Models

    May 15, 2026Sujie Hu, Chubin Chen, Jiashu Zhu +3AI AlignmentGroup Relative Policy Optimization

    1Tsinghua University · ⋆Work done during the internship at AMAP · 2AMAP, Alibaba Group

  58. From Descriptive to Prescriptive: Uncover the Social Value Alignment of LLM-based Agents

    May 13, 2026Jinxian Qu, Qingqing Gu, Teng Chen +1AI AlignmentLLM Safety Alignment

    Geely AI Lab

  59. Position: Assistive Agents Need Accessibility Alignment

    May 13, 2026Jie Hu, Changyuan Yan, Yu Zheng +2AI AlignmentHuman-Centered AI

    School of Artificial Intelligence and Robotics, Hunan University, Changsha, China

  60. Sustaining AI safety: Control-theoretic external impossibility, intrinsic necessity, and structural requirements

    May 13, 2026James M. MazzuAI AlignmentAI Safety

    Digie Inc.