LLM Alignment

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

48 papers in the last four weeks, up 118% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 422

All topics

Adaptive Pluralistic Alignment: A pipeline for dynamic artificial democracy
May 2, 2026Rachel FreedmanReward Modeling LLM Alignment
Department of Electrical Engineering and Computer Science, University of California, Berkeley, USA.
TUR-DPO: Topology- and Uncertainty-Aware Direct Preference Optimization
Apr 30, 2026Abdulhady Abas Abdullah, Fatemeh Daneshfar, Seyedali Mirjalili +1LLM Alignment Direct Preference Optimization
Artificial Intelligence and Innovation Centre, University of Kurdistan, Erbil, Iraq · Department of Computer Engineering, University of Kurdistan, Iran · Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Brisbane, Australia +2
How Frontier LLMs Adapt to Neurodivergence Context: A Measurement Framework for Surface vs. Structural Change in System-Prompted Responses
Apr 30, 2026Ishan Gupta, Pavlo BuryiLLM Alignment Language Model Safety Evaluation
Harrisburg University of Science and Technology
Models Recall What They Violate: Constraint Adherence in Multi-Turn LLM Ideation
Apr 30, 2026Garvin KruthofLLM Evaluation LLM Alignment
Technical University of Munich
Mind the Gap: Structure-Aware Consistency in Preference Learning
Apr 30, 2026Mehryar Mohri, Yutao ZhongPairwise Preference Learning LLM Alignment
Google Research, New York, NY · Courant Institute of Mathematical Sciences, New York, NY
Debiasing Reward Models via Causally Motivated Inference-Time Intervention
Apr 30, 2026Kazutoshi Shinoda, Kosuke Nishida, Kyosuke NishidaReward Modeling LLM Alignment
Human Informatics Labs., NTT, Inc.
Three Models of RLHF Annotation: Extension, Evidence, and Authority
Apr 28, 2026Steve CoyneLLM Alignment Human-in-the-Loop Annotation
University of Toronto, Canada · University of Toronto, Toronto, Canada
One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query Refinement
Apr 28, 2026Yixiao Zhou, Dongzhou Cheng, zhiliang wu +3LLM Alignment RL for Language Model Reasoning
Zhejiang University · Shanghai Innovation Institute · 1Zhejiang University, 2Shanghai Innovation Institute +9
Generating Place-Based Compromises Between Two Points of View
Apr 27, 2026Sumanta Bhattacharyya, Francine Chen, Scott Carter +6LLM Alignment Prompt Engineering
University of Illinois Chicago · Toyota Research Institute
Intrinsic Mutual Information as a Modulator for Preference Optimization
Apr 27, 2026Peng Liao, Peijia Zheng, Lingbo Li +2LLM Alignment Offline Preference Optimization
1Sun Yat-sen University · University of Warwick · 3Macao Polytechnic University
Hindsight Preference Optimization for Financial Time Series Advisory
Apr 27, 2026Yanwei Cui, Guanghui Wang, Xing Zhang +7LLM Alignment Financial Forecasting
1AWS Generative AI Innovation Center · 2HSBC Holdings Plc. HSBC Technology Center China
LLMs Reading the Rhythms of Daily Life: Aligned Understanding for Behavior Prediction and Generation
Apr 26, 2026Fanjin Meng, Jingtao Ding, Nian Li +2LLM Alignment Human Behavior Simulation
Department of Electronic Engineering, BNRist, Tsinghua University, Beijing, China
Pref-CTRL: Preference Driven LLM Alignment using Representation Editing
Apr 26, 2026Imranul Ashrafi, Inigo Jauregi Unanue, Massimo PiccardiLLM Alignment Representation Engineering
University of Technology Sydney, Australia
AI Safety Training Can be Clinically Harmful
Apr 25, 2026Suhas BN, Andrew M. Sherrill, Rosa I. Arriaga +2Mental Health Counseling LLM Alignment
College of Information Sciences and Technology, Penn State University, USA · Department of Psychiatry and Behavioral Sciences, Emory University, USA · School of Interactive Computing, Georgia Tech, USA +1
Controllable Spoken Dialogue Generation: An LLM-Driven Grading System for K-12 Non-Native English Learners
Apr 24, 2026Haidong Yuan, Haokun Zhao, Wanshi Xu +4RL for Language Models LLM Alignment
Peking University · Fudan University · Tencent +2
Multilingual Refusal Alignment for Safer Large Language Models
Apr 24, 2026Aleksandra Krasnodębska, Wojciech Kusa, Aldo LipaniMultilingual Language Model Evaluation LLM Alignment
NASK National Research Institute, Warsaw, Poland · University College London, London, UK
Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization
Apr 24, 2026Weixu Zhang, Ye Yuan, Changjiang Han +7LLM Alignment Language Model Steering
McGill University · Mila - Quebec AI Institute · MBZUAI +2
CAP: Controllable Alignment Prompting for Unlearning in LLMs
Apr 23, 2026Zhaokun Wang, Jinyu Guo, Jingwen Pu +7LLM Alignment LLM Unlearning
School of Information and Software Engineering, University of Electronic Science and Technology of China
Propensity Inference: Environmental Contributors to LLM Behaviour
Apr 22, 2026Olli Järviniemi, Oliver Makins, Jacob Merizian +2LLM Alignment LLM Auditing
UK AI Security Institute · Work done while at UK AISI.
Value-Conflict Diagnostics Reveal Widespread Alignment Faking in Language Models
Apr 22, 2026Inderjeet Nair, Jie Ruan, Lu WangLLM Alignment Language Model Safety Evaluation
Computer Science and Engineering University of Michigan Ann Arbor, MI 48109, USA
To Intervene or Not: Guiding Inference-time Alignment with Probabilistic Model Blending
Apr 22, 2026Jin Gan, Xin Li, Jun LuoLLM Alignment Inference-Time Language Model Alignment
College of Computing and Data Science, Nanyang Technological University, Singapore
HiPO: Hierarchical Preference Optimization for Adaptive Reasoning in LLMs
Apr 22, 2026Darsh Kachroo, Arjun Prasaath Anbazhagan, Adriana Caraeni +2LLM Alignment Direct Preference Optimization
Vellore Institute of Technology, Chennai · Northwestern University · University of Massachusetts Amherst +2
AeSlides: Incentivizing Aesthetic Layout in LLM-Based Slide Generation via Verifiable Rewards
Apr 21, 2026Yiming Pan, Chengwei Hu, Xuancheng Huang +6LLM Alignment Reinforcement Learning with Verifiable Rewards
Beijing Institute of Technology · Zhipu AI (Z.ai)
LLMs Know They're Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit
Apr 21, 2026Manav PandeyLLM Sycophancy LLM Alignment
Georgia Institute of Technology
OLLM: Options-based Large Language Models
Apr 21, 2026Shashank Sharma, Janina Hoffmann, Vinay NamboodiriLLM Alignment RL for Language Model Reasoning
Department of Computer Science University of Bath · Department of Psychology University of Bath
Local Linearity of LLMs Enables Activation Steering via Model-Based Linear Optimal Control
Apr 21, 2026Julian Skifstad, Xinyue Annie Yang, Glen ChouLLM Alignment Language Model-Based Control
1Georgia Institute of Technology, Atlanta, GA, USA. Schools of Electrical and Computer Engineering · 2Computer Science · 3Cybersecurity and Privacy, Aerospace Engineering
Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraints
Apr 20, 2026Hao Meng, Siyuan Zheng, Shuran Zhou +2Text-to-Music Generation LLM Alignment
Zuoyebang Education Technology, Beijing, China
Towards Disentangled Preference Optimization Dynamics: Suppress the Loser, Preserve the Winner
Apr 20, 2026Wei Chen, Yubing Wu, Junmei Yang +5Pairwise Preference Learning LLM Alignment
1South China University of Technology · 2AIP, RIKEN · 3Columbia University +1
ATLAS: Constitution-Conditioned Latent Geometry and Redistribution Across Language Models and Neural Perturbation Data
Apr 19, 2026Gareth Seneque, Lap-Hang Ho, Nafise Erfanian Saeedi +2LLM Alignment Neural Representation Geometry
Australian Broadcasting Corporation
Characterizing Model-Native Skills
Apr 19, 2026Feiyang Kang, Mahavir Dabas, Myeongseob Ko +1LLM Alignment LLM Training
Virginia Tech Blacksburg, VA 24060, USA

May 2, 2026, cs.LGJ/K move · Enter open · S save

Adaptive Pluralistic Alignment: A pipeline for dynamic artificial democracy

Rachel Freedman

Department of Electrical Engineering and Computer Science, University of California, Berkeley, USA.

Reward Modeling LLM Alignment Pluralistic Alignment

Open paper AskPDF arXiv

Prevailing alignment methods target a fixed set of preferences and therefore risk forcing value lock-in as societal norms evolve over time. We introduce Adaptive Pluralistic Alignment (APA), a modular pipeline for updating pluralistically aligned AI systems to track evolving values and avoid value lock-in without repeating costly pretraining or large-scale data collection. APA has three stages: (1) learning compact personalized reward models via low-rank reward basis decomposition, (2) using these models as a jury that collectively selects among candidate outputs through social-choice-theoretic voting, and (3) efficiently adapting the jury over time by fitting new annotator weights over the fixed reward bases as values shift. The resulting system is efficient, explainable, steerable, and modular. We implement a proof-of-concept instantiation using the PRISM multi-user alignment dataset and simulated historical annotators, and provide preliminary analysis showing that jury composition and the choice of voting rule can substantially affect outcomes, particularly when jury preferences are heterogeneous. We provide full code and resulting preference datasets at https://github.com/RachelFreedman/apa.

Momentum

Related topics

Latest papers 422