LLM Alignment

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

48 papers in the last four weeks, up 118% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 422

All topics

A Method for Learning Value Systems in Generative AI
Jul 18, 2026Andrés Holgado-Sánchez, Holger Billhardt, Sascha OssowskiReward Modeling LLM Alignment
1CETINIA, University Rey Juan Carlos
When Is Delegated Play Truthful? Within-Range Regret and the Trilemma of Aligned Delegation
Jul 15, 2026Taksch DubeMechanism Design LLM Alignment
Kent State University, Kent, OH, USA
Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Values
Jul 15, 2026Jan Betley, Johannes Treutlein, Jan Dubiński +5LLM Alignment Language Model Bias Evaluation
1Truthful AI · 2Warsaw University of Technology · 3NASK National Research Institute +2
ToolAlignBench: Investigating Alignment Conflicts in Tool-Calling Enabled LLMs
Jul 15, 2026Aryan Keluskar, Amrita Bhattacharjee, Huan LiuLLM Alignment AI Agent Safety Benchmarks
School of Computing & AI, Arizona State University, Tempe, AZ, USA.
Exploring Post-Training Alignment of Small Language Models for Biomedical Data-to-Text Generation: A Case Study of Medication Leaflet
Jul 15, 2026Xi Yang, Guodong Liu, Chuqin Li +10LLM Alignment Small Language Models
Advanced Intelligence, Eli Lilly and Company, Indianapolis, IN, USA · Department of Biostatistics and Health Data Science, Indiana University, Indianapolis, IN, USA · Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, United States +2
Meta-Learning Preferences for Multilingual LLM Alignment
Jul 14, 2026Jiaying Lin, Seongho Son, Nam Phuong Tran +3RL for Language Models LLM Alignment
Department of Computer Science, University of Warwick, Coventry, United Kingdom · Department of Computer Science, University College London, London, United Kingdom · Department of Mathematics and Computer Science, University of Basel, Basel, Switzerland
Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs
Jul 14, 2026Sen Yang, Yuen-Hei YeungLLM Alignment Causal Interventions in Language Models
Stern School of Business · New York University · Courant Institute of Mathematical Sciences
Optimization Is Not All You Need
Jul 13, 2026Minh Hua, Rita RaleyLLM Alignment AI Governance
Scale AI · San Francisco, California · Department of English +1
Toward Contemplative LLM: A Modular Framework for Evaluating and Enhancing LLM Alignment in Mental Health
Jul 12, 2026Asher Sprigler, Yang-Yang Feng, Iftach Amir +5LLM Alignment Moral Reasoning in Language Models
Electrical and Computer Engineering Purdue University West Lafayette, IN, USA · Biomedical Engineering Washington University in St. Louis St. Louis, MO, USA · Psychological & Brain Sciences Washington University in St. Louis St. Louis, MO, USA +3
How LLM Task-Adaptation Reshapes Alignment: A Multi-dimensional Study of Behavioral and Representational Drift
Jul 10, 2026James Elcock, William F. Shen, Xinchi Qiu +1LLM Alignment LLM Post-Training
University of Cambridge
An Emergent Mirage: Is Emergent Misalignment and Realignment Indeed a Robust Phenomenon?
Jul 10, 2026Abhinav Rao, Liancheng Gong, Bin Hu +1LLM Alignment LLM Fine-Tuning
umd · cmu
Optimizing Against Safety Representations: Activation-Guided Adversarial Suffixes and the Geometry of Refusal
Jul 9, 2026Ege Çakar, Hannah Guan, Kayden KeheLLM Alignment Adversarial Attacks on LLMs
Harvard University
Metadata-Free Meta-Reweighted Direct Preference Optimization under Noisy Preference Labels
Jul 9, 2026Hua Qu, Yifan Li, Xiaodong YuanLLM Alignment Meta-Learning
Xi’an Jiaotong University
PLURAL: A Global Dataset for Value Alignment
Jul 9, 2026Dhruv Agarwal, Anya Shukla, Tanya Goyal +1LLM Alignment Cultural Alignment
Cornell University
DiaLLM: An Investigation into the Robustness-Generation Gap in English Dialect Adaptation
Jul 8, 2026Jordan Painter, Dipankar Srirag, Adarsh Kappiyath +3Language Model Pretraining LLM Alignment
Institute for People-Centred AI, University of Surrey, Surrey, United Kingdom · University of New South Wales, Sydney, Australia
Alignment Plausibility: A New Standard for Assuring AI in Healthcare
Jul 8, 2026Gwydion Williams, Sara Zannone, Bilal A MateenLLM Alignment Healthcare
PATH, United Kingdom · UCL, United Kingdom
Online Data Selection Is Implicit Alignment
Jul 8, 2026Aoxiong Zeng, Yuxin Yang, Xiangquan YangSupervised Fine-Tuning LLM Alignment
East China Normal University · Shanghai University
From Application-Layer Simulation to Native Meta-Architecture: Structural Tension as an Endogenous Driver for Heterogeneous AI Evolution
Jul 7, 2026Heting MaoLLM Alignment Memory-Augmented Language Models
Shanghai Lixin University of Accounting and Finance
Turning Off-Policy Tokens On-Policy: A Plug-in Approach for Improving LLM Alignment
Jul 6, 2026Yu Li, Xiuyu Li, Mingyang Yi +4LLM Alignment Importance Sampling
Renmin University of China
Wrong Before Right: Late Rescue and Interface Failure in Aligned Language Models
Jul 6, 2026Jiaqi DengLLM Alignment LLM Interpretability
Independent Researcher
Transplanting, inverting, and preventing a misalignment persona: method-conditional emergent misalignment in Qwen2.5
Jul 5, 2026Lyndon Drake, Zandi EberstadtLLM Alignment LLM Fine-Tuning
University of Oxford
Aligning Language Models with Selective Prediction
Jul 3, 2026Gaoxiang Luo, Yifan Wu, Sinian Zhang +2RL for Language Models LLM Alignment
Department of Computer Science and Engineering · 2Bioinformatics and Computational Biology Program · 3Division of Biostatistics and Health Data Science
Best-of-Better- $N$ : Generating Pre-Aligned Responses with In-Context Learning
Jul 3, 2026Eric Lei, Hsiang Hsu, Chun-Fu ChenLLM Alignment Best-of-N Sampling
JPMorganChase Global Technology Applied Research
Unbiased Alignment for Large Language Models with Noisy Preferences
Jul 3, 2026Jialiang Wang, Xianming Liu, Xiong Zhou +2Pairwise Preference Learning LLM Alignment
1Harbin Institute of Technology · 2City University of Hong Kong.
Safe Inference-Time Alignment via Lagrangian Reward Augmentation
Jul 2, 2026Yaswanth Chittepu, Ativ Joshi, Sohini Chintala +1LLM Alignment LLM Safety Alignment
University of Massachusetts Amherst · Independent Researcher
Improving LLMs via Validator-to-Generator Alignment
Jul 2, 2026Juan Diego Rodriguez, Jocelyn Zhang, Katrin Erk +1LLM Alignment LLM Reliability
Department of Computer Science, The University of Texas at Austin · Departments of Linguistics and Computer Science, University of Massachusetts Amherst · Department of Computer Science & Center for Data Science, New York University
On the Limits of Steering Vectors for Preference-Aligned Generation
Jul 2, 2026Melanie Subbiah, Zara Hall, Kathleen McKeownLLM Alignment Language Model Steering
Department of Computer Science, Columbia University, USA
Distributionally Robust Listwise Preference Optimization
Jul 2, 2026Xudong Wu, Jian Qian, Pangpang Liu +2LLM Alignment Distributionally Robust Optimization
The University of Hong Kong · Hong Kong SAR · Yale University +3
Evo-PI: Aligning Medical Reasoning via Evolving Principle-Guided Supervision
Jun 30, 2026Xianda Zheng, Huan Gao, Meng-Fen Chiang +3LLM Alignment Medical VLMs
School of Computer Science, University of Auckland · Sapiens · National Yang Ming Chiao Tung University +3
On the Convergence of Self-Improving Online LLM Alignment
Jun 30, 2026Xudong Wu, Pangpang Liu, Vaneet Aggarwal +1LLM Alignment Optimization Convergence Analysis
The University of Hong Kong, Hong Kong SAR · Yale University, New Haven, CT, USA · Purdue University, West Lafayette, IN, USA

Jul 18, 2026, cs.CYJ/K move · Enter open · S save

A Method for Learning Value Systems in Generative AI

Andrés Holgado-Sánchez, Holger Billhardt, Sascha Ossowski

1CETINIA, University Rey Juan Carlos

Reward Modeling LLM Alignment Preference Learning

Open paper AskPDF arXiv

Value-aware AI systems require explicit computational representations of human values (groundings) and their aggregation into value systems in order to align their decisions with ours. As such representations are difficult to elicit, value learning seeks to infer them by observing human behaviour. This work addresses the lack of grounded value learning methods in generative AI: existing approaches typically replicate human preferences without awareness of the multidimensional structure of value alignment, or lack principled value system elicitation methods. To address these gaps, we adapt a previously validated value system learning method to the generative AI setting, which, based on pairwise prompt-response preference data, simultaneously learns: i) an implementation of a grounding for a set of values given by a multi-objective reward model, and ii) a value system representation in the form of a weighted linear scalarization of the previous grounding model. To ensure that the learned value systems are based on coherent value representations, our algorithm dynamically prioritizes the grounding learning process. We evaluate the method against baselines and a contemporary method on prompt-response preference datasets. Results show competitive performance and minimal trade-offs against the baselines, while improving explainability.

Momentum

Related topics

Latest papers 422