LLM Alignment

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

48 papers in the last four weeks, up 118% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 422

All topics

Value-Action Alignment in Large Language Models under Privacy-Prosocial Conflict
Jan 7, 2026Guanyu Chen, Chenxiao Yu, Xiyang HuLLM Evaluation LLM Alignment
Arizona State University · University of Southern California
Metaphors are a Source of Cross-Domain Misalignment of Large Reasoning Models
Jan 6, 2026Zhibo Hu, Chen Wang, Yanfeng Shu +2LLM Alignment Emergent Misalignment in Language Models
The University of New South Wales · CSIRO Data61
HAL: Inducing Human-likeness in LLMs with Alignment
Jan 6, 2026Masum Hasan, Junjie Zhao, Ehsan HoqueReward Modeling LLM Alignment
University of Rochester
Shapley-based Data Valuation for LLM Alignment via Sequential Preference Optimization
Dec 12, 2025Mélissa Tamine, Otmane Sakhi, Benjamin Heymann +2LLM Alignment Shapley Value Attribution
Criteo AI lab, FairPlay joint team, France · CREST, ENSAE, Institut Polytechnique de Paris · Criteo AI Lab, France +1
Overcoming State Inertia: Minimally Invasive Temporal Alignment for Evolving Contexts
Dec 3, 2025Yijun LiaoLLM Alignment Direct Preference Optimization
Aligning LLMs with Biomedical Knowledge using Balanced Fine-Tuning
Nov 26, 2025Zhenchao Tang, Fang Wang, Haohuai He +13LLM Alignment LLM Fine-Tuning
Tencent AI for Life Sciences Lab, Shenzhen, China. · Sun Yat-sen University, Shenzhen, China. · The Hong Kong Polytechnic University, Hong Kong SAR, China. +2
Value Drifts: Tracing Value Alignment During LLM Post-Training
Oct 30, 2025Mehar Bhatia, Shravan Nayak, Gaurav Kamath +4LLM Alignment Preference Optimization
Mila - Quebec AI Institute · McGill University · Université de Montréal +4
OpenReward: Learning to Reward Long-form Agentic Tasks via Reinforcement Learning
Oct 28, 2025Ziyou Hu, Zhengliang Shi, Minghang Zhu +5Reward Modeling RL for Language Models
Leiden University, Leiden, Netherland · Shandong University, Qingdao, China · Tsinghua University, Beijing, China
Navigating the Alignment-Calibration Trade-off: A Pareto-Superior Frontier via Model Merging
Oct 20, 2025Tiancheng Hu, Benjamin Minixhofer, Nigel CollierLLM Alignment Model Calibration
University of Cambridge
Interaction Protocol Shapes Moral Judgment in Multi-Agent Debate
Oct 11, 2025Pratik S. Sachdeva, Tom van NuenenLLM Alignment Moral Reasoning in Language Models
D-Lab, University of California, Berkeley
Moloch's Bargain: Emergent Misalignment When LLMs Compete for Audiences
Oct 7, 2025Batu El, James ZouLLM Alignment LLM Safety
Stanford University
TagPR: Tag-Guided Process Supervision for Personalization Reasoning in Large Language Models
Sep 27, 2025Song Jin, Juntian Zhang, Ruyu Lyu +7LLM Alignment LLM Personalization
Gaoling School of Artificial Intelligence, Renmin University of China · Meituan · Wuhan University
ESSA: Evolutionary Strategies for Scalable Alignment
Jul 6, 2025Daria Korotyshova, Boris Shaposhnikov, Alexey Malakhov +7LLM Alignment Evolutionary Optimization
T-Tech · Yandex
A Technical Survey of Reinforcement Learning Techniques for Large Language Models
Jul 5, 2025Saksham Sahai Srivastava, Vaneet AggarwalRL for Language Models LLM Alignment
University of Georgia, Athens, GA, USA · Purdue University, West Lafayette, IN, USA
Logit-Gap Steering: A Forward-Pass Diagnostic for Alignment Robustness
Jun 30, 2025Tung-Ling Li, Hongliang LiuLLM Alignment Language Model Safety Evaluation
Palo Alto Networks
KARE-RAG: Knowledge-Aware Refinement and Enhancement for RAG
Jun 3, 2025Yongjian Li, HaoCheng Chu, Yukun Yan +7Retrieval-Augmented Generation LLM Alignment
School of Biomedical Engineering, Tsinghua Medicine, Tsinghua University · 2Tsinghua Laboratory of Brain and Intelligence · School of Informatics, Xiamen University +6
InfiFPO: Implicit Model Fusion via Preference Optimization in Large Language Models
May 20, 2025Yanggan Gu, Yuanyi Wang, Zhaoyi Yan +4Language Model Merging LLM Alignment
The Hong Kong Polytechnic University (PolyU) · Zhejiang University · PolyU-Daya Bay Technology and Innovation Research Institute
R3: Robust Rubric-Agnostic Reward Models
May 19, 2025David Anugraha, Zilu Tang, Lester James V. Miranda +5Reward Modeling LLM Evaluation
Department of Computer Science, Stanford University · Department of Computer Science, Boston University · Allen Institute for AI +4
Bias Fitting to Mitigate Length Bias of Reward Model in RLHF
May 19, 2025Kangwen Zhao, Jianfeng Cai, Jinhua Zhu +5Reward Modeling LLM Alignment
University of Science and Technology of China
Adaptive Helpfulness-Harmlessness Alignment with Preference Vectors
Apr 27, 2025Ren-Wei Liang, Chin-Ting Hsu, Chan-Hung Yu +6LLM Alignment LLM Safety Alignment
National Taiwan University · Appier AI Research · Graduate Institute of Communication Engineering, National Taiwan University +1
Reinforcement Learning from Human Feedback
Apr 16, 2025Nathan LambertLLM Alignment Direct Preference Optimization
Dual-Difficulty Curriculum Learning for Direct Preference Optimization
Apr 10, 2025Mengyang Li, Haozhan Geng, Zhong Zhang +1Pairwise Preference Learning LLM Alignment
Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission Tianjin Normal University Tianjin, China
Truthful or Fabricated? Using Causal Attribution to Mitigate Reward Hacking in Explanations
Apr 7, 2025Pedro Ferreira, Wilker Aziz, Ivan TitovCoT Faithfulness Reward Hacking
Institute for Logic, Language and Computation (ILLC), University of Amsterdam · Institute for Language, Cognition and Computation (ILCC), University of Edinburgh
Evolutionary Guided Decoding: Iterative Value Refinement for LLMs
Mar 4, 2025Zhenhua Liu, Lijun Li, Ruizhe Chen +5LLM Alignment Language Model Decoding
Shanghai Artificial Intelligence Laboratory · Soochow University · Zhejiang University +1
Societal Alignment Frameworks Can Improve LLM Alignment
Feb 27, 2025Karolina Stańczak, Nicholas Meade, Mehar Bhatia +14LLM Alignment AI Alignment
ETH Zurich, Zurich, Switzerland · Mila, McGill University, Montreal, Canada · Université de Montréal, Montreal, Canada +12
Foundations of Large Language Models
Jan 16, 2025Tong Xiao, Jingbo ZhuLanguage Model Pretraining LLM Alignment
NLP Lab, Northeastern University & NiuTrans Research
Decoupled Alignment for Robust Plug-and-Play Adaptation
Jun 3, 2024Haozheng Luo, Jiahao Yu, Wenxin Zhang +9LLM Alignment LLM Safety Alignment
Northwestern University · New York University Abu Dhabi · Stanford University +3
KTO: Model Alignment as Prospect Theoretic Optimization
Feb 2, 2024Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff +2LLM Alignment Human Preference Modeling
Stanford University · Contextual AI
Aligning Language Models with Observational Data: Opportunities and Risks from a Causal Perspective
Date pendingErfan LoghmaniLLM Alignment LLM Fine-Tuning
Foster School of Business University of Washington Seattle, WA 98195
Alignment Reduces Expressed but Not Encoded Gender Bias: A Unified Framework and Study
Date pendingNour Bouchouchi, Thibault Laugel, Xavier Renard +3Gender Bias in Language Models LLM Alignment
Sorbonne Université, CNRS, LIP6, F-75005 Paris, France · AXA, Paris, France · Polish Academy of Science, IBS PAN, Warsaw, Poland

Jan 7, 2026, cs.CLJ/K move · Enter open · S save

Value-Action Alignment in Large Language Models under Privacy-Prosocial Conflict

Guanyu Chen, Chenxiao Yu, Xiyang Hu

Arizona State University · University of Southern California

LLM Evaluation LLM Alignment

Open paper AskPDF arXiv

Large language models (LLMs) are increasingly used to simulate decision-making tasks involving personal data sharing, where privacy concerns and prosocial motivations can push choices in opposite directions. Existing evaluations often measure privacy-related attitudes or sharing intentions in isolation, which makes it difficult to determine whether a model's expressed values jointly predict its downstream data-sharing actions as in real human behaviors. We introduce a context-based assessment protocol that sequentially administers standardized questionnaires for privacy attitudes, prosocialness, and acceptance of data sharing within a bounded, history-carrying session. To evaluate value-action alignments under competing attitudes, we use multi-group structural equation modeling (MGSEM) to identify relations from privacy concerns and prosocialness to data sharing. We propose Value-Action Alignment Rate (VAAR), a human-referenced directional agreement metric that aggregates path-level evidence for expected signs. Across multiple LLMs, we observe stable but model-specific Privacy-PSA-AoDS profiles, and substantial heterogeneity in value-action alignment.

Momentum

Related topics

Latest papers 422