Moral Reasoning

Moral reasoning research focuses on understanding how humans and artificial intelligence (AI) make ethical judgments and the factors influencing these decisions. Current research utilizes large language models (LLMs) to analyze moral content in text, benchmark AI's moral reasoning capabilities against human standards, and develop methods to improve AI's ethical decision-making through techniques like fine-tuning and knowledge augmentation. This work is crucial for mitigating biases in AI systems and ensuring their responsible development and deployment across various applications, from legal analysis to ethical decision support systems.

Papers

January 9, 2024

Informed AI Regulation: Comparing the Ethical Frameworks of Leading LLM Chatbots Using an Ethics-Based Audit to Assess Moral Reasoning and Normative Values
Jon Chun, Katherine Elkins
Moral Reasoning Moral Dilemma Ethical Framework LLM Chatbots

November 16, 2023

MOKA: Moral Knowledge Augmentation for Moral Event Extraction
Xinliang Frederick Zhang, Winston Wu, Nick Beauchamp, Lu Wang
Moral Reasoning Knowledge Augmentation Moral Evaluation

October 30, 2023

MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks
Allen Nie, Yuhui Zhang, Atharva Amdekar, Chris Piech, Tatsunori Hashimoto, Tobias Gerstenberg
Causal Event Human Intuition Language Model Alignment Moral Reasoning Moral Judgment Intuitive Explanation Human Moral Commonsense Understanding

October 11, 2023

Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs
Abhinav Rao, Aditi Khandelwal, Kumar Tanmay, Utkarsh Agarwal, Monojit Choudhury
New Framework Medical LLM Moral Reasoning Moral Value Ethical Principle Ethical Reasoning

October 2, 2023

EALM: Introducing Multidimensional Ethical Alignment in Conversational Information Retrieval
Yiyao Yu, Junjie Wang, Yuxiang Zhang, Lin Zhang, Yujiu Yang, Tetsuya Sakai
Active Learning Moral Reasoning Conversational Information Retrieval Ethic Dataset

September 23, 2023

Probing the Moral Development of Large Language Models through Defining Issues Test
Kumar Tanmay, Aditi Khandelwal, Utkarsh Agarwal, Monojit Choudhury
Proper Issue Labeling Moral Reasoning Moral Development

June 23, 2023

Potential Benefits of Employing Large Language Models in Research in Moral Education and Development
Hyemin Han
Large Language Model Large Corpus Development Activity DH Research Complementary Benefit Higher Order Moral Reasoning Moral Foundation

April 4, 2023

A Data Fusion Framework for Multi-Domain Morality Learning
Siyi Guo, Negar Mokhberian, Kristina Lerman
Language Model Adversarial Training Moral Reasoning Moral Value

October 13, 2022

Noise Audits Improve Moral Foundation Classification
Negar Mokhberian, Frederic R. Hopp, Bahareh Harandizadeh, Fred Morstatter, Kristina Lerman
Noisy Annotation Moral Reasoning Moral Foundation Environmental Noise

October 4, 2022

When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment
Zhijing Jin, Sydney Levine, Fernando Gonzalez, Ojasv Kamal, Maarten Sap, Mrinmaya Sachan, Rada Mihalcea, Josh Tenenbaum, Bernhard Schölkopf
Language Model Human Reasoning Moral Reasoning Human Moral Public Exception Mean End Account

August 10, 2022

The Moral Foundations Reddit Corpus
Jackson Trager, Alireza S. Ziabari, Aida Mostafazadeh Davani, Preni Golazizian, Farzan Karimi-Malekabadi, Ali Omrani, Zhihe Li, Brendan Kennedy, Nils Karl Reimer, Melissa Reyes, Kelsey Cheng, Mellow Wei, Christina Merrifield, Arta Khosravi, Evans Alvarez, Morteza Dehghani
User Sentiment Moral Reasoning Moral Value Moral Theory

May 3, 2022

A Holistic Framework for Analyzing the COVID-19 Vaccine Debate
Maria Leonor Pacheco, Tunazzina Islam, Monal Mahajan, Andrey Shor, Ming Yin, Lyle Ungar, Dan Goldwasser
General Analysis Moral Reasoning COVID 19 Infodemic

April 15, 2022

Learning to Adapt Domain Shifts of Moral Values via Instance Weighting
Xiaolei Huang, Alexandra Wormley, Adam Cohen
LeArning Abstract Domain Shift Moral Reasoning Moral Value Instance Weighting Cross Domain Classification

March 29, 2022

A Principles-based Ethics Assurance Argument Pattern for AI and Autonomous Systems
Zoe Porter, Ibrahim Habli, John McDermid, Marten Kaas
Artificial Intelligence Autonomous System Moral Reasoning Assurance Case

January 19, 2022

When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data
Edmond Awad, Sydney Levine, Andrea Loreggia, Nicholas Mattei, Iyad Rahwan, Francesca Rossi, Kartik Talamadupula, Joshua Tenenbaum, Max Kleiman-Weiner
Reasoning Capability Knowledge Representation Simple RULE Empirical Evidence Moral Reasoning Moral Judgment Human Moral

January 16, 2022

Memory-assisted prompt editing to improve GPT-3 after deployment
Aman Madaan, Niket Tandon, Peter Clark, Yiming Yang
GPT 3 Real World Deployment Moral Reasoning Prompt Decomposition Multilingual Lm Lexical Processing Large Lm Prompt Based Editing

Moral Reasoning

Papers

Informed AI Regulation: Comparing the Ethical Frameworks of Leading LLM Chatbots Using an Ethics-Based Audit to Assess Moral Reasoning and Normative Values

MOKA: Moral Knowledge Augmentation for Moral Event Extraction

MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks

Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs

EALM: Introducing Multidimensional Ethical Alignment in Conversational Information Retrieval

Probing the Moral Development of Large Language Models through Defining Issues Test

Potential Benefits of Employing Large Language Models in Research in Moral Education and Development

A Data Fusion Framework for Multi-Domain Morality Learning

Noise Audits Improve Moral Foundation Classification

When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment

The Moral Foundations Reddit Corpus

A Holistic Framework for Analyzing the COVID-19 Vaccine Debate

Learning to Adapt Domain Shifts of Moral Values via Instance Weighting

A Principles-based Ethics Assurance Argument Pattern for AI and Autonomous Systems

When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data

Memory-assisted prompt editing to improve GPT-3 after deployment