Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

December 19, 2024

Self-Evolution Knowledge Distillation for LLM-based Machine Translation
Yuncheng Song, Liang Ding, Changtong Zan, Shujian Huang
Large Language Model Knowledge Distillation Knowledge Transfer LLM Based Machine Translation Self Knowledge Distillation
ALKAFI-LLAMA3: Fine-Tuning LLMs for Precise Legal Understanding in Palestine
Rabee Qasem, Mohannad Hendi, Banan Tantour
Large Language Model Legal Document LLaMA 3 Legal Article Complex Legal
On Verbalized Confidence Scores for LLMs
Daniel Yang, Yao-Hung Hubert Tsai, Makoto Yamada
Large Language Model Uncertainty Quantification Confidence Score Calibrated Confidence
A Comparative Study of DSPy Teleprompter Algorithms for Aligning Large Language Models Evaluation Metrics to Human Evaluation
Bhaskarjit Sarmah, Kriti Dutta, Anna Grigoryan, Sachin Tiwari, Stefano Pasquali, Dhagash Mehta
Large Language Model Language Model Comparative Study Ground Truth Human Evaluation Prompt Optimization Self Refinement Instruction Aware Prompt Tuning
Length Controlled Generation for Black-box LLMs
Yuxuan Gu, Wenjie Wang, Xiaocheng Feng, Weihong Zhong, Kun Zhu, Lei Huang, Tat-Seng Chua, Bing Qin
Large Language Model Controllable Generation Black Box Large Language Model Length Control Accelerated Sampling
Learning to Generate Research Idea with Dynamic Control
Ruochen Li, Liqiang Jing, Chi Han, Jiawei Zhou, Xinya Du
Large Language Model Supervised Fine Tuning Dynamic Control Research Task
How good is GPT at writing political speeches for the White House?
Jacques Savoy
Large Language Model Speech Analysis GPT Neo Political Content Information Accuracy
Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoning
Kepu Zhang, Haoyue Yang, Xu Tang, Weijie Yu, Jun Xu
Large Language Model Reasoning Capability Legal Judgment Prediction Judgment Prediction Non Social Guilt
Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models
Xiao Cui, Mo Zhu, Yulei Qin, Liang Xie, Wengang Zhou, Houqiang Li
Large Language Model Language Model Knowledge Distillation Mutual Distillation Tokenization Matter Multi Marginal Optimal Transport
Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignment
Teng Xiao, Yige Yuan, Huaisheng Zhu, Mingxiao Li, Vasant G Honavar
Large Language Model Language Model Alignment Problem Direct Preference Optimization Contrastive Objective Implicit Reward Contrastive Preference
Do Large Language Models Defend Inferentialist Semantics?: On the Logical Expressivism and Anti-Representationalism of LLMs
Yuzuki Arai, Sho Tsugawa
Large Language Model Large Language Model Inference Linguistic Representation Foundational Ontology Expressivity Matter
Agent-SafetyBench: Evaluating the Safety of LLM Agents
Zhexin Zhang, Shiyao Cui, Yida Lu, Jingzhuo Zhou, Junxiao Yang, Hongning Wang, Minlie Huang
Large Language Model Human SAFETY LLM Agent Safe Agent
From Human Annotation to LLMs: SILICON Annotation Workflow for Management Research
Xiang Cheng, Raveesh Mayya, João Sedoc
Large Language Model Human Annotation Annotation Pipeline
Are Longer Prompts Always Better? Prompt Selection in Large Language Models for Recommendation Systems
Genki Kusano, Kosuke Akimoto, Kunihiro Takeoka
Large Language Model Full Model Complex Prompt Recommendation System Large Language Recommendation Task Natural Language Input Recommendation Accuracy
ORBIT: Cost-Effective Dataset Curation for Large Language Model Domain Adaptation with an Astronomy Case Study
Eric Modesitt, Ke Yang, Spencer Hulsey, Chengxiang Zhai, Volodymyr Kindratenko
Large Language Model Domain Specific Domain Knowledge Adaptation Concern Data Curation Orbital Motion Domain Specific Large Language Model
All-in-One Tuning and Structural Pruning for Domain-Specific LLMs
Lei Lu, Zhepeng Wang, Ruexue Bao, Mengbing Wang, Fangyi Li, Yawen Wu, Weiwen Jiang, Jie Xu, Yanzhi Wang, Shangqian Gao
Large Language Model Structural Pruning Domain Specific Large Language Model

December 18, 2024

Clinical Trials Ontology Engineering with Large Language Models
Berkan Çakır
Large Language Model Top Level Ontology Clinical Trial
ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals
Utkarsh Saxena, Sayeh Sharify, Kaushik Roy, Xin Wang
Large Language Model Post Training Quantization Multiplier Free Quantization Mixed Precision Quantization Quantization Error
Enhancing Knowledge Distillation for LLMs with Response-Priming Prompting
Vijay Goyal, Mustafa Khan, Aprameya Tirupati, Harveer Saini, Michael Lam, Kevin Zhu
Large Language Model Natural Language Processing Knowledge Distillation
Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICs
David Restrepo, Chenwei Wu, Zhengxu Tang, Zitao Shuai, Thao Nguyen Minh Phan, Jun-En Ding, Cong-Tinh Dao, Jack Gallifant, Robyn Gayle Dychiao, Jose Carlo Artiaga, André Hiroshi Bando, Carolina Pelegrini Barbosa Gracitelli, Vincenz Ferrer, Leo Anthony Celi, Danielle Bitterman, Michael G Morley, Luis Filipe Nakayama
Large Language Model Medical LLM Natural Language Chain of Thought Low Resource Direct Assessment Multilingual Benchmark Multilingual Bias

Large Language Model

Papers

Self-Evolution Knowledge Distillation for LLM-based Machine Translation

ALKAFI-LLAMA3: Fine-Tuning LLMs for Precise Legal Understanding in Palestine

On Verbalized Confidence Scores for LLMs

A Comparative Study of DSPy Teleprompter Algorithms for Aligning Large Language Models Evaluation Metrics to Human Evaluation

Length Controlled Generation for Black-box LLMs

Learning to Generate Research Idea with Dynamic Control

How good is GPT at writing political speeches for the White House?

Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoning

Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models

Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignment

Do Large Language Models Defend Inferentialist Semantics?: On the Logical Expressivism and Anti-Representationalism of LLMs

Agent-SafetyBench: Evaluating the Safety of LLM Agents

From Human Annotation to LLMs: SILICON Annotation Workflow for Management Research

Are Longer Prompts Always Better? Prompt Selection in Large Language Models for Recommendation Systems

ORBIT: Cost-Effective Dataset Curation for Large Language Model Domain Adaptation with an Astronomy Case Study

All-in-One Tuning and Structural Pruning for Domain-Specific LLMs

Clinical Trials Ontology Engineering with Large Language Models

ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals

Enhancing Knowledge Distillation for LLMs with Response-Priming Prompting

Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICs