Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

November 1, 2024

Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation
Bohan Lyu, Yadi Cao, Duncan Watson-Parris, Leon Bergen, Taylor Berg-Kirkpatrick, Rose Yu
Large Language Model LeArning Abstract Domain Knowledge Task Complexity
MoD: A Distribution-Based Approach for Merging Large Language Models
Quy-Anh Dang, Chris Ngo
Large Language Model Knowledge Transfer Model Merging Model Weight Mixed Task Distributional Model
Enhancing the Traditional Chinese Medicine Capabilities of Large Language Model through Reinforcement Learning from AI Feedback
Song Yu, Xiaofei Xu, Fangfei Xu, Li Li
Large Language Model Language Model Reinforcement Learning Supervised Fine Tuning AI Feedback Traditional Chinese Medicine
Attention Tracker: Detecting Prompt Injection Attacks in LLMs
Kuo-Han Hung, Ching-Yun Ko, Ambrish Rawat, I-Hsin Chung, Winston H. Hsu, Pin-Yu Chen
Large Language Model Prompt Injection Attack Attention Pattern Malicious Traffic
Rationale-Guided Retrieval Augmented Generation for Medical Question Answering
Jiwoong Sohn, Yein Park, Chanwoong Yoon, Sihyeon Park, Hyeon Hwang, Mujeen Sung, Hyunjae Kim, Jaewoo Kang
Large Language Model Retrieval Augmented Generation Biomedical Corpus Medical Question

October 31, 2024

MESS+: Energy-Optimal Inferencing in Language Model Zoos with Service Level Guarantees
Ryan Zhang, Herbert Woisetschläger, Shiqiang Wang, Hans Arno Jacobsen
Large Language Model Language Model Service Provider Provable Guarantee Energy Efficient Inference Inference Service Inference Stage
LLM4Mat-Bench: Benchmarking Large Language Models for Materials Property Prediction
Andre Niyongabo Rubungo, Kangming Li, Jason Hattrick-Simpers, Adji Bousso Dieng
Large Language Model Human Prediction Material SCIence Material Property Prediction Material Property ML Agent Bench
Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models
Haritz Puerto, Martin Gubri, Sangdoo Yun, Seong Joon Oh
Large Language Model Language Model Membership Inference Attack New Attack Membership Inference
SelfCodeAlign: Self-Alignment for Code Generation
Yuxiang Wei, Federico Cassano, Jiawei Liu, Yifeng Ding, Naman Jain, Zachary Mueller, Harm de Vries, Leandro von Werra, Arjun Guha, Lingming Zhang
Large Language Model Code Generation Instruction Tuning Self Alignment Instruction Response Pair
Constraint Back-translation Improves Complex Instruction Following of Large Language Models
Yunjia Qi, Hao Peng, Xiaozhi Wang, Bin Xu, Lei Hou, Juanzi Li
Large Language Model Instruction Following Back Translation Instruction Dataset Instruction Response Pair
Desert Camels and Oil Sheikhs: Arab-Centric Red Teaming of Frontier LLMs
Muhammed Saeed, Elgizouli Mohamed, Mukhtar Mohamed, Shaina Raza, Shady Shehata, Muhammad Abdul-Mageed
Large Language Model Language Model Absolute Stance Bias Bias Mitigation Red Teaming Electric SHEEP LLM Bias
Multilingual Pretraining Using a Large Corpus Machine-Translated from a Single Source Language
Jiayi Wang, Yao Lu, Maurice Weber, Max Ryabinin, Yihong Chen, Raphael Tang, Pontus Stenetorp
Large Language Model Large Corpus Domain Specific Multilingual Model Multilingual Large Language Model Multilingual Pretraining Source Language Multilingual Reasoning
BitStack: Fine-Grained Size Control for Compressed Large Language Models in Variable Memory Environments
Xinghao Wang, Pengyu Wang, Bo Wang, Dong Zhang, Yunhua Zhou, Xipeng Qiu
Large Language Model Fine Grained Memory Constraint
Exploring the Knowledge Mismatch Hypothesis: Hallucination Propensity in Small Models Fine-tuned on Data from Larger Models
Phil Wee, Riyadh Baghdadi
Large Language Model Fine Tuning Raw Data Large Model Content Hallucination Small Model Model Mismatch
Leveraging LLMs for MT in Crisis Scenarios: a blueprint for low-resource languages
Séamus Lankford, Andy Way
Large Language Model Machine Translation Unknown Language Natural Disaster Disaster Response Blueprint Architecture Disaster Response Scenario
Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphs
Liyi Chen, Panrong Tong, Zhongming Jin, Ying Sun, Jieping Ye, Hui Xiong
Large Language Model Knowledge Graph Reasoning Path Graph Based Planning Adaptive Planning
Audio Is the Achilles' Heel: Red Teaming Audio Large Multimodal Models
Hao Yang, Lizhen Qu, Ehsan Shareghi, Gholamreza Haffari
Large Language Model Large Multimodal Model Audio Driven Multimodal Information Multimodal Input Red Teaming
Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?
Zhanke Zhou, Rong Tao, Jianing Zhu, Yiwen Luo, Zengmao Wang, Bo Han
Large Language Model Language Model Chain of Thought Reasoning Path Robust Reasoning Noisy Preference
Commonsense Knowledge Editing Based on Free-Text in LLMs
Xiusheng Huang, Yequan Wang, Jun Zhao, Kang Liu
Large Language Model Commonsense Knowledge Knowledge Editing Unstructured Text Non Rigid Editing Knowledge Editing Method
What is Wrong with Perplexity for Long-context Language Modeling?
Lizhe Fang, Yifei Wang, Zhaoyang Liu, Chenheng Zhang, Stefanie Jegelka, Jinyang Gao, Bolin Ding, Yisen Wang
Large Language Model Long Context Long Context Language Long Context Understanding Long Context Benchmark Long Context Input

Large Language Model

Papers

Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation

MoD: A Distribution-Based Approach for Merging Large Language Models

Enhancing the Traditional Chinese Medicine Capabilities of Large Language Model through Reinforcement Learning from AI Feedback

Attention Tracker: Detecting Prompt Injection Attacks in LLMs

Rationale-Guided Retrieval Augmented Generation for Medical Question Answering

MESS+: Energy-Optimal Inferencing in Language Model Zoos with Service Level Guarantees

LLM4Mat-Bench: Benchmarking Large Language Models for Materials Property Prediction

Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models

SelfCodeAlign: Self-Alignment for Code Generation

Constraint Back-translation Improves Complex Instruction Following of Large Language Models

Desert Camels and Oil Sheikhs: Arab-Centric Red Teaming of Frontier LLMs

Multilingual Pretraining Using a Large Corpus Machine-Translated from a Single Source Language

BitStack: Fine-Grained Size Control for Compressed Large Language Models in Variable Memory Environments

Exploring the Knowledge Mismatch Hypothesis: Hallucination Propensity in Small Models Fine-tuned on Data from Larger Models

Leveraging LLMs for MT in Crisis Scenarios: a blueprint for low-resource languages

Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphs

Audio Is the Achilles' Heel: Red Teaming Audio Large Multimodal Models

Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?

Commonsense Knowledge Editing Based on Free-Text in LLMs

What is Wrong with Perplexity for Long-context Language Modeling?