Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

December 23, 2024

LLM4AD: A Platform for Algorithm Design with Large Language Model
Fei Liu, Rui Zhang, Zhuoliang Xie, Rui Sun, Kai Li, Xi Lin, Zhenkun Wang, Zhichao Lu, Qingfu Zhang
Large Language Model Practical Algorithm LLM Based Diverse Platform Algorithm Design
EM-MIAs: Enhancing Membership Inference Attacks in Large Language Models through Ensemble Modeling
Zichen Song, Sitan Huang, Zhongfeng Kang
Large Language Model Membership Inference Attack Ensemble Model Ensemble Attack
Highly Optimized Kernels and Fine-Grained Codebooks for LLM Inference on Arm CPUs
Dibakar Gope, David Mansell, Danny Loh, Ian Bratt
Large Language Model LLM Inference Codebook Learning Priority User Virtual ARM Kernel Optimization Multi Codebook
On the Generalization Ability of Machine-Generated Text Detectors
Yule Liu, Zhiyuan Zhong, Yifan Liao, Zhen Sun, Jingyi Zheng, Jiaheng Wei, Qingyuan Gong, Fenghua Tong, Yang Chen, Yang Zhang, Xinlei He
Large Language Model Machine Generated Machine Generated Text Human Written Text

December 22, 2024

Better Think with Tables: Leveraging Tables to Enhance Large Language Model Comprehension
Jio Oh, Geon Heo, Seungjun Oh, Jindong Wang, Xing Xie, Steven Euijong Whang
Large Language Model Table Semantics Structured Document Complex Query Model Understanding Intermediate Language
Hate Speech Detection and Target Identification in Devanagari Languages via Parameter Efficient Fine-Tuning of LLMs
Rushendra Sidibomma, Pransh Patwa, Parth Patwa, Aman Chadha, Vinija Jain, Amitava Das
Large Language Model Parameter Efficient Fine Tuning Hate Speech Hate Speech Detection Hindi English Target Identification Indic Script
DreamOmni: Unified Image Generation and Editing
Bin Xia, Yuechen Zhang, Jingyao Li, Chengyao Wang, Yitong Wang, Xinglong Wu, Bei Yu, Jiaya Jia
Large Language Model Image Generation Human Editing Synthetic Data Generation Pipeline
Analysis on LLMs Performance for Code Summarization
Md. Ahnaf Akib, Md. Muktadir Mazumder, Salman Ahsan
Large Language Model General Analysis Open Source Large Language Model Source Code Code Summarization Recent Large Language Model
The HalluRAG Dataset: Detecting Closed-Domain Hallucinations in RAG Applications Using an LLM's Internal States
Fabian Ridder, Malte Schilling
Large Language Model Financial Application Stronger Generalizability Internal State Model Hallucination Type II Hallucination Kg Rag
DR-Encoder: Encode Low-rank Gradients with Random Prior for Large Language Models Differentially Privately
Huiwen Wu, Deyi Zhang, Xiaohan Li, Xiaogang Xu, Jiafei Wu, Zhe Liu
Large Language Model Language Model Differential Privacy Low Rank Encoder Side Data Encoding Differential Privacy Guarantee Numerical Parameter Prior
MINTQA: A Multi-Hop Question Answering Benchmark for Evaluating LLMs on New and Tail Knowledge
Jie He, Nan Hu, Wanqiu Long, Jiaoyan Chen, Jeff Z. Pan
Large Language Model Question Generation Multi Hop Reasoning Multi Hop Question Answering Multi Hop Query
Online Preference-based Reinforcement Learning with Self-augmented Feedback from Large Language Model
Songjun Tu, Jingbo Sun, Qichao Zhang, Xiangyuan Lan, Dongbin Zhao
Large Language Model Language Model Reinforcement Learning Human Feedback Preference Feedback LLM Generated Online Service
Teaching LLMs to Refine with Tools
Dian Yu, Yuheng Zhang, Jiahao Xu, Tian Liang, Linfeng Song, Zhaopeng Tu, Haitao Mi, Dong Yu
Large Language Model Chain of Thought Iterative Refinement Efficient Inference Easy Tool
Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions
Hang Li, Tianlong Xu, Kaiqi Yang, Yucheng Chu, Yanling Chen, Yichi Song, Qingsong Wen, Hui Liu
Large Language Model Error Detection Math Word Problem Conformity Bias

December 21, 2024

Argumentation Computation with Large Language Models : A Benchmark Study
Zhaoqun Li, Xiaotong Fang, Chen Chen, Mengze Li, Beishui Liao
Large Language Model Benchmark Study Argumentation Framework Computational Argumentation Explanation Capability
Lillama: Large Language Models Compression via Low-Rank Feature Distillation
Yaya Sy, Christophe Cerisara, Irina Illina
Large Language Model Pruning Method Weight Matrix Feature Distillation Gradient Update
The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agents
Feiran Jia, Tong Wu, Xin Qin, Anna Squicciarini
Large Language Model Safe Agent Prompt Injection Conversational Assistant Task Alignment Shield Machine Test Time Defense
Internalized Self-Correction for Large Language Models
Nishanth Upadhyaya, Raghavendra Sridharamurthy
Large Language Model Self Correction Supervised Learning Problem
TimeRAG: BOOSTING LLM Time Series Forecasting via Retrieval-Augmented Generation
Silin Yang, Dong Wang, Haoqi Zheng, Ruochun Jin
Large Language Model Time Series Retrieval Augmented Generation Faithful Generation Time Series Forecasting LLM Based Dynamic Time Warping
Large Language Model Can Be a Foundation for Hidden Rationale-Based Retrieval
Luo Ji, Feixiang Guo, Teng Chen, Qingqing Gu, Xiaoyu Wang, Ningyuan Xi, Yihong Wang, Peng Yu, Yue Zhao, Hongyang Lei, Zhonglin Jiang, Yong Chen
Large Language Model Retrieval Augmented Generation App to App Retrieval Flawed Foundation Hidden Knowledge Retrieval Task Retrieval Augmented Lm

Large Language Model

Papers

LLM4AD: A Platform for Algorithm Design with Large Language Model

EM-MIAs: Enhancing Membership Inference Attacks in Large Language Models through Ensemble Modeling

Highly Optimized Kernels and Fine-Grained Codebooks for LLM Inference on Arm CPUs

On the Generalization Ability of Machine-Generated Text Detectors

Better Think with Tables: Leveraging Tables to Enhance Large Language Model Comprehension

Hate Speech Detection and Target Identification in Devanagari Languages via Parameter Efficient Fine-Tuning of LLMs

DreamOmni: Unified Image Generation and Editing

Analysis on LLMs Performance for Code Summarization

The HalluRAG Dataset: Detecting Closed-Domain Hallucinations in RAG Applications Using an LLM's Internal States

DR-Encoder: Encode Low-rank Gradients with Random Prior for Large Language Models Differentially Privately

MINTQA: A Multi-Hop Question Answering Benchmark for Evaluating LLMs on New and Tail Knowledge

Online Preference-based Reinforcement Learning with Self-augmented Feedback from Large Language Model

Teaching LLMs to Refine with Tools

Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions

Argumentation Computation with Large Language Models : A Benchmark Study

Lillama: Large Language Models Compression via Low-Rank Feature Distillation

The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agents

Internalized Self-Correction for Large Language Models

TimeRAG: BOOSTING LLM Time Series Forecasting via Retrieval-Augmented Generation

Large Language Model Can Be a Foundation for Hidden Rationale-Based Retrieval