Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

December 6, 2024

QueEn: A Large Language Model for Quechua-English Translation
Junhao Chen, Peng Shu, Yiwei Li, Huaqin Zhao, Hanqi Jiang, Yi Pan, Yifan Zhou, Zhengliang Liu, Lewis C Howe, Tianming Liu
Large Language Model Natural Language Retrieval Augmented Generation Low Resource Linguistic Resource Quechua Language
A Practical Examination of AI-Generated Text Detectors for Large Language Models
Brian Tufts, Xuandong Zhao, Lei Li
Large Language Model Language Model Adversarial Attack Data Detection Exam Document Text Detector Content Recognition
The Prompt Canvas: A Literature-Based Practitioner Guide for Creating Effective Prompts in Large Language Models
Michael Hewing, Vincent Leinhos
Large Language Model Prompt Engineering Style PROMPT Structured Explanation Image Prompt Role Based
Flash Communication: Reducing Tensor Parallelization Bottleneck for Fast Large Language Model Inference
Qingyuan Li, Bo Zhang, Liang Ye, Yifan Zhang, Wei Wu, Yerui Sun, Lin Ma, Yuchen Xie
Large Language Model Fast Inference Large Language Model Inference Level Parallelism Tensor Parallelism
C$^2$LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation
Yanyang Li, Tin Long Wong, Cheung To Hung, Jianqiao Zhao, Duo Zheng, Ka Wai Liu, Michael R. Lyu, Liwei Wang
Large Language Model Language Model Global Evaluation Evaluation Benchmark Large Scale Evaluation Free Task
Rethinking Time Series Forecasting with LLMs via Nearest Neighbor Contrastive Learning
Jayanie Bogahawatte, Sachith Seneviratne, Maneesha Perera, Saman Halgamuge
Large Language Model Contrastive Learning Time Series Forecasting Nearest Neighbor Positional Embeddings Short Term Forecasting Nearest Neighbor Contrastive Learning Shot Forecasting
GUIDE: A Global Unified Inference Engine for Deploying Large Language Models in Heterogeneous Environments
Yanyu Chen, Ganhong Huang
Large Language Model Full Model LLM Inference Large Language Inference Framework Heterogeneous Environment Performance Bottleneck Device Heterogeneity
Foundation Models for Low-Resource Language Education (Vision Paper)
Zhaojun Ding, Zhengliang Liu, Hanqi Jiang, Yizhu Gao, Xiaoming Zhai, Tianming Liu, Ninghao Liu
Large Language Model Foundation Model Natural Language Vision Paper Low Resource Language Multilingual Model Low Resourced Language Collective Learning
Ltri-LLM: Streaming Long Context Inference for LLMs with Training-Free Dynamic Triangular Attention Pattern
Hongyin Tang, Di Xiu, Lanrui Wang, Xiurui Geng, Jingang Wang, Xunliang Cai
Large Language Model Long Context Sparse Attention Text Benchmark Streaming Inference LLM dCache
BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English
Dipankar Srirag, Aditya Joshi, Jordan Painter, Diptesh Kanojia
Large Language Model New Benchmark Multilingual Model MAESTRO Dataset Implicit Sentiment Sarcasm Detection Wide Variety
Transformers Struggle to Learn to Search
Abulhair Saparov, Srushti Pawar, Shreyas Pimpalgaonkar, Nitish Joshi, Richard Yuanzhe Pang, Vishakh Padmakumar, Seyed Mehran Kazemi, Najoung Kim, He He
Large Language Model Transformer Megatron Decepticons Transformer Based Efficient Search Graph Connectivity
Privacy-Preserving Retrieval Augmented Generation with Differential Privacy
Tatsuki Koga, Ruihan Wu, Kamalika Chaudhuri
Large Language Model Differential Privacy Retrieval Augmented Generation Privacy Policy Sensitive Data Privacy Budget Differential Analysis Protecting Privacy
Smoothie: Label Free Language Model Routing
Neel Guha, Mayee F. Chen, Trevor Chow, Ishan S. Khare, Christopher Ré
Large Language Model Ground Truth FRUIT Produce SMOOTHIE

December 5, 2024

Improving LLM Group Fairness on Tabular Data via In-Context Learning
Valeriia Cherepanova, Chia-Jung Lee, Nil-Jana Akpinar, Riccardo Fogliato, Martin Andres Bertran, Michael Kearns, James Zou
Large Language Model Context Learning Tabular Data Group Fairness Prompt Optimization Debiasing Method Structure Fairness
Give me Some Hard Questions: Synthetic Data Generation for Clinical QA
Fan Bai, Keith Harrigian, Joel Stremmel, Hamid Hassanzadeh, Ardavan Saeedi, Mark Dredze
Large Language Model Synthetic Data Generation Question Generation Medical Question Answering Complex Question Medical Question Answering System
EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios
Lu Qiu, Yuying Ge, Yi Chen, Yixiao Ge, Ying Shan, Xihui Liu
Large Language Model Language Model New Benchmark Multimodal Large Language Model Real World Scenario Real World Planning Planning Perspective
Understanding Hidden Computations in Chain-of-Thought Reasoning
Aryasomayajula Ram Bharadwaj
Large Language Model Transformer Model Chain of Thought Complex Reasoning Task Privacy Preserving Computation
Retrieval-Augmented Machine Translation with Unstructured Knowledge
Jiaan Wang, Fandong Meng, Yingxue Zhang, Jie Zhou
Large Language Model Machine Translation Retrieval Augmented Generation Unstructured Data
Liquid: Language Models are Scalable Multi-modal Generators
Junfeng Wu, Yi Jiang, Chuofan Ma, Yuliang Liu, Hengshuang Zhao, Zehuan Yuan, Song Bai, Xiang Bai
Large Language Model Language Model Image Generation Visual Understanding Vision Language Understanding Multi Modal Generation Liquid State Multimodal Generation Capability
The Hyperfitting Phenomenon: Sharpening and Stabilizing LLMs for Open-Ended Text Generation
Fredrik Carlsson, Fangyu Liu, Daniel Ward, Murathan Kurfali, Joakim Nivre
Large Language Model Model Overfitting Pre Trained Large Language Model Generative Capability Open Ended Text Generation Generalization Characteristic

Large Language Model

Papers

QueEn: A Large Language Model for Quechua-English Translation

A Practical Examination of AI-Generated Text Detectors for Large Language Models

The Prompt Canvas: A Literature-Based Practitioner Guide for Creating Effective Prompts in Large Language Models

Flash Communication: Reducing Tensor Parallelization Bottleneck for Fast Large Language Model Inference

C$^2$LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation

Rethinking Time Series Forecasting with LLMs via Nearest Neighbor Contrastive Learning

GUIDE: A Global Unified Inference Engine for Deploying Large Language Models in Heterogeneous Environments

Foundation Models for Low-Resource Language Education (Vision Paper)

Ltri-LLM: Streaming Long Context Inference for LLMs with Training-Free Dynamic Triangular Attention Pattern

BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English

Transformers Struggle to Learn to Search

Privacy-Preserving Retrieval Augmented Generation with Differential Privacy

Smoothie: Label Free Language Model Routing

Improving LLM Group Fairness on Tabular Data via In-Context Learning

Give me Some Hard Questions: Synthetic Data Generation for Clinical QA

EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios

Understanding Hidden Computations in Chain-of-Thought Reasoning

Retrieval-Augmented Machine Translation with Unstructured Knowledge

Liquid: Language Models are Scalable Multi-modal Generators

The Hyperfitting Phenomenon: Sharpening and Stabilizing LLMs for Open-Ended Text Generation