Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

November 6, 2024

Number Cookbook: Number Understanding of Language Models and How to Improve It
Haotong Yang, Yi Hu, Shijia Kang, Zhouchen Lin, Muhan Zhang
Large Language Model Language Model Reasoning Task Numerical Data Numerical Result Numerical Representation
Deploying Multi-task Online Server with Large Language Model
Yincen Qu, Chao Ma, Yiting Wu, Xiangying Dai, Hui Zhou, Hengyue Liu
Large Language Model Language Model Multi Task Aware Filter Multi Server

November 5, 2024

AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution
Zhiqiang Xie, Hao Kang, Ying Sheng, Tushar Krishna, Kayvon Fatahalian, Christos Kozyrakis
Large Language Model LLM Agent Large Language Agent Based Parallel Simulation AI City Challenge Multi Agent Simulation
MetRex: A Benchmark for Verilog Code Metric Reasoning Using LLMs
Manar Abdelatty, Jingxiao Ma, Sherief Reda
Large Language Model New Benchmark Verilog Code Generation Abstraction Based VHDL Code
Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment
Alexander Goldberg, Ihsan Ullah, Thanh Gia Hieu Khuong, Benedictus Kent Rachmat, Zhen Xu, Isabelle Guyon, Nihar B. Shah
Large Language Model Peer Review Scientific Literature UniUD FBK UB UniBZ Submission Short Paper Automatic Usefulness Prediction Paper Submission
LLMs for Domain Generation Algorithm Detection
Reynier Leyva La O, Carlos A. Catania, Tatiana Parlanti
Large Language Model Domain Specific Domain Generation Algorithm
VERITAS: A Unified Approach to Reliability Evaluation
Rajkumar Ramamurthy, Meghana Arakkal Rajeev, Oliver Molenschot, James Zou, Nazneen Rajani
Large Language Model Unified Framework Hallucination Detection Reliability Evaluation Fact Checking Model
SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agents
Dawei Li, Zhen Tan, Peijia Qian, Yifan Li, Kumar Satvik Chaudhary, Lijie Hu, Jiayi Shen
Large Language Model Many Sparse Multiple Agent
DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models
Ying Zhou, Xinyao Wang, Yulei Niu, Yaojie Shen, Lexin Tang, Fan Chen, Ben He, Le Sun, Longyin Wen
Large Language Model Full Model Variational Autoencoder Latent Representation Synthetic Data Generation Latent Variable
Leveraging Large Language Models in Code Question Answering: Baselines and Issues
Georgy Andryushchenko, Vladimir Ivanov, Vladimir Makharev, Elizaveta Tukhtina, Aidar Valeev
Large Language Model Question Answering Source Code Baseline Result Proper Issue Labeling Community Question Answering
Controlling for Unobserved Confounding with Large Language Model Classification of Patient Smoking Status
Samuel Lee, Zach Wood-Doughty
Large Language Model Classification Code Causal Inference Causal Effect Unobserved Confounders Causal Interpretation Unmeasured Confounding Unobservable State
Growing a Tail: Increasing Output Diversity in Large Language Models
Michal Shur-Ofry, Bar Horowitz-Amsalem, Adir Rahamim, Yonatan Belinkov
Large Language Model Diversity Awareness Thin Tail Effective Generation Diverse Perspective
Photon: Federated LLM Pre-Training
Lorenzo Sani, Alex Iacob, Zeyu Cao, Royson Lee, Bill Marino, Yan Gao, Dongqi Cai, Zexi Li, Wanru Zhao, Xinchi Qiu, Nicholas D. Lane
Large Language Model Decoder Only Large Language Model Single Photon Large Scale Training Federated Training Particle Photon
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection
Wei Wu, Zhuoshi Pan, Chao Wang, Liyi Chen, Yunchu Bai, Kun Fu, Zheng Wang, Hui Xiong
Large Language Model Long Context KV Cache Length Extrapolation Token Selection
Graph-DPEP: Decomposed Plug and Ensemble Play for Few-Shot Document Relation Extraction with Graph-of-Thoughts Reasoning
Tao Zhang, Ning Yan, Masood Mortazavi, Hoang H. Nguyen, Zhongfen Deng, Philip S. Yu
Large Language Model Relation Extraction Diverse Ensemble Microbial Decomposition Document Level Relation Extraction Generative LLM Tree of Thought Full Length Document
CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaboration
Hongpeng Jin, Yanzhao Wu
Large Language Model LLM Inference Edge Cloud Collaboration
Language Models and Cycle Consistency for Self-Reflective Machine Translation
Jianqiao Wangni
Large Language Model Language Model Machine Translation View Translation Cycle Consistency LLM Based Machine Translation Translation Based

November 4, 2024

Fair In-Context Learning via Latent Concept Variables
Karuna Bhaila, Minh-Hao Van, Kennedy Edemacu, Chen Zhao, Feng Chen, Xintao Wu
Large Language Model Context Learning Latent Variable Fairness Regularization Latent Category
Zebra-Llama: A Context-Aware Large Language Model for Democratizing Rare Disease Knowledge
Karthik Soman, Andrew Langdon, Catalina Villouta, Chinmay Agrawal, Lashaw Salta, Braian Peetoom, Gianmarco Bellucci, Orion J Buske
Large Language Model Language Model Retrieval Augmented Whispering Llama Rare Disease Contextualized Language Model
TeleOracle: Fine-Tuned Retrieval-Augmented Generation with Long-Context Support for Network
Nouf Alabbasi, Omar Erak, Omar Alhussein, Ismail Lotfi, Sami Muhaidat, Merouane Debbah
Large Language Model Language Model Retrieval Augmented Generation Network Programming Long Context Semantic Search

Large Language Model

Papers

Number Cookbook: Number Understanding of Language Models and How to Improve It

Deploying Multi-task Online Server with Large Language Model

AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution

MetRex: A Benchmark for Verilog Code Metric Reasoning Using LLMs

Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment

LLMs for Domain Generation Algorithm Detection

VERITAS: A Unified Approach to Reliability Evaluation

SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agents

DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models

Leveraging Large Language Models in Code Question Answering: Baselines and Issues

Controlling for Unobserved Confounding with Large Language Model Classification of Patient Smoking Status

Growing a Tail: Increasing Output Diversity in Large Language Models

Photon: Federated LLM Pre-Training

TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection

Graph-DPEP: Decomposed Plug and Ensemble Play for Few-Shot Document Relation Extraction with Graph-of-Thoughts Reasoning

CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaboration

Language Models and Cycle Consistency for Self-Reflective Machine Translation

Fair In-Context Learning via Latent Concept Variables

Zebra-Llama: A Context-Aware Large Language Model for Democratizing Rare Disease Knowledge

TeleOracle: Fine-Tuned Retrieval-Augmented Generation with Long-Context Support for Network