Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

October 7, 2024

SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe
Yuxin Xiao, Shujian Zhang, Wenxuan Zhou, Marzyeh Ghassemi, Sanqiang Zhao
Large Language Model Spatio Temporal Mixup Mechanism Instruction Response Pair
LLMs Are In-Context Reinforcement Learners
Giovanni Monea, Antoine Bosselut, Kianté Brantley, Yoav Artzi
Large Language Model Reinforcement Learning
ChatVis: Automating Scientific Visualization with a Large Language Model
Tanwi Mallick, Orcun Yildiz, David Lenz, Tom Peterka
Large Language Model Language Model Natural Language Iterative Interaction Scientific Visualization
Precise Model Benchmarking with Only a Few Observations
Riccardo Fogliato, Pratik Patil, Nil-Jana Akpinar, Mathew Monfort
Large Language Model Question Answering Empirical Bayes Model Benchmark
Density estimation with LLMs: a geometric investigation of in-context learning trajectories
Toni J.B. Liu, Nicolas Boullé, Raphaël Sarfati, Christopher J. Earls
Large Language Model Geometric Analysis Density Estimation Handwritten Trajectory Different Context Kernel Density
Enhancing Equity in Large Language Models for Medical Applications
Yuelyu Ji, Wenhe Ma, Sonish Sivarajkumar, Hang Zhang, Eugene Mathew Sadhu, Zhuochun Li, Xizhi Wu, Shyam Visweswaran, Yanshan Wang
Large Language Model Bias Detection Medical Application Equity Context Health Equity Clinical Trial Matching
Efficient Inference for Large Language Model-based Generative Recommendation
Xinyu Lin, Chaoqun Yang, Wenjie Wang, Yongqi Li, Cunxiao Du, Fuli Feng, See-Kiong Ng, Tat-Seng Chua
Large Language Model Large Language Efficient Inference Speculative Decoding Generative Recommendation
Falcon Mamba: The First Competitive Attention-free 7B Language Model
Jingwei Zuo, Maksim Velikanov, Dhia Eddine Rhaiem, Ilyas Chahed, Younes Belkada, Guillaume Kunsch, Hakim Hacid
Large Language Model Long Sequence Mamba in Mamba Mamba Based Model Hybrid Transformer Mamba
Investigating large language models for their competence in extracting grammatically sound sentences from transcribed noisy utterances
Alina Wróblewska
Large Language Model Language Understanding Analogical Reasoning Textual Representation Competency Assessment
Explanation sensitivity to the randomness of large language models: the case of journalistic text classification
Jeremie Bogaert, Marie-Catherine de Marneffe, Antonin Descampe, Louis Escouflaire, Cedrick Fairon, Francois-Xavier Standaert
Large Language Model High Explainability Case Relevance Inherent Randomness Explainability Problem Composite Variable Construction Stable Explanation Headline Classification
TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
Lijie Yang, Zhihao Zhang, Zhuofu Chen, Zikun Li, Zhihao Jia
Large Language Model Long Context Sparse Attention LLM Accuracy
Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes
Kosuke Nishida, Kyosuke Nishida, Kuniko Saito
Large Language Model Transformer Model New Initialization Transformer Decoder Reparameterization Method Loss Spike
In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristics
Niki van Stein, Diederick Vermetten, Thomas Bäck
Large Language Model Simple Heuristic Hyper Parameter Optimization Automated Design User in the Loop
Can LLMs plan paths with extra hints from solvers?
Erik Wu, Sayan Mitra
Large Language Model Natural Language Processing Root to Leaf Path Automatic Solver Robot Planning Long Horizon Planning Natural Language Hint
FAME: Towards Factual Multi-Task Model Editing
Li Zeng, Yingyu Shan, Zeming Liu, Jiashu Yao, Yuhang Guo
Large Language Model Model Editing
Leverage Knowledge Graph and Large Language Model for Law Article Recommendation: A Case Study of Chinese Criminal Law
Yongming Chen, Miner Chen, Ye Zhu, Juan Pei, Siyu Chen, Yu Zhou, Yi Wang, Yifan Zhou, Hao Li, Songan Zhang
Large Language Model Knowledge Graph Case Study Legal Case Retrieval Chinese Legal Domain
Intent Classification for Bank Chatbots through LLM Fine-Tuning
Bibiána Lajčinová, Patrik Valábek, Michal Spišiak
Large Language Model Chatbot Response Generative Language Model LLM Fine Tuning Intent Classification
SoK: Towards Security and Safety of Edge AI
Tatjana Wingarz, Anne Lauscher, Janick Edinger, Dominik Kaaser, Stefan Schulte, Mathias Fischer
Large Language Model Human SAFETY Security Related Edge AI AI Application Decentralized Manner Safety Risk
Strong Model Collapse
Elvis Dohmatob, Yunzhen Feng, Julia Kempe
Large Language Model Neural Network Model Collapse
MINER: Mining the Underlying Pattern of Modality-Specific Neurons in Multimodal Large Language Models
Kaichen Huang, Jiahao Huo, Yibo Yan, Kun Wang, Yutao Yue, Xuming Hu
Large Language Model Multimodal Large Language Model Neuron Level

Large Language Model

Papers

SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe

LLMs Are In-Context Reinforcement Learners

ChatVis: Automating Scientific Visualization with a Large Language Model

Precise Model Benchmarking with Only a Few Observations

Density estimation with LLMs: a geometric investigation of in-context learning trajectories

Enhancing Equity in Large Language Models for Medical Applications

Efficient Inference for Large Language Model-based Generative Recommendation

Falcon Mamba: The First Competitive Attention-free 7B Language Model

Investigating large language models for their competence in extracting grammatically sound sentences from transcribed noisy utterances

Explanation sensitivity to the randomness of large language models: the case of journalistic text classification

TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention

Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes

In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristics

Can LLMs plan paths with extra hints from solvers?

FAME: Towards Factual Multi-Task Model Editing

Leverage Knowledge Graph and Large Language Model for Law Article Recommendation: A Case Study of Chinese Criminal Law

Intent Classification for Bank Chatbots through LLM Fine-Tuning

SoK: Towards Security and Safety of Edge AI

Strong Model Collapse

MINER: Mining the Underlying Pattern of Modality-Specific Neurons in Multimodal Large Language Models