Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

October 2, 2024

Long-range gene expression prediction with token alignment of large language model
Edouardo Honig, Huixin Zhan, Ying Nian Wu, Zijun Frank Zhang
Large Language Model Token Level Gene Expression Prediction Token Alignment
Towards Inference-time Category-wise Safety Steering for Large Language Models
Amrita Bhattacharjee, Shaona Ghosh, Traian Rebedea, Christopher Parisien
Large Language Model Steering Vector Representation Engineering
BordIRlines: A Dataset for Evaluating Cross-lingual Retrieval-Augmented Generation
Bryan Li, Samar Haider, Fiona Luo, Adwait Agashe, Chris Callison-Burch
Large Language Model Data Set Context Learning Multiple Language
Efficient Streaming LLM for Speech Recognition
Junteng Jia, Gil Keren, Wei Zhou, Egor Lakomkin, Xiaohui Zhang, Chunyang Wu, Frank Seide, Jay Mahadeokar, Ozlem Kalinli
Large Language Model Speech Recognition Resource Intensive LLM
Explain Like I'm Five: Using LLMs to Improve PDE Surrogate Models with Text
Cooper Lorsung, Amir Barati Farimani
Large Language Model Text Modality Partial Differential Equation Multimodal Machine Learning Neural PDE Numerical Solution

October 1, 2024

Mixing It Up: The Cocktail Effect of Multi-Task Fine-Tuning on LLM Performance -- A Case Study in Finance
Meni Brief, Oded Ovadia, Gil Shenderovitz, Noga Ben Yoash, Rachel Lemberg, Eitam Sheetrit
Large Language Model Case Study LLM Performance Domain Specific Large Language Model Multi Task Fine Tuning
SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models
Juan Pablo Muñoz, Jinjie Yuan, Nilesh Jain
Large Language Model Foundation Model Parameter Efficient Fine Tuning Large Pre Trained Model Efficient Model Adaptation Sparse Local Model
Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity
Michael R. Metel, Peng Lu, Boxing Chen, Mehdi Rezagholizadeh, Ivan Kobyzev
Large Language Model Black Box Optimization Speculative Decoding Fast Inference Cosine Similarity Speculative Exploration K$ Draft
LLMs May Not Be Human-Level Players, But They Can Be Testers: Measuring Game Difficulty with LLM Agents
Chang Xiao, Brenda Z. Yang
Large Language Model Autonomous Agent LLM Agent Strategy Game Game Testing Expertise Level Difficulty Measure
BabelBench: An Omni Benchmark for Code-Driven Analysis of Multimodal and Multistructured Data
Xuwu Wang, Qiwen Cui, Yunzhe Tao, Yiran Wang, Ziwei Chai, Xiaotian Han, Boyi Liu, Jianbo Yuan, Jing Su, Guoyin Wang, Tingkai Liu, Liyu Chen, Tianyi Liu, Tao Sun, Yufeng Zhang, Sirui Zheng, Quanzeng You, Yang Yang, Hongxia Yang
Large Language Model New Benchmark Visual Question Answering Multimodal Phenomenon Structured Data Multimodal Understanding Code Analysis
Empowering Large Language Model for Continual Video Question Answering with Collaborative Prompting
Chen Cai, Zheng Wang, Jianjun Gao, Wenyang Liu, Ye Lu, Runzhong Zhang, Kim-Hui Yap
Large Language Model Multiple Choice VideoQA Movie Dataset Continuous Video
Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation
Jiyoon Myung, Jihyeon Park, Jungki Son, Kyungro Lee, Joohyung Han
Large Language Model Generating Translation
Detección Automática de Patologías en Notas Clínicas en Español Combinando Modelos de Lenguaje y Ontologías Médicos
Léon-Paul Schaub Torre, Pelayo Quirós, Helena García Mieres
Large Language Model Medical Text BiOmedical Ontology Clinical Setting Dermatological Disease Diagnosis
ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Models
Mengxue Qu, Xiaodong Chen, Wu Liu, Alicia Li, Yao Zhao
Large Language Model Language Model Temporal Grounding E Chat Video Temporal Grounding
Self-Updatable Large Language Models with Parameter Integration
Yu Wang, Xinshuang Liu, Xiusi Chen, Sean O'Brien, Junda Wu, Julian McAuley
Large Language Model Knowledge Distillation Continual LEArning Customer Retention Conversational Recommendation System
Adversarial Suffixes May Be Features Too!
Wei Zhao, Zhe Li, Yige Li, Jun Sun
Large Language Model Feature Wise Adversarial Suffix Benign Data
LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management
Yi Xiong, Hao Wu, Changxu Shao, Ziqing Wang, Rui Zhang, Yuhong Guo, Junping Zhao, Ke Zhang, Zhenxuan Pan
Large Language Model Key Value Cache Parallelization Strategy Slow Motion Intact Adenovirus
Boosting the Capabilities of Compact Models in Low-Data Contexts with Large Language Models and Retrieval-Augmented Generation
Bhargav Shandilya, Alexis Palmer
Large Language Model Retrieval Augmented Generation Human Language Context Information Capability Evolution Linguistic Information Compact Model
Answer When Needed, Forget When Not: Language Models Pretend to Forget via In-Context Knowledge Unlearning
Shota Takashiro, Takeshi Kojima, Andrew Gambardella, Qi Cao, Yusuke Iwasawa, Yutaka Matsuo
Large Language Model Language Model Harmful Unlearning Top Two Answer Fine Tuned Large Language Model Contextual Knowledge Knowledge Unlearning
PclGPT: A Large Language Model for Patronizing and Condescending Language Detection
Hongbo Wang, Mingda Li, Junyu Lu, Hebin Xia, Liang Yang, Bo Xu, Ruizhu Liu, Hongfei Lin
Large Language Model Non Toxic Toxic Language Condescending Language

Large Language Model

Papers

Long-range gene expression prediction with token alignment of large language model

Towards Inference-time Category-wise Safety Steering for Large Language Models

BordIRlines: A Dataset for Evaluating Cross-lingual Retrieval-Augmented Generation

Efficient Streaming LLM for Speech Recognition

Explain Like I'm Five: Using LLMs to Improve PDE Surrogate Models with Text

Mixing It Up: The Cocktail Effect of Multi-Task Fine-Tuning on LLM Performance -- A Case Study in Finance

SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models

Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity

LLMs May Not Be Human-Level Players, But They Can Be Testers: Measuring Game Difficulty with LLM Agents

BabelBench: An Omni Benchmark for Code-Driven Analysis of Multimodal and Multistructured Data

Empowering Large Language Model for Continual Video Question Answering with Collaborative Prompting

Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translation

Detección Automática de Patologías en Notas Clínicas en Español Combinando Modelos de Lenguaje y Ontologías Médicos

ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Models

Self-Updatable Large Language Models with Parameter Integration

Adversarial Suffixes May Be Features Too!

LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management

Boosting the Capabilities of Compact Models in Low-Data Contexts with Large Language Models and Retrieval-Augmented Generation

Answer When Needed, Forget When Not: Language Models Pretend to Forget via In-Context Knowledge Unlearning

PclGPT: A Large Language Model for Patronizing and Condescending Language Detection