Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

December 2, 2024

Improved Large Language Model Jailbreak Detection via Pretrained Embeddings
Erick Galinkin, Martin Sablotny
Large Language Model Pre Trained Jina Embeddings Jailbreak Attack Large Relevance Improvement Text Embeddings LLM Safety Prompt Injection
Scaling Law for Language Models Training Considering Batch Size
Xian Shuai, Yiding Wang, Yimeng Wu, Xin Jiang, Xiaozhe Ren
Large Language Model Language Model Training Data Scaling Law Batch Size
Early Exit Is a Natural Capability in Transformer-based Models: An Empirical Study on Early Exit without Joint Optimization
Weiqiao Shan, Long Meng, Tong Zheng, Yingfeng Luo, Bei Li, junxin Wang, Tong Xiao, Jingbo Zhu
Large Language Model Empirical Study Transformer Based Model Joint Optimization Early eXit Early Exit Neural Network Auto Regressive Decoding Human Capability
Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledge
Yuhe Ji, Yilun Liu, Feiyu Yao, Minggui He, Shimin Tao, Xiaofeng Zhao, Su Chang, Xinhua Yang, Weibin Meng, Yuming Xie, Boxing Chen, Hao Yang
Large Language Model Natural Language Processing General Analysis Knowledge Based Open Source Large Language Model Domain Index
Understanding the World's Museums through Vision-Language Reasoning
Ada-Astrid Balauca, Sanjana Garai, Stefan Balauca, Rasesh Udayakumar Shetty, Naitik Agrawal, Dhwanil Subhashbhai Shah, Yuqian Fu, Xi Wang, Kristina Toutanova, Danda Pani Paudel, Luc Van Gool
Large Language Model Fine Grained Vision Language Large Vision Language Model World Event Vision Language Reasoning
The "LLM World of Words" English free association norms generated by large language models
Katherine Abramski, Riccardo Improta, Giulio Rossetti, Massimo Stella
Large Language Model Word List Implicit Bias Learning Norm Semantic Memory Semantic Association
RL2: Reinforce Large Language Model to Assist Safe Reinforcement Learning for Energy Management of Active Distribution Networks
Xu Yang, Chenhui Lin, Haotian Liu, Wenchuan Wu
Large Language Model LeArning Abstract Deep Reinforcement Learning Positive Reinforcement Power System Energy Management Penalty Method Active Distribution
CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search
Kaixin Wu, Yixin Ji, Zeyuan Chen, Qiang Wang, Cunxiang Wang, Hong Liu, Baijun Ji, Jia Xu, Zhongyi Liu, Jinjie Gu, Yuan Zhou, Linjian Mo
Large Language Model Natural Language Processing New Framework Context Learning Domain Knowledge Relative Relevance E Commerce Search Relevance Modeling Discriminative Region Adaptive Continual Learning
Do Large Language Models with Reasoning and Acting Meet the Needs of Task-Oriented Dialogue?
Michelle Elizabeth, Morgan Veyret, Miguel Couceiro, Ondrej Dusek, Lina M. Rojas-Barahona
Large Language Model Complex Reasoning Task Oriented Community Need Actor Loss
Best Practices for Large Language Models in Radiology
Christian Bluethgen, Dave Van Veen, Cyril Zakka, Katherine Link, Aaron Fanous, Roxana Daneshjou, Thomas Frauenfelder, Curtis Langlotz, Sergios Gatidis, Akshay Chaudhari
Large Language Model Best Practice Radiology Imaging Imaging Data
FD-LLM: Large Language Model for Fault Diagnosis of Machines
Hamzah A.A.M. Qaid, Bo Zhang, Dan Li, See-Kiong Ng, Wei Li
Large Language Model New Machine Open Source Large Language Model Intelligent Fault Diagnosis
MiningGPT -- A Domain-Specific Large Language Model for the Mining Industry
Kurukulasooriya Fernando ana Gianluca Demartini
Large Language Model Human Like Industry Assignment Mining Complex Generative LLM Domain Specific LLM
Enhancing Function-Calling Capabilities in LLMs: Strategies for Prompt Formats, Data Integration, and Multilingual Translation
Yi-Chang Chen, Po-Chun Hsu, Chan-Jan Hsu, Da-shan Shiu
Large Language Model Synthetic Data Style PROMPT Multilingual Translation Data Integration Textual Input Translation Pipeline Function Calling
Advancing Speech Language Models by Scaling Supervised Fine-Tuning with Over 60,000 Hours of Synthetic Speech Dialogue Data
Shuaijiang Zhao, Tingwei Guo, Bajian Xiang, Tongtang Wan, Qiang Niu, Wei Zou, Xiangang Li
Large Language Model Language Model Supervised Fine Tuning Temporal Data Speech Language Model Synthetic Conversational
Detecting Memorization in Large Language Models
Eduardo Slonski
Large Language Model Natural Language Processing Token Level Limited Memorization Activation Pattern Task Specific Memorization Measure

December 1, 2024

Competition Dynamics Shape Algorithmic Phases of In-Context Learning
Core Francisco Park, Ekdeep Singh Lubana, Itamar Pres, Hidenori Tanaka
Large Language Model Context Learning Markov Chain Competitive Algorithm Synthetic Source Domain
Linear Probe Penalties Reduce LLM Sycophancy
Henry Papadatos, Rachel Freedman
Large Language Model Reinforcement Learning LLM Generated Linear Probing RLHF V
LLMs as mirrors of societal moral standards: reflection of cultural divergence and agreement across ethical topics
Mijntje Meijer, Hadi Mohammadi, Ayoub Bagheri
Large Language Model Inverse Divergence Critical Reflection Cultural Bias Cultural Difference Ethical Discussion
Quantifying perturbation impacts for large language models
Paulius Rauba, Qiyao Wei, Mihaela van der Schaar
Large Language Model Distributional Assumption Small Perturbation Input Perturbation Tractable Probabilistic Inference
Large Language Models in Politics and Democracy: A Comprehensive Survey
Goshi Aoki
Large Language Model Generative AI Comprehensive Survey Political Discourse Political Event Political Communication Representative Democracy Online Modeling

Large Language Model

Papers

Improved Large Language Model Jailbreak Detection via Pretrained Embeddings

Scaling Law for Language Models Training Considering Batch Size

Early Exit Is a Natural Capability in Transformer-based Models: An Empirical Study on Early Exit without Joint Optimization

Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledge

Understanding the World's Museums through Vision-Language Reasoning

The "LLM World of Words" English free association norms generated by large language models

RL2: Reinforce Large Language Model to Assist Safe Reinforcement Learning for Energy Management of Active Distribution Networks

CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search

Do Large Language Models with Reasoning and Acting Meet the Needs of Task-Oriented Dialogue?

Best Practices for Large Language Models in Radiology

FD-LLM: Large Language Model for Fault Diagnosis of Machines

MiningGPT -- A Domain-Specific Large Language Model for the Mining Industry

Enhancing Function-Calling Capabilities in LLMs: Strategies for Prompt Formats, Data Integration, and Multilingual Translation

Advancing Speech Language Models by Scaling Supervised Fine-Tuning with Over 60,000 Hours of Synthetic Speech Dialogue Data

Detecting Memorization in Large Language Models

Competition Dynamics Shape Algorithmic Phases of In-Context Learning

Linear Probe Penalties Reduce LLM Sycophancy

LLMs as mirrors of societal moral standards: reflection of cultural divergence and agreement across ethical topics

Quantifying perturbation impacts for large language models

Large Language Models in Politics and Democracy: A Comprehensive Survey