Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

December 5, 2024

FlashSloth: Lightning Multimodal Large Language Models via Embedded Visual Compression
Bo Tong, Bokai Lai, Yiyi Zhou, Gen Luo, Yunhang Shen, Ke Li, Xiaoshuai Sun, Rongrong Ji
Large Language Model Multimodal Large Language Model TinyML Model Visual Token Multimodal Capability
Densing Law of LLMs
Chaojun Xiao, Jie Cai, Weilin Zhao, Guoyang Zeng, Xu Han, Zhiyuan Liu, Maosong Sun
Large Language Model Open Source Large Language Model Particle Density Effective Parameter
ALMA: Alignment with Minimal Annotation
Michihiro Yasunaga, Leonid Shamis, Chunting Zhou, Andrew Cohen, Jason Weston, Luke Zettlemoyer, Marjan Ghazvininejad
Large Language Model Alignment Problem Selective Annotation Large Scale Learning Response Generation Model
Evolutionary Pre-Prompt Optimization for Mathematical Reasoning
Mathurin Videau, Alessandro Leite, Marc Schoenauer, Olivier Teytaud
Large Language Model Shot Learning Chain of Thought Mathematical Reasoning Complex Reasoning Task Prompt Optimization
AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic
Nathaniel R. Robinson, Shahd Abdelmoneim, Kelly Marchisio, Sebastian Ruder
Large Language Model LLM Performance Language Technology Accuracy Measurement Dialect Speaker
Leveraging Large Language Models to Generate Course-specific Semantically Annotated Learning Objects
Dominic Lohr, Marc Berges, Abhishek Chugh, Michael Kohlhase, Dennis Müller
Large Language Model Generative Language Model Question Generation Semantic Annotation Learner Model Learning Resource
Monet: Mixture of Monosemantic Experts for Transformers
Jungwoo Park, Young Jin Ahn, Kee-Eung Kim, Jaewoo Kang
Large Language Model Transformer Megatron Decepticons Mixture Component Mechanistic Interpretability Sparse Autoencoders Revisit Monosemanticity
Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models
Yuhao Wang, Junwei Pan, Xiangyu Zhao, Pengyue Jia, Wanyu Wang, Yuan Wang, Yue Liu, Dapeng Liu, Jie Jiang
Large Language Model Sequential Recommendation Text Embeddings Recommendation Model LD Align Disentangle Content
Guidance is All You Need: Temperature-Guided Reasoning in Large Language Models
Eyad Gomaa, Gomaa Salah
Large Language Model Full Model Complex Reasoning Reasoning Capability Large Language Reasoning Path Human Guidance AI Reasoning
Practical Considerations for Agentic LLM Systems
Chris Sypherd, Vaishak Belle
Large Language Model LLM Based LLM Agent
LossAgent: Towards Any Optimization Objectives for Image Processing with LLM Agents
Bingchen Li, Xin Li, Yiting Lu, Zhibo Chen
Large Language Model Loss Function Image Processing Optimization Objective
MTMT: Consolidating Multiple Thinking Modes to Form a Thought Tree for Strengthening LLM
Changcheng Li, Xiangyu Wang, Qiuju Chen, Xiren Zhou, Huanhuan Chen
Large Language Model Medical LLM Higher Order Multi Step Tree of Thought Dual Thinking
Chain-of-Thought in Large Language Models: Decoding, Projection, and Activation
Hao Yang, Qianghua Zhao, Lei Li
Large Language Model Complex Reasoning Chain of Thought Targeted Activation Penalty Accurate Decoding Projection Bias Knowledge Retrieval Logistic Model
A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarios
Xiachong Feng, Longxu Dou, Ella Li, Qinghao Wang, Haochuan Wang, Yu Guo, Chang Ma, Lingpeng Kong
Large Language Model Timely Survey Game Theoretic Large Language Multi Scenario Model Based Agent Communication Game Social Agent
Uniform Discretized Integrated Gradients: An effective attribution based method for explaining large language models
Swarnava Sinha Roy, Ayan Kundu
Large Language Model Practical Method Gradient Computation Fine Tuned BERT Attribution Score Integrated Gradient
Beyond the Binary: Capturing Diverse Preferences With Reward Regularization
Vishakh Padmakumar, Chuanyang Jin, Hannah Rose Kirk, He He
Large Language Model Reward Report Binary Code Preference Datasets Synthetic Preference Preference Fine Tuning Preference Aggregation Interest Preference

December 4, 2024

Prompting Large Language Models for Clinical Temporal Relation Extraction
Jianping He, Laila Rasmy, Haifang Li, Jianfu Li, Zenan Sun, Evan Yu, Degui Zhi, Cui Tao
Large Language Model Process Extraction Temporal Relation
A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
Gabriel Lino Garcia, João Renato Ribeiro Manesco, Pedro Henrique Paiola, Lucas Miranda, Maria Paola de Salvo, João Paulo Papa
Large Language Model Narrative Review Medical Text Biomedical Research Scientific Information Extraction Evidence Synthesis
Chatting with Logs: An exploratory study on Finetuning LLMs for LogQL
Vishwanath Seshagiri, Siddharth Balyan, Vaastav Anand, Kaustubh Dhole, Ishan Sharma, Avani Wildani, José Cambronero, Andreas Züfle
Large Language Model Exploratory Study Log Message Query Language
Alignment at Pre-training! Towards Native Alignment for Arabic LLMs
Juhao Liang, Zhenyang Cai, Jianqing Zhu, Huang Huang, Kewei Zong, Bang An, Mosen Alharthi, Juncai He, Lian Zhang, Haizhou Li, Benyou Wang, Jinchao Xu
Large Language Model Language Model Alignment Problem Better Alignment Arabic LLM

Large Language Model

Papers

FlashSloth: Lightning Multimodal Large Language Models via Embedded Visual Compression

Densing Law of LLMs

ALMA: Alignment with Minimal Annotation

Evolutionary Pre-Prompt Optimization for Mathematical Reasoning

AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic

Leveraging Large Language Models to Generate Course-specific Semantically Annotated Learning Objects

Monet: Mixture of Monosemantic Experts for Transformers

Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models

Guidance is All You Need: Temperature-Guided Reasoning in Large Language Models

Practical Considerations for Agentic LLM Systems

LossAgent: Towards Any Optimization Objectives for Image Processing with LLM Agents

MTMT: Consolidating Multiple Thinking Modes to Form a Thought Tree for Strengthening LLM

Chain-of-Thought in Large Language Models: Decoding, Projection, and Activation

A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarios

Uniform Discretized Integrated Gradients: An effective attribution based method for explaining large language models

Beyond the Binary: Capturing Diverse Preferences With Reward Regularization

Prompting Large Language Models for Clinical Temporal Relation Extraction

A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences

Chatting with Logs: An exploratory study on Finetuning LLMs for LogQL

Alignment at Pre-training! Towards Native Alignment for Arabic LLMs