Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

November 14, 2024

Approximated Variational Bayesian Inverse Reinforcement Learning for Large Language Model Alignment
Yuang Cai, Yuyu Yuan, Jinsheng Shi, Qinhong Lin
Large Language Model Imitation Learning Inverse Reinforcement Learning Large Language Model Alignment
StreamAdapter: Efficient Test Time Adaptation from Contextual Streams
Dilxat Muhtar, Yelong Shen, Yaming Yang, Xiaodong Liu, Yadong Lu, Jianfeng Liu, Yuefeng Zhan, Hao Sun, Weiwei Deng, Feng Sun, Xueliang Zhang, Jianfeng Gao, Weizhu Chen, Qi Zhang
Large Language Model Context Learning Test Time Adaptation Efficient Inference Inference Cost
Enhancing Financial Domain Adaptation of Language Models via Model Augmentation
Kota Tanabe, Masanori Hirano, Kazuki Matoya, Kentaro Imajo, Hiroki Sakaji, Itsuki Noda
Large Language Model Language Model Domain Adaptation Full Model Soft Augmentation Financial Domain Financial Dataset
HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on X
Aniket Deroy, Subhankar Maity
Large Language Model Hate Speech Offensive Content X Klaim English Tweet
Comprehensive and Practical Evaluation of Retrieval-Augmented Generation Systems for Medical Question Answering
Nghia Trung Ngo, Chien Van Nguyen, Franck Dernoncourt, Thien Huu Nguyen
Large Language Model Retrieval Augmented Generation System Description Medical Question Answering
P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs
Yidan Zhang, Boyi Deng, Yu Wan, Baosong Yang, Haoran Wei, Fei Huang, Bowen Yu, Junyang Lin, Fei Huang, Jingren Zhou
Large Language Model Natural Language Processing Global Evaluation Multilingual Model Strong Consistency Multilingual Capability Multi Task Benchmark
Reducing Reasoning Costs - The Path of Optimization for Chain of Thought via Sparse Attention Mechanism
Libo Wang
Large Language Model Optimization Purpose Attention Mechanism Side Chain Thought Reasoning Sparse Attention Inference Cost

November 13, 2024

Code-mixed LLM: Improve Large Language Models' Capability to Handle Code-Mixing through Reinforcement Learning from AI Feedback
Wenbo Zhang, Aditya Majumdar, Amulya Yadav
Large Language Model Reinforcement Learning Code Mixed Code Switched Code LLM AI Feedback Code Mixing
Cut Your Losses in Large-Vocabulary Language Models
Erik Wijmans, Brody Huval, Alexander Hertzberg, Vladlen Koltun, Philipp Krähenbühl
Large Language Model Cross Entropy Loss Cross Entropy Planning Loss
Lynx: Enabling Efficient MoE Inference through Dynamic Batch-Aware Expert Selection
Vima Gupta, Kartik Sinha, Ada Gavrilovska, Anand Padmanabha Iyer
Large Language Model Mixture of Expert Expert Selection
CoCoP: Enhancing Text Classification with LLM through Code Completion Prompt
Mohammad Mahdi Mohajeri, Mohammad Javad Dousti, Majid Nili Ahmadabadi
Large Language Model Natural Language Processing Medical LLM Text Classification Style PROMPT Code Completion
The Limited Impact of Medical Adaptation of Large Language and Vision-Language Models
Daniel P. Jeong, Pranav Mani, Saurabh Garg, Zachary C. Lipton, Michael Oberst
Large Language Model Vision Language Model Large Language Domain Specific Model Biomedical Corpus Medical Task Adaptation
XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL
Yingqi Gao, Yifu Liu, Xiaoxia Li, Xiaorong Shi, Yin Zhu, Yiming Wang, Shiqi Li, Wei Li, Yuntao Hong, Zhiling Luo, Jinyang Gao, Liyu Mou, Yu Li
Large Language Model Context Learning Entity Recognition Text to SQL
Leveraging LLMs for Predictive Insights in Food Policy and Behavioral Interventions
Micha Kaiser, Paul Lohmann, Peter Ochieng, Billy Shi, Cass R. Sunstein, Lucia A. Reisch
Large Language Model Medical LLM BEHAVIOR Explanation Health Intervention Food Security Policy Making
LogLLM: Log-based Anomaly Detection Using Large Language Models
Wei Guan, Jian Cao, Shiyou Qian, Jianqi Gao
Large Language Model Log Message Log Based Anomaly Detection Log Parser
CorrSynth -- A Correlated Sampling Method for Diverse Dataset Generation from LLMs
Suhas S Kowshik, Abhishek Divekar, Vijit Malik
Large Language Model Shot Prompting Data Synthesis Classifier Free Guidance Diverse Task
One STEP at a time: Language Agents are Stepwise Planners
Minh Nguyen, Ehsan Shareghi
Large Language Model Time Matter Dynamic Environment Language Agent Cross Over Step Complex Task
Quantifying Qualitative Insights: Leveraging LLMs to Market Predict
Hoyoung Lee, Youngsoo Choi, Yuhee Kwon
Large Language Model Key Factor Market Analysis Qualitative Methodology
Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach
Shangfeng Chen, Xiayang Shi, Pu Li, Yinlin Li, Jingjing Liu
Large Language Model Machine Translation Retrieval Augmented Generation Constructive Approach Imperfect Translation
R3HF: Reward Redistribution for Enhancing Reinforcement Learning from Human Feedback
Jiahui Li, Tai-wei Chang, Fengda Zhang, Kun Kuang, Long Chen
Large Language Model Reinforcement Learning Human Feedback Reward Prediction Reward Redistribution

Large Language Model

Papers

Approximated Variational Bayesian Inverse Reinforcement Learning for Large Language Model Alignment

StreamAdapter: Efficient Test Time Adaptation from Contextual Streams

Enhancing Financial Domain Adaptation of Language Models via Model Augmentation

HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on X

Comprehensive and Practical Evaluation of Retrieval-Augmented Generation Systems for Medical Question Answering

P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs

Reducing Reasoning Costs - The Path of Optimization for Chain of Thought via Sparse Attention Mechanism

Code-mixed LLM: Improve Large Language Models' Capability to Handle Code-Mixing through Reinforcement Learning from AI Feedback

Cut Your Losses in Large-Vocabulary Language Models

Lynx: Enabling Efficient MoE Inference through Dynamic Batch-Aware Expert Selection

CoCoP: Enhancing Text Classification with LLM through Code Completion Prompt

The Limited Impact of Medical Adaptation of Large Language and Vision-Language Models

XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL

Leveraging LLMs for Predictive Insights in Food Policy and Behavioral Interventions

LogLLM: Log-based Anomaly Detection Using Large Language Models

CorrSynth -- A Correlated Sampling Method for Diverse Dataset Generation from LLMs

One STEP at a time: Language Agents are Stepwise Planners

Quantifying Qualitative Insights: Leveraging LLMs to Market Predict

Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach

R3HF: Reward Redistribution for Enhancing Reinforcement Learning from Human Feedback