Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

December 17, 2024

RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement
Jinhao Jiang, Jiayi Chen, Junyi Li, Ruiyang Ren, Shijie Wang, Wayne Xin Zhao, Yang Song, Tao Zhang
Large Language Model Verification Task Retrieval Augmented Complex Reasoning Task Bidirectional Correspondence Political Deliberation
DSGram: Dynamic Weighting Sub-Metrics for Grammatical Error Correction in the Era of Large Language Models
Jinxiang Xie, Yilin Li, Xunjian Yin, Xiaojun Wan
Large Language Model New Era Grammatical Error Correction Novel Evaluation Dynamic Weighting
More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression
Jiebin Zhang, Dawei Zhu, Yifan Song, Wenhao Wu, Chuqiao Kuang, Xiaoguang Li, Lifeng Shang, Qun Liu, Sujian Li
Large Language Model Long Context Low Precision Adaptive Token KV Cache Compression Anomalous Token
LLM-based Discriminative Reasoning for Knowledge Graph Question Answering
Mufan Xu, Kehai Chen, Xuefeng Bai, Muyun Yang, Tiejun Zhao, Min Zhang
Large Language Model Generative Pre Trained Transformer Discriminative Information Subgraph Retrieval
Baichuan4-Finance Technical Report
Hanyu Zhang, Boyu Qiu, Yuhao Feng, Shuqi Li, Qian Ma, Xiyuan Zhang, Qiang Ju, Dong Yan, Jian Xie
Large Language Model Chat Model Financial Large Language Model Chinese Stock Market
What External Knowledge is Preferred by LLMs? Characterizing and Exploring Chain of Evidence in Imperfect Context
Zhiyuan Chang, Mingyang Li, Xiaojun Jia, Junjie Wang, Yuekai Huang, Qing Wang, Yihao Huang, Yang Liu
Large Language Model Evidence Piece External Knowledge LLM Response Multi Hop QA
LLMs are Also Effective Embedding Models: An In-depth Overview
Chongyang Tao, Tao Shen, Shen Gao, Junshuo Zhang, Zhen Li, Zhengwei Tao, Shuai Ma
Large Language Model Natural Language Processing Full Model Jina Embeddings Sparse Embeddings
Process-Supervised Reward Models for Clinical Note Generation: A Scalable Approach Guided by Domain Expertise
Hanyin Wang, Qiping Xu, Bolun Liu, Guleid Hussein, Hariprasad Korsapati, Mohamad El Labban, Kingsley Iheasirim, Mohamed Hassan, Gokhan Anil, Brian Bartlett, Jimeng Sun
Large Language Model Reward Model Domain Expertise Task Specific Reward Scalable Approach Note Generation Process Supervision
Evaluating Zero-Shot Multilingual Aspect-Based Sentiment Analysis with Large Language Models
Chengyan Wu, Bolei Ma, Zheyu Zhang, Ningyuan Deng, Yanqing He, Yun Xue
Large Language Model Sentiment Analysis Aspect Based Sentiment Analysis Sequence Labeling Task Zero Shot Multilingual
Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQL
Geling Liu, Yunzhi Tan, Ruichao Zhong, Yuanzhen Xie, Lingchen Zhao, Qian Wang, Bo Hu, Zang Li
Large Language Model Context Learning Robust Version Text to SQL
LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Tasks
Hongbin Zhang, Kehai Chen, Xuefeng Bai, Yang Xiang, Min Zhang
Large Language Model Low Resource Fine Tuned Large Language Model Language Model Alignment Pre Trained Multilingual Model
RareAgents: Autonomous Multi-disciplinary Team for Rare Disease Diagnosis and Treatment
Xuanzhong Chen, Ye Jin, Xiaohao Mao, Lun Wang, Shuyang Zhang, Ting Chen
Large Language Model Agent Smith Medical Diagnosis Real World Clinical Accurate Treatment Domain Specific Model Rare Disease
Knowledge Boundary of Large Language Models: A Survey
Moxin Li, Yong Zhao, Yang Deng, Wenxuan Zhang, Shuaiyi Li, Wenya Xie, See-Kiong Ng, Tat-Seng Chua
Large Language Model Timely Survey Knowledge Gap LLM Use Knowledge Boundary
LITA: An Efficient LLM-assisted Iterative Topic Augmentation Framework
Chia-Hsuan Chang, Jui-Tse Tsai, Yi-Hang Tsai, San-Yih Hwang
Large Language Model High Efficiency Topic Modeling Topic Analysis Dynamic Topic Model

December 16, 2024

How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games
Yutong Xie, Yiyao Liu, Zhuang Ma, Lin Shi, Xiyuan Wang, Walter Yuan, Matthew O. Jackson, Qiaozhu Mei
Large Language Model AI Chatbots Behavioral Game
Can LLM Prompting Serve as a Proxy for Static Analysis in Vulnerability Detection
Ira Ceka, Feitong Qiao, Anik Dey, Aastha Valechia, Gail Kaiser, Baishakhi Ray
Large Language Model Data Detection Medical LLM Chain of Thought Latent Vulnerability Static Analysis Transparent Proxy Server Architecture Vulnerability Data Contrastive Demonstration
The Open Source Advantage in Large Language Models (LLMs)
Jiya Manchanda, Laura Boettcher, Matheus Westphalen, Jasser Jasser
Large Language Model Open Source Open Source Model Closed Source Model Open Sourcing
SciFaultyQA: Benchmarking LLMs on Faulty Science Question Detection with a GAN-Inspired Approach to Synthetic Dataset Generation
Debarshi Kundu
Large Language Model Synthetic Data Question Answering Synthetic Data Generation Non Negative Textual Response GAN Framework
Cost-Effective Label-free Node Classification with LLMs
Taiyan Zhang, Renchi Yang, Mingyu Yan, Xiaochun Ye, Dongrui Fan, Yurui Lai
Large Language Model Graph Neural Network Semi Supervised Node Classification Text Attributed Graph Node Selection
Inferring Functionality of Attention Heads from their Parameters
Amit Elhelo, Mor Geva
Large Language Model Scientific Inference Many Parameter Attention Head Explanatory Inference Salient Feature

Large Language Model

Papers

RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement

DSGram: Dynamic Weighting Sub-Metrics for Grammatical Error Correction in the Era of Large Language Models

More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression

LLM-based Discriminative Reasoning for Knowledge Graph Question Answering

Baichuan4-Finance Technical Report

What External Knowledge is Preferred by LLMs? Characterizing and Exploring Chain of Evidence in Imperfect Context

LLMs are Also Effective Embedding Models: An In-depth Overview

Process-Supervised Reward Models for Clinical Note Generation: A Scalable Approach Guided by Domain Expertise

Evaluating Zero-Shot Multilingual Aspect-Based Sentiment Analysis with Large Language Models

Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQL

LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Tasks

RareAgents: Autonomous Multi-disciplinary Team for Rare Disease Diagnosis and Treatment

Knowledge Boundary of Large Language Models: A Survey

LITA: An Efficient LLM-assisted Iterative Topic Augmentation Framework

How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games

Can LLM Prompting Serve as a Proxy for Static Analysis in Vulnerability Detection

The Open Source Advantage in Large Language Models (LLMs)

SciFaultyQA: Benchmarking LLMs on Faulty Science Question Detection with a GAN-Inspired Approach to Synthetic Dataset Generation

Cost-Effective Label-free Node Classification with LLMs

Inferring Functionality of Attention Heads from their Parameters