Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

December 21, 2024

Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types
Ziming Guo, Chao Ma, Yinggang Sun, Tiancheng Zhao, Guangyao Wang, Hai Huang
Large Language Model Conversational Question Question Classification Din SQL
Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models
Zhisong Zhang, Yan Wang, Xinting Huang, Tianqing Fang, Hongming Zhang, Chenlong Deng, Shuaiyi Li, Dong Yu
Large Language Model General Analysis Pre Trained Language Model Context Modeling Data Encoding Parallel Text Parallel Decoding Attention Entropy
Self-guided Knowledgeable Network of Thoughts: Amplifying Reasoning with Large Language Models
Chao-Chi Chen, Chin-Yuan Yeh, Hsi-Wen Chen, De-Nian Yang, Ming-Syan Chen
Large Language Model Chain of Thought Reasoning Capability Thought Reasoning Sequence Task Knowledge Network
HammerBench: Fine-Grained Function-Calling Evaluation in Real Mobile Device Scenarios
Jun Wang, Jiamu Zhou, Muning Wen, Xiaoyun Mo, Haoyu Zhang, Qiqiang Lin, Cheng Jin, Xihuai Wang, Weinan Zhang, Qiuying Peng, Jun Wang
Large Language Model Fine Grained Global Evaluation User Behavior Mobile User Dialogue Strategy
Chained Tuning Leads to Biased Forgetting
Megan Ung, Alicia Sun, Samuel J. Bell, Bhaktipriya Radharapu, Levent Sagun, Adina Williams
Large Language Model Catastrophic Forgetting Anti Forgetting Hyper Tune Safety Fine Tuning
Transducer-Llama: Integrating LLMs into Streamable Transducer-based Speech Recognition
Keqi Deng, Jinxi Guo, Yingyi Ma, Niko Moritz, Philip C. Woodland, Ozlem Kalinli, Mike Seltzer
Large Language Model Speech Recognition Pre Trained Librispeech Speech Recognition Online Streaming Transformer Transducer
Correcting Large Language Model Behavior via Influence Function
Han Zhang, Zhuo Zhang, Yi Zhang, Yuanzhao Zhai, Hanyang Peng, Yu Lei, Yue Yu, Hui Wang, Bin Liang, Lin Gui, Ruifeng Xu
Large Language Model Influence Function AI Alignment
Distilling Large Language Models for Efficient Clinical Information Extraction
Karthik S. Vedula, Annika Gupta, Akshay Swaminathan, Ivan Lopez, Suhana Bedi, Nigam H. Shah
Large Language Model BERT Model Process Extraction Clinical Information Extraction Distilled BERT

December 20, 2024

Can LLMs Obfuscate Code? A Systematic Analysis of Large Language Models into Assembly Code Obfuscation
Seyedreza Mohseni, Seyedali Mohammadi, Deepa Tilwani, Yash Saxena, Gerald Ndwula, Sriram Vema, Edward Raff, Manas Gaur
Large Language Model Obfuscation Technique
Logical Consistency of Large Language Models in Fact-checking
Bishwamittra Ghosh, Sarah Hasan, Naheed Anjum Arafat, Arijit Khan
Large Language Model Fact Checking Propositional Logic Conjunctive Query Paraphrase Detection Logical Consistency
The Evolution of LLM Adoption in Industry Data Curation Practices
Crystal Qian, Michael Xieyang Liu, Emily Reif, Grady Simon, Nada Hussein, Nathan Clement, James Wexler, Carrie J. Cai, Michael Terry, Minsuk Kahng
Large Language Model Specie Evolution Unstructured Data Data Curation Unstructured Text Data
From General to Specific: Tailoring Large Language Models for Personalized Healthcare
Ruize Shi, Hong Huang, Wei Zhou, Kehan Yin, Kai Zhao, Yun Zhao
Large Language Model General Text Medical Large Language Model Personalized Healthcare
MiniGPT-Pancreas: Multimodal Large Language Model for Pancreas Cancer Classification and Detection
Andrea Moglia, Elia Clement Nastasio, Luca Mainardi, Pietro Cerveri
Large Language Model Data Detection Multimodal Phenomenon Fetal Liver Pancreatic Cancer Abdominal CT
Less is More: Towards Green Code Large Language Models via Unified Structural Pruning
Guang Yang, Yu Zhou, Xiangyu Zhang, Wei Cheng, Ke Liu, Xiang Chen, Terry Yue Zhuo, Taolue Chen
Large Language Model Structural Pruning Spatial Pruning
Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning
Sungjin Park, Xiao Liu, Yeyun Gong, Edward Choi
Large Language Model Language Model Reasoning Ability Complex Process Tree Search
Linguistic Features Extracted by GPT-4 Improve Alzheimer's Disease Detection based on Spontaneous Speech
Jonathan Heitz, Gerold Schneider, Nicolas Langer
Large Language Model Data Detection GPT 4 Common Disease Semantic Feature Linguistic Feature Spontaneous Speech
VORD: Visual Ordinal Calibration for Mitigating Object Hallucinations in Large Vision-Language Models
Dexter Neo, Tsuhan Chen
Large Language Model Large Vision Language Model Image Pair Training Free Mitigating Hallucination Ordinal Learning
Contrastive Learning for Task-Independent SpeechLLM-Pretraining
Maike Züfle, Jan Niehues
Large Language Model Contrastive Learning Domain Specific Task Specific Two Stage Training Speech Processing Task
Inference Scaling vs Reasoning: An Empirical Analysis of Compute-Optimal LLM Problem-Solving
Marwan AbdElhameed, Pavly Halim
Large Language Model Complex Reasoning Scientific Inference Reasoning Capability Empirical Analysis Reasoning Technique Impressive Reasoning Capability
Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage
Zhi Gao, Bofei Zhang, Pengxiang Li, Xiaojian Ma, Tao Yuan, Yue Fan, Yuwei Wu, Yunde Jia, Song-Chun Zhu, Qing Li
Large Language Model Vision Language Model Greater Public Use Multimodal Agent Agent Tuning

Large Language Model

Papers

Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types

Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models

Self-guided Knowledgeable Network of Thoughts: Amplifying Reasoning with Large Language Models

HammerBench: Fine-Grained Function-Calling Evaluation in Real Mobile Device Scenarios

Chained Tuning Leads to Biased Forgetting

Transducer-Llama: Integrating LLMs into Streamable Transducer-based Speech Recognition

Correcting Large Language Model Behavior via Influence Function

Distilling Large Language Models for Efficient Clinical Information Extraction

Can LLMs Obfuscate Code? A Systematic Analysis of Large Language Models into Assembly Code Obfuscation

Logical Consistency of Large Language Models in Fact-checking

The Evolution of LLM Adoption in Industry Data Curation Practices

From General to Specific: Tailoring Large Language Models for Personalized Healthcare

MiniGPT-Pancreas: Multimodal Large Language Model for Pancreas Cancer Classification and Detection

Less is More: Towards Green Code Large Language Models via Unified Structural Pruning

Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning

Linguistic Features Extracted by GPT-4 Improve Alzheimer's Disease Detection based on Spontaneous Speech

VORD: Visual Ordinal Calibration for Mitigating Object Hallucinations in Large Vision-Language Models

Contrastive Learning for Task-Independent SpeechLLM-Pretraining

Inference Scaling vs Reasoning: An Empirical Analysis of Compute-Optimal LLM Problem-Solving

Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage