Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

November 4, 2024

Context-Informed Machine Translation of Manga using Multimodal Large Language Models
Philip Lippmann, Konrad Skublicki, Joshua Tanner, Shonosuke Ishiwatari, Jie Yang
Large Language Model Language Model Machine Translation Multimodal Large Language Model Multimodal Phenomenon Manga Understanding
Training-free Regional Prompting for Diffusion Transformers
Anthony Chen, Jianjin Xu, Wenzhao Zheng, Gaole Dai, Yida Wang, Renrui Zhang, Haofan Wang, Shanghang Zhang
Large Language Model Text to Image Complex Prompt Diffusion Transformer
Fantastic LLMs for Preference Data Annotation and How to (not) Find Them
Guangxuan Xu, Kai Xu, Shivchander Sudalairaj, Hao Wang, Akash Srivastava
Large Language Model Reward Function Reward Model Preference Fine Tuning Preference Annotation
Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models
Guangzhi Xiong, Eric Xie, Amir Hassan Shariatmadari, Sikun Guo, Stefan Bekiranov, Aidong Zhang
Large Language Model Language Model Knowledge Graph Knowledge Based Hypothesis Generation
Addressing Uncertainty in LLMs to Enhance Reliability in Generative AI
Ramneet Kaur, Colin Samplawski, Adam D. Cobb, Anirban Roy, Brian Matejek, Manoj Acharya, Daniel Elenius, Alexander M. Berenbeim, John A. Pavlik, Nathaniel D. Bastian, Susmit Jha
Large Language Model Generative AI Uncertainty Quantification Conformal Prediction System Reliability Tackle Uncertainty
"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Eldar Kurtic, Alexandre Marques, Shubhra Pandit, Mark Kurtz, Dan Alistarh
Large Language Model Quantization Operator Activation Quantization Weight Only Quantization Inference Performance Different Quantization Accuracy Efficiency Trade
WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning
Zehan Qi, Xiao Liu, Iat Long Iong, Hanyu Lai, Xueqiao Sun, Xinyue Yang, Jiadai Sun, Yu Yang, Shuntian Yao, Tianjie Zhang, Wei Xu, Jie Tang, Yuxiao Dong
Large Language Model Reinforcement Learning LLM Based Curriculum Reinforcement Learning Online Training Web Automation Evolutionary Curriculum
Sparsing Law: Towards Large Language Models with Greater Activation Sparsity
Yuqi Luo, Chenyang Song, Xu Han, Yingfa Chen, Chaojun Xiao, Zhiyuan Liu, Maosong Sun
Large Language Model Sparsity Increase Random Sparsification Targeted Activation Penalty Activation Sparsity
AVSS: Layer Importance Evaluation in Large Language Models via Activation Variance-Sparsity Analysis
Zichen Song, Yuxin Wu, Sitan Huang, Zhongfeng Kang
Large Language Model Activation Sparsity Variance Network
Advancements and limitations of LLMs in replicating human color-word associations
Makoto Fukushima, Shusuke Eshita, Hiroshige Fukuhara
Large Language Model Fundamental Limitation Human Cognition Association Capability Color Perception Color Emotion Association
Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention
Xingtai Lv, Ning Ding, Kaiyan Zhang, Ermo Hua, Ganqu Cui, Bowen Zhou
Large Language Model Low Rank Attention Layer Scalable Training
Culinary Class Wars: Evaluating LLMs using ASH in Cuisine Transfer Task
Hoonick Lee, Mogan Gim, Donghyeon Park, Donghee Choi, Jaewoo Kang
Large Language Model Recipe Generation Class Interference Ash Cloud
Ask, and it shall be given: Turing completeness of prompting
Ruizhong Qiu, Zhe Xu, Wenxuan Bao, Hanghang Tong
Large Language Model Probabilistic Completeness Finite Data Scaling Transformer
Enhancing Multiple Dimensions of Trustworthiness in LLMs via Sparse Activation Control
Yuxin Xiao, Chaoqun Wan, Yonggang Zhang, Wenxiao Wang, Binbin Lin, Xiaofei He, Xu Shen, Jieping Ye
Large Language Model Many Sparse Semantic Feature Targeted Activation Penalty Sparse Activation Semantic Content Representation Engineering Higher Dimension
QCG-Rerank: Chunks Graph Rerank with Query Expansion in Retrieval-Augmented LLMs for Tourism Domain
Qikai Wei, Mingzhi Yang, Chunlong Han, Jingfu Wei, Minghao Zhang, Feifei Shi, Huansheng Ning
Large Language Model Retrieval Augmented Generation Information Retrieval Ranking Model Query Expansion Ranking Method Travel Domain
KptLLM: Unveiling the Power of Large Language Model for Keypoint Comprehension
Jie Yang, Wang Zeng, Sheng Jin, Lumin Xu, Wentao Liu, Chen Qian, Ruimao Zhang
Large Language Model Real Power Pixel Level Keypoint Detection Knowledge Comprehension Capability Unified Multimodal
Code-Switching Curriculum Learning for Multilingual Transfer in LLMs
Haneul Yoo, Cheonbok Park, Sangdoo Yun, Alice Oh, Hwaran Lee
Large Language Model Cross Lingual Transfer Code Switched Cross Lingual Continual
Can Language Models Enable In-Context Database?
Yu Pan, Hongfeng Yu, Tianjiao Zhao, Jianxin Sun
Large Language Model Language Model Contextual Data
SALSA: Soup-based Alignment Learning for Stronger Adaptation in RLHF
Atoosa Chegini, Hamid Kazemi, Iman Mirzadeh, Dong Yin, Maxwell Horton, Moin Nabi, Mehrdad Farajtabar, Keivan Alizadeh
Large Language Model Reinforcement Learning Policy OpTimization Alignment Training Model Soup RLHF V SALSA Fresca Effective Adaptation
A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness
Fali Wang, Zhiwei Zhang, Xianren Zhang, Zongyu Wu, Tzuhao Mo, Qiuhao Lu, Wanjing Wang, Rui Li, Junjie Xu, Xianfeng Tang, Qi He, Yao Ma, Ming Huang, Suhang Wang
Large Language Model Language Model Financial Application Medical LLM Domain Knowledge Barzilai Borwein Technique Inference Latency

Large Language Model

Papers

Context-Informed Machine Translation of Manga using Multimodal Large Language Models

Training-free Regional Prompting for Diffusion Transformers

Fantastic LLMs for Preference Data Annotation and How to (not) Find Them

Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models

Addressing Uncertainty in LLMs to Enhance Reliability in Generative AI

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning

Sparsing Law: Towards Large Language Models with Greater Activation Sparsity

AVSS: Layer Importance Evaluation in Large Language Models via Activation Variance-Sparsity Analysis

Advancements and limitations of LLMs in replicating human color-word associations

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

Culinary Class Wars: Evaluating LLMs using ASH in Cuisine Transfer Task

Ask, and it shall be given: Turing completeness of prompting

Enhancing Multiple Dimensions of Trustworthiness in LLMs via Sparse Activation Control

QCG-Rerank: Chunks Graph Rerank with Query Expansion in Retrieval-Augmented LLMs for Tourism Domain

KptLLM: Unveiling the Power of Large Language Model for Keypoint Comprehension

Code-Switching Curriculum Learning for Multilingual Transfer in LLMs

Can Language Models Enable In-Context Database?

SALSA: Soup-based Alignment Learning for Stronger Adaptation in RLHF

A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness