Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

September 10, 2024

Questioning Internal Knowledge Structure of Large Language Models Through the Lens of the Olympic Games
Juhwan Choi, YoungBin Kim
Large Language Model Natural Language Processing Camera Lens Knowledge Structure
User Preferences for Large Language Model versus Template-Based Explanations of Movie Recommendations: A Pilot Study
Julien Albert, Martin Balfroid, Miriam Doh, Jeremie Bogaert, Luca La Fisca, Liesbet De Vos, Bryan Renard, Vincent Stragier, Emmanuel Jean
Large Language Model Recommender System Movie Recommendation Explanation Method Pilot Study Graph Explainability
RNR: Teaching Large Language Models to Follow Roles and Rules
Kuan Wang, Alexander Bukharin, Haoming Jiang, Qingyu Yin, Zhengyang Wang, Tuo Zhao, Jingbo Shang, Chao Zhang, Bing Yin, Xian Li, Jianshu Chen, Shiyang Li
Large Language Model Instruction Tuning Simple RULE Instruction Fine Tuning Multi Role
TopoChat: Enhancing Topological Materials Retrieval With Large Language Model and Multi-Source Knowledge
HuangChao Xu, Baohua Zhang, Zhong Jin, Tiannian Zhu, Quansheng Wu, Hongming Weng
Large Language Model Relational Reasoning Multiple Knowledge Source Material Classification
Enhancing Temporal Understanding in Audio Question Answering for Large Audio Language Models
Arvind Krishna Sridhar, Yinyi Guo, Erik Visser
Large Language Model Temporal Feature Temporal Understanding Audio Question Answering
MathGLM-Vision: Solving Mathematical Problems with Multi-Modal Large Language Model
Zhen Yang, Jinhao Chen, Zhengxiao Du, Wenmeng Yu, Weihan Wang, Wenyi Hong, Zhihuan Jiang, Bin Xu, Yuxiao Dong, Jie Tang
Large Language Model Multi Modal Large Language Model Math Problem Modal Large Language Model Geometric Vision
Accelerating Large Language Model Pretraining via LFR Pedagogy: Learn, Focus, and Review
Neha Prakriya, Jui-Nan Yen, Cho-Jui Hsieh, Jason Cong
Large Language Model Narrative Review Human Driving Focus Long Term Memory Training Paradigm

September 9, 2024

Doppelgänger's Watch: A Split Objective Approach to Large Language Models
Shervin Ghasemlou, Ashish Katiyar, Aparajita Saraf, Seungwhan Moon, Mangesh Pujari, Pinar Donmez, Babak Damavandi, Anuj Kumar
Large Language Model Multi Objective Supervision Signal Lookalike Model
Regression with Large Language Models for Materials and Molecular Property Prediction
Ryan Jacobs, Maciej P. Polak, Lane E. Schultz, Hamed Mahdavi, Vasant Honavar, Dane Morgan
Large Language Model Novel Regression Molecular Property Prediction Molecular Property Material Response Material Property Prediction Generative LLM
DetoxBench: Benchmarking Large Language Models for Multitask Fraud & Abuse Detection
Joymallya Chakraborty, Wei Xia, Anirban Majumder, Dan Ma, Walid Chaabene, Naveed Janvekar
Large Language Model Natural Language Processing Task Credit Card Fraud Abuse Detection Fine Grained Detoxification
FairHome: A Fair Housing and Fair Lending Dataset
Anusha Bagalkotkar (1), Aveek Karmakar (1), Gabriel Arnson (1), Ondrej Linda (1) ((1) Zillow Group)
Large Language Model Data Set Fair Representation Fair Credit
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
Ziyao Wang, Zheyu Shen, Yexiao He, Guoheng Sun, Hongyi Wang, Lingjuan Lyu, Ang Li
Large Language Model Fine Tuning Adaptation Concern Fast LoRA
Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers
Siyu Chen, Heejune Sheen, Tianhao Wang, Zhuoran Yang
Large Language Model Transformer Megatron Decepticons Context Learning Feature Learning Training Dynamic Transformer Performance Head Transformer
Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning Approach
Meng Zhou, Surajsinh Parmar, Anubhav Bhatti
Large Language Model Instruction Tuning Multilingual Benchmark Instruction Fine Tuning
MemoRAG: Moving towards Next-Gen RAG Via Memory-Inspired Knowledge Discovery
Hongjin Qian, Peitian Zhang, Zheng Liu, Kelong Mao, Zhicheng Dou
Large Language Model Retrieval Augmented Generation Long Term Memory Knowledge Discovery
CauseJudger: Identifying the Cause with LLMs for Abductive Logical Reasoning
Jinwei He, Feng Lu
Large Language Model Reasoning Task Actual Cause Abductive Reasoning
Logically Consistent Language Models via Neuro-Symbolic Integration
Diego Calanzone, Stefano Teso, Antonio Vergari
Large Language Model Language Model Fine Tuning Language Understanding Neuro Symbolic Logical Constraint Symbolic Integration
Elsevier Arena: Human Evaluation of Chemistry/Biology/Health Foundational Large Language Models
Camilo Thorne, Christian Druckenbrodt, Kinga Szarkowska, Deepika Goyal, Pranita Marajan, Vijay Somanath, Corey Harper, Mao Yan, Tony Scerri
Large Language Model Model Training Human Evaluation Language Generation Model Organic Chemistry Training Set Arena Hard
Tele-LLMs: A Series of Specialized Large Language Models for Telecommunications
Ali Maatouk, Kenny Chirino Ampudia, Rex Ying, Leandros Tassiulas
Large Language Model Language Model Natural Language Processing Domain Specific Open Source Large Language Model TV Show Telecom Domain
$\mathbb{USCD}$: Improving Code Generation of LLMs by Uncertainty-Aware Selective Contrastive Decoding
Shuai Wang, Liang Ding, Li Shen, Yong Luo, Zheng He, Wei Yu, Dacheng Tao
Large Language Model Code Generation Contrastive Decoding

Large Language Model

Papers

Questioning Internal Knowledge Structure of Large Language Models Through the Lens of the Olympic Games

User Preferences for Large Language Model versus Template-Based Explanations of Movie Recommendations: A Pilot Study

RNR: Teaching Large Language Models to Follow Roles and Rules

TopoChat: Enhancing Topological Materials Retrieval With Large Language Model and Multi-Source Knowledge

Enhancing Temporal Understanding in Audio Question Answering for Large Audio Language Models

MathGLM-Vision: Solving Mathematical Problems with Multi-Modal Large Language Model

Accelerating Large Language Model Pretraining via LFR Pedagogy: Learn, Focus, and Review

Doppelgänger's Watch: A Split Objective Approach to Large Language Models

Regression with Large Language Models for Materials and Molecular Property Prediction

DetoxBench: Benchmarking Large Language Models for Multitask Fraud & Abuse Detection

FairHome: A Fair Housing and Fair Lending Dataset

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations

Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers

Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning Approach

MemoRAG: Moving towards Next-Gen RAG Via Memory-Inspired Knowledge Discovery

CauseJudger: Identifying the Cause with LLMs for Abductive Logical Reasoning

Logically Consistent Language Models via Neuro-Symbolic Integration

Elsevier Arena: Human Evaluation of Chemistry/Biology/Health Foundational Large Language Models

Tele-LLMs: A Series of Specialized Large Language Models for Telecommunications

$\mathbb{USCD}$: Improving Code Generation of LLMs by Uncertainty-Aware Selective Contrastive Decoding