Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

October 6, 2024

Alignment Between the Decision-Making Logic of LLMs and Human Cognition: A Case Study on Legal LLMs
Lu Chen, Yuxuan Huang, Yixing Li, Yaohui Jin, Shuai Zhao, Zilong Zheng, Quanshi Zhang
Large Language Model Case Study Human Cognition Logical Inference Decision Logic
GenSim: A General Social Simulation Platform with Large Language Model based Agents
Jiakai Tang, Heyang Gao, Xuchen Pan, Lei Wang, Haoran Tan, Dawei Gao, Yushuo Chen, Xu Chen, Yankai Lin, Yaliang Li, Bolin Ding, Jingren Zhou, Ji-Rong Wen
Large Language Model Agent Smith Long Term LLM Based Agent Social Simulation
Continuous Approximations for Improving Quantization Aware Training of LLMs
He Li, Jianhang Hong, Yuanzhuo Wu, Snehal Adbol, Zonglin Li
Large Language Model Model Compression Quantization Operator Quantization Aware Training Approximation Theory
ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model
Shuhao Gu, Mengdi Zhao, Bowen Zhang, Liangdong Wang, Jijie Li, Guang Liu
Large Language Model Long Text Online Tokenizer Better Representation Model Representation
OD-Stega: LLM-Based Near-Imperceptible Steganography via Optimized Distributions
Yu-Shin Huang, Peter Just, Krishna Narayanan, Chao Tian
Large Language Model Speech Token Stego Image
Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion
Guanchu Wang, Yu-Neng Chuang, Ruixiang Tang, Shaochen Zhong, Jiayi Yuan, Hongye Jin, Zirui Liu, Vipin Chaudhary, Shuai Xu, James Caverlee, Xia Hu
Large Language Model State of the Art LLM Weight Update Token Generation Taylor Expansion

October 5, 2024

Functional Homotopy: Smoothing Discrete Optimization via Continuous Parameters for LLM Jailbreak Attacks
Zi Wang, Divyam Anshumaan, Ashish Hooda, Yudong Chen, Somesh Jha
Large Language Model Language Model Jailbreak Attack Many Parameter Discrete Optimization Homotopy Optimization Homotopy Class Homotopy Path
Multimodal Large Language Models for Inverse Molecular Design with Retrosynthetic Planning
Gang Liu, Michael Sun, Wojciech Matusik, Meng Jiang, Jie Chen
Large Language Model Multimodal Large Language Model Molecule Generation Retrosynthesis Prediction Molecular Information Inverse Molecular Design
Correlation-Aware Select and Merge Attention for Efficient Fine-Tuning and Context Length Extension
Ning Wang, Zekun Li, Tongxin Bai, Guoqi Li
Large Language Model Long Sequence Sparse Attention Context Length Selection Policy Positional Embeddings
CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing Constraints
Anirudh Atmakuru, Jatin Nainani, Rohith Siddhartha Reddy Bheemreddy, Anirudh Lakkaraju, Zonghai Yao, Hamed Zamani, Haw-Shiuan Chang
Large Language Model Numerical Data Sustained Creativity Natural Language Constraint
Solution for OOD-CV UNICORN Challenge 2024 Object Detection Assistance LLM Counting Ability Improvement
Zhouyang Chi, Qingyuan Jiang, Yang Yang
Large Language Model Solution Path Object Detection Model Detection Task Ood Cv
DiDOTS: Knowledge Distillation from Large-Language-Models for Dementia Obfuscation in Transcribed Speech
Dominika Woszczyk, Soteris Demetriou
Large Language Model Knowledge Distillation Obfuscation Technique
Toxic Subword Pruning for Dialogue Response Generation on Large Language Models
Hongyuan Lu, Wai Lam
Large Language Model Language Model Machine Translation Dialogue Response Generation
From Reading to Compressing: Exploring the Multi-document Reader for Prompt Compression
Eunseong Choi, Sunkyung Lee, Minjin Choi, June Park, Jongwuk Lee
Large Language Model Prompt Compression Multi Document Fusion in Decoder
Text2Chart31: Instruction Tuning for Chart Generation with Automatic Feedback
Fatemeh Pesaran Zadeh, Juyeon Kim, Jin-Hwa Kim, Gunhee Kim
Large Language Model Instruction Tuning Chart Comprehension Visualization Generation Chart Generation
Neuron-Level Sequential Editing for Large Language Models
Houcheng Jiang, Junfeng Fang, Tianyu Zhang, An Zhang, Ruipeng Wang, Tao Liang, Xiang Wang
Large Language Model Anti Forgetting Model Editing
A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction Based on Large Language Models
Houquan Zhou, Zhenghua Li, Bo Zhang, Chen Li, Shaopeng Lai, Ji Zhang, Fei Huang, Min Zhang
Large Language Model Prompt Learning Training Free Prompt Based Chinese Spelling
PalmBench: A Comprehensive Benchmark of Compressed Large Language Models on Mobile Platforms
Yilong Li, Jingyu Liu, Hao Zhang, M Badri Narayanan, Utkarsh Sharma, Shuai Zhang, Pan Hu, Yijing Zeng, Jayaram Raghuram, Suman Banerjee
Large Language Model New Benchmark Comprehensive Benchmark Mobile Application GPU Cluster
Hyperbolic Fine-tuning for Large Language Models
Menglin Yang, Aosong Feng, Bo Xiong, Jihong Liu, Irwin King, Rex Ying
Large Language Model Fine Tuning Jina Embeddings Latent Tree

October 4, 2024

KidLM: Advancing Language Models for Children -- Early Insights and Future Directions
Mir Tafseer Nayeem, Davood Rafiei
Large Language Model Language Model Future Direction Nine Year Old Child Child Speech

Large Language Model

Papers

Alignment Between the Decision-Making Logic of LLMs and Human Cognition: A Case Study on Legal LLMs

GenSim: A General Social Simulation Platform with Large Language Model based Agents

Continuous Approximations for Improving Quantization Aware Training of LLMs

ReTok: Replacing Tokenizer to Enhance Representation Efficiency in Large Language Model

OD-Stega: LLM-Based Near-Imperceptible Steganography via Optimized Distributions

Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion

Functional Homotopy: Smoothing Discrete Optimization via Continuous Parameters for LLM Jailbreak Attacks

Multimodal Large Language Models for Inverse Molecular Design with Retrosynthetic Planning

Correlation-Aware Select and Merge Attention for Efficient Fine-Tuning and Context Length Extension

CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing Constraints

Solution for OOD-CV UNICORN Challenge 2024 Object Detection Assistance LLM Counting Ability Improvement

DiDOTS: Knowledge Distillation from Large-Language-Models for Dementia Obfuscation in Transcribed Speech

Toxic Subword Pruning for Dialogue Response Generation on Large Language Models

From Reading to Compressing: Exploring the Multi-document Reader for Prompt Compression

Text2Chart31: Instruction Tuning for Chart Generation with Automatic Feedback

Neuron-Level Sequential Editing for Large Language Models

A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction Based on Large Language Models

PalmBench: A Comprehensive Benchmark of Compressed Large Language Models on Mobile Platforms

Hyperbolic Fine-tuning for Large Language Models

KidLM: Advancing Language Models for Children -- Early Insights and Future Directions