Large Scale Language Model

Large-scale language models (LLMs) are powerful AI systems designed to understand and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM efficiency through techniques like iterative refinement, hierarchical architectures, and model compression methods such as quantization and pruning, as well as improving their reliability and addressing issues like hallucinations. These advancements are driving significant progress in diverse fields, including recommendation systems, mental health support, and legal document drafting, demonstrating LLMs' practical impact and their potential to revolutionize numerous applications.

Papers

June 4, 2023

Exposing Bias in Online Communities through Large-Scale Language Models
Celine Wald, Lukas Pfahler
Large Language Model Language Model Social Medium Absolute Stance Bias Social Bias Natural Language Generation Large Scale Language Model Online Community

May 24, 2023

Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
Ximing Lu, Faeze Brahman, Peter West, Jaehun Jang, Khyathi Chandu, Abhilasha Ravichander, Lianhui Qin, Prithviraj Ammanabrolu, Liwei Jiang, Sahana Ramnath, Nouha Dziri, Jillian Fisher, Bill Yuchen Lin, Skyler Hallinan, Xiang Ren, Sean Welleck, Yejin Choi
Language Model Large Scale Language Model Large Lm

May 23, 2023

May 20, 2023

May 19, 2023

Self-QA: Unsupervised Knowledge Guided Language Model Alignment
Xuanyu Zhang, Qing Yang
Large Scale Language Model Instruction Data Unsupervised Discovery Language Model Alignment

May 18, 2023

Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation
Wanrong Zhu, Xinyi Wang, Yujie Lu, Tsu-Jui Fu, Xin Eric Wang, Miguel Eckstein, William Yang Wang
Text to Image Generation Text to Image GPT Neo Large Scale Language Model Text Generation Capability Editing Capability Prompt Editing Collaborative Generative

May 15, 2023

Text Classification via Large Language Models
Xiaofei Sun, Xiaoya Li, Jiwei Li, Fei Wu, Shangwei Guo, Tianwei Zhang, Guoyin Wang
Context Learning Text Classification Large Scale Language Model

May 7, 2023

Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language models
Sixia Li, Shogo Okada
Inherent Interpretability Text Modality Sentiment Analysis Large Scale Language Model Interpretable Way Multimodal Sentiment Analysis Polarity Prediction

April 20, 2023

GPT-NER: Named Entity Recognition via Large Language Models
Shuhe Wang, Xiaofei Sun, Xiaoya Li, Rongbin Ouyang, Fei Wu, Tianwei Zhang, Jiwei Li, Guoyin Wang
Entity Recognition MAESTRO Dataset GPT Neo Large Scale Language Model Text Generation Model NER Model

April 17, 2023

An Evaluation on Large Language Model Outputs: Discourse and Memorization
Adrian de Wynter, Xun Wang, Alex Sokolov, Qilong Gu, Si-Qing Chen
Large Scale Language Model Limited Memorization Discourse Level Data Memorization Quality Text Language Model Output Memorized Knowledge

April 3, 2023

RPTQ: Reorder-based Post-training Quantization for Large Language Models
Zhihang Yuan, Lin Niu, Jiawei Liu, Wenyu Liu, Xinggang Wang, Yuzhang Shang, Guangyu Sun, Qiang Wu, Jiaxiang Wu, Bingzhe Wu
Post Training Quantization Large Scale Language Model Multiplier Free Quantization Product Quantization Memory Reduction

February 28, 2023

GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generation
Jing Zhang, Xiaokang Zhang, Daniel Zhang-Li, Jifan Yu, Zijun Yao, Zeyao Ma, Yiqi Xu, Haohua Wang, Xiaohan Zhang, Nianyi Lin, Sunrui Lu, Juanzi Li, Jie Tang
Large Scale Language Model Knowledge Grounded Dialogue Generation Knowledge Grounded Conversation Knowledge Grounded Dialogue Noise Tolerance

February 21, 2023

$k$NN-Adapter: Efficient Domain Adaptation for Black-Box Language Models
Yangsibo Huang, Daogao Liu, Zexuan Zhong, Weijia Shi, Yin Tat Lee
Large Language Model Language Model Domain Adaptation Large Scale Language Model Retrieval Augmented Language Model Black Box Language Model Efficient Domain Adaptation

January 2, 2023

SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
Elias Frantar, Dan Alistarh
Large Scale Language Model Generative Pre Trained Transformer Unstructured Sparsity

December 30, 2022

Targeted Phishing Campaigns using Large Scale Language Models
Rabimba Karanjai
Large Scale Language Model Natural Language Model Social Engineering Attack Phishing Email

December 21, 2022

Prompt-Augmented Linear Probing: Scaling beyond the Limit of Few-shot In-Context Learners
Hyunsoo Cho, Hyuhng Joon Kim, Junyeob Kim, Sang-Woo Lee, Sang-goo Lee, Kang Min Yoo, Taeuk Kim
Language Model Context Learning Continuum Limit Large Scale Language Model Linear Probing Shot in Context Learning

December 20, 2022

Can Current Task-oriented Dialogue Models Automate Real-world Scenarios in the Wild?
Sang-Woo Lee, Sungdong Kim, Donghyeon Ko, Donghoon Ham, Youngki Hong, Shin Ah Oh, Hyunhoon Jung, Wangkyo Jung, Kyunghyun Cho, Donghyun Kwak, Hyungsuk Noh, Woomyoung Park
Wild Challenge Dialogue System Speech Presence Large Scale Language Model Task Oriented Dialogue System Task Oriented Dialogue Dialogue Model

November 28, 2022

Action-GPT: Leveraging Large-scale Language Models for Improved and Generalized Action Generation
Sai Shashank Kalakonda, Shubh Maheshwari, Ravi Kiran Sarvadevabhatla
Large Scale Language Model Motion Capture Action Generation Text to Motion

Large Scale Language Model

Papers

Exposing Bias in Online Communities through Large-Scale Language Models

Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning

Assessing Linguistic Generalisation in Language Models: A Dataset for Brazilian Portuguese

Enhancing Black-Box Few-Shot Text Classification with Prompt-Based Data Augmentation

Can Public Large Language Models Help Private Cross-device Federated Learning?

Accurate Knowledge Distillation with n-best Reranking

Self-QA: Unsupervised Knowledge Guided Language Model Alignment

Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation

Text Classification via Large Language Models

Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language models

GPT-NER: Named Entity Recognition via Large Language Models

An Evaluation on Large Language Model Outputs: Discourse and Memorization

RPTQ: Reorder-based Post-training Quantization for Large Language Models

GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generation

$k$NN-Adapter: Efficient Domain Adaptation for Black-Box Language Models

SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot

Targeted Phishing Campaigns using Large Scale Language Models

Prompt-Augmented Linear Probing: Scaling beyond the Limit of Few-shot In-Context Learners

Can Current Task-oriented Dialogue Models Automate Real-world Scenarios in the Wild?

Action-GPT: Leveraging Large-scale Language Models for Improved and Generalized Action Generation