Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

September 17, 2024

SC-Phi2: A Fine-tuned Small Language Model for StarCraft II Macromanagement Tasks
Muhammad Junaid Khan, Gita Sukthankar
Large Language Model Language Model StarCraft II Phi 3
Strategic Insights in Human and Large Language Model Tactics at Word Guessing Games
Matīss Rikters, Sanita Reinsone
Large Language Model Human Generated Game Content Wordle Game Vocabulary Word
KVPruner: Structural Pruning for Faster and Memory-Efficient Large Language Models
Bo Lv, Quan Zhou, Xuanang Ding, Yan Wang, Zeming Ma
Large Language Model Edge Pruning Efficient Model Faster Pace Structural Pruning Perplexity Analysis Depth Pruning
Large Language Models are Good Multi-lingual Learners : When LLMs Meet Cross-lingual Prompts
Teng Wang, Zhenqi He, Wing-Yin Yu, Xiaojin Fu, Xiongwei Han
Large Language Model Natural Language Structured Generation Translation Prompt Multilingual Ability
Hierarchical Narrative Analysis: Unraveling Perceptions of Generative AI
Riona Matsuoka, Hiroki Matsumoto, Takahiro Yoshida, Tomohiro Watanabe, Ryoma Kondo, Ryohei Hisano
Large Language Model Generative AI Sentiment Analysis Abstract Argumentation Hierarchical Framework Unraveling Key Factor Narrative Alignment
Enhancing Multilingual Speech Generation and Recognition Abilities in LLMs with Constructed Code-switched Data
Jing Xu, Daxin Tan, Jiaqi Wang, Xiao Chen
Large Language Model Speech Synthesis Speech Generation Code Switching Data
Attention-Seeker: Dynamic Self-Attention Scoring for Unsupervised Keyphrase Extraction
Erwin D. López Z., Cheng Tang, Atsushi Shimada
Large Language Model Self Attention Attention Weight Keyphrase Extraction Author Assigned Keyphrases Vector Attention
Adaptive Large Language Models By Layerwise Attention Shortcuts
Prateek Verma, Mert Pilanci
Large Language Model Attention Mechanism Transformer Architecture Attention Layer Attention Map AI Revolution
Challenging Fairness: A Comprehensive Exploration of Bias in LLM-Based Recommendations
Shahnewaz Karim Sakib, Anindya Bijoy Das
Large Language Model Language Model Absolute Stance Bias Movie Recommendation Depth Analysis Recommendation Quality Rethinking Fairness

September 16, 2024

Model Tells Itself Where to Attend: Faithfulness Meets Automatic Attention Steering
Qingru Zhang, Xiaodong Yu, Chandan Singh, Xiaodong Liu, Liyuan Liu, Jianfeng Gao, Tuo Zhao, Dan Roth, Hao Cheng
Large Language Model Contextual Information Input Context
Multidimensional Human Activity Recognition With Large Language Model: A Conceptual Framework
Syed Mhamudul Hasan
Large Language Model Activity Recognition Wearable Device Wearable Sensor Disaster Response
Model-in-the-Loop (MILO): Accelerating Multimodal AI Data Annotation with LLMs
Yifan Wang, David Stevens, Pranay Shah, Wenwen Jiang, Miao Liu, Xu Chen, Robert Kuo, Na Li, Boying Gong, Daniel Lee, Jiabo Hu, Ning Zhang, Bob Kamma
Large Language Model Human Annotation Human in the Loop Individual Annotator
Do Large Language Models Need a Content Delivery Network?
Yihua Cheng, Kuntai Du, Jiayi Yao, Junchen Jiang
Large Language Model LLM Inference Knowledge Injection Knowledge Network
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Zhenhua Han, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
Large Language Model Retrieval Performance Attention Computation Long Context LLM Vector Retrieval
LLM as BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning
Jicong Ao, Fan Wu, Yansong Wu, Abdalla Swikir, Sami Haddadin
Large Language Model Medical LLM Task Planning Robotic Task Behavior Tree Robotic Assembly Robotic Assembly Sequence Planning
AI Conversational Interviewing: Transforming Surveys with LLMs as Adaptive Interviewers
Alexander Wuttke, Matthias Aßenmacher, Christopher Klamm, Max M. Lang, Quirin Würschinger, Frauke Kreuter
Large Language Model Research Survey Conversational Artificial Intelligence Interview Data Adaptive Questionnaire
The 20 questions game to distinguish large language models
Gurvan Richardeau, Erwan Le Merrer, Camilla Penzo, Gilles Tredan
Large Language Model Black Box Pop Quiz
Enhancing RL Safety with Counterfactual LLM Reasoning
Dennis Gross, Helge Spieker
Large Language Model Reinforcement Learning Safe Reinforcement Learning LLM Reasoning
Householder Pseudo-Rotation: A Novel Approach to Activation Editing in LLMs with Direction-Magnitude Perspective
Van-Cuong Pham, Thien Huu Nguyen
Large Language Model Novel Approach Visual Perspective
On the Diagram of Thought
Yifan Zhang, Yang Yuan, Andrew Chi-Chih Yao
Large Language Model Thought Reasoning Reasoning Process Fundamental Diagram Iterative Reasoning Robust Reasoning

Large Language Model

Papers

SC-Phi2: A Fine-tuned Small Language Model for StarCraft II Macromanagement Tasks

Strategic Insights in Human and Large Language Model Tactics at Word Guessing Games

KVPruner: Structural Pruning for Faster and Memory-Efficient Large Language Models

Large Language Models are Good Multi-lingual Learners : When LLMs Meet Cross-lingual Prompts

Hierarchical Narrative Analysis: Unraveling Perceptions of Generative AI

Enhancing Multilingual Speech Generation and Recognition Abilities in LLMs with Constructed Code-switched Data

Attention-Seeker: Dynamic Self-Attention Scoring for Unsupervised Keyphrase Extraction

Adaptive Large Language Models By Layerwise Attention Shortcuts

Challenging Fairness: A Comprehensive Exploration of Bias in LLM-Based Recommendations

Model Tells Itself Where to Attend: Faithfulness Meets Automatic Attention Steering

Multidimensional Human Activity Recognition With Large Language Model: A Conceptual Framework

Model-in-the-Loop (MILO): Accelerating Multimodal AI Data Annotation with LLMs

Do Large Language Models Need a Content Delivery Network?

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

LLM as BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planning

AI Conversational Interviewing: Transforming Surveys with LLMs as Adaptive Interviewers

The 20 questions game to distinguish large language models

Enhancing RL Safety with Counterfactual LLM Reasoning

Householder Pseudo-Rotation: A Novel Approach to Activation Editing in LLMs with Direction-Magnitude Perspective

On the Diagram of Thought