Large Language Model

Large language models (LLMs) are sophisticated AI systems designed to process and generate human-like text, aiming to improve various natural language processing tasks. Current research focuses on enhancing LLM safety, efficiency (through techniques like quantization and optimized decoding), and fairness, as well as improving their ability to perform complex reasoning and handle diverse instructions. These advancements are significant because they address critical limitations in current LLMs and pave the way for broader applications across diverse fields, including healthcare, legal tech, and autonomous systems.

Papers

December 14, 2024

Inference Scaling for Bridging Retrieval and Augmented Generation
Youngwon Lee, Seung-won Hwang, Daniel Campos, Filip Graliński, Zhewei Yao, Yuxiong He
Large Language Model Retrieval Augmented Generation Scientific Inference Scalable Inference Augmented Generation

December 13, 2024

Too Big to Fool: Resisting Deception in Language Models
Mohammad Reza Samsami, Mats Leon Richter, Juan Rodriguez, Megh Thakkar, Sarath Chandar, Maxime Gasse
Large Language Model Language Model Context Information Task Specific Unsafe Prompt Deception Cue
RAGServe: Fast Quality-Aware RAG Systems with Configuration Adaptation
Siddhant Ray, Rui Pan, Zhuohan Gu, Kuntai Du, Ganesh Ananthanarayanan, Ravi Netravali, Junchen Jiang
Large Language Model Retrieval Augmented Generation
On Adversarial Robustness and Out-of-Distribution Robustness of Large Language Models
April Yang, Jordan Tab, Parth Shah, Paul Kotchavong
Large Language Model Language Model Native Robustness Adversarial Robustness Adversarial Perturbation Robustness Evaluation Distribution Robustness
One world, one opinion? The superstar effect in LLM responses
Sofie Goethals, Lauren Rhue
Large Language Model World Event Non Negative Textual Response Linguistic Diversity Human Opinion LLM Response Lombard Effect Global Semantics
Cultural Evolution of Cooperation among LLM Agents
Aron Vallinder, Edward Hughes
Large Language Model Artificial Intelligence LLM Agent Long Term Cooperation Emergent Behavior Indirect Reciprocity Cultural Evolution
Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Unanswerable Questions and Ambiguous Prompts
Hazel Kim, Adel Bibi, Philip Torr, Yarin Gal
Large Language Model General Analysis Multi Layer Information Flow Model Hallucination LLM Hallucination Cross Layer Unanswerable Question
Efficient Continual Pre-training of LLMs for Low-resource Languages
Arijit Nag, Soumen Chakrabarti, Animesh Mukherjee, Niloy Ganguly
Large Language Model Medical LLM Large Corpus Low Resource Language High Resource Language Continual Pre Training
Retrieval-Augmented Semantic Parsing: Using Large Language Models to Improve Generalization
Xiao Zhang, Qianru Meng, Johan Bos
Large Language Model Strong Generalization Semantic Parsing Lexical Knowledge
From Allies to Adversaries: Manipulating LLM Tool-Calling through Adversarial Injection
Haowei Wang, Rupeng Zhang, Junjie Wang, Mingyang Li, Yuekai Huang, Dandan Wang, Qing Wang
Large Language Model Adversary Agent Malicious Sample Tool Invocation
MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples
Shuo Xie, Fangzhi Zhu, Jiahui Wang, Lulu Wen, Wei Dai, Xiaowei Chen, Junxiong Zhu, Kai Zhou, Bo Zheng
Large Language Model Preference Optimization Negative Sample Preference Dataset Arbitrary Natural Language Text
ASLoRA: Adaptive Sharing Low-Rank Adaptation Across Layers
Junyan Hu, Xue Xiao, Mengqi Zhang, Xiao Chen, Zhaochun Ren, Zhumin Chen, Pengjie Ren
Large Language Model Fine Tuning Multi Layer Adaptive Importance Adaptation Concern NLP Task Parameter Sharing
RETQA: A Large-Scale Open-Domain Tabular Question Answering Dataset for Real Estate Sector
Zhensheng Wang, Wenmian Yang, Kun Zhou, Yiquan Zhang, Weijia Jia
Large Language Model Data Set Source Domain QA Datasets Question Answering System Table Question Answering Real Estate
GAOKAO-Eval: Does high scores truly reflect strong capabilities in LLMs?
Zhikai Lei, Tianyi Liang, Hanglei Hu, Jin Zhang, Yunhua Zhou, Yunfan Shao, Linyang Li, Chenchui Li, Changbo Wang, Hang Yan, Qipeng Guo
Large Language Model Capability Evolution Comprehensive Benchmark LLM Evaluation High Performance
A Comparative Study of LLMs, NMT Models, and Their Combination in Persian-English Idiom Translation
Sara Rezaeimanesh, Faezeh Hosseini, Yadollah Yaghoobzadeh
Large Language Model Comparative Study New Combination Neural Machine Translation Model
Small Language Model as Data Prospector for Large Language Model
Shiwen Ni, Haihong Wu, Di Yang, Qiang Qu, Hamid Alinejad-Rokny, Min Yang
Large Language Model Language Model Instruction Data High Quality Data Data Analysis Agent
AI and the Future of Digital Public Squares
Beth Goldberg, Diana Acosta-Navas, Michiel Bakker, Ian Beacock, Matt Botvinick, Prateek Buch, Renée DiResta, Nandika Donthi, Nathanael Fast, Ravi Iyer, Zaria Jalan, Andrew Konya, Grace Kwak Danciu, Hélène Landemore, Alice Marwick, Carl Miller, Aviv Ovadya, Emily Saltz, Lisa Schirch, Dalit Shalom, Divya Siddarth, Felix Sieker, Christopher Small, Jonathan Stray, Audrey Tang, Michael Henry Tessler, Amy Zhang
Large Language Model Artificial Intelligence Future Reasoning Online Discourse Deliberation Model
Llama 3 Meets MoE: Efficient Upcycling
Aditya Vavre, Ethan He, Dennis Liu, Zijie Yan, June Yang, Nima Tajbakhsh, Ashwath Aithal
Large Language Model High Efficiency Mixture of Expert LLaMa LlamaCare
Enhancing Nursing and Elderly Care with Large Language Models: An AI-Driven Framework
Qiao Sun, Jiexin Xie, Nanyang Ye, Qinying Gu, Shijie Guo
Large Language Model AI Based Framework Nursing Activity
B-VLLM: A Vision Large Language Model with Balanced Spatio-Temporal Tokens
Zhuqiang Lu, Zhenfei Yin, Mengwei He, Zhihui Wang, Zicheng Liu, Zhiyong Wang, Kun Hu
Large Language Model Large Vision Language Model Video Understanding K TOKEN Visual Token Visual Understanding Task

Large Language Model

Papers

Inference Scaling for Bridging Retrieval and Augmented Generation

Too Big to Fool: Resisting Deception in Language Models

RAGServe: Fast Quality-Aware RAG Systems with Configuration Adaptation

On Adversarial Robustness and Out-of-Distribution Robustness of Large Language Models

One world, one opinion? The superstar effect in LLM responses

Cultural Evolution of Cooperation among LLM Agents

Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Unanswerable Questions and Ambiguous Prompts

Efficient Continual Pre-training of LLMs for Low-resource Languages

Retrieval-Augmented Semantic Parsing: Using Large Language Models to Improve Generalization

From Allies to Adversaries: Manipulating LLM Tool-Calling through Adversarial Injection

MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples

ASLoRA: Adaptive Sharing Low-Rank Adaptation Across Layers

RETQA: A Large-Scale Open-Domain Tabular Question Answering Dataset for Real Estate Sector

GAOKAO-Eval: Does high scores truly reflect strong capabilities in LLMs?

A Comparative Study of LLMs, NMT Models, and Their Combination in Persian-English Idiom Translation

Small Language Model as Data Prospector for Large Language Model

AI and the Future of Digital Public Squares

Llama 3 Meets MoE: Efficient Upcycling

Enhancing Nursing and Elderly Care with Large Language Models: An AI-Driven Framework

B-VLLM: A Vision Large Language Model with Balanced Spatio-Temporal Tokens