Context Learning

October 2, 2024

Bayes' Power for Explaining In-Context Learning Generalizations
Samuel Müller, Noah Hollmann, Frank Hutter
Neural Network Context Learning Real Power Bayes Rule Context Generalization
In-Context Transfer Learning: Demonstration Synthesis by Transferring Similar Tasks
Dingzirui Wang, Xuangliang Zhang, Qiguang Chen, Longxu Dou, Xiao Xu, Rongyu Cao, Yingwei Ma, Qingfu Zhu, Wanxiang Che, Binhua Li, Fei Huang, Yongbin Li
Large Language Model Context Learning Task Similarity Task Demonstration
Disentangling Latent Shifts of In-Context Learning Through Self-Training
Josip Jukić, Jan Šnajder
Natural Language Processing Context Learning Self Training Autoregressive Large Language Model Weak to Strong Latent Shift
Mitigating Copy Bias in In-Context Learning through Neuron Pruning
Ameen Ali, Lior Wolf, Ivan Titov
Large Language Model Context Learning Mitigating Bias Shot Scenario Synthetic Task Task Vector Neuron Pruning
Sparse Autoencoders Reveal Temporal Difference Learning in Large Language Models
Can Demircan, Tankred Saanum, Akshay K. Jagadish, Marcel Binz, Eric Schulz
Large Language Model Reinforcement Learning Context Learning Sparse Autoencoders
Transformers Handle Endogeneity in In-Context Linear Regression
Haodong Liang, Krishnakumar Balasubramanian, Lifeng Lai
Transformer Megatron Decepticons Transformer Based Context Learning Transformer Architecture Global Endogenous Variate
BordIRlines: A Dataset for Evaluating Cross-lingual Retrieval-Augmented Generation
Bryan Li, Samar Haider, Fiona Luo, Adwait Agashe, Chris Callison-Burch
Large Language Model Data Set Context Learning Multiple Language

October 1, 2024

Exploring the Learning Capabilities of Language Models using LEVERWORLDS
Eitan Wagner, Amir Feder, Omri Abend
Language Model Context Learning Transformer Language Model Modern Language Model Generative Learning

September 30, 2024

September 29, 2024

Efficient Long-Form Speech Recognition for General Speech In-Context Learning
Hao Yen, Shaoshi Ling, Guoli Ye
Automatic Speech Recognition Fine Tuning Context Learning Speaker Adaptation Attention Based Encoder Decoder

September 25, 2024

Can Vision Language Models Learn from Visual Demonstrations of Ambiguous Spatial Reasoning?
Bowen Zhao, Leo Parker Dirac, Paulina Varshavskaya
Vision Language Model Context Learning Large Vision Language Model Vision Task Spatial Reasoning Video Demonstration

September 24, 2024

In-Context Ensemble Learning from Pseudo Labels Improves Video-Language Models for Low-Level Workflow Understanding
Moucheng Xu, Evangelos Chatzaroulas, Luc McCutcheon, Abdul Ahad, Hamzah Azeem, Janusz Marecki, Ammar Anwar
Zero Shot Context Learning Ensemble Learning Context Modeling Human Demonstration Video Language Model

September 23, 2024

September 21, 2024

StateAct: State Tracking and Reasoning for Acting and Planning with Large Language Models
Nikolai Rozanov, Marek Rei
Large Language Model Context Learning Complex Reasoning Task Planning Internal State Artificial Intelligence Method State Observation

September 20, 2024

LLM for Everyone: Representing the Underrepresented in Large Language Models
Samuel Cahyawijaya
Medical LLM Context Learning Instruction Tuning Underrepresented Group Cross Lingual Generalization Represented Language

September 19, 2024

Zero-to-Strong Generalization: Eliciting Strong Capabilities of Large Language Models Iteratively without Gold Labels
Chaoqun Liu, Qin Chao, Wenxuan Zhang, Xiaobao Wu, Boyang Li, Anh Tuan Luu, Lidong Bing
Context Learning Supervised Fine Tuning Weak to Strong Model Capability Gold Standard Label Eliciting Code Capability

September 18, 2024

Papers

Bayes' Power for Explaining In-Context Learning Generalizations

In-Context Transfer Learning: Demonstration Synthesis by Transferring Similar Tasks

Disentangling Latent Shifts of In-Context Learning Through Self-Training

Mitigating Copy Bias in In-Context Learning through Neuron Pruning

Sparse Autoencoders Reveal Temporal Difference Learning in Large Language Models

Transformers Handle Endogeneity in In-Context Linear Regression

BordIRlines: A Dataset for Evaluating Cross-lingual Retrieval-Augmented Generation

Exploring the Learning Capabilities of Language Models using LEVERWORLDS

TaskComplexity: A Dataset for Task Complexity Classification with In-Context Learning, FLAN-T5 and GPT-4o Benchmarks

Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models

Efficient Long-Form Speech Recognition for General Speech In-Context Learning

Can Vision Language Models Learn from Visual Demonstrations of Ambiguous Spatial Reasoning?

In-Context Ensemble Learning from Pseudo Labels Improves Video-Language Models for Low-Level Workflow Understanding

In-Context Learning May Not Elicit Trustworthy Reasoning: A-Not-B Errors in Pretrained Language Models

Instruction Tuning Vs. In-Context Learning: Revisiting Large Language Models in Few-Shot Computational Social Science

StateAct: State Tracking and Reasoning for Acting and Planning with Large Language Models

LLM for Everyone: Representing the Underrepresented in Large Language Models

Zero-to-Strong Generalization: Eliciting Strong Capabilities of Large Language Models Iteratively without Gold Labels

Provable In-Context Learning of Linear Systems and Linear Elliptic PDEs with Transformers

ARTICLE: Annotator Reliability Through In-Context Learning