Context Learning

November 4, 2024

Fair In-Context Learning via Latent Concept Variables
Karuna Bhaila, Minh-Hao Van, Kennedy Edemacu, Chen Zhao, Feng Chen, Xintao Wu
Large Language Model Context Learning Latent Variable Fairness Regularization Latent Category
TI-PREGO: Chain of Thought and In-Context Learning for Online Mistake Detection in PRocedural EGOcentric Videos
Leonardo Plini, Luca Scofano, Edoardo De Matteis, Guido Maria D'Amely di Melendugno, Alessandro Flaborea, Andrea Sanchietti, Giovanni Maria Farinella, Fabio Galasso, Antonino Furnari
Data Detection Context Learning Egocentric Video Open Set Thought Reasoning Human Answer Mistake Step Recognition
Pretrained transformer efficiently learns low-dimensional target functions in-context
Kazusato Oko, Yujin Song, Taiji Suzuki, Denny Wu
Neural Network Context Learning Simple Function Contextual Data Efficient in Context Learning Feature Dimension
Provably Transformers Harness Multi-Concept Word Semantics for Efficient In-Context Learning
Dake Bu, Wei Huang, Andi Han, Atsushi Nitanda, Taiji Suzuki, Qingfu Zhang, Hau-San Wong
High Efficiency Context Learning Transformer Based Large Language Model Linear Transformer Word Semantics
Shortcut Learning in In-Context Learning: A Survey
Rui Song, Yingji Li, Lida Shi, Fausto Giunchiglia, Hao Xu
Timely Survey Strong Generalization Context Learning Shortcut Learning Shortcut Feature Robust Decision
N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needs
Ilya Zisman, Alexander Nikulin, Andrei Polubarov, Nikita Lyubaykin, Vladislav Kurenkov
Reinforcement Learning Context Learning Core Stability Head Transformer
RuAG: Learned-rule-augmented Generation for Large Language Models
Yudi Zhang, Pei Xiao, Lu Wang, Chaoyun Zhang, Meng Fang, Yali Du, Yevgeniy Puzyrev, Randolph Yao, Si Qin, Qingwei Lin, Mykola Pechenizkiy, Dongmei Zhang, Saravan Rajmohan, Qi Zhang
Natural Language Processing Context Learning Faithful Generation First Order Logic Logical Rule LLM Prompt

November 3, 2024

Robust Neural Processes for Noisy Data
Chen Shapira, Dan Rosenbaum
Context Learning Noisy Data Different Context Neural Process Neural Network Robustness

October 31, 2024

Dynamic Uncertainty Ranking: Enhancing In-Context Learning for Long-Tail Knowledge in LLMs
Shuyang Yu, Runxue Bao, Parminder Bhatia, Taha Kass-Hout, Jiayu Zhou, Cao Xiao
Large Language Model Context Learning Question Answering Knowledge Based Long Tail

October 30, 2024

October 29, 2024

October 28, 2024

Similarity-based context aware continual learning for spiking neural networks
Bing Han, Feifei Zhao, Yang Li, Qingqun Kong, Xianqi Li, Yi Zeng
Continual LEArning Context Learning Active Learning Continual Learning Network Programming SNN Model Adjacent Context Coordination Network Contextual Similarity

October 27, 2024

Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identifications
Xilun Zhang, Shiqi Liu, Peide Huang, William Jongwon Han, Yiqi Lyu, Mengdi Xu, Ding Zhao
Context Learning Real World Complex Prompt Person Identification Interactive Simulation Simulation Environment Sim to Real Transfer Sim to Real

October 26, 2024

DAWN-ICL: Strategic Planning of Problem-solving Trajectories for Zero-Shot In-Context Learning
Xinyu Tang, Xiaolei Wang, Wayne Xin Zhao, Ji-Rong Wen
Context Learning Monte Carlo Tree Search Problem Solving Strategic Planning Zero Shot in Context

October 25, 2024

SAD: State-Action Distillation for In-Context Reinforcement Learning under Random Policies
Weiqin Chen, Santiago Paternain
Reinforcement Learning Context Learning Action Space Mutual Distillation Deterministic Policy Autoregressive Neural Network Behavior Policy

October 24, 2024

Label Set Optimization via Activation Distribution Kurtosis for Zero-shot Classification with Generative Models
Yue Li, Zhixue Zhao, Carolina Scarton
Generative Model Context Learning Zero Shot Classification Lexical Collocation Label Free Model Evaluation Kurtosis Concentration

Papers

Fair In-Context Learning via Latent Concept Variables

TI-PREGO: Chain of Thought and In-Context Learning for Online Mistake Detection in PRocedural EGOcentric Videos

Pretrained transformer efficiently learns low-dimensional target functions in-context

Provably Transformers Harness Multi-Concept Word Semantics for Efficient In-Context Learning

Shortcut Learning in In-Context Learning: A Survey

N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needs

RuAG: Learned-rule-augmented Generation for Large Language Models

Robust Neural Processes for Noisy Data

Dynamic Uncertainty Ranking: Enhancing In-Context Learning for Long-Tail Knowledge in LLMs

DemoCraft: Using In-Context Learning to Improve Code Generation in Large Language Models

EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning

Comparative Analysis of Demonstration Selection Algorithms for LLM In-Context Learning

Toward Understanding In-context vs. In-weight Learning

Improving In-Context Learning with Small Language Model Ensembles

On the Role of Depth and Looping for In-Context Learning with Task Diversity

Similarity-based context aware continual learning for spiking neural networks

Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identifications

DAWN-ICL: Strategic Planning of Problem-solving Trajectories for Zero-Shot In-Context Learning

SAD: State-Action Distillation for In-Context Reinforcement Learning under Random Policies

Label Set Optimization via Activation Distribution Kurtosis for Zero-shot Classification with Generative Models