In-Context Example Selection

Overview

The field studies which labeled examples, demonstrations, or other context to place in a model’s prompt so it can generalize to a new query. Common approaches retrieve semantically similar examples, while others optimize for diversity and latent coverage, task-specific utility, decision-boundary cases, or signals from model activations; learned ranking, bandit, and reinforcement-learning methods also refine selections. Methods are evaluated across settings such as classification, reasoning, translation, multimodal tasks, and tabular prediction, often measuring accuracy alongside prompt length, latency, or robustness to noise. A central tension is that similarity is cheap but can miss useful contrasts, while more tailored selection can improve results yet may be costly or fail to transfer across models and tasks.

Latest papers

CardsList

32 papers3 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. The Price of Choosing Examples: Context Overfitting in Adaptive In-Context Learning

    Nov 16, 2026Xiaoyu Li, Jiangxuan LongIn-Context Example SelectionIn-Context Learning

  2. Revisiting What Makes a Good Context Subset: A Sparse Latent Basis Perspective

    Nov 14, 2026Cen-Jhih Li, Siddhant Chaudhary, Aditya BhaskaraIn-Context Example SelectionIn-Context Learning

  3. Can Jev Improve Demonstration Retrieval for In-Context Learning?

    Oct 31, 2026Rui Song, Yingji Li, Hao XuIn-Context Example SelectionIn-Context Learning

  4. POS-Signature Demonstration Retrieval for In-Context Dependency Parsing

    Oct 22, 2026Muhammad Azam Afridi, Rajab Ali, Marco PassarottiIn-Context Example SelectionDependency Parsing

  5. From Observation to Intervention: Distilling Self-Generated In-Context Demonstrations via Executable Causal Intervention

    Oct 15, 2026Minming Ye, Min Liu, Haoang Chi +2In-Context LearningIn-Context Example Selection

  6. PULSE: Identifying Demonstration-Utility Features with Sparse Autoencoders

    Sep 26, 2026Chenduo Hao, Chuanbao Gao, Pinjun Zeng +4In-Context Example SelectionIn-Context Learning

  7. ClusterFewshot: Improving Few-shot Optimization for LLMs workflow

    Sep 22, 2026Omri Bar Haim, Shahar Katz, Lior WolfIn-Context Example SelectionLarge Language Model-Guided Optimization

  8. Long-Context Demonstration Selection Using State Space Models

    Sep 15, 2026Ziniu Zhang, Zhenshuo Zhang, Ruoxuan Xiong +2In-Context Example SelectionIn-Context Learning

  9. Data Efficient Sample Selection for In-Context Learning

    Sep 6, 2026V Venktesh, Cem Levi, Avishek AnandIn-Context Example SelectionIn-Context Learning

  10. ARASH: Adaptive Retrieval And Shot Selection for Tabular Prediction

    Aug 18, 2026Samirasadat Jamalidinan, Yue Xu, Kazem CheshmiTabular PredictionTabular ICL

  11. When Less Is Enough: Context Selection and Prompting Strategies for Bengali News Headline Generation

    Aug 16, 2026Muhammad Ashad Kabir, Kawsar Ahmed, Md. OsamaLLM PromptingText Generation

  12. MAG: MAnifold Guided Semi-Supervised Multi-modal In-Context Learning

    Aug 13, 2026Zirui Cheng, Xun Xu, Tiankai Chen +7In-Context Example SelectionMultimodal ICL

  13. EdgeLM: Edge Demonstrations for Language Models' Table Understanding

    Aug 5, 2026Soroush Omidvartehrani, Mohammadamin Habibollah, Mohammadreza Daviran +1In-Context Example SelectionIn-Context Learning

  14. Gradient-free Task-Conditioned Retrieval for On-Device In-Context Learning

    Jul 30, 2026Xinyu Luo, Hui Liu, Yihua Shao +3In-Context Example SelectionIn-Context Retrieval

  15. Bounded Context Management for Tabular Foundation Models on Stream Learning

    Jun 17, 2026Jinmo Lee, Doyun Choi, Moongi Choi +1In-Context Example SelectionTabular Foundation Models

  16. Encode Errors: Representational Retrieval of In-Context Demonstrations for Multilingual Grammatical Error Correction

    Jun 13, 2026Guangyue Peng, Wei Li, Wen Luo +1In-Context Example SelectionGrammatical Error Correction

  17. Activation-Based Active Learning for In-Context Learning: Challenges and Insights

    Jun 3, 2026Yaseen M. Osman, Geoff V. Merrett, Stuart E. MiddletonIn-Context Example SelectionActive Learning

  18. Easier to Judge than to Find: Predicting In-Context Learning Success for Demonstration Selection

    May 18, 2026Haochun Wang, Chaofen Yang, Jiatong Liu +5LLM Inference EfficiencyIn-Context Example Selection

  19. VIP-COP: Context Optimization for Tabular Foundation Models

    May 13, 2026Yilong Chen, Xueying Ding, Leman AkogluIn-Context Example SelectionTabular Foundation Models

  20. GRaSp: Automatic Example Optimization for In-Context Learning in Low-Data Tasks

    May 8, 2026Simen Bihaug-Frøyland, Henrik BrådlandIn-Context Example SelectionIn-Context Learning

  21. UCS: Estimating Unseen Coverage for Improved In-Context Learning

    Apr 13, 2026Jiayi Xin, Xiang Li, Evan Qiang +4In-Context Example SelectionIn-Context Learning

  22. Learning to Select Visual In-Context Demonstrations

    Mar 24, 2026Eugene Lee, Yu-Chi Lin, Jiajie DiaoIn-Context Example SelectionMultimodal ICL

  23. CFMS: Towards Explainable and Fine-Grained Chinese Multimodal Sarcasm Detection Benchmark

    Mar 23, 2026Junzhao Zhang, Hsiu-Yuan Huang, Chenming Tang +2Sarcasm DetectionMultimodal Model Evaluation

  24. Optimizing In-Context Demonstrations for LLM-based Automated Grading

    Feb 28, 2026Yucheng Chu, Hang Li, Kaiqi Yang +4EducationAutomated Grading