Retrieval-Augmented ICL

ICL: In-Context Learning

Overview

Retrieval-augmented in-context learning studies how to select and present examples or other evidence so a pretrained model can perform a task without changing its weights. Methods range from nearest-neighbor search with text or multimodal embeddings to task-aware retrievers trained with model feedback, structured context selection, and iterative agents that identify information gaps. These approaches are used in settings such as question answering, classification, reasoning, medical image interpretation, and robotics, with benchmarks often comparing retrieval against random or fixed demonstrations and against fine-tuning. A central open tension is that similarity does not always predict usefulness: retrieval must balance task relevance, context budget, evidence format, inference cost, and risks such as privacy leakage or negative transfer.

Latest papers

CardsList

49 papers5 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. Similar Is Not Useful: Selecting In-Context Demonstrations by Closed-Loop Utility

    Nov 17, 2026Jiachen Li, Zhigen Zhao, Shihao Li +3Retrieval-Augmented ICLVision-Language-Action Models

  2. VICTR: Value-Informed In-Context Learning for Vision-Language-Action Models

    Nov 5, 2026Luca Macesanu, Tianluo Zhang, Aditya Patil +5ICL for RoboticsVision-Language-Action Models

  3. Retrieval Supersedes Scale: Efficient Log Level Prediction via Multiplex Socio-Technical Context

    Nov 4, 2026Youssef Esseddiq Ouatiti, Mohammed Sayagh, Bram Adams +1Software EngineeringRetrieval-Augmented ICL

  4. Can Jev Improve Demonstration Retrieval for In-Context Learning?

    Oct 31, 2026Rui Song, Yingji Li, Hao XuIn-Context Example SelectionIn-Context Learning

  5. Beyond the Vote: When Do LLMs Add Value to Retrieval-Based Tabular Classification?

    Oct 21, 2026Ziquan Wang, Yuxuan Nie, Jian Ma +1Tabular ICLRetrieval-Augmented ICL

  6. RAG-RST: Retrieved Exemplars as In-Context Discourse Schema for RST Parsing

    Oct 15, 2026Mohammadreza Sediqin, Shlomo Engelson ArgamonRetrieval-Augmented ICL

  7. ActICL: Post-Training for Agentic Multimodal In-Context Learning

    Oct 14, 2026Yanshu Li, Ruixiang Tang, Junyi Jessy Li +1Multimodal ICLRetrieval-Augmented ICL

  8. Retrieval-Based In-Context Learning: A Domain Adaptation Framework

    Oct 5, 2026Yilun Zhu, Naihao Deng, Yingcong Li +2Distribution ShiftDomain Adaptation

  9. When Does Retrieval Help? A Study of In-Context Adaptation in Vision-Language-Action Models

    Oct 4, 2026Zixuan Liu, Joris Köster, Zizhan Zheng +1Vision-Language-Action ModelsRetrieval-Augmented ICL

  10. RETRACE: From Entangled Repair Histories to Reusable Experience for CI Repair

    Oct 3, 2026Rabeya Khatun Muna, Muhammad Ahasanuzzaman, Nakhla Rafi +3Automated Program RepairRetrieval-Augmented ICL

  11. PULSE: Identifying Demonstration-Utility Features with Sparse Autoencoders

    Sep 26, 2026Chenduo Hao, Chuanbao Gao, Pinjun Zeng +4In-Context Example SelectionIn-Context Learning

  12. URA-NER: A Unified Retrieval-Augmented Framework with Retrieval Alignment and Uncertainty Reduction for Low-Resource NER

    Sep 21, 2026Jingyu Wang, Shijie Wu, Fusheng JinNamed Entity RecognitionIn-Context Learning

  13. Representation-guided in-context learning for medical image interpretation with multimodal large language models

    Sep 21, 2026Minda Zhao, Fangyu Hu, Yan Luo +8Medical Image AnalysisMultimodal Large Language Models

  14. Option-Aware Retrieval and Task-Specific VLM Adaptation for Medical VQA

    Sep 14, 2026Tristan Kirscher, Niklas C. Koser, Soren PirkVLM AdaptationMultiple-Choice Question Answering

  15. Beyond Surface Imitation: Contrastive Modeling for Reasoning Path Alignment in Multimodal In-Context Learning

    Sep 9, 2026Mingbo Yang, Wenqiang Wang, Zhaolu Kang +4Contrastive LearningMultimodal ICL

  16. MUCnoHARM@GermEval Shared Task 2026: Retrieval-based In-Context Learning for Defamatory Offences, and Where It Falls Short

    Sep 9, 2026Kristin Gnadt, Maximilian Meidinger, Matthias AßenmacherLegal NLPIn-Context Retrieval

  17. LoGIC: Budgeted Context Construction for Node-Level Graph In-Context Learning with Tabular Foundation Models

    Sep 5, 2026Mingqi Yang, Zidong Guo, Jihui Yang +1In-Context LearningRetrieval-Augmented ICL

  18. Understanding the Surprising Generalization Properties of Tabular Foundation Models

    Aug 18, 2026Nour Shaheen, Junwei Ma, Alex Labach +3Tabular Foundation ModelsTabular ICL

  19. Localized TabICLv2: Scaling Tabular In-Context Learning through k-NN

    Aug 17, 2026Beimnet Bekele GutaTabular ICLTabular Classification

  20. Boosting Knowledge-based Visual Question Answering with Structured Context Reasoning

    Aug 17, 2026Qiyou Liu, Yong Zhang, Jianjie Luo +2Knowledge-Based Visual Question AnsweringVLM Reasoning

  21. Align-RAG: Alignment Is All You Need for TSFM In-Context Learning

    Aug 6, 2026Mohammad Asadi, Soheil Hor, Bardiya Akhbari +6Zero-Shot Time Series ForecastingRetrieval-Augmented ICL

  22. Gradient-free Task-Conditioned Retrieval for On-Device In-Context Learning

    Jul 30, 2026Xinyu Luo, Hui Liu, Yihua Shao +3In-Context Example SelectionIn-Context Retrieval

  23. RAG-HAR+: Towards Cost-Efficient LLM-Based Human Activity Recognition for Edge Deployment

    Jul 29, 2026Hansi Karunarathna, Nirhoshan Sivaroopan, Chamara Madarasingha +2Human Activity RecognitionCost-Aware Inference

  24. In-Context Learning for Wound Classification with Small Multimodal Language Models

    Jul 21, 2026George Martvel, Oskar Gustafsson, John Pavia +1Multimodal ICLMultimodal Large Language Models