In-Context Learning

Ask about this topic

Momentum

42 papers in the last four weeks, up 133% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 276

All topics
CardsList

  1. Closing the Context Gap: Activation Alignment for Tabular In-Context Learning

    Oct 5, 2026Yoel ZeldesIn-Context Learning

    Independent Researcher

  2. RepICL: Reusable In-Context Prediction Across Heterogeneous Representation Spaces

    Oct 5, 2026Yu-Hsiang Liu, Kuan-Yu Chen, Chih-Sheng Chen +3Few-Shot LearningIn-Context Learning

    SinoPac Holdings, Taipei, Taiwan

  3. Retrieval-Based In-Context Learning: A Domain Adaptation Framework

    Oct 5, 2026Yilun Zhu, Naihao Deng, Yingcong Li +2In-Context Learning

    University of Michigan. · New Jersey Institute of Technology. · Northwestern University.

  4. Rethinking Tabular Foundation Models On Data Streams

    Oct 4, 2026Nilesh Verma, Daniel Nowak-Assis, Afonso Lourenço +4Tabular Foundation ModelsTime Series Foundation Models

    AI Institute, University of Waikato, New Zealand · LIP6, CNRS, Sorbonne Universit´e, France · GECAD, Polytechnic of Porto, Portugal

  5. Diffusion Transformers are Provably Optimal In-context Generators

    Oct 4, 2026Guoji Fu, Tomoya Wakayama, Ryotaro Kawata +3Diffusion TransformersIn-Context Learning

    National University of Singapore · RIKEN AIP · The University of Tokyo +1

  6. Pooling Helps, Learned Weighting Hurts In-Context: Decomposing Group Attention

    Oct 1, 2026Michael Fore, James Mason Inder, Mrishika Nair +2Global Average PoolingIn-Context Learning

    Amazon

  7. In-context Learning of Single-index Targets: Comparing Kernel and Feature Learners

    Oct 1, 2026Haotian Gu, Yizhou Xu, Lenka ZdeborováIn-Context LearningLinear Attention

    Statistical Physics of Computation Laboratory, École Polytechnique Fédérale de Lausanne (EPFL) · University of Chinese Academy of Sciences · Information, Learning and Physics Laboratory, École Polytechnique Fédérale de Lausanne (EPFL)

  8. Capturing In-Context Learning Dynamics with Task Operators

    Oct 1, 2026Guangzhi Xiong, Zhenghao He, Bohan Liu +3In-Context Learning

    University of Virginia

  9. Efficient Task Adaptation in Large Language Models: A Survey of Weight-Based, Prompt-Based, and Embedding-Based Adaptations

    Oct 1, 2026Jungwon Park, Changin Choi, Jimyeong Kim +2Efficient Task AdaptationParameter-Efficient Adaptation

    RICS · Daegu Gyeongbuk Institute of Science and Technology · IPAI +3

  10. Rules Amortize, Pairings Don't: Linguistic Structure Determines What Latent Task Representations Can Replace In-Context Learning

    Sep 30, 2026Gunmay JhingranIn-Context LearningLinguistics

    Delhi Technological University

  11. Are In-Context Images Worth 10 Dimensions?

    Sep 29, 2026Adhemar de Senneville, Xavier Bou, Jérémy Anger +2In-Context LearningIn-Context

    Université Paris-Saclay, CNRS, ENS Paris-Saclay, Centre Borelli, Paris, France · Pôle recherche de l’AMIAD, Palaiseau, France · Institut Universitaire de France, Paris, France

  12. Exploring In-Context Learning for Handwritten Text Recognition

    Sep 29, 2026Eric Ayllon, Abel Gandia, Jorge Calvo-ZaragozaHandwritten Text RecognitionHandwriting

  13. Support-Set Target Leakage in Relational Foundation Models during In-Context Learning: Model Dependence and Evaluation Reliability

    Sep 29, 2026Roshan Reddy Upendra, Alexandre Dorais, Joe Meyer +6Relational Deep LearningRelational Databases

    SAP Palo Alto, CA, USA · SAP Montreal, Canada · SAP Seattle, WA, USA

  14. Support-Set Target Leakage in Relational Foundation Models during In-Context Learning: Impact, Detection, and Mitigation

    Sep 28, 2026Roshan Reddy Upendra, Alexandre Dorais, Joe Meyer +5Relational DatabasesIn-Context Learning

    SAP

  15. In-Context Learning Amplifies a Latent Symbolic Circuit

    Sep 28, 2026Melissa WesselIn-Context LearningIn-Context

    Independent Researcher.

  16. LoopICL: Looping a single transformer block to solve tabular tasks

    Sep 28, 2026Amir Rezaei Balef, Katharina EggenspergerTabular Foundation ModelsTransformer Architectures

    TU Dortmund University, Dortmund, Germany · Lamarr Institute for Machine Learning and Artificial Intelligence, Dortmund, Germany · University of Tübingen, Tübingen, Germany

  17. In-Context Learning for Robots: Methods and Applications

    Sep 28, 2026Haojian Huang, Zexi Li, Junhao Guo +36In-Context LearningRobot Systems

    Knowin AI · HKUST(GZ) · The Chinese University of Hong Kong +5

  18. Neural Language Models Learn the Contextual Distributions of Dependency Structures: a statistical learning theory to compositionality

    Sep 28, 2026Wang Bojun, Junjie Chen, Holly Jenkins +1Language ModelingIn-Context Learning

    Department of Education, University of Oxford, Oxford, United Kingdom · Department of Statistics, University of Oxford, Oxford, United Kingdom

  19. Shaping Persistent Representations from Independent Interactions

    Sep 28, 2026Ji Dai, Quan Fang, Junyu Gao +4Transition LearningIn-Context Learning

    Beijing University of Posts and Telecommunications · Institute of Automation, Chinese Academy of Sciences · Shenzhen University +1

  20. RoboICL: Embodied In-Context Learning with GPT-6 Astra

    Sep 28, 2026Fangcheng Liu, Yeqing Shen, Anda Cheng +7Scalable Robot LearningRobocasa

    Samsung Research, Beijing, China · Samsung Robotics eXperience · Shanghai Jiao Tong University

  21. You Only Edit Once: Incentivizing In-Context Capability of LLMs via Local Demonstration Refinement

    Sep 27, 2026Jiarong Wen, Qi Wang, Yun Qu +8In-Context LearningIn-Context

    Department of Automation, Tsinghua University

  22. MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression

    Sep 24, 2026Youpeng Zhao, Tian Tan, Liqian Peng +2Large Language Model CompressionKey-Value Cache Compression

    Google · University of Central Florida

  23. Transformers as Cross-Task Learners: Shared Structure Drives Sample Efficiency in In-Context Learning

    Sep 24, 2026Zhongjie Shi, Rongjie Lai, Alexander Cloninger +1In-Context LearningTransformer Architectures

    School of Mathematics, Georgia Institute of Technology, Atlanta, GA 30332, United States · Department of Mathematics, Purdue University, West Lafayette, IN 47907, United States · Department of Mathematics and Halıcıoğlu Data Science Institute, University of California, San Diego, La Jolla, CA 92093, United States

  24. M2^2PFN: End-to-End Disentangled Alignment for Generalizable Multimodal In-Context Learning in Alzheimer's Disease

    Sep 23, 2026Lujia Zhong, Shuo Huang, Jianwei Zhang +2AlzheimerMultimodal Neuroimaging

    Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA · Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA · Alfred E. Mann Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA 90089, USA

  25. Gender Bias in Vision-Language In-Context Learning

    Sep 23, 2026Tong Xiang, Yuta Nakashima, Noa GarciaGender BiasGender

    The University of Osaka, Japan

  26. What Do Tabular Foundation Models Compute In Context? In-Situ Representation Refinement through Attention-Gated Updates

    Sep 23, 2026Tian Zhou, Beverly Jin, Linxiao Yang +6Tabular Foundation ModelsIn-Context Learning

    Ant Group · Independent Researcher

  27. When Context Misleads: In-context Learning with Jurisdiction in Large Language Models

    Sep 23, 2026Pei-lin Li, Qingle Liu, Junyang Feng +4In-Context LearningIn-Context

    Department of Computer Science and Technology, Tsinghua University · School of Integrated Circuits, Huazhong University of Science and Technology

  28. In-Context Guidance: Learning Inter-Task Synergies via Numerical Foundational Models for Few-Shot Multitask Optimization

    Sep 22, 2026Tingyang Wei, Haofeng Wu, Jiao Liu +3Multi--Task LearningMulti-Objective Optimization

    College of Computing and Data Science, Nanyang Technological University, Singapore · Institute of Advanced Intelligence and Computing, Agency for Science, Technology and Research, Singapore · Singapore Institute of Manufacturing Technology (SIMTech), Agency for Science, Technology and Research, Singapore +1

  29. Zeva-Ego: Egocentric Mid-Training with In-Context Causal Learning for Robot Manipulation

    Sep 21, 2026Bingjia Huang, Xin Ding, Fu Chen +5Robotic ManipulationEmbodied Artificial Intelligence

    Institute for AI Industry Research (AIR), Tsinghua University; Z-Trans AI

  30. Representation-guided in-context learning for medical image interpretation with multimodal large language models

    Sep 21, 2026Minda Zhao, Fangyu Hu, Yan Luo +8Medical Vision-Language ModelsMultimodal Clinical Data

    Harvard AI and Robotics Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA · Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA · Department of Ophthalmology, National Taiwan University Hospital, Taipei City, Taiwan +6

  31. InterHier: Learning Interconnected Hierarchical Semantics for Open-Vocabulary Object Detection

    Sep 21, 2026Yeong-Jin Kim, Ho-Joong Kim, Seong-Whan LeeOpen-Vocabulary Object DetectionSemantic Representations

    Department of Artificial Intelligence, Korea University, Seoul 02841, Republic of Korea

  32. Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data

    Sep 16, 2026Jinli Hu, Ross M. Clarke, Yichuan Zhang +1Model WeightsIn-Context Learning

    Boltzbit Limited · University of Cambridge

  33. Long-Context Demonstration Selection Using State Space Models

    Sep 15, 2026Ziniu Zhang, Zhenshuo Zhang, Ruoxuan Xiong +2Efficient Long-Context InferenceIn-Context Learning

    Northeastern University · Emory University

  34. Large Language Models Develop Belief State Geometry In-Context

    Sep 15, 2026Daniel Balcells, Andrew Jun Lee, Chirag Rastogi +3In-Context LearningIn-Context

    Independent · UCLA · UIUC +2

  35. On the Importance of Gating: Memorization vs. In-Context Learning in State Space Models

    Sep 15, 2026William L. Tong, Aryo Lotfi, Emmanuel Abbe +6State Space ModelsSequence Modeling

    Harvard University · Apple

  36. V-ICAL Bench: Evaluating Video In-Context Learning for Multimodal Agents in Interactive Environments

    Sep 14, 2026Ziqian Fan, Shibo Xu, Junjie Li +8Multimodal AgentsIn-Context Learning

    South China University of Technology · Shanghai Jiao Tong University · Fudan University +4

  37. Distilling Foundation Models for Agentic What-If Reasoning:Cost, Latency, and Governance in a Hybrid LLM+SLM Architecture

    Sep 14, 2026Sourish Dey, Aditya KumarTabular Foundation ModelsAgentic Reasoning

    Machine Learning SumUp, Berlin

  38. TwinICL: Diagnosing Multimodal In-Context Learning through Paired Counterfactuals

    Sep 14, 2026Zihan Xue, Po-Yi Lu, Serhii Honcharenko +5Multimodal LearningIn-Context Learning

    University of California, Los Angeles · 2National Taiwan University · 3Texas A&M University +2

  39. One Example Is Enough to Pass Fairness Benchmarks: Rethinking Fairness Evaluation for Aligned LLMs

    Sep 14, 2026Naihao Deng, Samee Arif, Shuaichen Chang +2Algorithmic FairnessLarge Language Model Alignment

    University of Michigan · The Ohio State University · University of Aberdeen +1

  40. SWRouter: Similarity-Contractive Window Routing for Multi-Turn Large Language Model Conversations

    Sep 12, 2026Yu Wang, Yuchen Li, Rui Kong +11Large Language Model RoutingDialogue Benchmarks

    Department of Big Data Management and Application, Shanghai Jiao Tong University, Shanghai, China · School of Computer Science, Shanghai Jiao Tong University, Shanghai, China · Baidu Inc., Beijing, China +3

  41. Evaluating Context Segmentation in Locally Deployable SLMs for Cybersecurity CTF Tasks

    Sep 11, 2026Sebastiano Nordio, Michele LottoCybersecuritySmall Large Language Models

    Independent · University of Genoa, Via All’Opera Pia, 16145 Genoa, Italy

  42. Amortized Low-Rank Adaptation for Model-Based Reinforcement Learning

    Sep 10, 2026Fernando Palafox, David Fridovich-KeilModel-Based Reinforcement LearningIn-Context Learning

    University of Texas at Austin Austin, TX, USA

  43. Beyond Surface Imitation: Contrastive Modeling for Reasoning Path Alignment in Multimodal In-Context Learning

    Sep 9, 2026Mingbo Yang, Wenqiang Wang, Zhaolu Kang +4Multimodal Large Language ModelsIn-Context Learning

    Sun Yat-Sen University Shenzhen, Guangdong, China · Peking University Beijing, Beijing, China · Sun Yat-Sen University Shenzhen, Guangdong, China Pengcheng Laboratory +1

  44. MUCnoHARM@GermEval Shared Task 2026: Retrieval-based In-Context Learning for Defamatory Offences, and Where It Falls Short

    Sep 9, 2026Kristin Gnadt, Maximilian Meidinger, Matthias AßenmacherHate SpeechViolence Detection

    Central Office for Information Technology in the Security Sector (ZITiS), Munich, Germany · Department of Statistics, LMU Munich, Germany · Munich Center for Machine Learning (MCML), Germany

  45. Structural Jailbreaks Generalize but Do Not Compound: A cross-provider and multilingual study of Involuntary In-Context Learning

    Sep 8, 2026Tejasvi C. AddagadaLarge Language Model JailbreaksJailbreak Attacks

    Independent researcher

  46. Xiaomi-TabLDM: A Tabular Foundation Model Technical Report

    Sep 3, 2026Xiaomi-TabLDM Team, :, Penghui Wang +10Tabular Foundation ModelsMle-Bench Lite

    Xiaomi

  47. Typological Feature Prediction with Large Language Models: An In-Context Learning Approach

    Sep 3, 2026Qianwen Wang, York Hay Ng, Aditya Khan +1TypologyLinguistics

    University of Toronto, Canada · Columbia · Ontario Tech University, Canada

  48. FoRIS: Progressive Foreground Refinement for Training-Free In-Context Segmentation

    Sep 3, 2026Ming Hu, Jianfu Yin, Mingyu Dou +5In-Context Learning

    Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Xi’an Jiaotong University +1

  49. LLMs Learn Better In-Context from Rules than from Examples

    Sep 2, 2026Xiang Fu, Seungmin Cho, Yukyung Lee +1In-Context LearningIn-Context

    Boston University

  50. Unifying Conformal Language Tasks with In-Context Ensembles

    Sep 2, 2026Xiao Shi Huang, Chen-Yuan Lin, Bruce Kuwahara +2Natural Language ProcessingIn-Context Learning

    Signal 1 AI · Layer 6 AI

  51. KSG-Net: Key-Sparse and Global-Context Learning for Maritime 3D Ship Detection

    Sep 2, 2026Zhouyuan Huai, Meiqi Wan, Yan Yang +4Ship Detection3D Object Detection

    School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan 430065, China · State Key Laboratory of Robotics and Intelligent Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China · China University of Chinese Academy of Sciences, Beijing 100049, China +1

  52. Prompt-Robust Language Models: Which Training Strategies Work?

    Sep 1, 2026Frederic Sadrieh, Michal ŠtefánikInstruction-Tuned ModelsIn-Context Learning

    Center for Information and Language Processing, LMU Munich · R&D Centre for Large Language Models, National Institute of Informatics, Japan

  53. Compile, Don't Memorize: A Context Compilation Architecture (CCA) for In-Context Learning

    Sep 1, 2026Jinhu Qi, Minda Hu, Wentao Zhang +4In-Context LearningSkills

    The Chinese University of Hong Kong · Macao Polytechnic University · Xi’an Jiaotong University +1

  54. Type-Balanced Contextual Learning for Incremental Named Entity Recognition

    Aug 31, 2026Duzhen Zhang, Yahan Yu, Xiuyi Chen +2Named-Entity RecognitionIn-Context Learning

    Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE · Kyoto University, Kyoto, Japan · Institute of Automation, Chinese Academy of Sciences, Beijing, China +2

  55. Zeva: In-Context Causal Learning for Generalizable Embodied Manipulation

    Aug 31, 2026Fu Chen, Xin Ding, Bingjia Huang +8In-Context LearningIn-Context

    Institute for AI Industry Research (AIR), Tsinghua University

  56. ChorusTIC: Training-Free Multivariate Time Series Classification via Chorus In-Context Learning

    Aug 25, 2026Juntao Fang, Shifeng Xie, Ruichu Cai +6Time-Series ClassificationTime Series Foundation Models

    Guangdong University of Technology · Huawei Noah’s Ark Lab · Université Paris Cité +2

  57. Beyond Attention Masks: Instruction Anchoring for Efficient In-Context Diffusion Generation

    Aug 21, 2026Yangshuai Liu, Zheming Li, Jiaao Li +4Diffusion TransformersMultimodal Generation

    Harbin Institute of Technology · KlingAI Research

  58. From Answers to Policies: Efficient In-Context Learning System through Emulating Expert Investigation

    Aug 17, 2026Minh-Ha Nguyen, Ngoc-Ngo Quang Tran, Thuy Dung Nguyen +1Large Language Model Policy OptimizationIn-Context Learning

    Department of Epidemiology, Vanderbilt University, Nashville, TN, USA · Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN, USA · Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, USA +1

  59. LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure

    Aug 13, 2026Fanfei Li, Jana Zeller, Manuel Prada-Corral +4CurriculumPedagogical Frameworks

    MPI-IS, Ellis Institute · MPI-IS, Ellis Institute, ETHZ · ETHZ

  60. When Is a Task Vector Enough? An Empirical Theory of Implicit Multimodal ICL

    Aug 13, 2026Jiaqian LiIn-Context LearningMultimodal Understanding

    Brown University