cs.LGJan 29, 2026

SWE-Spot: Building Small Repo-Experts with Repository-Centric Learning

Authors: Jinjun Peng, Magnus Saebo, Tianjun Zhong, Junfeng Yang, Shi-Xiong Zhang, Baishakhi Ray, Simin Chen, Yangruibo Ding

Organizations: Department of Computer Science, Columbia University, New York, USA · Computer Science Department, University of California, Los Angeles, California, USA.

Abstract

The deployment of coding agents in privacy-sensitive and resource-constrained environments drives the demand for capable open-weight Small Language Models (SLMs). However, they suffer from a fundamental capability gap: unlike frontier large models, they lack the inference-time strong generalization to handle complicated, unfamiliar codebases. We identify that the prevailing Task-Centric Learning (TCL) approach, which scales exposure across disparate repositories, fails to address this limitation. In response, we propose Repository-Centric Learning (RCL), a shift that prioritizes vertical, single-repository depth over horizontal, single-task breadth for SLM training. To accomplish this depth, we design a four-unit Repository-Centric Experience, transforming static codebases into interactive learning signals, to train SWE-Spot-4B, a family of highly compact models built as repo-specialized experts. Under controlled comparisons with the same teacher and data budget, RCL consistently outperforms TCL across tasks, teachers, model scales, and programming languages. On seven target repositories, SWE-Spot-4B experts match or exceed existing open-weight models up to 8×8\times larger (e.g., CWM by Meta, Qwen3-Coder-30B) and surpass or match efficiency-focused commercial models (e.g., GPT-4.1-mini, GPT-5-nano) across multiple SWE tasks. Further analysis reveals that RCL yields higher training and inference efficiency, deep knowledge acquisition, and can scale to repository-cluster experts. Our work emphasizes that for building efficient intelligence, repository mastery is a distinct, necessary, and practical dimension that complements general coding capability.

Figures & tables

Explore similar work

CardsList
  1. SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding

    Mar 17, 2026Songcheng Cai, Zhiheng Lyu, Yuansheng Ni +13AI Agent BenchmarksSoftware Engineering Benchmarks

  2. CodeScout: An Effective Recipe for Reinforcement Learning of Code Search Agents

    Mar 18, 2026Lintang Sutawika, Aditya Bharat Soni, Bharath Sriraam R R +8Code LocalizationCode Search

  3. CodeGrep: An RL-Trained Retrieval Agent for LLM Coding Agents

    Aug 6, 2026Wuya Chen, Yihao yang, Yang Cao +1AI Coding AgentsLLM Agent Workflow Optimization