Small Language Models

Also known as SLM

Overview

Researchers build small language models by training compact models from scratch, distilling larger teachers, or adapting open models with supervised fine-tuning, LoRA/QLoRA, preference optimization, and quantization. To extend their capabilities, systems combine them with retrieval, tools, structured reasoning, verification, or selective handoff to larger models, particularly for edge, private, and latency-sensitive use. Evaluations span reasoning and coding benchmarks such as GSM8K and SWE-bench, structured tasks such as Spider and BIRD text-to-SQL, and domains including medicine, law, and low-resource languages. Specialized small models can be efficient and competitive, but results depend on the task: grounding retrieved context, reliable multi-step reasoning, safety, and generalization remain challenges, alongside trade-offs among accuracy, latency, memory, energy, and cost.

Latest papers

CardsList

296 papers30 papers in the last four weeks, down 14% on the four weeks before. 0.2% of all new papers.

  1. CARE-SD: Explainable Reasoning Architecture for Local SLM Self-Disclosure Analysis in Textual Data

    Oct 15, 2026Aisvarya Adeseye, Adeyemi Adeseye, Mohammad Tahir +1Small Language ModelsExplainable Artificial Intelligence

  2. Maximising Transparency in Context Compaction Improves Retention of Facts and Commitments for Lightweight Coding Agents

    Oct 14, 2026Felix WoolfordContext Compaction for LLM AgentsContext Compression

  3. Progress-Aware Distillation for Mitigating Stagnation in Small Language Model Agents

    Oct 14, 2026Yuanpu Cao, Saket Sathe, Hanyu Wang +3LLM Agent TrainingLanguage Model Distillation

  4. ixi-sLM: On-Device sLM for AI Call Agent Service

    Oct 14, 2026Han-Sang Lee, Kyuho Lee, Juneyoung Park +10On-Device Language Model InferenceSmall Language Models

  5. Reliable Text-to-SQL in Resource-Constrained Settings with Small LLMs via Iterative Retry Workflows

    Oct 12, 2026Bilel Abderrahmane Benziane, Xavier ScheplerText-to-SQLSmall Language Models

  6. Context-Aware Precision Scheduling for Small Language Models

    Oct 11, 2026Mukund Athmaram, Manoj Rao, Liang MaEfficient Language Model InferenceOn-Device Language Model Inference

  7. Iterate on an LLM, Serve on an SLM

    Oct 10, 2026Keegan WangLLM Agent TrainingSmall Language Models

  8. Skill-SLM: Agent Skill-driven Small Language Models for Reliable Robot Operation

    Oct 7, 2026Wenhao Wang, Yanyan Li, Jiawei YuanSmall Language ModelsRobot Task Planning

  9. Using Small Language Models to Reverse-Engineer Machine Learning Pipelines Structures

    Oct 7, 2026Nicolas Lacroix, Frederic Precioso, Mireille Blay-Fornarino +1Small Language ModelsSoftware Engineering

  10. Multi-Objective Aligned Small Language Model Framework for SUD Patient Dialogue Generation

    Oct 6, 2026Thushara Manjari Naduvilakandy, Hyeju Jang, Mohammad Al HasanSmall Language ModelsUser Simulation

  11. Not Every Call Needs a Frontier Model: Per-Call-Site Evaluation of Small Language Models in a Deployed Agentic Home-Automation System

    Oct 6, 2026Panagiotis Kasnesis, Christos Chatzigeorgiou, Lazaros Toumanidis +1Small Language ModelsLLM Agent Evaluation

  12. Do I Need the Cloud? Uncertainty-Aware Step-Level Handoff for Small Language Model Agents

    Oct 6, 2026Abolfazl YounesiSmall Language ModelsLLM Agents

  13. Small Language Models for Smart Data Model Classification at the Edge: A Cost-Aware Hybrid Approach

    Oct 5, 2026Cristian Martella, Angelo Martella, Antonella Longo +1Small Language ModelsSemantic Mapping

  14. Small Agents with Semantic Search: Efficient Multilingual Code Localization

    Oct 4, 2026Maxence Lasbordes, Aarush Sinha, Raphael Sourty +2AI Coding AgentsSemantic Search

  15. Toward a Locally Deployable Agentic Co-Scientist: Small-Model Planning for Early-Stage Drug Discovery

    Oct 3, 2026Tian Liang, Jiayu Chang, Alejandro F. Frangi +2LLM Tool UseLLM Agent Planning

  16. Saying, Not Knowing: Aggressively GGUF-Quantized Small Language Models Still Write Rare Words They Can No Longer Define

    Oct 3, 2026Saurabh Kumar Singh, Yogeshwar Singh Dadwhal, Malhar VedakLLM QuantizationSmall Language Models

  17. Toward SLM-based agentic task-tool intent matching

    Oct 2, 2026Chiara Troiani, Arash Salarian, Majed El Helou +4LLM Agent VerificationLLM Agent Safety

  18. Mingbird: A Local-First Agent Harness Enabling Small Open Models to Complete Real Tasks

    Oct 1, 2026Hao Wang, Ting HuangSmall Language ModelsAI Agent Benchmarks

  19. Beyond Leaderboards: Tokenomics of Agentic Small Language Model Ensembles

    Oct 1, 2026Alexei N. Skurikhin, Emily M. Taylor, Nathan A. DeBardelebenLLM Inference EfficiencyLanguage Model Generation Evaluation

  20. Also Small Models Can Reasonably Self-Evaluate Their Confidence

    Sep 30, 2026Idil Kapikiran, Thomas Decker, Thomas RunklerConfidence Estimation in Language ModelsSmall Language Models

  21. Offline Guidance, Online Reasoning: Reusing LLM Feedback for Small Language Models

    Sep 30, 2026Bohan Zhang, Linan Yue, Weibo Gao +3Efficient Language Model ReasoningSmall Language Models

  22. Solving Without Stopping: On-Policy Distillation at Small Scale

    Sep 29, 2026Hongyang Li, Yiming Zhu, Xiao Li +3Reasoning DistillationSmall Language Models

  23. SKILLLITE: Evidence-Guided Malicious Skill Auditing with Compact LLMs

    Sep 29, 2026Haoran Ou, Gelei Deng, Xuanye Zhang +3Small Language ModelsLLM Agent Security