Small Language Models

Also known as SLM

Overview

Researchers build small language models by training compact models from scratch, distilling larger teachers, or adapting open models with supervised fine-tuning, LoRA/QLoRA, preference optimization, and quantization. To extend their capabilities, systems combine them with retrieval, tools, structured reasoning, verification, or selective handoff to larger models, particularly for edge, private, and latency-sensitive use. Evaluations span reasoning and coding benchmarks such as GSM8K and SWE-bench, structured tasks such as Spider and BIRD text-to-SQL, and domains including medicine, law, and low-resource languages. Specialized small models can be efficient and competitive, but results depend on the task: grounding retrieved context, reliable multi-step reasoning, safety, and generalization remain challenges, alongside trade-offs among accuracy, latency, memory, energy, and cost.

Latest papers

CardsList

296 papers25 papers in the last four weeks, down 40% on the four weeks before. 0.2% of all new papers.

  1. IronLLM: Forging Compact Edge-Native Language Models for Real-Time Embodied Intelligence

    Sep 29, 2026Changdi Yang, Fengquan Jiao, Haochih Lin +14Multi-Token PredictionOn-Device Language Model Inference

  2. Optimizing the Phi-2 Small Language Model for Real-time Chatbot Applications Using Parameter-Efficient Fine-Tuning (PEFT) with QLoRA Quantization

    Sep 27, 2026PhanTan Khanh Nguyen, Ashfaq Ali Shafin, Khandaker Mamun AhmedOn-Device Language Model InferenceSmall Language Models

  3. Can You Check That? The Checkability Boundary for Local LLM Network Automation

    Sep 25, 2026Maleeha Masood, Momina NofalLLM Answer VerificationLLM Routing

  4. PTC-Decoder: Towards Intelligent SLMs on Offline Resource-Constrained Edge Devices

    Sep 25, 2026Minghui Yu, Ke Mu, Gang WuLLM Tool UseSmall Language Models

  5. The Path Matters: Evaluating Small Language Models Beyond Answer Accuracy in KGQA

    Sep 23, 2026Eduin E. Hernandez, Sergio A. Diaz, Luis F. Garcia +2Small Language ModelsKnowledge Graph Question Answering

  6. Does Step Law Transfer to Small-Scale Language Models? An Empirical Recalibration Below 59M Parameters

    Sep 23, 2026Egor Romanyukov, Timofey Novikov, Timur Shokarov +3Language Model Scaling LawsHyperparameter Transfer

  7. Toward Personalized Sleep Guidance from Wearable Data Using Language Models

    Sep 18, 2026Yusheng Tan, Running Zhao, Sofia Angel +14Small Language ModelsPersonalized Language Models

  8. Samsone: A Family of Open Small Audio Language Models for On-Device Inference

    Sep 18, 2026Piotr Masztalski, Michał K. Grzeszczyk, Olaf SikorskiAudio-Language ModelsSmall Language Models

  9. Depth and Scale in the Sub-150M Regime: JugnuLM-53M vs JugnuLM-110M

    Sep 13, 2026Dushyant Rajput, Nirdesh Chauhan, Siddharth KosarajuLanguage Model PretrainingSmall Language Models

  10. Evaluating Context Segmentation in Locally Deployable SLMs for Cybersecurity CTF Tasks

    Sep 11, 2026Sebastiano Nordio, Michele LottoCybersecuritySmall Language Models

  11. Looped GPT-BERT: Trading Parameters for Computation in Small Language Modeling

    Sep 9, 2026Tingshuo Fan, Hongtao Mu, Tianyu Zhou +2Language Model PretrainingSmall Language Models

  12. From Fixed Keys to Readable Schemas: Small Language Models for Vehicle Agent Function Calls

    Sep 8, 2026Hamed Jafarzadeh Asl, Yuanhao Yu, Vahid Partovi NiaLLM Inference EfficiencyOn-Device Language Model Inference

  13. Triple-Bottom-Line Sustainability of Language Models for Edge AI: A Comparison Between SLMs and Quantized LLMs

    Sep 1, 2026Jainil Dharmil ShahLLM QuantizationLLM Evaluation

  14. EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models

    Aug 31, 2026Muran Yu, Jiechao Gao, Yuandong Pan +5Knowledge GraphsSmall Language Models

  15. Calibrating Small Language Models for Claim Check-Worthiness Detection

    Aug 31, 2026Pratuat Amatya, V Venktesh, Vinay SettyClaim VerificationSmall Language Models

  16. Free the Language Model From the Vision Encoder: Semantic Serialization as a Perception Interface for Small Language Models

    Aug 29, 2026Cong Xu, Ravi SankarVision-Language ModelsEmbodied QA

  17. Improving Natural-Language Combinatorial-Optimization Accuracy in Resource-Constrained Language Models via Formal Abstractions

    Aug 19, 2026Shrenil Shaun Sharma, Avi SharmaLarge Language Model-Guided OptimizationCombinatorial Optimization

  18. Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometry

    Aug 18, 2026Emma Ceccherini, Daniel Lawson, Anjulika SalhanSmall Language ModelsText Classification

  19. Benchmarking the Benchmarks: Evaluating Automated Safety Benchmarks for Small Language Models

    Aug 17, 2026Nyamtulla Shaik, Fengjun Li, Bo LuoLanguage Model Safety EvaluationSmall Language Models

  20. Structured Driving-State Narratives for Small Language Model-Based GNSS Spoofing Detection

    Aug 17, 2026Abyad Enan, Sagar Dasgupta, Mizanur Rahman +1CybersecurityAdversarial Attacks