Small Large Language Models

Ask about this topic

Momentum

15 papers in the last four weeks, up 114% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 126

All topics
CardsList

  1. Are Language Models Script-Aware?

    Oct 6, 2026David Kletz, Sandra Mitrović, Ljiljana Dolamić +1Small Large Language Models

    SUPSI, IDSIA, Switzerland · armasuisse, Science & Technology, Switzerland

  2. Do I Need the Cloud? Uncertainty-Aware Step-Level Handoff for Small Language Model Agents

    Oct 6, 2026Abolfazl YounesiSmall Large Language Models

    Department of Computer Engineering Sharif University of Technology Tehran, Iran

  3. Keyword Harnesses Fail Open: A Cheap Diagnostic Ladder for Tool-Use Claims in Small Language Models

    Oct 1, 2026Juan S. SantillanaSmall Large Language ModelsSmall Models

    Independent Researcher

  4. Pre-registered tests of solid-state-physics-inspired LLM compression: a cluster-level negative result at small-language-model scale

    Sep 28, 2026Jun-qiang LuLarge Language Model CompressionLarge Language Model Pretraining

    Department of Physics, University of Puerto Rico, Mayagüez, PR 00680, USA

  5. Optimizing the Phi-2 Small Language Model for Real-time Chatbot Applications Using Parameter-Efficient Fine-Tuning (PEFT) with QLoRA Quantization

    Sep 27, 2026PhanTan Khanh Nguyen, Ashfaq Ali Shafin, Khandaker Mamun AhmedLarge Language Model QuantizationSmall Large Language Models

    Beacom College of Computer and Cyber Sciences, Dakota State University · Mathematics and Computer Science, Augustana College

  6. The Path Matters: Evaluating Small Language Models Beyond Answer Accuracy in KGQA

    Sep 23, 2026Eduin E. Hernandez, Sergio A. Diaz, Luis F. Garcia +2Knowledge GraphsSmall Large Language Models

    NYCU, Taiwan · National Yang Ming Chiao Tung University (NYCU), Taiwan

  7. Does Step Law Transfer to Small-Scale Language Models? An Empirical Recalibration Below 59M Parameters

    Sep 23, 2026Egor Romanyukov, Timofey Novikov, Timur Shokarov +3BatchSmall Large Language Models

    Faculty of Computer Science HSE University

  8. Constrained Decoding Eliminates Structural Failures in Small LLMs but Reveals a Scale-Dependent Semantic Gap

    Sep 20, 2026Akash ChavanLarge Language Models FailConstrained Decoding

  9. Mirror, Mirror on the Wall: Prompt Echoing in Small Instruct Language Models

    Sep 14, 2026Inez Okulska, Bartosz Naskręcki, Jan Piotrowski +1Small Large Language ModelsPrompt Engineering

    Centre for Credible AI, Warsaw University of Technology · Adam Mickiewicz University Poznan · Institute of Fundamental Technological Research, Polish Academy of Sciences

  10. Breaking the Token Ceiling: Distilling Smaller, Stronger Byte Models

    Sep 14, 2026Kalyani Marathe, Artidoro Pagnoni, Tomasz Limisiewicz +4Small Large Language ModelsTransformer Encoder

    University of Washington, Seattle · Work done at Meta FAIR · Meta FAIR

  11. Evaluating Context Segmentation in Locally Deployable SLMs for Cybersecurity CTF Tasks

    Sep 11, 2026Sebastiano Nordio, Michele LottoCybersecuritySmall Large Language Models

    Independent · University of Genoa, Via All’Opera Pia, 16145 Genoa, Italy

  12. Scaling Post-Training Ternarisation to Qwen3-8B Capability Retention, Reproduction, Lossless Packing, and Packed Execution

    Sep 10, 2026Anirudh Malik, M Sparsh Mehra, Poojith DevanModel SizeQwen3

    OneBit AI

  13. From Fixed Keys to Readable Schemas: Small Language Models for Vehicle Agent Function Calls

    Sep 10, 2026Hamed Jafarzadeh Asl, Yuanhao Yu, Vahid Partovi NiaSmall Large Language ModelsSchema

    Huawei Noah’s Ark Lab, Canada · Huawei Noah’s Ark Lab · Polytechnique Montreal, Canada

  14. Geometry Conditioning in an Embodied SLM: Training Controls and Robustness Diagnostics in a 0.8B Hybrid Model

    Sep 10, 2026Hao Li, Haofei Sun, Lin HeLibero Manipulation BenchmarkSmall Large Language Models

    University of Tennessee, Knoxville

  15. From Retrieval to Weights: Parametric Individualization of Small Language Models with Individual Text Corpora

    Sep 9, 2026Christoph Wigbels, Ali Abusaleh, Markus T. Jansen +2Large Language Model MemorySmall Large Language Models

    Bergische Universität Wuppertal · Goethe-Universität Frankfurt

  16. Looped GPT-BERT: Trading Parameters for Computation in Small Language Modeling

    Sep 9, 2026Tingshuo Fan, Hongtao Mu, Tianyu Zhou +2Small Large Language ModelsBert-Based Models

    College of Foreign Languages and Literature, Fudan University

  17. Beyond Fluent Generation: A CPU Reliability Benchmark for MCP-Style Tool Calling in Sub-2B Small Language Models for Edge Deployment

    Sep 7, 2026Abrar Shahriar Qurat-Ul-Ain MastoiSmall Large Language ModelsModel Context Protocol

    University of the West of England, Bristol,BS16 1QY United Kingdom

  18. Post-Training Ternarization of Qwen3-4B Capability, Effective Bit Budget, Storage Compression, and Deployment

    Sep 2, 2026Anirudh Malik, M Sparsh Mehra, Poojith DevanQwen3Small Large Language Models

    OneBit AI

  19. Triple-Bottom-Line Sustainability of Language Models for Edge AI: A Comparison Between SLMs and Quantized LLMs

    Sep 1, 2026Jainil Dharmil ShahSmall Large Language ModelsResource-Constrained Edge Devices

    Elmore Family School of Electrical and Computer Engineering · Purdue University, West Lafayette, Indiana, USA

  20. Calibrating Small Language Models for Claim Check-Worthiness Detection

    Aug 31, 2026Pratuat Amatya, V Venktesh, Vinay SettyLarge Language Model ReliabilitySmall Large Language Models

    1Factiverse AS · University of Stavanger · 3Stockholm University

  21. Improving Argument Saliency Coverage in Small LLMs for Long Legal Opinion Summarization via Sequence-Level Distillation

    Aug 30, 2026Mohamed Elaraby, Ahmed Elhady, Diane LitmanSummarizationSmall Large Language Models

    University of Pittsburgh, Pittsburgh, PA, USA · HiTZ Center, University of the Basque Country (UPV/EHU)

  22. Benchmarking Trustworthiness of SLMs: Pre-trained vs. Compressed

    Aug 12, 2026Haokun Lin, Kaijie Zhu, Haobo Xu +4Small Large Language ModelsLarge Language Model Reliability

    Institute of Automation, CAS Beijing, China · Tsinghua University Beijing, China · Harvard Medical School Boston, U.S. +1

  23. SKILLER: Language-Level Reinforcement Learning for Reusable Skill Extraction in Small Language Models

    Aug 11, 2026Chenhao Dang, Siyuan Xiong, Conghui He +1Small Large Language ModelsOffline Reinforcement Learning

    1Shanghai Jiao Tong University · 2Shanghai Artificial Intelligence Laboratory · 3Harbin Institute of Technology, Shenzhen +1

  24. Locally Deployable Small Language Models for Emergency Department Decision Support: A Systematic Benchmark of Fine-Tuning Strategies

    Aug 10, 2026Qingfeng Zhang, Yuanxiong Guo, Yanmin GongSmall Large Language ModelsEmergency Departments

    The University of Texas at San Antonio, San Antonio, TX · Texas A&M University, Houston, TX

  25. DASyR-LLM: Domain-Aware Symbolic Regression with LLMs for Kinetic Model Discovery

    Aug 5, 2026Roberto Aliaga Medina, Paulina Quintanilla, Antonio del Rio ChanonaSymbolic RegressionChemical Process Systems

    Department of Chemical Engineering Imperial College London South Kensington, London, SW7 2AZ, UK · Department of Chemical Engineering, Biotechnology, and Materials University of Chile, Santiago, Chile · Department of Chemical Engineering University College London Gower Street, London, WC1E 6BT, UK

  26. Provable Limits and Certified Deferral for Verbalized Uncertainty in Small Language Models

    Aug 5, 2026Jianru ShenConfidence CalibrationSmall Large Language Models

    University of Montana, Missoula, MT 59812, USA

  27. Protoreasoning in Tiny Transformers

    Aug 5, 2026Eduardo Valle, Fergal ReidProgressive ReasoningSmall Large Language Models

    Fin AI Research

  28. Energy- and Memory-Efficient PEFT Methods for Personalized On-Device SLMs on Consumer GPUs

    Aug 5, 2026Kuanysh Akhmetzhanov, Jurn-Gyu ParkParameter-Efficient Fine-Tuning MethodsSmall Large Language Models

    Department of Computer Science, Nazarbayev University, Astana 010000, Kazakhstan

  29. TQLite: Multi-LLM Jury Guided Distillation for Real-time MQM Translation Quality Evaluation

    Aug 4, 2026Bhavin Jawade, Cameron R. WolfeMachine Translation QualityLarge Language Model Evaluation

    Netflix

  30. Small Is Enough: Per-User Style Rewriting of AI-Edited Text via LoRA Adapters

    Jul 31, 2026Antorweep ChakravortyAi-Assisted WritingSmall Large Language Models

    University of Stavanger, Norway

  31. Towards Robust Reinforcement Learning for Small-Scale Language Model Agents

    Jul 27, 2026Md Rezwanul Haque, Md. Milon Islam, Fakhri KarrayLarge Language Model Reinforcement LearningSmall Large Language Models

    Centre for Pattern Analysis and Machine Intelligence, Department of Electrical and Computer Engineering, University of Waterloo, N2L 3G1, Ontario, Canada · Department of Computer Science and Engineering, Khulna University of Engineering & Technology, Khulna, Bangladesh · Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates

  32. From Data to Device: ELMOD An Efficient German-First 2.7B Language Model for Mobile Inference

    Jul 27, 2026Darina Gold, Alexander Schwirjow, Viktor Haag +4Small Large Language ModelsEfficient Inference

    IIS Fraunhofer

  33. Do Small Models Use the Law You Give Them? Context-Injected Fine-Tuning for Legal QA in Bangladesh

    Jul 26, 2026Moniruzzaman Mahadi, Abrar Mohammed Tanzim Alam, Sayma Siddika Monalisa +3BanglaSmall Large Language Models

    Department of Electrical and Computer Engineering, North South University Dhaka, Bangladesh · Department of Computer Science and Engineering, BRAC University Dhaka, Bangladesh

  34. Offline Vision-Language Navigation with Geometric Goal Localization for Outdoor Environments

    Jul 24, 2026Ali Salmasi, Xianjia Yu, Tomi WesterlundVision-Language NavigationRobot Navigation

    Turku Intelligent Embedded and Robotic Systems (TIERS) Lab, University of Turku, Turku, Finland.

  35. Trustworthiness Costs of Domain Adaptation in Small Language Models:A Cross-Architecture Empirical Study

    Jul 23, 2026Ramesh B. ParamkushamLarge Language Model AdaptationLarge Language Model Reliability

    Independent Researcher; Adjunct Faculty, University of the Cumberlands, Williamsburg, KY, USA

  36. Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysis

    Jul 22, 2026Adel ElZemity, Shujun Li, Budi AriefMalwareSmall Large Language Models

    University of Kent, Canterbury, United Kingdom

  37. Are you Talking Logic to Me? Assessing Language Models Syllogistic Reasoning Capabilities

    Jul 22, 2026Hanna Abi Akl, Fabien Gandon, Catherine Faron +1Small Large Language ModelsLogic

    Université Côte d’Azur, Inria, CNRS, I3S, Sophia Antipolis, France · Data ScienceTech Institute, Paris, France

  38. Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models

    Jul 22, 2026Yurong Liu, Yeye He, Haoyu Dong +4Auto ResearchTable Reasoning Datasets

    New York University · Microsoft Research

  39. Find Before You Fine-Tune: A Diagnostic Study of Small LLMs for Cybersecurity QA

    Jul 21, 2026Shaswata Mitra, Subash Neupane, Trisha Chakraborty +4Large Language Model SafetySmall Large Language Models

    The University of Alabama · Meharry Medical College · Mississippi State University +1

  40. AdaHome: An Adaptive Smart Home Assistant using Local Small Language Models

    Jul 20, 2026Eu Jin Lim, Zhaoxing Li, Sebastian SteinSmart HomesLarge Language Model Personalization

    University of Southampton Southampton, United Kingdom

  41. RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation

    Jul 17, 2026Pei Tian, Zihan Dong, Tianci Liu +2Agentic Retrieval-Augmented Generation SystemsSmall Large Language Models

    Department of Computer Science, Columbia University · Department of Statistics, Rutgers University · School of Electrical and Computer Engineering, Purdue University +1

  42. Exploring Post-Training Alignment of Small Language Models for Biomedical Data-to-Text Generation: A Case Study of Medication Leaflet

    Jul 15, 2026Xi Yang, Guodong Liu, Chuqin Li +10Large Language Model AlignmentBiomedical Text

    Advanced Intelligence, Eli Lilly and Company, Indianapolis, IN, USA · Department of Biostatistics and Health Data Science, Indiana University, Indianapolis, IN, USA · Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, United States +2

  43. On-Device Deep Research at 4B: Exposure Bounds Faithfulness, Retrieval Bounds Coverage

    Jul 14, 2026Vinay Kumar ChagantiCitationsExplanation Faithfulness

    Independent Researcher

  44. Workload-Driven Optimization for On-Device Real-Time Subtitle Translation

    Jul 10, 2026Tsz-To WongTranslation QualitySmall Large Language Models

    National Yang Ming Chiao Tung University, Hsinchu, Taiwan

  45. Index SLM Technical Report

    Jul 10, 2026Lusheng Zhang, Shien He, Tianxing Yan +5Small Large Language ModelsInstruction

    Bilibili Index LLM Team

  46. Creativity, honesty and designed forgetting emerge in small hyperbolic language models

    Jul 10, 2026Kwan Soo Shin, In Seok Kang, Yunkyung MinSmall Large Language ModelsCreativity

    PolymathMinds Lab, Seoul, Republic of Korea. · Department of Chemical Engineering, POSTECH, Pohang, and aSSIST University, Seoul, Republic of Korea. · Korean Educational Development Institute, Jincheon, Republic of Korea.

  47. SQuaD-SQL: Efficient Text-to-SQL with Small Language Models via LLM-Guided Knowledge Distillation

    Jul 9, 2026Wangyu Wu, Xiaojian Lin, Rong Fu +4Text-To-SqlSmall Large Language Models

    The University of Liverpool · Microsoft · Tsinghua University +4

  48. Selective Left-Shift: Turning Test-Time Compute and Difficulty-based Curation into Training Data for Low-Resource Code Generation

    Jul 8, 2026Didula Samaraweera, Anjana Supun, Srinath PereraCode GenerationSmall Large Language Models

    WSO2 Santa Clara, CA, USA

  49. Measuring the practice of shared-decision making (OPTION12): An Investigation into Open-sourced Smaller LLMs (OS-sLLMs) for Better Privacy and Sustainability

    Jul 7, 2026Tamara Wit, Lifeng Han, Carly Heipon +3Large Language Model DecisionsSmall Large Language Models

    BDS, Leiden University Medical Centre, NL · The Leiden Institute of Advanced Computer Science, LU, NL

  50. Energy-Efficient GPU DVFS for Fine-Tuning of SLMs on Resource-constrained Embedded Devices

    Jul 7, 2026Jurn-Gyu Park, Sanzhar Zholdybayev, Aidar Amangeldi +1Resource-Constrained Edge DevicesModel Fine-Tuning

    School of Engineering and Digital Sciences, Nazarbayev University, 010000 Astana, Kazakhstan

  51. CSTutorBench: Benchmarking Small Language Models as Tutors for Block-Based Programming

    Jul 6, 2026H. Chad Lane, Bryson KagelerTutorsSmall Large Language Models

    University of Illinois Urbana-Champaign, Champaign, IL, USA

  52. The Wiola Architecture for Efficient Small Language Models

    Jul 1, 2026Aryuemaan Kumar Chowdhury, Afreen Shaik, Yaparla Bhargavi +1Small Large Language ModelsTransformer Architectures

    Research and Development, Oscowl Ai IIT Hyderabad Hyderabad, India · Research and Development, Oscowl Ai Hyderabad, India

  53. Large Databases Need Small, Open-Weight Language Models

    Jun 30, 2026Parker Glenn, Alfy SamuelSmall Large Language ModelsLarge Databases

    Capital One

  54. Little Brains, Big Feats: Exploring Compact Language Models

    Jun 29, 2026Dari Baturova, Elena Bruches, Ivan Chernov +3Small Large Language ModelsLanguage Modeling

    Siberian Neuronets LLC, Novosibirsk, Russia

  55. Continual Learning for Sequential Personalization of Small Language Models: A Stability Monitoring Analysis

    Jun 26, 2026Thomas S. Paula, Lucas S. Kupssinskü, Rodrigo C. BarrosSmall Large Language ModelsReplay-Based Continual Learning

    MALTA, Machine Learning Theory and Applications Lab, PUCRS, Porto Alegre, Brazil · Kunumi Institute, Brazil

  56. AnySimLite: A Lightweight Few-Shot Similarity Encoder for On-Device Speech-Adjacent Classification

    Jun 24, 2026Sourav Ghosh, Yash Bhatia, Keshav Goyal +3Small Large Language ModelsChannel

    Samsung R&D Institute Bangalore, India · ITBHU

  57. Closed-Loop Control with Rule-Aligned Small Language Models and Multi-Agent Self-Correction

    Jun 24, 2026Yuchen Wang, Javal Vyas, Tong Liu +1Small Large Language ModelsMixture-Of-Agents

    School of Computer Science University of Sheffield Sheffield, UK · Department of Chemical Engineering Imperial College London London, UK

  58. Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction

    Jun 21, 2026Despina Christou, Grigorios TsoumakasSmall Large Language ModelsBert-Based Models

    School of Informatics, Aristotle University of Thessaloniki, 54124, Greece · Archimedes, Athena Research Center, Greece

  59. Emergent Culture in Minimal LLM Systems

    Jun 21, 2026Simon Jones, Sabine HauertLarge Language Model AgentsEmergence

    University of Bristol, UK

  60. L20-Edu-135M: An Auditable Single-GPU Study of Data-Efficient Small Language Modeling

    Jun 20, 2026Yin LiSmall Large Language ModelsCpu-Gpu Hybrid Designs

    University of Birmingham