Small Large Language Models

Ask about this topic

Recent momentum

-55%

9 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Small Large Language Models.

Period ending 2026-09-07

4 new papers

A weekly snapshot of new work published in Small Large Language Models.

110 papers

Latest in Small Large Language Models

Open your feed →
CardsList

  1. Efficient Reasoning Distillation: Small Video-Language Models via Synthetic CoT and Difficulty-Aware Fine-Tuning

    Sep 14, 2026Mantek Singh, Jeshwanth Challagundla, Siddharth Raina +1Small Large Language Models

  2. Evaluating Context Segmentation in Locally Deployable SLMs for Cybersecurity CTF Tasks

    Sep 11, 2026Sebastiano Nordio, Michele LottoCybersecuritySmall Large Language Models

  3. Scaling Post-Training Ternarisation to Qwen3-8B Capability Retention, Reproduction, Lossless Packing, and Packed Execution

    Sep 10, 2026Anirudh Malik, M Sparsh Mehra, Poojith DevanLarge Language Model ScalePost-Training Pipelines

  4. Geometry Conditioning in an Embodied SLM: Training Controls and Robustness Diagnostics in a 0.8B Hybrid Model

    Sep 10, 2026Hao Li, Haofei Sun, Lin HeGoal-Conditioned Reinforcement LearningTrainable Parameter

  5. From Retrieval to Weights: Parametric Individualization of Small Language Models with Individual Text Corpora

    Sep 9, 2026Christoph Wigbels, Ali Abusaleh, Markus T. Jansen +2Large Language Model MemorySmall Large Language Models

  6. Beyond Fluent Generation: A CPU Reliability Benchmark for MCP-Style Tool Calling in Sub-2B Small Language Models for Edge Deployment

    Sep 7, 2026Abrar Shahriar Qurat-Ul-Ain MastoiSmall Large Language ModelsModel Context Protocol

  7. Post-Training Ternarization of Qwen3-4B Capability, Effective Bit Budget, Storage Compression, and Deployment

    Sep 2, 2026Anirudh Malik, M Sparsh Mehra, Poojith DevanQwen3Small Large Language Models

  8. Triple-Bottom-Line Sustainability of Language Models for Edge AI: A Comparison Between SLMs and Quantized LLMs

    Sep 1, 2026Jainil Dharmil ShahSmall Large Language ModelsSustainability

  9. Calibrating Small Language Models for Claim Check-Worthiness Detection

    Aug 31, 2026Pratuat Amatya, V Venktesh, Vinay SettySmall Large Language ModelsFact-Checking

  10. Improving Argument Saliency Coverage in Small LLMs for Long Legal Opinion Summarization via Sequence-Level Distillation

    Aug 30, 2026Mohamed Elaraby, Ahmed Elhady, Diane LitmanSummarizationSmall Large Language Models

  11. Benchmarking Trustworthiness of SLMs: Pre-trained vs. Compressed

    Aug 12, 2026Haokun Lin, Kaijie Zhu, Haobo Xu +4Small Large Language ModelsLarge Language Model Reliability

  12. A Cost-Efficient Routing Pipeline for Multilingual Short-Text Classification Using Small Language Models

    Aug 11, 2026Wajdi Ben Saad, Safa MadiouniMultilingualDynamic Routing

  13. SKILLER: Language-Level Reinforcement Learning for Reusable Skill Extraction in Small Language Models

    Aug 11, 2026Chenhao Dang, Siyuan Xiong, Conghui He +1Small Large Language ModelsAgentic Reinforcement Learning

  14. Locally Deployable Small Language Models for Emergency Department Decision Support: A Systematic Benchmark of Fine-Tuning Strategies

    Aug 10, 2026Qingfeng Zhang, Yuanxiong Guo, Yanmin GongSmall Large Language ModelsFinetuning

  15. Toward Deployable Bangla Sign Language Recognition with Expert-Validated Data and a Lightweight Attention-Based Model

    Aug 6, 2026Saad Ahmed, Md Khalid SyfullahSign Language TranslationBangla

  16. DASyR-LLM: Domain-Aware Symbolic Regression with LLMs for Kinetic Model Discovery

    Aug 5, 2026Roberto Aliaga Medina, Paulina Quintanilla, Antonio del Rio ChanonaIncomplete KineticsSymbolic Regression

  17. Provable Limits and Certified Deferral for Verbalized Uncertainty in Small Language Models

    Aug 5, 2026Jianru ShenSmall Large Language ModelsFinite-Sample Certificates

  18. TQLite: Multi-LLM Jury Guided Distillation for Real-time MQM Translation Quality Evaluation

    Aug 4, 2026Bhavin Jawade, Cameron R. WolfeMachine Translation QualityLarge Language Model Evaluation

  19. Small Is Enough: Per-User Style Rewriting of AI-Edited Text via LoRA Adapters

    Jul 31, 2026Antorweep ChakravortySmall Large Language ModelsUsers

  20. Models for minimalist RAG: B1ade 335M Embedding and 1B Parameter Small Language Models

    Jul 29, 2026Shreyas Subramanian, Mecit Gungor, Vikram ElangoHievi-RagRetrieval-Augmented Generation

  21. Towards Robust Reinforcement Learning for Small-Scale Language Model Agents

    Jul 27, 2026Md Rezwanul Haque, Md. Milon Islam, Fakhri KarraySmall Large Language ModelsProximal Policy Optimization

  22. Do Small Models Use the Law You Give Them? Context-Injected Fine-Tuning for Legal QA in Bangladesh

    Jul 26, 2026Moniruzzaman Mahadi, Abrar Mohammed Tanzim Alam, Sayma Siddika Monalisa +3Llm-Based Statutory Question AnsweringBangla

  23. Offline Vision-Language Navigation with Geometric Goal Localization for Outdoor Environments

    Jul 24, 2026Ali Salmasi, Xianjia Yu, Tomi WesterlundVision-And-Language NavigationRobot Navigation

  24. Small Vision-Language Models Know When They Are Wrong But Cannot Say So: A Two-Model Study of Stated versus Internal Confidence Under Realistic Image Degradation

    Jul 24, 2026M M Asif FerdousLarge Language Model UncertaintyConfidence Calibration

  25. Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysis

    Jul 22, 2026Adel ElZemity, Shujun Li, Budi AriefMalware FamiliesMalware Classification

  26. TINY_SCHILLER: A Drop-In German Drama Corpus for Small Language Models

    Jul 22, 2026Mark SchuteraCorpusSmall Large Language Models

  27. Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models

    Jul 22, 2026Yurong Liu, Yeye He, Haoyu Dong +4MissingnessPredictive Performance

  28. Bounding Boxes to Improve Small Language Model Performance on Vision-Based Grading Tasks

    Jul 21, 2026Lachlan McGinnessSmall Large Language ModelsBounding Box

  29. Find Before You Fine-Tune: A Diagnostic Study of Small LLMs for Cybersecurity QA

    Jul 21, 2026Shaswata Mitra, Subash Neupane, Trisha Chakraborty +4Large Language Model SafetySmall Large Language Models

  30. AdaHome: An Adaptive Smart Home Assistant using Local Small Language Models

    Jul 20, 2026Eu Jin Lim, Zhaoxing Li, Sebastian SteinSmart HomesLarge Language Model Personalization

  31. RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation

    Jul 17, 2026Pei Tian, Zihan Dong, Tianci Liu +2Retrieval-Augmented GenerationSmall Large Language Models

  32. On-Device Deep Research at 4B: Exposure Bounds Faithfulness, Retrieval Bounds Coverage

    Jul 14, 2026Vinay Kumar ChagantiCitationsExplanation Faithfulness

  33. Workload-Driven Optimization for On-Device Real-Time Subtitle Translation

    Jul 10, 2026Tsz-To WongSubword TokenizationTranslation

  34. Creativity, honesty and designed forgetting emerge in small hyperbolic language models

    Jul 10, 2026Kwan Soo Shin, In Seok Kang, Yunkyung MinArtificial Intelligence CompanionsSmall Large Language Models

  35. SQuaD-SQL: Efficient Text-to-SQL with Small Language Models via LLM-Guided Knowledge Distillation

    Jul 9, 2026Wangyu Wu, Xiaojian Lin, Rong Fu +4Text-To-SqlSmall Large Language Models

  36. Selective Left-Shift: Turning Test-Time Compute and Difficulty-based Curation into Training Data for Low-Resource Code Generation

    Jul 8, 2026Didula Samaraweera, Anjana Supun, Srinath PereraAI Code GenerationSmall Large Language Models

  37. Measuring the practice of shared-decision making (OPTION12): An Investigation into Open-sourced Smaller LLMs (OS-sLLMs) for Better Privacy and Sustainability

    Jul 7, 2026Tamara Wit, Lifeng Han, Carly Heipon +3Small Large Language ModelsDecisions

  38. BlueMagpie-TTS: A Token-Efficient Tokenizer, Language Model, and TTS for Taiwanese-Accent Code-Switching Speech

    Jul 7, 2026Ho Lam Chung, Bo-Xuan Zheng, Cheng-Chieh Huang +8Tts ApplicationText-To-Speech

  39. Energy-Efficient GPU DVFS for Fine-Tuning of SLMs on Resource-constrained Embedded Devices

    Jul 7, 2026Jurn-Gyu Park, Sanzhar Zholdybayev, Aidar Amangeldi +1Resource-Constrained DevicesSmall Large Language Models

  40. CSTutorBench: Benchmarking Small Language Models as Tutors for Block-Based Programming

    Jul 6, 2026H. Chad Lane, Bryson KagelerSmall Large Language ModelsPedagogical Frameworks

  41. The Wiola Architecture for Efficient Small Language Models

    Jul 1, 2026Aryuemaan Kumar Chowdhury, Afreen Shaik, Yaparla Bhargavi +1Small Large Language ModelsRotary Position Embedding

  42. Little Brains, Big Feats: Exploring Compact Language Models

    Jun 29, 2026Dari Baturova, Elena Bruches, Ivan Chernov +3Small Large Language ModelsProtein Language Model

  43. AnySimLite: A Lightweight Few-Shot Similarity Encoder for On-Device Speech-Adjacent Classification

    Jun 24, 2026Sourav Ghosh, Yash Bhatia, Keshav Goyal +3Small Large Language ModelsEncoding Models

  44. Closed-Loop Control with Rule-Aligned Small Language Models and Multi-Agent Self-Correction

    Jun 24, 2026Yuchen Wang, Javal Vyas, Tong Liu +1Small Large Language Models

  45. Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction

    Jun 21, 2026Despina Christou, Grigorios TsoumakasSmall Large Language ModelsModernbert

  46. Emergent Culture in Minimal LLM Systems

    Jun 21, 2026Simon Jones, Sabine HauertLarge Language Model AgentsEmergence

  47. L20-Edu-135M: An Auditable Single-GPU Study of Data-Efficient Small Language Modeling

    Jun 20, 2026Yin LiSmall Large Language ModelsRtx

  48. Clinical Term Extraction using Open-Source Small Language Models

    Jun 19, 2026Noah Marchal, William E. Janes, Mihail Popescu +1Clinical NotesSmall Large Language Models

  49. Evaluation of Small Language Models for Arabic Language Processing

    Jun 19, 2026Jumana Alsubhi, Ahmed Alhusayni, Abdulrahman Gharawi +5Arabic Natural Language ProcessingSmall Large Language Models

  50. Surpassing Scale by Efficiency: A Compact 135M Parameter Foundational LLM Natively Adapted for the Bangla Language

    Jun 15, 2026Rabindra Nath NandiBanglaSmall Large Language Models

  51. Small LLMs: Pruning vs. Training from Scratch

    Jun 12, 2026Yufeng Xu, Taiming Lu, Kunjun Li +3Small Large Language ModelsStructured Pruning

  52. SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptation

    Jun 11, 2026Marek Šuppa, Andrej Ridzik, Daniel Hládek +2Patient-Specific Textual EmbeddingsMultilingual Benchmark

  53. A Quantitative Experimental Repeated Measures Study of Training Dynamics in a Small Llama Style Language Model Under a Compute-Aware Token Budget

    Jun 11, 2026Joe DwyerSmall Large Language ModelsLow-Precision Training

  54. Small LLMs for Biomedical Claim Verification: Cost-Effective Fine-Tuning, Structural Dataset Shortcuts, and Cross-Domain Generalization

    Jun 11, 2026Gaurav KumarSmall Large Language ModelsFinetuning

  55. More Yap Less Meaning: Uncovering Self-Improvement Behavior in SLMs

    Jun 7, 2026Marina Igitkhanian, Erik ArakelyanSelf-CorrectionLarge Language Models Fail

  56. TinyGiantALM: A Compact Audio-Language Model for Intent-Aware Reasoning under Resource Constraints

    Jun 7, 2026Vinh-Thuan LyLarge Audio Language ModelsAudio Reasoning

  57. Model Multiplicity for Adversarial Detection in Small Language Model Training on Edge Devices

    Jun 5, 2026Stefan Behfar, Richard MortierModel-Agnostic DefenseSmall Large Language Models

  58. SLMJury: Can Small Language Models Judge as Well as Large Ones?

    Jun 5, 2026Anish Laddha, Nitesh Pradhan, Gaurav SrivastavaLarge Language Model JudgesEvaluation Benchmarks

  59. The Fine-Tuning Trap: Evaluating Negative Transfer and the Role of PEFT in Sub-1B Mathematical Reasoning

    Jun 5, 2026Rahul Nair, Chun TaoFinetuningSmall Large Language Models

  60. Automated Proving of Shannon-Type Entropy Inequalities via Fine-Tuned Language Models and Guided Tree Search

    Jun 4, 2026Shing Yin Wong, Shaocheng Liu, Linqi Song +2TheoremSmall Large Language Models