Small Language Models

Recent momentum

-20%

16 papers in the last 28 days · 0.3% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Small Language Models.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Small Language Models.

Period ending 2026-09-07

4 new papers

A weekly snapshot of new work published in Small Language Models.

194 papers

Latest in Small Language Models

  1. The Wiola Architecture for Efficient Small Language Models

    Jul 1, 2026Aryuemaan Kumar Chowdhury, Afreen Shaik, Yaparla Bhargavi +1Small Language ModelsRotary Position Embedding

  2. Factored Gossip DiLoCo: Reducing Blocking Communication in DiLoCo

    Jun 22, 2026Chamin Hewa Koneputugodage, Thalaiyasingam Ajanthan, Sameera Ramasinghe +7Distributed OptimizationDistributional Learning

  3. Small LLMs: Pruning vs. Training from Scratch

    Jun 12, 2026Yufeng Xu, Taiming Lu, Kunjun Li +3Small Language ModelsPruning

  4. Short-form Text Rewriting with Phi Silica

    May 30, 2026Divya Tadimeti, Shawn Pan, Sameera Lanka +2ParaphrasingSmall Language Models