Small Models

Ask about this topic

Momentum

10 papers in the last four weeks, up 67% on the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 66

All topics
CardsList

  1. Keyword Harnesses Fail Open: A Cheap Diagnostic Ladder for Tool-Use Claims in Small Language Models

    Oct 1, 2026Juan S. SantillanaSmall Large Language ModelsSmall Models

    Independent Researcher

  2. Also Small Models Can Reasonably Self-Evaluate Their Confidence

    Sep 30, 2026Idil Kapikiran, Thomas Decker, Thomas RunklerSmall ModelsUncertainty Quantification

    Technical University of Munich · Siemens AG · LMU Munich +1

  3. Solving Without Stopping: On-Policy Distillation at Small Scale

    Sep 29, 2026Hongyang Li, Yiming Zhu, Xiao Li +3Efficient On-Policy DistillationTeacher

    University of Luxembourg · Seafill Open-Source Community · Universit´e Paris-Saclay

  4. Small transformers track Bayesian evidence for latent common causes via a context-invariant mechanism

    Sep 28, 2026Amir Mohammadpour, Michael FrankeTransformer ArchitecturesSmall Models

    Department of Linguistics, University of Tübingen

  5. QuantaSpike: Short-Window Spike-Driven Quantization for Large Language Models

    Sep 28, 2026Bang Hu, Guowei Zhu, Changze Lv +4Large Language Model QuantizationLLM Inference Optimization

    School of Computer Science, Fudan University, Shanghai, China

  6. Reinforcement Learning with Verifiable Rewards for Small Search Agents

    Sep 23, 2026Gaurisankar Jayadas, Aske Plaat, Álvaro Serra-Gómez +1Reinforcement Learning With Verifiable RewardVerifiable Rewards

    Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands

  7. Small yet Assistive: Spatially-Aware Post-Training for Low Vision

    Sep 23, 2026Rishabh Choudhary, Shreyansh Raj, Umesh Goyal +6Recent Vision-Language ModelsAssistive Agents

    Indian Institute of Technology Mandi · Mohamed bin Zayed University of Artificial Intelligence

  8. little m: An AI Agent for Industrial Process Optimization

    Sep 15, 2026Yongchao Ye, Xinyu He, Dutliff Boshoff +2Large Language Model WorkflowsClosed Loop

    Department of Data Science, City University of Hong Kong, Hong Kong SAR, China · Hong Kong Institute for Advanced Study, City University of Hong Kong

  9. Continuous Learning of Gravity Field Irregularities Around Small Bodies via Neural Hamiltonian ODEs

    Sep 14, 2026Giacomo Acciarini, Dario IzzoNear-Earth ObjectsHamiltonian

    Advanced Concepts Team, European Space Agency, ESTEC, Noordwijk, The Netherlands

  10. Re-engineering SORT-based algorithms for low-cost small object tracking from omnidirectional footage

    Sep 7, 2026Xin Shu, Meegan Gower, Yvonne Buckley +1Multi-Object TrackingMotion Estimation

    Sigmedia Group, Electronic and Electrical Engineering, Trinity College Dublin · School of Zoology, Trinity College Dublin

  11. Synthetic Semantic Supervision for Contrastive Code Representation Learning in Small Transformers: An Empirical Study

    Sep 3, 2026Kenneth Paulsen, Florian Tambon, Mike Papadakis +1Text EmbeddingsContrastive Learning

    University of Luxembourg (SnT) · School of Computing, KAIST

  12. Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers

    Sep 2, 2026Ahmed Abdelnaby, Mohamed ElmahallawyClean Label Backdoor AttackUnsupervised Detection

    School of Engineering and Applied Sciences, Washington State University, Richland, WA 99354, USA

  13. Scaling Near-Optimal SFT-RL Annotation Budget Allocation from Small to Large LLMs

    Sep 1, 2026Jingtan Wang, Arun Verma, Xiaoqiang Lin +4Token Budget AllocationSmall Models

    Department of Computer Science, National University of Singapore, Republic of Singapore · Singapore-MIT Alliance for Research and Technology Centre, Republic of Singapore · Agency for Science, Technology, and Research (A*STAR), Republic of Singapore +1

  14. Anomaly Detection on Small Industrial Components via Vision-Based Tactile Sensing

    Aug 31, 2026G. F. Preziosa, M. Casiglia, M. Faroni +2Multimodal Industrial Anomaly DetectionTactile

    Politecnico di Milano, Piazza Leonardo da Vinci, 32, Milano (Italy)

  15. Do Small Models Use the Law You Give Them? Measuring Context Use on a Bilingual Bangladesh Legal Benchmark

    Aug 31, 2026Moniruzzaman Mahadi, Abrar Mohammed Tanzim Alam, Sayma Siddika Monalisa +3Legal DomainBangla

    North South University · BRAC University

  16. LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure

    Aug 13, 2026Fanfei Li, Jana Zeller, Manuel Prada-Corral +4CurriculumPedagogical Frameworks

    MPI-IS, Ellis Institute · MPI-IS, Ellis Institute, ETHZ · ETHZ

  17. Smart Compaction: Predicting Compaction Utility from Lakehouse Table Metadata

    Aug 9, 2026Jannic Cutura, Subash PrakashCompactionData Lakes

    ECB† · DSTI‡ · IBM§

  18. Understand Before Detect: Vision--Language Learning for Omni-Domain Infrared Small Target Detection

    Aug 7, 2026Haoyang Yuan, Boyang Li, Yingqian Wang +7Infrared Small Target DetectionScene Reasoning

    National University of Defense Technology, Changsha, China · Peking University, Beijing, China

  19. Beyond Foundation Models: Dimension-Aware Neural Architecture Search with Small-Data Representation Models for Cryocooler Lifetime Prediction

    Aug 7, 2026Gregor Molan, Grafika Jati, Francesco Barchi +3Time Series Foundation ModelsRepresentation Learning

    Comtrade 360 d.o.o., Letališka cesta 29b, Ljubljana, 1000, Slovenia · Comtrade AI GmbH, Grafenauweg 8, Zug, 6300, Switzerland · Alma Mater Studiorum – Università di Bologna, Department of Electrical, Electronic, and Information Engineering (DEI), Viale del Risorgimento 2, Bologna, 40136, Italy +2

  20. Optimizing Minimax Regret in Uncertain MDPs with Small Sets of Policies

    Aug 3, 2026Sterre Lutz, Daniël Vos, Matthijs T. J. Spaan +1Markov Decision ProcessesSequential Decision Making

    Delft University of Technology

  21. Beyond Magnitude and Shape: A Direction-Aware Loss for Time Series Forecasting

    Aug 3, 2026Seunghan Lee, Jaehoon Lee, Jun Seo +9Time Series ForecastingLoss Function

    LG AI Research

  22. Unsupervised Multidomain Approaches to Named Entity Recognition with Small Datasets

    Aug 2, 2026Israel Fianyi, James Montgomery, Soonja YeomNamed-Entity RecognitionTransfer Learning

    School of Information Communication Technologies, University of Tasmania, Launceston, Tasmania, Australia · School of Information Communication Technologies, University of Tasmania, Hobart, Tasmania Australia

  23. The Social Cost of an AI Teammate: How an Artificial Teammate Reshapes Human-Human Communication in Small-Team Decision-Making

    Jul 29, 2026Nia Nixon, Jaeyoon Choi, Pedro Martins De Bastos +4Complex SocietiesDiscourse

    University of California, Irvine, USA · University of Tübingen, Germany

  24. Bigger or Cheaper? Scale and Quantization Effects on Uncertainty Signals in Vision-Language Models Under Image Degradation

    Jul 27, 2026M M Asif FerdousLarge Language Model UncertaintyQuantized

    Independent Researcher

  25. Do Small Models Use the Law You Give Them? Context-Injected Fine-Tuning for Legal QA in Bangladesh

    Jul 26, 2026Moniruzzaman Mahadi, Abrar Mohammed Tanzim Alam, Sayma Siddika Monalisa +3BanglaSmall Large Language Models

    Department of Electrical and Computer Engineering, North South University Dhaka, Bangladesh · Department of Computer Science and Engineering, BRAC University Dhaka, Bangladesh

  26. Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos

    Jul 22, 2026Penglei Sun, Yehua Huang, Zhuoli Tao +8Aerial DatasetMultimodal Large Language Models

    Information Hub, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · University of Freiburg, Freiburg, German · Hangzhou City University, Hangzhou, China +3

  27. Physics-Informed Machine Learning Under Small-Data Constraints: Lessons from Abrasive Waterjet Milling

    Jul 8, 2026Sarah Grewe, Jörg FrochtePhysics-Informed LearningPorous Media

    Bochum University of Applied Sciences Germany

  28. Multiplication Beyond Groups: Stratified Fourier Mechanisms in Transformer Circuits

    Jul 8, 2026Zitong Andrew Chen, Junaid Hasan, Akhil Srinivasan +2FourierSmall Models

    1UW Math AI Lab, University of Washington.

  29. When Does Small Data Work? Accuracy and Efficiency Trade-offs Between Tabular Foundation Models and Conventional Methods for Crowd-State Classification at Hajj and Umrah

    Jul 4, 2026AlJawharh S. AlOtaibi, Mohamed Eltahir, Jude AlSubaieTabular Foundation ModelsTabular Learning

    Riyadh, Saudi Arabia

  30. Variable Bit-width Quantization: Learning Per-Group Precision for "Bigger-but-Smaller" Language Models

    Jul 3, 2026Hamish OgilvyLarge Language Model QuantizationAutoregressive Decoding

    Algolia Research

  31. On the Smallness of the Large Language Models Scaling Exponents

    Jun 23, 2026Sauro Succi, Peter V. Coveney, Alex HansenScaling LawsExponents

    Italian Institute of Technology, Viale Regina Elena, 291, 00161, Rome, Italy · PoreLab, Physics Department, Norwegian University of Science and Technology, 7491 Trondheim, Norway · Centre for Computational Science, Chemistry Department, University College of London, 20 Gordon Street, WC1H 0AJ, London, United Kingdom

  32. Robot Critics that Sweat the Small Stuff

    Jun 19, 2026Sruthi Sudhakar, Junbang Liang, Sreehari Rammohan +3Robot PoliciesTask Success Rate

    Columbia University · Toyota Research Institute

  33. Small Data, Big Noise: Adversarial Training for Robust Parameter-Efficient Fine-Tuning

    Jun 9, 2026Eitan Cohen, Idan Simai, Uri ShahamParameter-Efficient Fine-Tuning MethodsAdversarial Training

    Bar-Ilan University · Ramat Gan, Israel

  34. Spatial Priors via Space Filling Curves for Small and Limited Data Vision Transformers

    Jun 8, 2026Leyla Naz Candogan, Arshia Afzal, Pol Puigdemont +1Self-Supervised Vision TransformersVision Transformer

    LIONS, École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland.

  35. POLARIS: Guiding Small Models to Write Long Stories

    Jun 2, 2026Rishanth Rajendhran, Jenna Russell, Mohit Iyyer +1NarrativesSmall Models

    University of Maryland · Google DeepMind

  36. Self-Improving Small Object Grounding in LVLMs

    Jun 1, 2026Tianze Yang, Yucheng Shi, Ruitong Sun +2Small ModelsObjects

    University of Georgia

  37. Learning Controlled Separation of Small Objects Between Two Fingers with a Tactile Skin

    May 29, 2026Ulf Kasolowsky, Berthold BäumlRobotic HandsTactile

    Learning AI for Dextrous Robots Lab (aidx-lab.org), Technical University of Munich, Germany · DLR Institute of Robotics and Mechatronics, German Aerospace Center

  38. Elias in the Lighthouse, Again? Diagnosing Low Diversity in LLM Stories

    May 26, 2026Sil Hamilton, David MimnoNarrative GenerationLarge Language Model Generation

    Department of Information Science Cornell University

  39. Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solvers

    May 25, 2026Shyam Sankaran, Hanwen Wang, Paris PerdikarisNeural Partial Differential Equation SolversDeep Learning Architectures

    Department of Mechanical Engineering and Applied Mechanics, University of Pennsylvania · Graduate Program in Applied Mathematics and Computational Science, University of Pennsylvania

  40. TinyFormer: Preserving Tiny Objects in YOLO-DETR Hybrid Real-time Detectors

    May 24, 2026Jun-Wei Hsieh, Meng-Yu Kao, Ghufron Wahyu Kurniawan +1Yolo26Unsupervised Detection

    College of Artificial Intelligence, National Yang Ming Chiao Tung University, Taiwan · 2Mitsubishi Electric Research Laboratories

  41. To Select or not to Select, that is the Question: Distilling Robot Skill Prediction into a Small Ensemble

    May 20, 2026Haechan Mark Bong, Simon Roy, Euhid Aman +1Robot SystemsSynthetic Data

    Department of Computer Engineering and Software Engineering, Polytechnique Montréal, QC., Canada. · MILA, QC., Canada. · National Taiwan University of Science and Technology (NTUST), Taipei City, Taiwan.

  42. DAD4TS: Data-Augmentation-Oriented Diffusion Model for Time-Series Forecasting with Small-Scale Data

    May 18, 2026Masahiro Suzuki, Bohui Xia, Hiroto Yamamoto +1Time SeriesDiffusion Models

    Sony Group Corporation Tokyo, Japan

  43. Slower Generalization, Faster Memorization: A Sweet Spot in Algorithmic Learning

    May 14, 2026Shin So, Kyelim Lee, Albert NoMemorizationSmall Models

    Yonsei University

  44. Dense vs Sparse Pretraining at Tiny Scale: Active-Parameter vs Total-Parameter Matching

    May 13, 2026Abdalrahman WaelMixture-Of-ExpertsSmall Models

    Independent Researcher

  45. Scaling few-shot spoken word classification with generative meta-continual learning

    May 13, 2026Louise Beyers, Batsirayi Mupamhi Ziki, Ruan van der MerweFew-Shot LearningSubword Tokenization

    Bytefuse

  46. CoT-Guard: Small Models for Strong Monitoring

    May 12, 2026Nirav Diwan, Han Wang, Berkcan Kapusuzoglu +6Realistic Threat ModelLLM Defense Mechanisms

    †University of Illinois Urbana-Champaign · ♢Capital One

  47. RDEx-CASK: Cauchy Mutation, Archive, and Stagnation Kick for RDEx-CSOP

    May 10, 2026Dikshant, Dikshit Chauhan, Chen Hao +3Lattice MutationVariance

  48. Sparsity Moves Computation: How FFN Architecture Reshapes Attention in Small Transformers

    May 10, 2026Gabriel Smithline, Chris MascioliTransformer AttentionFeed-Forward

    University of Michigan

  49. Nearly Optimal Attention Coresets

    May 7, 2026Edo Liberty, Alexandr Andoni, Eldar KleinerGeometry-Aware Uncertainty CoresetsBounded-Memory

  50. MiniMind-O Technical Report: An Open Small-Scale Speech-Native Omni Model

    May 5, 2026Jingyao GongSmall ModelsTechnical Report

    Independent Researcher

  51. Evaluating LLMs on Large-Scale Graph Property Estimation via Random Walks

    May 2, 2026Sunil Kumar Maurya, Xin LiuLLM Reasoning StrategiesLarge Language Model Evaluation

    University of Tokyo Tokyo, Japan · AIST Tokyo, Japan

  52. Spreadsheet Modeling Experiments Using GPTs on Small Problem Statements and the Wall Task

    Apr 28, 2026Thomas A. Grossman, Yuan Chen, Sopiko DatuashviliSpreadsheetsReproducibility

    University of San Francisco 2130 Fulton St. San Francisco, CA 94117 USA

  53. Training Transformers as a Universal Computer

    Apr 28, 2026Ruize Xu, Chenxiao Yang, Yanhong Li +1Small ModelsCortex

    The University of Chicago · Toyota Technological Institute at Chicago · Allen Institute for AI

  54. Robust Grounding with MLLMs Against Occlusion and Small Objects via Language-Guided Semantic Cues

    Apr 27, 2026Beomchan Park, Seongho Kim, Hyunjun Kim +2Multimodal Large Language ModelsGrounding

    Integrated Vision Language Lab., KAIST, Republic of Korea

  55. Can Multimodal Large Language Models Truly Understand Small Objects?

    Apr 24, 2026Fujun Han, Junan Chen, Xintong Zhu +4Multimodal Large Language ModelsSmall Models

    Shanghai AI Laboratory · The Chinese University of Hong Kong, Shenzhen · University of Science and Technology of China +2

  56. Learning to count small and clustered objects with application to bacterial colonies

    Apr 21, 2026Minghua Zheng, Na Helian, Peter C. R. Lane +2Bacterial Colony CountingMicroscopy

    King’s College London, St Thomas Street, London, SE1 1UL, United Kingdom · University of Hertfordshire, College Lane, Hatfield, AL10 9AB, United Kingdom · Synoptics Ltd, Beacon House, Nuffield Road, Cambridge, CB4 1TF, United Kingdom

  57. Prompt Sensitivity in Vision-Language Grounding: How Small Changes in Wording Affect Object Detection

    Apr 18, 2026Dawar Jyoti Deka, Amit Sethi, Syed Mohammad AliVision-Language Model GroundingOpen-Vocabulary

    Department of Aerospace Engineering, Indian Institute of Technology Bombay, Mumbai, India · Department of Electrical Engineering, Indian Institute of Technology Bombay, Mumbai, India

  58. Small Model as Master Orchestrator: Learning Unified Agent-Tool Orchestration with Parallel Subtask Decomposition

    Apr 18, 2026Wenzhen Yuan, Wutao Xiong, Fanchen Yu +7Multi-Agent OrchestrationOrchestration

    Shanghai Jiao Tong University · Sichuan University · Shanghai AI Lab +2

  59. Frozen Vision Transformers for Dense Prediction on Small Datasets: A Case Study in Arrow Localization

    Apr 18, 2026Maxwell ShepherdDense PredictionObject Localization

  60. Improving Reasoning Capabilities in Small Models through Mixture-of-Layers Distillation with Stepwise Attention on Key Information

    Apr 17, 2026Yao Chen, Jiawei Sheng, Wenyuan Zhang +1Dataset DistillationReasoning Skills

    Institute of Information Engineering, Chinese Academy of Sciences · School of Cyber Security, University of Chinese Academy of Sciences