Small Models

Follow this topic Ask about this topic

Recent momentum

+25%

5 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Small Models.

Period ending 2026-09-07

3 new papers

A weekly snapshot of new work published in Small Models.

26 papers

Latest in Small Models

Open your feed →

A Statistical Approach to Estimating Sample Size of Machine Learning Models
Sep 10, 2026Dat Phan-Trong, Sunil Gupta, Svetha VenkateshSample Size Machine Learning
Noēsis: Deterministic-First Retrieval with Two-Tier Context Hydration for Factuality-Critical Queries on Small Local Models
Sep 7, 2026Nicola CogottiRetrieval-Augmented Generation Facts
Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching
Sep 1, 2026Jaewoo Park, Minyoung Lee, Sukmin Seo +11Drone Diffusion-Based Vision-Language-Actions
CoMPASS: Collaborative Molecular Property Prediction via Adaptive Small-Large Model Synergy
Aug 31, 2026Wentao Li, Jiangjie Qiu, Yijun Li +2Molecular Property Prediction Chemistry
Do Small Models Use the Law You Give Them? Measuring Context Use on a Bilingual Bangladesh Legal Benchmark
Aug 31, 2026Moniruzzaman Mahadi, Abrar Mohammed Tanzim Alam, Sayma Siddika Monalisa +3Llm-Based Statutory Question Answering Bangla
Beyond Foundation Models: Dimension-Aware Neural Architecture Search with Small-Data Representation Models for Cryocooler Lifetime Prediction
Aug 7, 2026Gregor Molan, Grafika Jati, Francesco Barchi +3Time Series Foundation Models Representation Learning
Personalizing Large Language Model Agents with Small Policy Models
Jul 31, 2026Dian Jin, Zhi Zhang, Huichao Li +3Large Language Model Personalization Large Language Model Agents
Bigger or Cheaper? Scale and Quantization Effects on Uncertainty Signals in Vision-Language Models Under Image Degradation
Jul 27, 2026M M Asif FerdousLarge Language Model Quantization Quantization Effects
Do Small Models Use the Law You Give Them? Context-Injected Fine-Tuning for Legal QA in Bangladesh
Jul 26, 2026Moniruzzaman Mahadi, Abrar Mohammed Tanzim Alam, Sayma Siddika Monalisa +3Llm-Based Statutory Question Answering Bangla
WinDOM: Self-Family Distillation for Small-Model GUI Grounding
Jun 24, 2026Chengheng Li-Chen, Zhiqian Zhou, Hao Chen +1Graphical User Interface Small Models
POLARIS: Guiding Small Models to Write Long Stories
Jun 2, 2026Rishanth Rajendhran, Jenna Russell, Mohit Iyyer +1Small Models Narratives
Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO
May 29, 2026Yiming Ren, Yiran Xu, Zicheng Lin +8Relative Policy Optimization Prior Prompt Optimization Techniques
Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift
May 26, 2026Yusuf Brima, Marcellin Atemkeng, Lansana Hassim Kallon +4Tabular Foundation Models Tabular Learning
Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solvers
May 25, 2026Shyam Sankaran, Hanwen Wang, Paris PerdikarisNeural Partial Differential Equation Solvers Neural Architectures
Towards Family-Grouped Hierarchical Federated Learning on Sub-5KB Models: A Feasibility Study of Privacy-Preserving ECG Monitoring for Ultra-Resource-Constrained Wearables
May 15, 2026Hangyu WuElectrocardiogram Image Classification Microcontrollers
Three-Stage Learning Unlocks Strong Performance in Simple Models for Long-Term Time Series Forecasting
May 13, 2026Zhenan Yu, Guangxin Jiang, Jin YangTime Series Forecasting Long-Term
CoT-Guard: Small Models for Strong Monitoring
May 12, 2026Nirav Diwan, Han Wang, Berkcan Kapusuzoglu +6Guard Small Models
SpecKV: Adaptive Speculative Decoding with Compression-Aware Gamma Selection
May 4, 2026Shikhar ShuklaSpeculative Decoding LLM Inference Efficiency
AgentFloor: How Far Up the tool use Ladder Can Small Open-Weight Models Go?
May 1, 2026Ranit Karmakar, Jayita ChatterjeeAgentic Benchmarks Frontier Models
Nautile-370M: Spectral Memory Meets Attention in a Small Reasoning Model
Apr 27, 2026Maixent ChenebauxSmall Models
Small Model as Master Orchestrator: Learning Unified Agent-Tool Orchestration with Parallel Subtask Decomposition
Apr 18, 2026Wenzhen Yuan, Wutao Xiong, Fanchen Yu +7Multi-Agent Orchestration Orchestration
Improving Reasoning Capabilities in Small Models through Mixture-of-Layers Distillation with Stepwise Attention on Key Information
Apr 17, 2026Yao Chen, Jiawei Sheng, Wenyuan Zhang +1Dataset Distillation Small Models
Small Reward Models via Backward Inference
Feb 14, 2026Yike Wang, Faeze Brahman, Shangbin Feng +3Llm-As-A-Judge Small Models
$μ$ pscaling small models: Principled warm starts and hyperparameter transferμpscaling small models: Principled warm starts and hyperparameter transfer
Feb 11, 2026Yuxin Ma, Nan Chen, Mateo Díaz +3Hyperparameter Upsampling
CRPS-LAM: Probabilistic Regional Weather Forecasting with Continuous Ranked Probability Score
Oct 10, 2025Erik Larsson, Joel Oskarsson, Tomas Landelius +1Artificial Intelligence Weather Models Autoregressive Model
Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks
Apr 24, 2025Yang Liu, Kejia Zhang, Bingjie Yan +11Large Language Model Adaptation Small Models

Sep 10, 2026 · cs.LGJ/K move · Enter open · S save

A Statistical Approach to Estimating Sample Size of Machine Learning Models

Dat Phan-Trong, Sunil Gupta, Svetha Venkatesh

Sample size determination for machine learning (ML) prediction models is challenging because conventional power analysis typically requires the predictor-outcome relationship and effect structure to be specified a priori. Nonlinear ML models learn complex prediction surfaces that do not admit straightforward analytical power calculations. We propose a framework that approximates nonlinear ML models with localized linear representations and estimates sample size requirements by evaluating statistical power across these local regions.

Sample Size Machine Learning Statistics Small Models Automation and Machines

Open paper Ask about it PDF