Small Reasoning Model

Follow this topic Ask about this topic

Momentum

4 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 17

All topics

IrekoGPT: Turning Structured Pruning into Post-Hoc Slimmable LLMs
Sep 30, 2026Pietro Moriello, Pietro Buzzega, Angelo Porrello +1Large Language Model Compression Structured Pruning
AImageLab, University of Modena and Reggio Emilia, Italy
Smaller Models, Better Rejects: Preference Distillation Scaling
Sep 30, 2026Rui Cai, Wenhui Zhu, Xiwen Chen +15Small Reasoning Model Residual Distillation
AI Agentic Modeling and Foundation Team, LinkedIn · University of California, Davis · Arizona State University +3
Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
Sep 28, 2026Chanuk Lee, Minki Kang, Sangwoo Park +3Small Reasoning Model Test Time
KAIST
Noēsis: Deterministic-First Retrieval with Two-Tier Context Hydration for Factuality-Critical Queries on Small Local Models
Sep 7, 2026Nicola CogottiFacts Small Reasoning Model
Alpha Cogs
Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching
Sep 1, 2026Jaewoo Park, Minyoung Lee, Sukmin Seo +11Autonomous Drones Multimodal Large Language Models
Drone AI Team, NAVER Cloud
CoMPASS: Collaborative Molecular Property Prediction via Adaptive Small-Large Model Synergy
Aug 31, 2026Wentao Li, Jiangjie Qiu, Yijun Li +2Molecular Property Prediction Chemistry
Beijing Key Laboratory of Artificial Intelligence for Advanced Chemical Engineering Materials · State Key Laboratory of Chemical Engineering and Low-Carbon Technology · Department of Chemical Engineering, Tsinghua University
Personalizing Large Language Model Agents with Small Policy Models
Jul 31, 2026Dian Jin, Zhi Zhang, Huichao Li +3Large Language Model Agents Small Reasoning Model
Department of Statistics and Data Science, National University of Singapore · Department of Statistics and Data Science, University of California, Los Angeles · Department of Data Science, Fudan University
WinDOM: Self-Family Distillation for Small-Model GUI Grounding
Jun 24, 2026Chengheng Li-Chen, Zhiqian Zhou, Hao Chen +1Supervised Finetuning Small Reasoning Model
Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland · Logitech · Universitat Politècnica de Catalunya (UPC), Barcelona, Spain.
Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO
May 29, 2026Yiming Ren, Yiran Xu, Zicheng Lin +8Frictive Policy Optimization Rollout
Tsinghua University · Shanghai AI Laboratory · The Chinese University of Hong Kong +1
Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift
May 26, 2026Yusuf Brima, Marcellin Atemkeng, Lansana Hassim Kallon +4Tabular Foundation Models Tabular Learning
Computer Vision, Institute of Cognitive Science, Osnabrück University, Germany · Department of Mathematics, Rhodes University, South Africa · National Institute for Theoretical and computational Sciences (NITheCS), Stellenbosch, 7600, South Africa +6
Towards Family-Grouped Hierarchical Federated Learning on Sub-5KB Models: A Feasibility Study of Privacy-Preserving ECG Monitoring for Ultra-Resource-Constrained Wearables
May 15, 2026Hangyu WuArrhythmia Classification Federated Learning
Shenzhen Coddie Technology co.,ltd, Shenzhen, 518000, China
Three-Stage Learning Unlocks Strong Performance in Simple Models for Long-Term Time Series Forecasting
May 13, 2026Zhenan Yu, Guangxin Jiang, Jin YangLong-Term Residual Learning
1Harbin Institute of Technology
SpecKV: Adaptive Speculative Decoding with Compression-Aware Gamma Selection
May 4, 2026Shikhar ShuklaSpeculative Decoding Self-Speculative
University of Kentucky, Lexington, KY, USA
AgentFloor: How Far Up the tool use Ladder Can Small Open-Weight Models Go?
May 1, 2026Ranit Karmakar, Jayita ChatterjeeSmall Reasoning Model Production Agentic Systems
Harvard University, Boston, MA 02115 · Boston, MA 02115
Nautile-370M: Spectral Memory Meets Attention in a Small Reasoning Model
Apr 27, 2026Maixent ChenebauxSmall Large Language Models Small Reasoning Model
Trickstr
Small Reward Models via Backward Inference
Feb 14, 2026Yike Wang, Faeze Brahman, Shangbin Feng +3Llm-As-A-Judge Small Reasoning Model
University of Washington · Allen Institute for Artificial Intelligence
CRPS-LAM: Probabilistic Regional Weather Forecasting with Continuous Ranked Probability Score
Oct 10, 2025Erik Larsson, Joel Oskarsson, Tomas Landelius +1Probabilistic Forecasting Small Reasoning Model
Linköping University · ETH AI Center · SMHI & Linköping University

Sep 30, 2026, cs.LGJ/K move · Enter open · S save

IrekoGPT: Turning Structured Pruning into Post-Hoc Slimmable LLMs

Pietro Moriello, Pietro Buzzega, Angelo Porrello, Simone Calderara

AImageLab, University of Modena and Reggio Emilia, Italy

Large Language Model Compression Structured Pruning Small Reasoning Model Openai

Open paper AskPDF arXiv

We introduce IrekoGPT, a post-hoc method for converting pretrained LLMs into slimmable models whose width can be adjusted at inference time. Building on SliceGPT, we retain its projection matrices without pruning them, allowing a single model to expose nested subnetworks at different widths. We improve robustness by calibrating each layer across multiple compression ratios, and correct downstream linear layers through gradient-free ridge regression. Across Llama and Qwen models, preliminary results show improvements over naive PCA-based slimming, with the largest gains at high compression. Code is available at https://github.com/aimagelab/IrekoGPT

Momentum

Related topics

Latest papers 17