LLM Input Optimization

LLM: Large Language Model

Follow this topic Ask about this topic

Latest papers

24 papers0 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Understanding When Reflective Prompt and Skill Optimization Helps on Locally Served Reasoning Models: A Two-Model Study of GEPA and SkillOpt
Oct 19, 2026Andrea Giummarra, Carmelo Baglieri, Antonio Di Maria +3LLM Input Optimization Large Language Model-Guided Optimization
Evision srl, Ragusa, Italy · Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy
ESPO: Error-Structured Prompt Optimization via Diagnose, Diversify, and Stabilize
Sep 3, 2026Lihao Liu, Peng Tang, Kunwar Yashraj Singh +1Evolutionary Optimization Large Language Model-Guided Optimization
AWS Agentic AI
SEPO: Evidence-Grounded Prompt Optimization via Structural Editing
Aug 28, 2026Xiaoyu Ma, Haoyue Liu, Yiwen Li +4Automatic Prompt Optimization Prompt Optimization
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen · Xi’an Jiaotong University · Shenzhen Future Network of Intelligence Institute (FNiI-Shenzhen) +1
RLMOpt: Adaptive Prompt Optimization via Recursive Language Models
Aug 11, 2026Subhash Bangalore Satheesha, Nirvik Pande, Deepthi Duddempudi +1Large Language Model-Guided Optimization LLM Agents
Autonomize AI · Carnegie Mellon University
Moral Hazard in Multi-Agent Language Models
Jul 27, 2026Dane MalenfantLLM Input Optimization LLM Prompting
School of Computer Science · McGill University · Mila - The Québec AI Institute
Graph-based Target Back-Propagation for Context Adaptation in Multi-LLM Agentic Systems
Jun 12, 2026Tan Zhu, Tong Yao, Kananart Kuwaranancharoen +4Multi-Agent LLM Systems LLM Input Optimization
Retail Intelligence, Walmart Global Tech, Sunnyvale, CA, USA
Navigating LLM Valley: From AdamW to Memory-Efficient and Matrix-Based Optimizers
May 9, 2026Aditya RanganathDeep Learning Optimization LLM Input Optimization
Center for Applied Scientific Computing Lawrence Livermore National Laboratory Livermore, CA, USA
Revealing Modular Gradient Noise Imbalance in LLMs: Calibrating Adam via Signal-to-Noise Ratio
May 7, 2026Ziqing Wen, Zhouyang Liu, Jiahuan Wang +4Deep Learning Optimization LLM Input Optimization
College of Computer Science and Technology, National University of Defense Technology, Changsha, Hunan, China
Telegraph English: Semantic Prompt Compression via Structured Symbolic Rewriting
May 6, 2026Mikhail L. Arbuzov, Sisong Bei, Ziwei Dong +2LLM Compression Prompt Compression
Independent Researcher · Palo Alto Networks
When Correct Isn't Usable: Improving Structured Output Reliability in Small Language Models
May 4, 2026Cosimo Galeone, Minsu Park, Giuseppe Ettorre +1LLM Evaluation LLM Input Optimization
Alomana, Grottaglie, Italy
Optimization before Evaluation: Evaluation with Unoptimised Prompts Can be Misleading
Apr 30, 2026Nicholas Sadjoli, Tim Siefken, Atin Ghosh +2LLM Evaluation Language Model Generation Evaluation
SAP · Stanford University
Semantic Density Effect (SDE): Maximizing Information Per Token Improves LLM Accuracy
Apr 19, 2026Amr AhmedLLM Prompting Prompt Optimization
Public Health Department, Riyadh First Health Cluster · Ministry of Health, Saudi Arabia
ONTO: A Token-Efficient Columnar Notation for LLM Input Optimization
Apr 19, 2026Harshavardhanan DeekeswarLLM Inference Efficiency LLM Input Optimization
Independent Researcher · Chennai, India
Self-Evolving LLM Memory Extraction Across Heterogeneous Tasks
Apr 13, 2026Yuqing Yang, Tengxiao Liu, Wang Bill Zhu +3LLM Input Optimization LLM Memory
University of Southern California · University of California, Santa Barbara
SAGE: Sign-Adaptive Gradient for Memory-Efficient LLM Optimization
Apr 9, 2026Wooin Lee, Hyun-Tae KimLLM Input Optimization Memory-Efficient Optimization
London, United Kingdom · Seoul, Republic of Korea
Adaptive Prompt Structure Factorization: A Framework for Self-Discovering and Optimizing Compositional Prompt Programs
Apr 8, 2026Haoyue Liu, Zhichao Wang, Yongxin Guo +2LLM Input Optimization LLM Prompting
The Chinese University of Hong Kong, Shenzhen · Taobao and Tmall Group
Combee: Scaling Prompt Learning for Self-Improving Language Model Agents
Apr 5, 2026Hanchen Li, Runyuan He, Qizheng Zhang +11LLM Input Optimization LLM Prompting
UC Berkeley · Stanford University · Independent +1
Do We Need Frontier Models to Verify Mathematical Proofs?
Apr 2, 2026Aaditya Naik, Guruprerana Shabadi, Rajeev Alur +1LLM Input Optimization Reasoning Verification
University of Pennsylvania, U.S.A.
RASPRef: Retrieval-Augmented Self-Supervised Prompt Refinement for Large Reasoning Models
Mar 27, 2026Rahul SoniLLM Input Optimization LLM Prompting
Independent Researcher
Enhancing LLM Training via Spectral Clipping
Mar 15, 2026Xiaowen Jiang, Andrei Semenov, Sebastian U. StichLLM Input Optimization Spectral Regularization
CISPA Helmholtz Center for Information Security, Saarbrücken, Germany · Universität des Saarlandes, Saarbrücken, Germany · EPFL
NuMuon: Nuclear-Norm-Constrained Muon for Compressible LLM Training
Mar 4, 2026Hadi Mohaghegh Dolatabadi, Thalaiyasingam Ajanthan, Sameera Ramasinghe +7LLM Input Optimization LLM Compression
Pluralis Research
How Confident Is the First Token? An Uncertainty-Calibrated Prompt Optimization Framework for Large Language Model Classification and Understanding
Feb 23, 2026Wei Chen, Guoyang Ju, Yuanyuan QiLLM Input Optimization LLM Prompting
China Jiliang University, Hangzhou, China
BudgetMem: Training-Free Selective Memory for Cost-Efficient Long-Context Processing in Language Models
Nov 7, 2025Chandra Vamsi Krishna Alla, Harish Naidu Gaddam, Manohar Kommi +1Memory-Efficient Optimization LLM Compression
University of Texas at Arlington
Optimizing Prompt Sequences using Monte Carlo Tree Search for LLM-Based Optimization
Aug 8, 2025Fei Xu Yu, Gina Adam, Nathaniel D. Bastian +1Natural Language to Optimization Modeling Large Language Model-Guided Optimization
The George Washington University · United States Military Academy

Oct 19, 2026J/K move · Enter open · S save

Understanding When Reflective Prompt and Skill Optimization Helps on Locally Served Reasoning Models: A Two-Model Study of GEPA and SkillOpt

Andrea Giummarra, Carmelo Baglieri, Antonio Di Maria, Andrea Farruggio+2

Evision srl, Ragusa, Italy · Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy

LLM Input Optimization Large Language Model-Guided Optimization LLM Reasoning Language Model Reasoning Evaluation

Open paper AskPDF arXiv

Reflective text-space optimizers such as GEPA and SkillOpt have reported large gains on frontier and mid-size models. We test replication across two reasoning-native target-serving configurations: DeepSeek V4 Flash through DwarfStar and Qwen3.8-27B through LM Studio. For each target, we evaluate the same held-out tasks and four conditions - minimal baseline, GEPA prompt, SkillOpt skill, and manually engineered prompt - on HotpotQA (n=500 per condition) and MATH-500 (n=250). In the primary Qwen v2 rerun under the same frozen protocol, GEPA selects the HotpotQA seed and exactly reproduces baseline behavior, whereas SkillOpt's validation gain reverses into held-out degradation. On MATH-500, GEPA raises exact match from 0.828 to 0.904 while reducing latency but increasing token consumption, so lower response time does not imply lower token cost. DeepSeek likewise shows its strongest GEPA effect on MATH-500 (0.852 to 0.908). Across both targets, GEPA's strongest gains occur on MATH-500, while neither optimizer improves the HotpotQA baseline. Optimization is therefore task- and method-dependent, and validation gains may reverse on held-out evaluation. An earlier Qwen run is retained as serving-sensitivity evidence. These results suggest that textual headroom for a model-task pair and the observed effect of a text-space optimizer are more informative when decomposed into content/reasoning, answer-realization/evaluator alignment, and serving-completion/reliability. The cross-benchmark pattern further suggests that optimization may benefit from low-ambiguity, actionable evaluation signals.