LLM Self-Refinement

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

6 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 62

All topics

SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinement
Jun 9, 2026Srishti Gautam, Arjun Radhakrishna, Sumit GulwaniLLM Self-Refinement LLM Agent Self-Improvement
Microsoft
(Auto)formalization is supposed to be easy: Trellis process semantics for spelling out rigorous proofs
Jun 8, 2026Wesley PegdenLLM Self-Refinement LLM Agents
Department of Mathematical Sciences, Carnegie Mellon University.
Closing the Prior-Posterior Loop: Self-Reflective Molecular Design with Analysis-Driven LLM Iteration
Jun 8, 2026Junyi Gong, Zijie Qiu, Ben Zhong TangMolecular Optimization LLM Self-Refinement
Faculty of Chemistry, Shenzhen MSU-BIT University · School of Science and Engineering, Chinese University of Hong Kong (Shenzhen) · Department of Chemistry, Hong Kong University of Science and Technology
Reasoning without Gold Standards: A Proxy-Judge Theory of Autoformalization
Jun 8, 2026Lei Xu, Xin Quan, André FreitasLLM Self-Refinement LLM-as-a-Judge
1Idiap Research Institute, Switzerland · 2École Polytechnique Fédérale de Lausanne (EPFL), Switzerland · Department of Computer Science, University of Manchester, United Kingdom +1
FLARE: Fine-Grained Diagnostic Feedback for LLM Code Refinement
Jun 2, 2026Yinsheng Yao, Hongxiang Zhang, Weixi Tong +1LLM Self-Refinement Automated Program Repair
Purdue University West Lafayette, IN, USA
On the Generalization Gap in Self-Evolving Language Model Reasoning
May 31, 2026Zhenting Qi, Susanna Maria Baby, Stefanie Anna Baby +5LLM Self-Refinement Language Modeling
Google Research · Harvard University · Google +1
What Am I Missing? Question-Answering as Hidden State Probing
May 29, 2026Chu Fei Luo, Samuel Dahan, Xiaodan ZhuLLM Self-Refinement Language Model Self-Assessment
Department of Electrical and Computer Engineering & Ingenuity Labs, Queen’s University · Conflict Analytics Lab, Queen’s University · Cornell Law School +1
Self-Trained Verification for Training- and Test-Time Self-Improvement
May 28, 2026Chen Henry Wu, Aditi RaghunathanLLM Self-Refinement Language Model Self-Improvement
Carnegie Mellon University
Honest Lying: Understanding Memory Confabulation in Reflexive Agents
May 28, 2026Prakhar Dixit, Sadia Kamal, Tim OatesAI Agent Reliability LLM Self-Refinement
Department of Computer Science, University of Maryland Baltimore County, Baltimore, MD, USA.
Hallucination Detection-Guided Preference Optimization for Clinical Summarization
May 27, 2026Shamanth Kuthpadi Seethakantha, Dung Ngoc Thai, Vara Prasad Gudi +6LLM Self-Refinement LLM Hallucination Mitigation
1Manning College of Information and Computer Sciences · 2Ensemble HP · 3Columbia University +1
CORE: Contrastive Reflection Enables Rapid Improvements in Reasoning
May 27, 2026Linas Nasvytis, Simon Jerome Han, Ben Prystawski +3LLM Self-Refinement Efficient Language Model Reasoning
Stanford University
CoSPlay: Cooperative Self-Play at Test-Time with Self-Generated Code and Unit Test
May 22, 2026Zhangyi Hu, Chenhui Liu, Tian Huang +6LLM Self-Refinement Execution-Guided Code Generation
1The Hong Kong University of Science and Technology (Guangzhou) · Institute of Deep Perception Technology, JITRI, Wuxi, China
Self-Refining Topology Optimization via an LLM-Based Multi-Agent Framework
May 22, 2026Hyunjee Park, Hayoung ChungTopology Optimization Multi-Agent LLM Systems
Department of Mechanical Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulju-gun, Ulsan, 44919, Republic of Korea
ImProver 2: Iteratively Self-Improving LMs for Neurosymbolic Proof Optimization
May 21, 2026Riyaz Ahuja, Tate Rowney, Jeremy Avigad +1LLM Self-Refinement Automated Theorem Proving
Carnegie Mellon University
Reflective Prompt Tuning through Language Model Function-Calling
May 20, 2026Farima Fatahi Bayat, Moin Aminnaseri, Pouya Pezeshkpour +1LLM Self-Refinement LLM Prompting
Megagon Labs
REFLECTOR: Internalizing Step-wise Reflection against Indirect Jailbreak
May 20, 2026Jiachen Ma, Jiawen Zhang, Xiangtian Li +3LLM Self-Refinement LLM Safety
Fudan University · Shanghai Artificial Intelligence Laboratory · Zhejiang University
A-ProS: Towards Reliable Autonomous Programming Through Multi-Model Feedback
May 18, 2026Anika Tabassum, Md Sifat Hossain, Md. Fahim Arefin +2LLM Self-Refinement Execution-Guided Code Generation
Dept. of Computer Science and Engineering, University of Dhaka, Bangladesh · Dept. of Information Systems, University of Maryland, Baltimore County, USA
STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discovery
May 18, 2026Jiarui Su, Songjun Tu, Bei Sun +1LLM Self-Refinement AI Agents for Scientific Discovery
Central South University · Institute of Automation, Chinese Academy of Sciences · Pengcheng Laboratory
What Does LLM Refinement Actually Improve? A Systematic Study on Document-Level Literary Translation
May 13, 2026Shaomu Tan, Dawei Zhu, Ke Tran +5LLM Self-Refinement Document-Level MT
University of Amsterdam · 3Amazon AGI · University of Cambridge
ICRL: Learning to Internalize Self-Critique with Reinforcement Learning
May 13, 2026Jianbo Lin, Xiaomin Yu, Yi Xin +7RL for Language Models LLM Self-Refinement
Hong Kong University of Science and Technology (Guangzhou) · Nanjing University · Sun Yat-sen University +3
RubricRefine: Improving Tool-Use Agent Reliability with Training-Free Pre-Execution Refinement
May 10, 2026Will LeVine, Brendan Evers, Sam Saltwick +1LLM Self-Refinement Rubric-Based Evaluation
Anduril Industries
Interactive Critique-Revision Training for Reliable Structured LLM Generation
May 8, 2026Fei Xu Yu, Zuyuan Zhang, Mahdi Imani +2LLM Self-Refinement Group Relative Policy Optimization
The George Washington University · Northeastern University · United States Military Academy
TheraAgent: Self-Improving Therapeutic Agent for Precise and Comprehensive Treatment Planning
May 7, 2026Junkai Li, Yunghwei Lai, Tianyi Zhu +3LLM Self-Refinement Healthcare
1Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China · Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China · School of Computing, National University of Singapore, Singapore
LLM-ReSum: A Framework for LLM Reflective Summarization through Self-Evaluation
Apr 28, 2026Huyen Nguyen, Haoxuan Zhang, Yang Zhang +2LLM Evaluation LLM Self-Refinement
Cigna Group Evernorth Health Services Austin, Texas, USA · dept. of Information Science University of North Texas Denton, Texas, USA · dept. of Data Science University of North Texas Denton, Texas, USA
Feedback Over Form: Why Execution Feedback Matters More Than Pipeline Topology in 1-3B Code Generation
Apr 23, 2026Charles Junichi McAndrewsLLM Self-Refinement Execution-Guided Code Generation
Evaluating Remote Sensing Image Captions Beyond Metric Biases
Apr 22, 2026Ziyun Chen, Fan Liu, Liang Yao +3VLM Evaluation Remote Sensing Image Understanding
Hohai University Nanjing, China · Cardiff University Cardiff, UK
A Multi-Agent Framework with Structured Reasoning and Reflective Refinement for Multimodal Empathetic Response Generation
Apr 21, 2026Liping Wang, Cheng Ye, Weidong Chen +3LLM Self-Refinement Multimodal Reasoning
School of Information Science and Technology, USTC Hefei, China
ProtoCycle: Reflective Tool-Augmented Planning for Text-Guided Protein Design
Apr 18, 2026Yutang Ge, Guojiang Zhao, Sihang Li +7LLM Self-Refinement LLM Tool Use
Shanghai Jiao Tong University, School of Mathematical Sciences · DP Technology · University of Science and Technology of China +1
RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning
Apr 1, 2026Shaopeng Fu, Xingxing Zhang, Li Dong +1RL for Code Generation LLM Self-Refinement
Work done during an internship at Microsoft Research · KAUST · Microsoft Research
SpecMind: Cognitively Inspired, Interactive Multi-Turn Framework for Postcondition Inference
Feb 24, 2026Cuong Chi Le, Minh V. T Pham, Tung Vu Duy +4LLM Self-Refinement LLM Prompting
The University of Texas at Dallas · FPT Software AI Center · VinUniversity +1

Jun 9, 2026, cs.MAJ/K move · Enter open · S save

SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinement

Srishti Gautam, Arjun Radhakrishna, Sumit Gulwani

Microsoft

LLM Self-Refinement LLM Agent Self-Improvement LLM Agent Skill Learning

Open paper AskPDF arXiv

Skill documents, structured natural-language instructions that guide Large Language Model (LLM) agents, are critical to modern agent frameworks, yet LLMs struggle to write skills that actually work. On SkillsBench, human-authored skills improve pass rates by 16.2 percentage points, while LLM-authored skills provide no measurable gain. We introduce SkillAxe, a fully unsupervised framework that enables LLMs to iteratively diagnose and refine their own skills. SkillAxe decomposes skill quality into four interpretable dimensions (quality impact, trigger precision, instruction compliance with fault attribution, and solution-path coverage), producing structured improvement briefs that require no ground-truth labels, test suites, or environment rewards. On SkillsBench, SkillAxe improves pass rates by 28% relative over unimproved LLM skills and closes 47--67% of the gap to human-authored skills. We validate the approach as a continuous improvement engine in the wild on SpreadsheetBench, where a SkillAxe-built skill library learns from past agent trajectories and raises pass rate from 16.0% to 52.0% using only 22 skills.

Momentum

Related topics

Latest papers 62