Iterative Refinement
Iterative refinement is a computational technique that improves results through successive iterations, leveraging feedback to correct errors and enhance accuracy. Current research focuses on applying this approach across diverse fields, employing various methods including diffusion models, neural networks (with architectures like transformers and residual networks), and multi-agent systems to refine predictions, generate high-quality outputs, and improve model robustness. This methodology is proving significant for advancing numerous applications, from improving large language model reasoning and code generation to enhancing medical image analysis and autonomous driving systems.
Papers
A Multi-AI Agent System for Autonomous Optimization of Agentic AI Solutions via Iterative Refinement and LLM-Driven Feedback Loops
Kamer Ali Yuksel, Hassan Sawaf
Teaching LLMs to Refine with Tools
Dian Yu, Yuheng Zhang, Jiahao Xu, Tian Liang, Linfeng Song, Zhaopeng Tu, Haitao Mi, Dong Yu
Visual Prompting with Iterative Refinement for Design Critique Generation
Peitong Duan, Chin-Yi Chen, Bjoern Hartmann, Yang Li