Automatic Prompt Engineering
Automatic prompt engineering (APE) aims to automate the process of crafting effective prompts for large language models (LLMs), replacing the often laborious manual process. Current research focuses on developing algorithms, such as gradient-based optimization and reinforcement learning methods, that iteratively refine prompts based on model performance and user feedback, sometimes incorporating techniques like hint generation or data augmentation. This field is significant because effective APE can drastically improve LLM performance across diverse tasks, ranging from text classification and information retrieval to code generation and text-to-image synthesis, ultimately enhancing the usability and efficiency of these powerful models.
Papers
TIPO: Text to Image with Text Presampling for Prompt Optimization
Shih-Ying Yeh, Sang-Hyun Park, Giyeong Oh, Min Song, Youngjae Yu
Efficient and Accurate Prompt Optimization: the Benefit of Memory in Exemplar-Guided Reflection
Cilin Yan, Jingyun Wang, Lin Zhang, Ruihui Zhao, Xiaopu Wu, Kai Xiong, Qingsong Liu, Guoliang Kang, Yangyang Kang