Prompt Optimization
Prompt optimization aims to automatically generate effective prompts for large language models (LLMs), reducing the need for manual, time-consuming prompt engineering. Current research focuses on developing algorithms that learn from both positive and negative examples, using techniques like contrastive learning and reinforcement learning, often incorporating generative adversarial networks or other neural networks to refine prompts iteratively. This field is crucial for improving LLM performance across diverse tasks, from code generation and question answering to image synthesis and anomaly detection, ultimately enhancing the usability and reliability of these powerful models.
Papers
Concentrate Attention: Towards Domain-Generalizable Prompt Optimization for Language Models
Chengzhengxu Li, Xiaoming Liu, Zhaohan Zhang, Yichen Wang, Chen Liu, Yu Lan, Chao Shen
Task Facet Learning: A Structured Approach to Prompt Optimization
Gurusha Juneja, Nagarajan Natarajan, Hua Li, Jian Jiao, Amit Sharma