Prompt Engineering
Prompt engineering is the art and science of crafting effective instructions—prompts—to guide large language models (LLMs) towards desired outputs. Current research focuses on developing automated methods for prompt optimization, exploring techniques like chain-of-thought prompting, and adapting prompts to specific LLMs and tasks (e.g., code generation, question answering, medical image analysis). This field is significant because effective prompt engineering dramatically improves the accuracy, efficiency, and reliability of LLMs across diverse applications, ranging from healthcare and education to software development and scientific research.
Papers
Provable optimal transport with transformers: The essence of depth and prompt engineering
Hadi Daneshmand
Introducing MAPO: Momentum-Aided Gradient Descent Prompt Optimization
Anthony Cui, Pranav Nandyalam, Kevin Zhu
Intelligent Understanding of Large Language Models in Traditional Chinese Medicine Based on Prompt Engineering Framework
Yirui Chen, Qinyu Xiao, Jia Yi, Jing Chen, Mengyang Wang
CELI: Controller-Embedded Language Model Interactions
Jan-Samuel Wagner, Dave DeCaprio, Abishek Chiffon Muthu Raja, Jonathan M. Holman, Lauren K. Brady, Sky C. Cheung, Hosein Barzekar, Eric Yang, Mark Anthony Martinez II, David Soong, Sriram Sridhar, Han Si, Brandon W. Higgs, Hisham Hamadeh, Scott Ogden
Do LLMs "know" internally when they follow instructions?
Juyeon Heo, Christina Heinze-Deml, Oussama Elachqar, Shirley Ren, Udhay Nallasamy, Andy Miller, Kwan Ho Ryan Chan, Jaya Narain
AMPO: Automatic Multi-Branched Prompt Optimization
Sheng Yang, Yurong Wu, Yan Gao, Zineng Zhou, Bin Benjamin Zhu, Xiaodi Sun, Jian-Guang Lou, Zhiming Ding, Anbang Hu, Yuan Fang, Yunsong Li, Junyan Chen, Linjun Yang
StraGo: Harnessing Strategic Guidance for Prompt Optimization
Yurong Wu, Yan Gao, Bin Benjamin Zhu, Zineng Zhou, Xiaodi Sun, Sheng Yang, Jian-Guang Lou, Zhiming Ding, Linjun Yang
A Framework for Collaborating a Large Language Model Tool in Brainstorming for Triggering Creative Thoughts
Hung-Fu Chang, Tong Li
Prompt Engineering a Schizophrenia Chatbot: Utilizing a Multi-Agent Approach for Enhanced Compliance with Prompt Instructions
Per Niklas Waaler, Musarrat Hussain, Igor Molchanov, Lars Ailo Bongo, Brita Elvevåg