Automatic Prompt Optimization

Ask about this topic

Momentum

7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 61

All topics
CardsList

  1. Goldsmith: Gold-Loss-Guided Definition Optimization with an Agentic Annotation Harness

    Oct 7, 2026Yihan Li, Hanyi Zhang, Xiaoxi Jiang +1LLM-Assisted AnnotationLarge Language Model-Guided Optimization

    Sun Yat-sen University, Guangzhou, China · South China University of Technology, Guangzhou, China

  2. Joint Workflow and Prompt Optimization for User Behavior Simulation

    Oct 6, 2026Nipun B Nair, Tongtong Wu, Hongzhi Yin +2Multi-Agent LLM SystemsAutomatic Prompt Optimization

    Monash University · The University of Queensland · Xiamen University

  3. DP-ES: Differentially Private Evolution Strategies for Prompt Optimization

    Oct 5, 2026Ziniu Liu, Aiping Li, Yue Han +5Large Language Model-Guided OptimizationEvolution Strategies

    National University of Defense Technology · CRRC Zhuzhou Electric Locomotive Research Institute Co., Ltd., China Academy of Railway Sciences

  4. How Should a Prompt Optimizer Spend a Tight Budget? BudgetAPO with Noise-Adaptive Evaluation

    Oct 5, 2026Haoyue Liu, Zhichao Wang, Huanyu Yan +1Automatic Prompt OptimizationPrompt Optimization

    School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen · Shenzhen Future Network of Intelligence Institute (FNii-Shenzhen) · Guangdong Provincial Key Laboratory of Future Networks of Intelligence, CUHK(SZ)

  5. Benchmarking Prompt Optimization of Large Language Models With Chess

    Sep 30, 2026Timothée Lesort, Alejandra López de Aberasturi Gómez, Tristan Karch +4LLM EvaluationAutomatic Prompt Optimization

    imec AI.labs

  6. MERGE: Multi-LLM Ensemble for Retrieval via Generative Enrichment

    Sep 29, 2026Tzu-I Ho, Yung-Yu Shih, Shang-Yu Su +2LLM PromptingAutomatic Prompt Optimization

    University of Waterloo · National Taiwan University · Rakuten Group, Inc. +1

  7. From Weak Task Specifications to Scientific Extraction Agents: Optimizing Task Construction

    Sep 28, 2026Zixiao Dong, Wei Yang, Zihao Liu +4LLM Agent Self-ImprovementAutomatic Prompt Optimization

    School of Computer Science and Technology, University of Science and Technology of China · State Key Laboratory of Cognitive Intelligence · University of Science and Technology of China +1

  8. APOLO: Automatic Prompt Optimization for Ontology Learning

    Sep 28, 2026Huu Tan Mai, Roman Kochnev, Cuong Xuan Chu +3Automatic Prompt OptimizationOntology Learning

    Bosch Center for Artificial Intelligence, Robert-Bosch-Campus 1, 71272 Renningen, Germany · University of Mannheim, Schloss, 68131 Mannheim, Germany · University of Würzburg, Sanderring 2, 97070 Würzburg, Germany +1

  9. ClusterFewshot: Improving Few-shot Optimization for LLMs workflow

    Sep 22, 2026Omri Bar Haim, Shahar Katz, Lior WolfIn-Context Example SelectionLarge Language Model-Guided Optimization

    Blavatnik School of Computer Science, Tel Aviv University

  10. STEVE: Stabilizing Textual Gradient-Based Prompt Optimization via Error-Driven Refinement and Regularized Verification

    Sep 20, 2026Yifan Xu, Yixuan Li, Xinzhuo Li +4Large Language Model-Guided OptimizationAutomatic Prompt Optimization

    University of Illinois Urbana-Champaign · Google DeepMind

  11. Failure-Guided Co-Evolution of Prompts and Training Data

    Sep 14, 2026Tianyu Yuan, Zhuzhong QianLarge Language Model-Guided OptimizationAutomatic Prompt Optimization

    Nanjing University

  12. ESPO: Error-Structured Prompt Optimization via Diagnose, Diversify, and Stabilize

    Sep 3, 2026Lihao Liu, Peng Tang, Kunwar Yashraj Singh +1Evolutionary OptimizationLarge Language Model-Guided Optimization

    AWS Agentic AI

  13. LLM-as-a-Judge Is Not an Oracle: Why Self-Improving Agents Need Deterministic Guardrails

    Sep 2, 2026Vansh WahiLLM-as-a-JudgeSelf-Improving Agents

    AI Research Engineer

  14. Improving Information Extraction with Learned Queries

    Aug 31, 2026Omar Sharif, Soroush Vosoughi, Nikhil SinghClinical Information ExtractionAutomatic Prompt Optimization

    Department of Computer Science Dartmouth College

  15. Optimize Cheap, Deploy Strong: Cost-Aware Cross-Tier Transfer for Evolutionary Optimization

    Aug 11, 2026Tal Oved, Roi Pony, Oshri Naparstek +1Evolutionary OptimizationLarge Language Model-Guided Optimization

    IBM Research

  16. The Optimizer Is the Agent: Reasoning-Driven Search across Prompts, Programs, and ML Workflows

    Aug 7, 2026Junbo Li, Boyi Liu, Canwen Xu +5Large Language Model-Guided OptimizationLLM Agent Workflow Optimization

    The University of Texas at Austin · Snowflake

  17. COMPAS: Difficulty-Aware Joint Search for Optimizing Code Generation

    Aug 5, 2026Jingzhi Gong, Jie M. Zhang, Gunel Jahangirova +3Large Language Model-Guided OptimizationCode Generation

    King’s College London, University of London · National University of Singapore · University College London, University of London

  18. MIDAS: Multi-LLM Iterative Data-Adaptive Summarization

    Aug 5, 2026Karen Lee, Dhanashree Balaram, Seojun Shon +1Text SummarizationAutomatic Prompt Optimization

    Volkswagen Group Innovation, California

  19. From Monolithic to Modular: Segment-level Automatic Prompt Optimization

    Jul 21, 2026Nikita Kulin, Viktor Zhuravlev, Artur Khairullin +4Large Language Model-Guided OptimizationAutomatic Prompt Optimization

    ITMO University · HSE · AXXX

  20. One Rewrite to Fix Them All? Type-Aware Repair Allocation for Text-to-Image Prompt Optimization

    Jul 21, 2026Haoyue Liu, Xiaoyu Ma, Ye Chen +2T2I GenerationAutomatic Prompt Optimization

    School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen 518172, China · XJTU-POLIMI Joint School, Xi’an Jiaotong University, Xi’an 710049, China · Shenzhen Future Network of Intelligence Institute (FNii-Shenzhen)

  21. TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter

    Jul 17, 2026Oliver Savolainen, Emanuele Bastianelli, Hosein AzarbonyadAutomatic Prompt OptimizationLanguage Model Post-Training

    University of Amsterdam, Amsterdam, The Netherlands · 2Elsevier, Amsterdam, The Netherlands

  22. BayesPO: Bayesian Prompt Optimization via Parallel-Tempered Gradient-Guided Discrete MCMC

    Jul 17, 2026Junjie Zhou, Zhijian OuMarkov Chain Monte CarloLLM Prompting

    Speech Processing and Machine Intelligence (SPMI) Lab Tsinghua University, China

  23. A Multi-Agent System for Autonomous, Fine-Tuning-Free Clinical Symptom Detection: Development and Validation Study

    Jul 14, 2026Cameron Cagan, Pedram Fard, Jiazi Tian +3Multi-Agent LLM SystemsMedical Diagnosis

    Department of Medicine, Massachusetts General Hospital, Boston, MA, USA · Department of Biomedical Informatics and Medical Education, University of Washington, WA, USA

  24. MAGE: Understanding Stability-Performance Trade-offs in Multi-component Prompt Optimization

    Jul 11, 2026Prateek SinghStochastic OptimizationLarge Language Model-Guided Optimization

  25. A Single Rewrite Suffices: Empirical Lessons from Production Skill Description Optimization

    Jun 29, 2026Yangqiaoyu Zhou, Mohammad Alqudah, Kwei-Herng Lai +3Automatic Prompt OptimizationLLM Agent Routing

    Microsoft

  26. Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinement

    Jun 28, 2026Aunabil Chakma, Mihai Surdeanu, Eduardo BlancoRelation ExtractionAutomatic Prompt Optimization

    University of Arizona, Tucson, AZ, USA

  27. FAPO: Fully Automated Prompt Optimization of Multi-Step LLM Pipelines

    Jun 17, 2026Paul Kassianik, Baturay Saglam, Huaibo Zhao +4Large Language Model-Guided OptimizationLLM Agent Workflow Optimization

    Foundation AI–Cisco Systems Inc. · Yale University

  28. SAGE: Stochastic Prompt Optimization via Agent-Guided Exploration

    Jun 17, 2026Ziyi Zhu, Luka Smyth, Saki Shinoda +1Large Language Model-Guided OptimizationAutomatic Prompt Optimization

    1Slingshot AI · Department of Engineering, University of Cambridge

  29. Environment-Grounded Automated Prompt Optimization for LLM Game Agents

    Jun 16, 2026Rean Clive Fernandes, Lukas Fehring, Theresa Eimer +2Multi-Agent LLM SystemsGame-Playing Agents

    Lamarr institute for ML and AI TU Dortmund University · Leibniz University Hannover · L3S Research Center

  30. Graph-based Target Back-Propagation for Context Adaptation in Multi-LLM Agentic Systems

    Jun 12, 2026Tan Zhu, Tong Yao, Kananart Kuwaranancharoen +4Multi-Agent LLM SystemsLarge Language Model-Guided Optimization

    Retail Intelligence, Walmart Global Tech, Sunnyvale, CA, USA

  31. Multi-Objective Coevolution of Prompts and Templates for Circuit Approximation

    Jun 11, 2026Martin Tomasovic, Lukas SekaninaMulti-Objective Evolutionary OptimizationLarge Language Model-Guided Optimization

    Brno University of Technology, Faculty of Information Technology Brno, Czech Republic

  32. TAHOE: Text-to-SQL with Automated Hint Optimization from Experience

    Jun 10, 2026Zhiyi Chen, Jie Song, Peng LiLLM PromptingText-to-SQL

    ByteDance Inc. · Georgia Institute of Technology · Work done during an internship at the ByteBrain team, ByteDance

  33. APEX: Automated Prompt Engineering eXpert with Dynamic Data Selection

    Jun 9, 2026Fei Wang, Si Si, Cho-Jui Hsieh +1Evolutionary OptimizationLLM Prompting

    Google · UCLA

  34. CRAFT: Cost-aware Refinement And Front-aware Tuning of Prompts

    Jun 3, 2026Shanu Kumar, Shubhanshu Khandelwal, Akhila Yesantarao Venkata +3LLM PromptingCost-Aware Inference

    MBZUAI · Microsoft

  35. SePO: Self-Evolving Prompt Agent for System Prompt Optimization

    Jun 3, 2026Wangcheng Tao, Han Wu, Weng-Fai WongLLM Agent Self-ImprovementAutomatic Prompt Optimization

    National University of Singapore · City University of Hong Kong

  36. Training Prompt Matters: State-Adaptive Optimization for Robust Fine-Tuning

    Jun 1, 2026Wenhang Shi, Yiren Chen, Shuqing Bian +5Continual Learning for LLMsPrompt Learning

    School of Information, Renmin University of China, Beijing, China · Peking University, Beijing, China · Tencent, Beijing, China

  37. Prompt Codebooks: Discrete Compositional Optimization for Language Model Instruction Refinement

    May 27, 2026Jyotirmoy Nath, Neeraj Kumar, Brejesh LallLLM PromptingLarge Language Model-Guided Optimization

    1IIT Delhi, India

  38. LLMs Are Already Good Tutors: Training-Free Prompt Optimization for Pedagogical Math Tutoring

    May 26, 2026Unggi Lee, Minchul Shin, Yeil Jeong +5Intelligent Tutoring SystemsLLM Prompting

    Korea University Sejong Campus · 1Korea University Sejong Campus · Gyeonggi Institute of Education +9

  39. Why Prompt Optimization Works, and Why It Sometimes Doesn't: A Causal-Inspired Edit-Level Analysis

    May 26, 2026Shuzhi Gong, Hechuan WenAutomatic Prompt OptimizationLLM Reasoning

    The University of Melbourne, Melbourne, Victoria, Australia · The University of Queensland, Brisbane, Queensland, Australia

  40. SPEAR: Code-Augmented Agentic Prompt Optimization

    May 25, 2026Mengyin Lu, Cong Feng, Huimin Han +6Tool-Augmented Language Model AgentsAutomatic Prompt Optimization

    LinkedIn Corporation

  41. PACE: Two-Timescale Self-Evolution for Small Language Model Agents

    May 21, 2026Chen Ling, Pei Chen, Albert Guan +4Small Language ModelsLLM Agent Workflow Optimization

    Amazon

  42. Reflective Prompt Tuning through Language Model Function-Calling

    May 20, 2026Farima Fatahi Bayat, Moin Aminnaseri, Pouya Pezeshkpour +1LLM Self-RefinementLLM Prompting

    Megagon Labs

  43. APM: Evaluating Style Personalization in LLMs with Arbitrary Preference Mappings

    May 20, 2026Philipp Spohn, Leander Girrbach, Zeynep AkataLLM EvaluationLLM Personalization

    Technical University of Munich, Helmholtz Munich · Munich Center for Machine Learning (MCML)

  44. Embedding by Elicitation: Dynamic Representations for Bayesian Optimization of System Prompts

    May 18, 2026Zhiyuan Jerry Lin, Benjamin Letham, Samuel Dooley +2Bayesian OptimizationLarge Language Model-Guided Optimization

    Meta

  45. iPOE: Interpretable Prompt Optimization via Explanations

    May 18, 2026Jiahui Li, Yarik Menchaca Resendiz, Sean Papay +1LLM InterpretabilityLLM-Assisted Annotation

    Fundamentals of Natural Language Processing, University of Bamberg, Germany · Leibniz-Institut für Psychologie (ZPID), Trier, Germany

  46. Towards Robust Argumentative Essay Understanding via TIDE: An Interactive Framework with Trial and Debate

    May 17, 2026Zheqin Yin, Yupei Ren, Yadong Zhang +2Argument MiningAutomated Essay Scoring

    School of Computer Science and Technology, East China Normal University · 2Shanghai Institute of Artificial Intelligence for Education, East China Normal University · Lab of Artificial Intelligence for Education, East China Normal University

  47. MO-CAPO: Multi-Objective Cost-Aware Prompt Optimization

    May 15, 2026Jan Büssing, Moritz Schlager, Timo Heiß +2Cost-Aware InferenceAutomatic Prompt Optimization

    LMU Munich, Germany · Technical University of Munich (TUM), Munich Center for Machine Learning (MCML), Germany · LMU Munich, Munich Center for Machine Learning (MCML), Germany +2

  48. Prompt Segmentation and Annotation Optimisation: Controlling LLM Behaviour via Optimised Segment-Level Annotations

    May 14, 2026Devika Prasad, Luke Gerschwitz, Tong Li +5LLM PromptingAutomatic Prompt Optimization

    Commonwealth Bank of Australia

  49. Efficient Multi-objective Prompt Optimization via Pure-exploration Bandits

    May 14, 2026Donghao Li, Chengshuai Shi, Weijuan Ou +2Multi-Armed BanditsLLM Prompting

    University of Virginia, Charlottesville, VA 22904, USA · Princeton University, Princeton, NJ 08544, USA · Southern University of Science and Technology, Shenzhen, Guangdong 518055, China

  50. Prompt Optimization for User Simulation in Conversational Recommender Systems: A Multi-Objective Framework

    May 8, 2026Nipun B Nair, Tongtong Wu, Weiqing WangAutomatic Prompt OptimizationRecommender Systems

    Monash University, Australia

  51. A Reproducible Optimisation Protocol for Calibrating Prompt-Based Large Language Model Workflows in Evidence Synthesis

    May 7, 2026Teo SusnjakLarge Language Model-Guided OptimizationLanguage Model Calibration

    School of Mathematical and Computational Sciences Massey University, Auckland, New Zealand

  52. Adaptive Prompt Embedding Optimization for LLM Jailbreaking

    Apr 27, 2026Miles Q. Li, Benjamin C. M. Fung, Boyang Li +2Adversarial Prompt GenerationAdversarial Attacks on LLMs

    School of Information Studies, McGill University, Montreal, QC, Canada · Department of Computer Science, Kean University, Union, NJ, United States · Mila - Quebec AI Institute, Montreal, QC, Canada +1

  53. PrismaDV: Automated Task-Aware Data Unit Test Generation

    Apr 23, 2026Hao Chen, Arnab Phani, Sebastian SchelterAutomatic Prompt OptimizationAutomated Test Generation

    BIFOLD & TU Berlin

  54. Exploiting LLM-as-a-Judge Disposition on Free Text Legal QA via Prompt Optimization

    Apr 22, 2026Mohamed Hesham Elganayni, Runsheng Chen, Sebastian Nagl +1LLM EvaluationLLM-as-a-Judge

    Technical University of Munich Germany

  55. From Fuzzy to Formal: Scaling Hospital Quality Improvement with AI

    Apr 21, 2026Patrick Vossler, Jean Feng, Venkat Sivaraman +9Human-in-the-Loop AIAutomatic Prompt Optimization

    University of California, San Francisco · 2Zuckerberg San Francisco General Hospital

  56. ContraPrompt: Contrastive Prompt Optimization via Dyadic Reasoning Trace Analysis

    Apr 20, 2026Rishav Rishav, Pushpak Pujari, Pushpendre RastogiPairwise ComparisonCoT Reasoning

    Vizops AI

  57. Prompt Optimization Is a Coin Flip: Diagnosing When It Helps in Compound AI Systems

    Apr 16, 2026Xing Zhang, Guanghui Wang, Yanwei Cui +4Prompt SensitivityLarge Language Model-Guided Optimization

    AWS Generative AI Innovation Center · HSBC Holdings Plc., HSBC Technology Center, China.

  58. KernelFoundry: Hardware-aware evolutionary GPU kernel optimization

    Mar 12, 2026Nina Wiedemann, Quentin Leboutet, Michael Paulitsch +2GPU Kernel OptimizationGPU Acceleration

    Intel Corporation

  59. Synthetic Interaction Data for Scalable Personalization in Large Language Models

    Feb 12, 2026Yuchen Ma, Yue Huang, Wenjie Wang +3RL for Language ModelsLLM Personalization

    Munich Center for Machine Learning & LMU Munich · University of Notre Dame · Sichuan University

  60. MA-SAPO: Multi-Agent Reasoning for Score-Aware Prompt Optimization

    Oct 18, 2025Juhyeon Lee, Wonduk Seo, Junseo Koh +6Automatic Prompt OptimizationMulti-Agent LLMs

    Peking University · Enhans · Fudan University +1