UtilityMax Prompting: A Formal Framework for Multi-Objective Large Language Model Tasks

Ofir Marom

cs.CLMar 12, 2026

UtilityMax Prompting: A Formal Framework for Multi-Objective Large Language Model Tasks

Authors: Ofir Marom

Organizations: Independent Researcher

Abstract

The success of a Large Language Model (LLM) task depends heavily on its prompt. Most use-cases specify prompts using natural language, which is inherently ambiguous when multiple objectives must be simultaneously satisfied. In this paper we introduce UtilityMax Prompting, a framework that specifies tasks using formal mathematical language. We reconstruct the task as an influence diagram in which the LLM's answer is the sole decision variable. A utility function is defined over the conditional probability distributions within the diagram, and the LLM is instructed to find the answer that maximises expected utility. This constrains the LLM to reason explicitly about each component of the objective, directing its output toward a precise optimization target rather than a subjective natural language interpretation. We validate our approach on the MovieLens 1M dataset across three frontier models (Claude Sonnet 4.6, GPT-5.4, and Gemini 2.5 Pro), demonstrating consistent improvements in precision and Normalized Discounted Cumulative Gain (NDCG) over natural language baselines in a multi-objective movie recommendation task.

Figures & tables

Panel of Figure 1 — Figure 1: Influence diagram for UtilityMax Prompting under conditional independence, showing decision node $A$ , chance nodes $\{X_{1},X_{2},\ldots,X_{n}\}$ , and utility node $U$ .

Model	Prompt	Precision@10	NDCG@10
Claude Sonnet 4.6	Basic	0.418 (0.054)	0.570 (0.070)
	Harsh	0.421 (0.067)	0.559 (0.083)
	UtilityMax	0.471 (0.060)	0.664 (0.064)
GPT-5.4	Basic	0.532 (0.052)	0.739 (0.056)
	Harsh	0.518 (0.050)	0.712 (0.060)
	UtilityMax	0.578 (0.047)	0.788 (0.050)

Table 1: Precision@10 and NDCG@10 averaged over

20

users and

20

queries per user. Standard deviations are shown in parentheses.

Model	vs Basic	vs Harsh
Claude Sonnet 4.6	0.0028	0.0006
GPT-5.4	0.0068	0.0042
Gemini 2.5 Pro	0.0014	0.0032

Table 2: One-sided paired Wilcoxon signed-rank test p-values for UtilityMax vs each baseline on NDCG@10. All results are significant at the

p<0.01

level.

LLM Prompting

Large language model prompting studies how instructions, examples, context, and formats steer model behavior at inference time.

See all 429 papers

May 14, 2026

Efficient Multi-objective Prompt Optimization via Pure-exploration Bandits

Prompt engineering has become central to eliciting the capabilities of large language models (LLMs). At its core lies prompt selection -- efficiently identifying the most effective prompts. However, most prior investigations overlook a key challenge: the inherently multi-faceted nature of prompt performance, which cannot be captured by a single metric. To fill this gap, we study the multi-objective prompt selection problem under two practical settings: Pareto prompt set recovery and best feasible prompt identification. Casting the problem into the pure-exploration bandits framework, we adapt provably efficient algorithms from multi-objective bandits and further introduce a novel design for best feasible arm identification in structured bandits, with theoretical guarantees on the identification error in the linear case. Extensive experiments across multiple LLMs show that the bandit-based approaches yield significant improvements over baselines, establishing a principled and efficient framework for multi-objective prompt optimization.

Donghao Li, Chengshuai Shi, Weijuan Ou +2

University of Virginia, Charlottesville, VA 22904, USA · Princeton University, Princeton, NJ 08544, USA · Southern University of Science and Technology, Shenzhen, Guangdong 518055, China

Multi-Armed Bandits LLM Prompting Automatic Prompt Optimization Prompt Optimization Combinatorial Multi-Armed Bandits

Ask PDF

May 19, 2026

Less Back-and-Forth: A Comparative Study of Structured Prompting

Large language models (LLMs) are widely used for open-ended tasks, but underspecified prompts can lead to low-quality answers and additional interaction. This paper studies whether structured prompt design improves response quality while reducing user effort. We compare three prompt conditions: a raw prompt, a checklist-improved prompt, and a clarifying-question prompt. We evaluate these conditions across four task types--summarization, planning, explanation, and coding--using three LLM systems: ChatGPT, Claude, and Grok. Each output is scored with a unified rubric covering task completion, correctness, compliance, and clarity. Checklist-improved prompts achieved the highest mean rubric score, 7.50 out of 8, compared with 5.67 for raw prompts and 6.67 for clarifying-question prompts. Checklist prompts also produced the best quality-effort tradeoff, using fewer average tokens than both raw and clarifying prompts. These results suggest that a simple prompt checklist can improve LLM responses while reducing unnecessary interaction.

Saurav Ghosh, Gabriella Polach, Abdou Sow

Washington University in St. Louis Saint Louis, Missouri, USA

LLM Evaluation Structured Prompting Language Model Generation Evaluation LLM Prompting Prompt Engineering

Ask PDF

Mar 13, 2026

LLM Routing as Reasoning: A MaxSAT View

Routing a query through an appropriate LLM is challenging, particularly when user preferences are expressed in natural language and model attributes are only partially observable. We propose a constraint-based interpretation of language-conditioned LLM routing, formulating it as a weighted MaxSAT/MaxSMT problem in which natural language feedback induces hard and soft constraints over model attributes. Under this view, routing corresponds to selecting models that approximately maximize satisfaction of feedback-conditioned clauses. Empirical analysis on a 25-model benchmark shows that language feedback produces near-feasible recommendation sets, while no-feedback scenarios reveal systematic priors. Our results suggest that LLM routing can be understood as structured constraint optimization under language-conditioned preferences.

Son Nguyen, Xinyuan Liu, Ransalu Senanayake

Arizona State University

LLM Routing Large Language Model-Based Recommendation

Ask PDF

Abstract

LLM Prompting

Explore similar work

Efficient Multi-objective Prompt Optimization via Pure-exploration Bandits

Less Back-and-Forth: A Comparative Study of Structured Prompting

LLM Routing as Reasoning: A MaxSAT View