cs.AIOct 3, 2026

SHarP: Saliency-based Pruning of Agent Harnesses

Authors: Xinyi Gao, Qiucheng Wu, Kaizhi Qian, Handong Zhao, Shiyu Chang, Yang Zhang

Organizations: University of California, Santa Barbara · MIT-IBM Watson AI Lab · Adobe Research

Abstract

Agent harnesses are systems that coordinate model calls, tool use, and task execution to help large language models complete complex tasks. To meet task requirements and address failures, these systems are often iteratively refined by amending and patching their instructions, tools, and workflows, continuously increasing harness complexity. It is therefore unclear whether some resulting harness modules are redundant, introducing substantial token overhead with little, if any, performance gain. Inspired by neural network pruning, in this paper, we study harness pruning as a means of striking a better balance between task performance and token cost. We propose SHarP (Saliency-based Harness Pruning), a simple yet effective pruning strategy based on the saliency of each harness module with respect to performance and efficiency. Specifically, we first identify tools, instructions, and supporting mechanisms as components that can be individually disabled. We then estimate the saliency of each module by ablating it and assessing its task performance and token cost relative to the full set of single-module ablations. Modules with the smallest contribution to performance or largest computational overhead are subsequently pruned. Our evaluation across various harnesses on held-out validation sets reveals a surprising finding: most harnesses that we studied are highly redundant and can maintain comparable performance and efficiency even after a substantial portion of their modules are pruned. Our pruning approach and empirical findings provide new perspectives on agent harness design and optimization.

Figures & tables

Appendix figures & tables21 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Composing Task-specific Agent Harnesses at Test Time with Reusable Primitives

    Sep 30, 2026Peng Kuang, Haibo Jin, Dehao Wu +4Agent Harness OptimizationLLM Agent Harnesses

  2. MESH-Harness: Self-Improving Agent Harnesses via Bandit-Guided Compositional Evolution

    Oct 4, 2026Zhiwei Shang, Yu Huo, Mingrong Gong +6Agent Harness OptimizationLLM Agent Workflow Optimization

  3. Elicitation or Expansion? Demystifying Gains from Agent Harness Optimization

    Oct 20, 2026Younghyun Kim, Wooseok Seo, Minseo Kim +6Agent Harness OptimizationLLM Agent Harnesses