cs.AINov 5, 2026

DelegateEval: Evaluating Platforms for Personal External Service Agents

Authors: Jichao Li, Jinrong Lu, Manjiang Yu, Zhixuan Liu

Organizations: BRICS Institute of Future Networks (China Branch)

Abstract

AI agents are expanding from personal assistance into professional services delivered to external clients on an individual's behalf. We define a personal external service agent as one authorized and managed on an ongoing basis by an individual. It uses that person's knowledge, experience, and professional methods to accept client work, deliver results, and provide follow-up support. Client feedback, professional reputation, and potential income may give individuals more direct incentives to keep developing and improving agents for external services than for personal assistance. Yet building a safe, reliable external service system independently remains difficult, even with AI-assisted programming. People without AI expertise need platforms that are easy to use and safe to operate, with support for creating, developing, and running their agents. We propose the DelegateEval evaluation framework and experimental design to assess these platforms and guide their development. The framework covers eight dimensions: ease of creation and management, service discovery and matching, delivery quality, expertise inheritance, service continuity, learning and improvement, reliability and governance, and efficiency and value. A complete dataset, executable environment, and unified scoring protocol remain to be developed, and empirical validation across foundation models has yet to be conducted.

Figures & tables

Explore similar work

CardsList
  1. Talk, Evaluate, Diagnose: User-aware Agent Evaluation with Automated Error Analysis

    Mar 16, 2026Penny Chong, Harshavardhan Abichandani, Jiyuan Shen +4LLM Agent EvaluationAgent Evaluation

  2. JADE: Expert-Grounded Dynamic Evaluation for Open-Ended Professional Tasks

    Feb 6, 2026Lanbo Lin, Jiayao Liu, Tianyuan Yang +5LLM-as-a-JudgeAI Agent Evaluation

  3. A Framework for Evaluating Agentic Skills at Scale

    Jun 16, 2026Maksim Shaposhnikov, Nicolas Fortuin, Simon Stipcich +3LLM Agent Skill EvaluationLLM Agent Evaluation