cs.AINov 1, 2026

CHATDIFY: Automating End-to-End Dify Workflow Synthesis from Natural Language via Multi-Agent Collaboration

Authors: Tao Fan, Guoqiang Ma

Organizations: Hong Kong University of Science and Technology, Hong Kong, China · WeBank Co., Ltd, Shenzhen, China

Abstract

The proliferation of Large Language Models has catalyzed powerful application development platforms like Dify, which enable users to build sophisticated LLM-powered workflows through modular node orchestration. However, manually configuring these workflows requires deep platform expertise and remains time-consuming and error-prone, creating a significant barrier for non-expert users. To address this challenge, we propose ChatDify, a novel multi-agent framework that automates end-to-end Dify workflow synthesis from natural language descriptions. ChatDify employs an Actor-Critic architecture comprising three specialized agents: the Planner Agent that decomposes user requests into structured execution plans, the Executor Agent that performs context-aware parameter synthesis and schema-augmented DSL compilation, and the Reviewer Agent that ensures reliability through hybrid verification with closed-loop refinement. We evaluate ChatDify on a curated benchmark of 100 production-inspired tasks across three state-of-the-art LLM backends, achieving 0.96, 0.91, and 0.75 success rates with Qwen-3.7, GLM-5.1, and DeepSeek-v4, respectively. These results demonstrate its robustness and practical applicability for lowering the technical barrier to creating sophisticated LLM applications.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. FlowBot: Inducing LLM Workflows with Bilevel Optimization and Textual Gradients

    Apr 29, 2026Hongyeon Yu, Young-Bum Kim, Yoon KimAgentic WorkflowsLLM Agent Workflow Optimization

  2. WorkflowOps: Learning Agent Collaboration Priors for Multi-Agent Workflow Orchestration

    Oct 6, 2026Qi Cheng, Shengyu Chen, Wei Cheng +4LLM Agent OrchestrationLLM Agent Workflow Optimization