WirelessAgent++: Automated Agentic Workflow Design and Benchmarking for Wireless Networks
Organizations: College of Electronics and Information Engineering, Shenzhen University, Shenzhen, China · Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR
Abstract
The integration of large language models (LLMs) into wireless networks has sparked growing interest in building autonomous AI agents for wireless tasks. However, existing approaches rely heavily on manually crafted prompts and static agentic workflows, a process that is labor-intensive, unscalable, and often suboptimal. In this paper, we propose WirelessAgent++, a framework that automates the design of agentic workflows for various wireless tasks. By treating each workflow as an executable code composed of modular operators, WirelessAgent++ casts agent design as a program search problem and solves it with a domain-adapted Monte Carlo Tree Search (MCTS) algorithm. Moreover, we establish WirelessBench, a standardized multi-dimensional benchmark suite comprising Wireless Communication Homework (WCHW), Network Slicing (WCNS), and Mobile Service Assurance (WCMSA), covering knowledge reasoning, code-augmented tool use, and multi-step decision-making. Experiments demonstrate that \wap{} autonomously discovers superior workflows, achieving test scores of (WCHW), (WCNS), and (WCMSA), with a total search cost below \ 531%11.1%$, validating its effectiveness in generating robust, self-evolving wireless agents. The code is available at https://github.com/jwentong/WirelessAgent-R2.
Figures & tables
| Parameter | Value |
|---|---|
| TX power | 30 dBm |
| Carrier frequency | 2.4 GHz |
| Bandwidth | 20 MHz |
| Noise figure | 8 dB |
| Thermal noise | dBm |
| User height | 1.5 m |
| Level | Condition | Allowed Changes |
|---|---|---|
| Ultra-conservative | Saturated | Single word / punctuation only |
| Conservative | Minor prompt wording; no structural changes | |
| Moderate | Single structural change; no new branches | |
| Aggressive | Structural changes, new operators, ToolAgent additions |
| Condition | Score |
|---|---|
| Relative error | 1.0 |
| Relative error | 0.9 |
| Relative error | 0.7 |
| Off by or (unit error) | 0.5 |
| Off by (common miscalculation) | 0.3 |
| Otherwise | 0.0 |
| Sub-Metric | Weight | Scoring Rule |
|---|---|---|
| Slice type | 25% | Binary: exact match 1.0, else 0.0 |
| CQI | 15% | Exact 1.0; 0.8; ; 0.2 |
| Bandwidth | 35% | Rel. err.: ; ; |
| Throughput | 25% | Same tiered scheme as bandwidth |
| Sub-Metric | Weight | Scoring Rule |
|---|---|---|
| Position prediction | 15% | Distance decay: |
| CQI prediction | 15% | Exact 1.0; ; 0.50 |
| Slice type | 20% | Binary: exact 1.0, else 0.0 |
| Bandwidth allocation | 25% | Same tiered scheme as WCNS |
| Throughput | 20% | Same tiered scheme as WCNS |
| QoS verification | 5% | Binary: correct Yes/No 1.0, else 0.0 |
| Benchmark | Val. | Test | Metric | Task Type |
|---|---|---|---|---|
| WCHW | 348 | 1,044 | Accuracy | Knowledge reasoning |
| WCNS | 250 | 750 | Composite | Code + tool use |
| WCMSA | 250 | 750 | Composite | Multi-step diagnosis |
| WirelessBench (Solve Rate) | |||||
|---|---|---|---|---|---|
| Method | HotpotQA (F1) | DROP (F1) | MATH (Solve Rate) | Before | After |
| Qwen-turbo-latest [ 31 ] | 0.1423 | 0.5641 | 0.6412 | 0.5013 | 0.5834 |
| CoT [ 32 ] | 0.5379 | 0.7607 | 0.6828 | 0.5032 | 0.6032 |
| MedPrompt [ 33 ] | 0.5411 | 0.7559 | 0.6996 | 0.5422 | 0.6122 |
| ADAS [ 13 ] | 0.5110 | 0.7423 | 0.4953 | 0.4813 | 0.5313 |
| AFlow [ 20 ] | 0.5823 | 0.7811 | 0.7864 | 0.5152 | 0.6992 |
| Configuration | Accuracy (%) | |
|---|---|---|
| WirelessAgent ++ (Full) | 81.78 | – |
| w/o Penalized Selection | 79.11 | |
| w/o Heuristic Critic | 80.34 | |
| w/o 3-Class Experience | 78.59 | |
| w/o Domain Tools | 62.44 | |
| AFlow (No enhancements) † | 69.92 |
| WCHW | WCNS | WCMSA | |
| Search Rounds | 19 | 11 | 11 |
| Wall-Clock Time (min) | 63 | 13 | 14 |
| Total Search Cost (USD) | 4.95 | 0.99 | 1.05 |
| Per-Problem Cost (USD) | 0.00083 | 0.00056 | 0.00068 |
| CQI | Modulation | Code Rate | (bps/Hz) |
|---|---|---|---|
| 1 | QPSK | 78 | 0.15 |
| 2 | QPSK | 120 | 0.23 |
| 3 | QPSK | 193 | 0.38 |
| 4 | QPSK | 308 | 0.60 |
| 5 | QPSK | 449 | 0.88 |
| 6 | QPSK | 602 | 1.18 |
| Operator | Description |
|---|---|
| Custom | Invokes an LLM with input and instruction prompt; the most flexible operator |
| ToolAgent | ReAct-based agent (Algorithm 1 ) with tool calling; max iterations with early stopping |
| CodeLevel | Deterministic, LLM-free tool execution via compiled code (e.g., CodeLevelRayTracing , CodeLevelKalmanPredictor ); zero variance, near-zero cost |
| ScEnsemble | Self-consistency ensemble [ 34 ] : maps candidate solutions to letters and selects the most consistent answer |
| MdEnsemble | Medicine-inspired ensemble [ 33 ] : shuffles answers, votes 5 times, returns majority answer |
| Programmer | Generates and executes Python code (3 retries, 30s timeout per attempt) |
| Service | Slice | Min Rate (Mbps) |
|---|---|---|
| 4K video streaming | eMBB | 25 |
| HD movie download | eMBB | 50 |
| Cloud gaming (high graphics) | eMBB | 35 |
| AR navigation (3D maps) | eMBB | 20 |
| VR social experience | eMBB | 40 |
| 8K live sports broadcast | eMBB | 80 |
| Region | OSM File | Typical Bldg. | Propagation |
|---|---|---|---|
| North | HKUST_North.osm | Low-rise academic | LOS-dominant |
| Center | HKUST_Center.osm | Mixed-height | Moderate NLOS |
| South | HKUST_South.osm | High-rise residential | Deep NLOS |
| Parameter | Default | Description |
| (top- ) | 5 | Parent candidates for Boltzmann selection |
| 0.3 | Uniform exploration weight in ( 11 ) | |
| 0.2 | Boltzmann temperature in ( 11 ) | |
| 0.02 | 3-class significance threshold in ( 13 ) | |
| 5 | Validation runs per evaluation | |
| 20 | Maximum optimization rounds |