Self-evolving agent skills enable AI agents to accumulate and refine reusable procedural knowledge from interaction experience without updating model parameters. However, since such skills are typically represented as textual documents and executed through LLM reasoning, even previously learned procedures must be repeatedly interpreted and regenerated, introducing avoidable uncertainty into every execution. In contrast, program execution is deterministic and independently verifiable. Intuitively, transforming well-specified operations into executable programs can reduce reliance on LLM reasoning and, consequently, reduce execution uncertainty. Motivated by this intuition, we introduce SKillCompiler, a self-evolving skill framework that integrates programmatic compilation into the skill evolution process. Specifically, SkillCompiler adopts an executability-aware skill compilation strategy that decomposes skills into fine-grained operations, analyzes their executability, and constructs hybrid skill skeletons that retain LLM reasoning for context-dependent operations while compiling well-specified ones into validated programs. To avoid redundant program synthesis and enable executable knowledge to accumulate across evolving skills, we further design a program asset reuse mechanism that organizes validated programs as reusable assets, retrieves existing implementations whenever applicable, and synthesizes and verifies new programs only when necessary. Extensive experiments on five benchmarks and six model families demonstrate that SkillCompiler consistently outperforms state-of-the-art methods, achieving up to 32.33% improvement in task performance.
Figures & tables
Fig. 1: Framework and Overview of SkillCompiler
Benchmark
Train
Val
Test
SearchQA [ 28 ]
300
24
1,400
OfficeQA [ 29 ]
120
24
102
DocVQA [ 30 ]
180
22
201
LiveMath [ 31 ]
60
17
100
ALFWorld [ 32 ]
120
24
134
TABLE I: Dataset partition statistics for the five evaluation benchmarks.
Model
Method
SearchQA
OfficeQA
DocVQA
LiveMath
Avg
MiniMax-M3
No Skill
76.21
52.94
72.64
32.00
58.45
Human Skill
76.17
53.92
83.91
33.67
61.92
Trace2Skill [ 9 ]
79.43
60.78
91.38
42.00
68.40
EvoSkill [ 13 ]
79.24
62.09
89.88
51.33
70.64
EmbodiSkill [ 12 ]
77.64
61.76
79.77
34.67
63.46
GEPA [ 11 ]
79.57
59.48
90.55
48.67
69.57
TABLE II: Performance comparison of SkillCompiler and baseline methods across four benchmarks using six models.
Method
Success Rate (%)
No Skill
79.60
Human Skill
83.83
Trace2Skill
88.31
EvoSkill
85.82
EmbodiSkill
93.53
GEPA
86.82
TABLE III: Performance comparison on ALFWorld using DeepSeek-V4.1-Flash.
Fig. 2: Execution reliability comparison on ALFWorld using DeepSeek-V4.1-Flash.
Method
EM ↑
EIR@3 ↓
No Skill
28.33
19.00
Human Skill
28.33
13.00
Trace2Skill
40.67
28.00
EvoSkill
55.33
31.00
EmbodiSkill
27.67
18.00
GEPA
58.00
23.00
TABLE IV: Performance and execution uncertainty comparison on LiveMath using Gemini-3.8-Flash.
Method
Learning (M tokens)
Test/task (k tokens)
Calls/task
No Skill
0.000
5.429
1.007
Human Skill
0.000
5.997
1.000
Trace2Skill
1.117
8.918
1.003
EvoSkill
1.752
17.311
1.060
EmbodiSkill
2.988
19.335
3.047
GEPA
5.631
17.504
1.033
TABLE V: Resource consumption comparison on LiveMath using Gemini-3.8-Flash.
Method
Learning (M tokens)
Test/task (k tokens)
Calls/task
No Skill
0.000
47.906
20.020
Human Skill
0.000
27.885
16.813
Trace2Skill
3.212
68.418
14.085
EvoSkill
3.515
39.102
19.420
SkillOpt
57.468
50.906
14.674
EmbodiSkill
10.934
42.710
15.321
TABLE VI: Resource consumption comparison on ALFWorld using DeepSeek-V4.1-Flash.
Metric
Definition
Mean (%)
PPC
Persistent Program Coverage (covered / total tasks)
100.00
CPO
Consumed Program Outputs (trace-confirmed lower bound)
≥48.36
CSR
Cross-Skill Reuse (multi-skill / used programs)
54.85
PIS
Program Invocation Success (successful / total calls)
88.84
PAS
Program Action Share (program / total actions)
87.06
TABLE VII: Program execution and reuse statistics of SkillCompiler on ALFWorld across three learning seeds.
Condition
SR ↑
Test tokens (k/task) ↓
EIR@3 ↓
APS@3 ↑
Full SkillCompiler
98.26
41.954
2.99
81.27
w/o Skill Skeleton
95.52
115.424
8.21
67.49
w/o Programmer
53.48
308.887
19.40
54.51
w/o Skill Optimization
95.52
103.858
4.48
61.95
TABLE VIII: Ablation study on ALFWorld using DeepSeek-V4.1-Flash.