Organizations: Laboratory of Parallel Software and Computational Science, ISCAS, Beijing, China · University of Chinese Academy of Sciences, Beijing, China · SKLCS and Key Laboratory of System Software, ISCAS, Beijing, China
Large language models can often identify useful semantic structure in formal artifacts, but their outputs cannot be trusted as proofs or solver decisions. We study whether LLMs can instead guide formal reasoning systems through a narrow, solver-verifiable interface. We instantiate this idea in quantified array SMT solving, where modern instantiation-based techniques can fail when key ground terms and equalities are hidden by auxiliary variables, axiom guards, and nested array terms. We observe that many instances are largely driven by a small set of focal ground terms or constraints, similar to the backdoor sets in SAT solving. Building on this, we present LinguaArray, a framework where an LLM proposes a small Semantic Focus Set (ground terms/constraints), while a conventional SMT solver remains the sole proof engine and certifies all results. LinguaArray uses these LLM-suggested, solver-validated finite sets to significantly enhance solver capability, solving additional satisfiable and unsatisfiable instances that the backend alone fails to solve. It interacts within a finite time and then falls back to the backend solver to mitigate potential regressions. Evaluation on 1015 SMT-LIB instances across five logics under 1200s timeout (including LLM latency) shows that LinguaArray solves up to 69.1% of instances and increases solved-instance counts by 105%--397% over the corresponding backends.
Figures & tables
Figure 1: Overview of LinguaArray.
ABV (400)
ABVFP (60)
ABVFPLRA (77)
ALIA (400)
ANIA (78)
Overall (1015)
Method
SAT
UNSAT
SR
SAT
UNSAT
SR
SAT
UNSAT
SR
SAT
UNSAT
SR
SAT
UNSAT
SR
Solved
SR
Z3 (Baseline)
34
11
11.25%
0
0
0.00%
0
0
0.00%
51
8
14.75%
28
9
47.44%
141
13.89%
CVC5 (Baseline)
93
15
27.00%
31
3
56.67%
45
1
59.74%
84
15
24.75%
27
7
43.59%
321
31.63%
CVC5 -COMP
130
82
53.00%
37
3
66.67%
47
2
63.64%
15
66
20.25%
4
2
7.69%
388
38.23%
Harness-only (Z3)
34
10
11.00%
0
0
0.00%
0
0
0.00%
52
8
15.00%
28
11
50.00%
143
14.09%
Randomized (Z3)
160
19
44.75%
0
0
0.00%
0
0
0.00%
181
17
49.50%
45
14
75.64%
436
42.96%
Table 1: Results on five logics with a 1200s timeout (including LLM latency). LinguaArray uses DeepSeek-V3.2-chat. For each logic, we report #SAT / #UNSAT and success rate (SR).
Figure 2: Comparison of solved instances across settings: (a) different LLMs; (b) iteration budget under a 1200s timeout. Each point in (b) reports cumulative instances solved within the given budget.
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
Term
CVC5 parameters
fmf
--finite-model-find
arr
--arrays-exp
fp
--fp-exp
mbqi
--mbqi
enum
--enum-inst
cegqi
--cegqi
Appendix
Table 2: Glossary of components and the corresponding CVC5 flags.
Configuration
SAT
UNSAT
Total
baseline
36
24
60
fmf
50
15
65
fmf_arr
51
15
66
fmf_arr_fp
51
15
66
Appendix
Table 3: Effect of base parameters.
Configuration
SAT
UNSAT
Total
fmf_arr_fp_mbqi_enum
280
41
321
fmf_arr_fp_mbqi
271
32
303
fmf_arr_fp_mbqi_enum_cegqi
260
39
299
fmf_arr_fp_mbqi_cegqi
249
33
282
fmf_arr_fp_enum_cegqi
53
136
189
fmf_arr_fp_enum_cegqi_sygus
137
49
186
Appendix
Table 4: Ablation results.
Method
Avg. total time
#Solved
Avg. time (solved only)
Z3 (Baseline)
1033.41s
141
0.79s
CVC5 (Baseline)
820.75s
321
0.80s
LinguaArray(Z3)
424.15s
701
76.63s
LinguaArray(CVC5)
469.91s
659
75.51s
Appendix
Table 5: Runtime statistics corresponding to the results in Table 1 . Unsolved instances are counted as 1200 seconds.