When Valid Decisions Are Not Enough: Evaluating Structural Constraints in Knowledge-Guided Generative Systems
Authors: Josef Pavlíček, Petra Pavlíčková, Martin Molhanec
Organizations: Department of Software Engineering, Faculty of Information Technology, Czech Technical University in Prague, Czech Republic · Faculty of Electrical Engineering, Czech Technical University in Prague, Prague 6, Czech Republic
Knowledge-guided generative systems use explicit domain constraints to improve decision consistency and alignment with human-created solutions. However, locally valid decisions do not necessarily preserve contextual relationships in human decision-making. This paper examines when structural constraints improve or degrade agreement with human reference solutions. We introduce HARMONIX, an experimental framework using automated musical harmonization as a controlled testbed for knowledge-guided decision-making. Four configurations share the same Viterbi-based optimization mechanism: a baseline, repetition constraints, functional constraints, and their combination. Experiments cover 19,745 records and 143,634 motif pairs across training and validation partitions. Combined constraints improve reference root-interval agreement by approximately five percentage points in stable structural contexts but reduce it by nearly nine percentage points in contexts involving transposition tracking. These opposing effects are consistent across both partitions, while overall exact chord agreement changes only marginally. Contexts are identified retrospectively using reference annotations; no adaptive constraint-selection mechanism is evaluated. The findings demonstrate that interpretable constraints can introduce systematic context-specific failures concealed by aggregate accuracy metrics. They highlight the need to evaluate relationships between decisions and the contextual applicability of constraints in knowledge-guided generative systems.
Figures & tables
Figure 1: Architecture of the HARMONIX experimental framework. Four structural configurations share the same iterative optimization procedure. Human reference harmonizations are used only during post-generation evaluation.
Configuration
λR
λF
Baseline
0
0
R
0.12
0
F
0
0.06
RF
0.12
0.06
Table 1: Experimental configurations of HARMONIX.
TRAIN
VALID
Configuration
Agreement
Δ (pp)
Agreement
Δ (pp)
B (baseline)
18.3225
–
18.9664
–
R (repetition)
18.4104
+0.0879
19.0713
+0.1049
F (functional)
18.3231
+0.0006
19.0301
+0.0636
RF (combined)
18.3812
+0.0587
19.0347
+0.0683
Table 2: Mean exact chord agreement across records (%) and changes relative to baseline B (percentage points, pp).
Context
R
F
RF
Untransposed, same root
+4.78
+3.87
+5.08
Untransposed, changed root
-1.44
-0.73
-1.52
Transposed, tracking
-8.08
-1.59
-8.80
Transposed, non-tracking
+3.95
+0.74
+4.13
Table 3: TRAIN: change in reference root-interval agreement relative to B (percentage points).
Context
R
F
RF
Untransposed, same root
+4.91
+3.88
+5.00
Untransposed, changed root
-0.95
-0.45
-0.99
Transposed, tracking
-8.93
-2.44
-8.93
Transposed, non-tracking
+3.46
+1.11
+4.18
Table 4: VALID: change in reference root-interval agreement relative to B (percentage points).
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen 518172, China · Shenzhen Future Network of Intelligence Institute (FNii-Shenzhen)