Instance retrieval is the main bottleneck of concept-learning systems based on refinement operators. We present NIR, a family of neural instance retrievers for ALCIQ that output graded membership scores from knowledge graph embeddings. We compare tokenization-based encoders (GRU, LSTM, Transformer) with a Compositional encoder that mirrors DL operators via primitive sub-networks. On eight benchmarks, all variants approximate Pellet closely on complete knowledge bases, while the Transformer model is most robust under incompleteness. The source code of our approach is at https://github.com/dice-group/owlapy.
Figures & tables
Construct
Synthax
Semantics
Top concept
⊤
ΔI
Bottom concept
⊥
∅
Atomic concept
C
{a∈ΔI:a∈CI}
Negation
¬C
ΔI\CI
Conjunction
C⊓D
CI∩DI
Disjunction
C⊔D
CI∪DI
Table 1: Syntax and Semantics of ALCIQ \xspace . I=(ΔI,⋅I) is an interpretation.
Symbol
Meaning
ϕ(C)
embedding of concept C (composition of ϕ\and , ϕ≤ , ϕinv )
a , R
KGE vectors for individual a and role R
ρ(C) , h(⋅)
instance set from Pellet; PMA pooling over all a ’s from C
ϕ\and,ϕ≤,ϕinv
primitive maps used in ϕ(⋅)
(ϕ\and,fϕ\and) , (ϕ≤,fϕ≤) , (ϕinv,fϕinv)
neural modules (map and scoring head)
fϕ…
scoring head of primitive ϕ… (logit for (C,a) )
Table 2: Notation for the Compositional retriever (our experiments use d=256 , hidden size 128 , dropout 0.1 , threshold γ=0.5 ).
Constructor
ϕ(⋅)
∃R.C
ϕ\and(ϕ≤(0,R,ϕ(C)),ϕ≤(0,R,ϕ(C)))
∀R.C
ϕ≤(0,R,ϕ(¬C))
R−
ϕinv(R)
≤nR.C
ϕ≤(n,R,ϕ(C))
≥nR.C , n≥1
ϕ\and(ϕ≤(n−1,R,ϕ(C)),ϕ≤(n−1,R,ϕ(C)))
≥0R.C
ϕ(⊤)
Table 3: Recursive definition of ϕ .
Animals
Carcinogenesis
Family
Lymphography
Mutagenesis
Nctrer
Semantic Bible
Suramin
∣NC∣
39
142
18
49
86
37
48
46
∣NR∣
2
4
4
0
5
9
29
3
∣NI∣
20
22372
202
148
14145
10209
724
2979
Train
2983
20877
3484
3368
10556
4231
16000
2946
Test
746
5220
872
842
2640
1058
4000
737
Table 4: Evaluation datasets. ∣NC∣ , ∣NR∣ , and ∣NI∣ are the numbers of named concepts, named roles, and individuals, respectively.
Individual
Type
Individual
Type
animals#bat01
Bat
animals#lizard01
Lizard
animals#boy01
Boy
animals#ostrich01
Ostrich
animals#cat01
Cat
animals#penguin01
Penguin
animals#croco01
Crocodile
animals#platypus01
Platypus
animals#dog01
Dog
animals#shark01
Shark
animals#dolphin01
Dolphin
animals#snake01
Snake
Table 5: Individuals in the Animals benchmark. The prefix animals# denotes the DL-Learner namespace.
Dataset
Metric
Compositional
Transformer
GRU
LSTM
EBR
Animals
Jaccard
0.994
0.989
0.981
0.841
0.198
F1 -score
0.995
0.992
0.986
0.854
0.309
ΔTime (%)
-100*
-75 *
-50 *
-150*
<-1000 *
Carcinogenesis
Jaccard
0.871
0.937
0.894
0.802
–
F1 -score
0.917
0.952
0.933
0.871
–
ΔTime (%)
-78.2*
-5.5*
33.8 *
-5.3 *
–
Table 6: Retrieval results across all datasets. For each dataset, we report Jaccard, F1 -score, and relative ΔTime (%). The asterisk (*) indicates that the runtime difference between the respective model and Pellet is statistically significant (Wilcoxon signed-rank test, p<0.05 ). ΔTime is 100×(TPellet−Tmodel)/TPellet ; values outside [−1000,1000] are shown as <-1000 or >1000 . Hence, positive ΔTime indicates that an approach is faster than Pellet. Empty entries for EBR indicate that it did not complete within 96 hours.
Figure 1: Average Jaccard scores by class expression length for different model architectures. Markers (disc, square, triangle, pentagon) indicate the actual performance for each architecture.
Figure 8
Figure 2: Average Jaccard on complete knowledge bases for GRU and Transformer with TransE and DeCal embeddings.
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
Setting
Value
Optimizer
Adam, learning rate 3.5×10−4
LR schedule
Cosine annealing
Epochs
400 (no early stopping)
Batch size
256
Train/validation split
90% / 10%
Embedding dimension d
256
Appendix
Table 7: Shared training hyperparameters for all NIR variants.