cs.AISep 24, 2024

Linear-time Rule Mining Under Formal Guarantees

Authors: Jonathan Feldstein, Dominic Phillips, Efthymia Tsamoura

Organizations: Bennu.Ai Edinburgh, United Kingdom · University of Edinburgh Edinburgh, United Kingdom · Samsung AI Cambridge, United Kingdom

Abstract

Probabilistic logical models are a core component of neurosymbolic AI and are important in their own right for tasks that require high explainability. Unlike neural networks, logical theories that underlie the model are often handcrafted using domain expertise, making their development costly and prone to errors. While there are algorithms that learn logical theories from data, they are generally prohibitively expensive, limiting their applicability in real-world settings. Here, we introduce precision and recall for logical rules and define their composition as rule utility -- a measure of the predictive power of logical theories that can be computed in linear time in the data size. We then present SPECTRUM, a linear-time framework for learning logical theories from relational data, that mines recurrent patterns in the data, and subsequently uses our utility measure to evaluate and rank the rules derived from these patterns. Finally, we prove theoretical guarantees on the utility of the learnt logical theory. As a result, we demonstrate across various tasks that SPECTRUM scales to databases with orders of magnitude more relations and entities, often learning more accurate logical theories on CPUs in < 1% of the runtime of state-of-the-art neural network approaches on GPUs.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. ANDRE: An Attention-based Neuro-symbolic Differentiable Rule Extractor for Inductive Logic Programming

    May 5, 2026Iman Sharifi, Peng Wei, Saber FallahLogic ProgrammingDifferentiable Programming

  2. Learning Probabilistic Logic Programs with Functional Gradient Guided Language Models

    Oct 8, 2026Saurabh Mathur, Sahil Sidheekh, Bhavan Vasu +4Probabilistic LogicInductive Logic Programming

  3. Rule-Based Languages for Neurosymbolic AI

    Oct 5, 2026Stefania Dumbrava, Efthymia TsamouraNeuro-Symbolic AILogic Programming