cs.AIOct 30, 2026

ReX-GG: a LLM Ensemble Pipeline for Relation-extraction and Graph Generation

Authors: Giacomo Magnifico, Eduard Barbu

Organizations: Institute of Computer Science, University of Tartu, Tartu, Estonia

Abstract

Current LLM ensemble frameworks focus on multi-step setups with additional modules for answer ranking, often opting for token and span analysis rather than structured outputs, leading to heavyweight architectures with potential fail states along the pipeline. Faster, lighter solutions are more vulnerable to hallucination propagation and can lack output control in more complex pipelines. This paper proposes a customisable, lightweight ensemble workflow of coordinated Large Language Models that leverages JSON-structured outputs and anonymous peer-review ranking to mitigate hallucinatory outputs and single-model failure points. The pipeline is demonstrated on a relation extraction task applied to popular science articles in English, targeting four ontologically-grounded relation types (strong causation, weak causation, contrastive, and compositional), with semantic node canonicalisation and interactive, colour-coded HTML causal graphs as the final output. Performance is evaluated through an anonymous user study, achieving an average perceived accuracy of 0.778 against a human-annotated gold standard. The modular architecture supports flexible deployment across both API-based and in-house LLM setups, and the full framework is released under an open license to foster reproducibility and collaborative research.

Figures & tables

Explore similar work

CardsList
  1. LLMs Underperform Graph-Based Parsers on Supervised Relation Extraction for Complex Graphs

    Apr 9, 2026Paolo Gajo, Domenic Rosati, Hassan Sajjad +1Relation ExtractionLLM Information Extraction

  2. PEARL: Auditable Repair for Scientific Reasoning Graph Extraction

    Jul 20, 2026Bohan Su, Pengze Li, Yuchen Lu +1LLM Reasoning with GraphsLLM Auditing

  3. Reasoning Consensus: Structural Ensembling of LLM Reasoning via Weighted DAG Aggregation

    Jul 30, 2026Amruta Parulekar, Jinu Lee, Dilek Hakkani-Tür +1Structured ReasoningLLM Reasoning with Graphs