cs.AIAug 27, 2026

Discovering Relationships in Data Lakes Using Large Language Models: An Industrial Case

Authors: Ahlame Diouan, Eric Ferey, Sabine Loudcher, Jérôme Darmont

Organizations: ERIC, UL2 · Université Lumière Lyon 2, UR ERIC, Lyon, France · Bial-X, Lyon, France

Abstract

Data lakes rely on metadata to remain usable, yet this meta data is often limited or weakly informative for column relationship discovery, especially in ERP-derived datasets with coded or abbreviated schema labels. We propose ColRel, a two-stage method that builds column embeddings from metadata and data available at ingestion time. In difficult cases, such as coded schemata, business dictionaries help better interpret column names and support the generation of short natural-language descriptions used in the second stage. Experiments on public benchmarks and an industrial ERP dataset show that ColRel is particularly effective in semantically related, weak-signal settings.

Explore similar work

CardsList
  1. TACO: Task-Aware Column Description Generation Using LLMs

    Jun 19, 2026Ting Cai, Rakesh R. Menon, Yiru Chen +8LLM-Assisted Annotation

  2. Discovery-Driven Integration of Disjoint Tables via Text

    Sep 22, 2026Md Ataur Rahman, Dimitris Sacharidis, Oscar Romero +1Cross-Modal RetrievalTabular Representation Learning