cs.CLOct 26, 2026

Adapting LLM-SC to Living Sacred Heritage: Domain-Specific Extraction, Semantic Networks and Human Evaluation on Pashupatinath Temple Reviews

Authors: Hari Sitaula, Manish Sakhakarmy, Pujan Pant, Sagar Newpane

Organizations: Department of Mathematical Sciences, Montana Technological University, Butte, MT 59701, USA · ASI Industrial, Billings, MT 59101, USA · Herald College Kathmandu, University of Wolverhampton, Naxal, Kathmandu 44600, Nepal

Abstract

Large language model (LLM) pipelines can turn visitor reviews into structured data, but generic schemes may miss rituals, sacred spaces, cultural restrictions and emotionally mixed experiences at living sacred heritage sites. We adapted the LLM-Social Computing (LLM-SC) framework to Pashupatinath Temple, Nepal, by specifying a 12-type entity taxonomy (four original LLM-SC types plus eight sacred-heritage types), four relation types and nine aspect-sentiment dimensions in a GPT-4o extraction prompt, which was applied to a fixed random sample of 2,500 English-language Tripadvisor reviews from a processed corpus of 3,939. The exports contain 11,286 entity, 6,232 aspect-sentiment and 5,590 relation records, covering 2,485, 2,487 and 2,433 reviews, respectively; the eight added sacred-heritage types account for 64.8% of entity records. Against an adjudicated two-annotator reference for 200 reviews, exact normalized surface-and-type matching gave provisional entity scores of 41.0% precision, 21.8% recall and 28.4% micro-F1. Aspect-presence F1 was 53.6% and end-to-end aspect-plus-polarity F1 was 42.6%. Human adjudication supported 153 of 194 first-listed relation candidates (one per review; 78.9%), a candidate-level rate that does not estimate relation recall or whole-graph precision. The contribution is a culturally grounded, domain-specific adaptation with component-wise human evaluation and explicit reproducibility and generalization limitations.

Explore similar work

CardsList
  1. A Context-Aware Cultural Heritage Guide Powered by LLMs

    Aug 1, 2026Liliana Ardissono, Fabio Ferrero, Angelo Geninatti Cossatin +2Cultural HeritageDigital Cultural Heritage

  2. Multi-Dimensional Evaluation of Sustainable City Trips with LLM-as-a-Judge and Human-in-the-Loop

    Apr 27, 2026Ashmi Banerjee, Adithi Satish, Wolfgang Wörndl +1LLM EvaluationLLM-as-a-Judge

  3. From Outliers to Errors: Auditing Pali-to-English LLM Translations with Multi-Reference Adjudication

    May 31, 2026Máté Metzger, Nadnapang Phophichit, Hansa DhammahasoLLM AuditingMachine Translation