cs.CLSep 19, 2026

From Lexical Baselines to Agentic Retrieval-Augmented Generation: Structured Skill and Responsibility-Level Extraction with the SFIA Framework

Authors: Ranuga Disansa, U. S. Samarasinghe, Lasith Gunawardena

Organizations: Informatics Institute of Technology, Colombo, Sri Lanka · Department of Information Technology, University of Sri Jayewardenepura, Colombo, Sri Lanka

Abstract

Automated skill extraction underpins workforce planning, yet most systems represent skills as flat labels with no notion of the responsibility level at which a skill is practiced. The Skills Framework for the Information Age (SFIA) captures exactly this dimension, defining 147 professional skills across seven responsibility levels, but no automated LLM-based extraction targeting SFIA has been reported. We formalize the task as structured prediction of (skill, level) pairs from free text and ask three questions: how accurately can text be mapped onto SFIA's closed vocabulary, which strategies reliably predict the level alongside the skill, and do agentic designs improve on simpler retrieval and prompting? We evaluate five strategies (a lexical baseline, dense retrieval with LLM reranking, a zero-shot schema-constrained LLM, single-agent agentic RAG, and a three-agent retriever--matcher--verifier crew) against expert-mapped European ICT role profiles, all drawing on an SFIA~9 corpus built by a fully automated agentic pipeline that we release. Retrieval-based matching identifies the most skills while generative strategies are markedly more precise; only strategies assigning the level as an explicit decision predict it reliably, with similarity-based selection more than twice as inaccurate; and the crew doubles latency without improving accuracy, so added agent roles do not automatically benefit closed-taxonomy matching. These results provide the first reproducible baseline for structured, level-aware skill extraction against SFIA.

Figures & tables

Explore similar work

CardsList
  1. SkillSight: Calibrating Generic Content Bias for Skill Retrieval

    Jul 21, 2026Jinying Xiao, Bin Li, Xiaopeng Li +7Lexical RetrievalLLM Agent Skill Retrieval

  2. SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale

    Sep 30, 2026Guanqun Yang, Wenlong Zhang, Tian Shi +1LLM Agent Skill RetrievalInformation Retrieval

  3. Skill Retrieval Augmentation for Agentic AI

    Apr 27, 2026Weihang Su, Jianming Long, Qingyao Ai +6AI Agent BenchmarksLLM Agent Skill Retrieval