Recruiters and job seekers rely on search systems to navigate labor markets, making candidate matching engines critical for hiring outcomes. Most systems act as keyword filters, failing to handle skill synonyms and nonlinear careers, resulting in missed candidates and opaque match scores. We introduce JobMatchAI, a production-ready system integrating Transformer embeddings, skill knowledge graphs, and interpretable reranking. Our system optimizes utility across skill fit, experience, location, salary, and company preferences, providing factor-wise explanations through resume-driven search workflows. We release JobSearch-XS benchmark and a hybrid retrieval stack combining BM25, knowledge graph and semantic components to evaluate skill generalization. We assess system performance on JobSearch-XS across retrieval tasks, provide a demo video, a hosted website and installable package.
Table 1: Default reranking weights. Users may adjust these interactively; the utility function recomputes in real time.
Figure 2: JobMatchAI Platform Interface
Figure 3: Visualization of the JobMatchAI knowledge graph illustrating the relationships between candidates, jobs, skills, locations, and companies used for hybrid retrieval and explainable reranking.
BM25
Sem.
KG
NDCG@5
NDCG@10
R@50
R@100
P50 (ms)
✓
✗
✗
0.721
0.756
0.49
0.57
79
✗
✗
✓
0.758
0.790
1.00 *
1.00 *
–
✓
✓
✗
0.740
0.771
0.36
0.42
80
✓
✗
✓
0.747
0.776
0.33
0.39
81
✓
✓
✓
0.750
0.780
0.29
0.35
82
✓
✓
✓ +R
0.785
0.810
0.29
0.35
82
Table 2: Retrieval performance on JobSearch-XS (evaluated on human-verified gold labels). ✓/✗ indicate active retrieval channels.
Intent type
n
Mean
Std
IQR
Job title
3
0.90
0.09
0.08
Natural language
6
0.74
0.34
0.39
Skill synonym
6
0.60
0.31
0.46
Overall
15
0.72
0.30
0.45
Table 3: NDCG@10 distribution across gold queries by query intent (Hybrid+Reranker pipeline).
Extractor
NDCG@10
R@100
High-precision (current)
0.791
0.336
High-recall
0.817
0.326
Δ (recall − precision)
+0.026
−0.010
Table 4: End-to-end retrieval quality under two skill-extractor operating points (Hybrid+Reranker).
Metric
Mean ± Std
Task-based evaluation
Top-5 relevance (Smart Search)
3.92 ± 0.79
Skill synonym handling
3.75 ± 0.87
Explanation helpfulness
4.17 ± 0.72
Weight adjustment usefulness
3.83 ± 0.94
Usability
Table 5: User study results ( N=20 ). Scores are mean ± std on a 1–5 Likert scale.
Feature
JobMatchAI
LinkedIn
Jobright
Teal
Jobscan
Semantic search
✓
~
✓
✗
✗
Knowledge graph
✓
✗
✗
✗
✗
Hybrid retrieval
✓
✗
✗
✗
✗
Explainable scores
✓
✗
✗
✗
~
Factor-level control
✓
✗
✗
✗
✗
Resume-driven search
✓
~
✓
✓
✓
Table 6: Feature comparison with representative job search tools. ✓= supported, ✗= not supported, ~= partial.
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
Field
Base P
Base R
Base F1
Ours P
Ours R
Ours F1
Δ F1
Name
–
–
0.33
–
–
0.64
+0.31
Skills
0.41
0.60
0.48
0.94
0.12
0.19
− 0.29
Education
0.74
0.31
0.42
1.00
1.00
1.00
+0.58
Appendix
Table 7: Component-level resume parsing quality on a labeled set of 45 resumes. Baseline uses a single-strategy spaCy NER pipeline.
A reliable resume-job matching system helps a company find suitable candidates from a pool of resumes and helps a job seeker find relevant jobs from a list of job posts. While recent advances in embedding-based methods such as ConFit and ConFit v2 can efficiently retrieve candidates at scale, the lack of controllability and explainability limits their real-world adaptations. LLM-based re-rankers can address these limitations through reasoning, but existing training recipes are developed on short-document benchmarks and do not account for noise in real-world recruiting data. In this work, we first conduct a systematic analysis over the LLM re-ranker training pipeline for person-job fit, covering inference algorithm design, RL algorithm selection, data processing, and SFT distillation. We find that using multi-pass re-ranking, training with listwise RL objectives, removing noisy samples, and distilling from a stronger LLM before RL significantly improves re-ranking performance. We then aggregate these findings to train ConFit v3 with Qwen3-8B and Qwen3-32B on real-world person-job fit datasets, and find significant improvements over existing best person-job fit systems as well as strong LLMs such as GPT-5 and Claude Opus-4.5. We hope our findings provide useful insights for future research on adapting LLM-based re-rankers to person-job fit systems.
Xiao Yu, Ruize Xu, Chengyuan Xue +6
Columbia University · New York, NY, USA · John Hopkins University +6
Modern recruitment platforms operate under severe information imbalance: job seekers must search over massive, rapidly changing collections of postings, while employers are overwhelmed by high-volume, low-relevance applicant pools. Existing recruitment recommender systems typically rely on keyword matching or single-stage semantic retrieval, which struggle to capture fine-grained alignment between candidate experience and job requirements under real-world scale and cost constraints. We present Synapse, a multi-stage semantic recruitment system that separates high-recall candidate generation from high-precision semantic reranking, combining efficient dense retrieval using FAISS with an ensemble of contrastive learning and Large Language Model (LLM) reasoning. To improve transparency, Synapse incorporates a retrieval-augmented explanation layer that grounds recommendations in explicit evidence. Beyond retrieval, we introduce a novel evolutionary resume optimization framework that treats resume refinement as a black-box optimization problem. Using Differential Evolution with LLM-guided mutation operators, the system iteratively modifies candidate representations to improve alignment with screening objectives, without any labeled data. Evaluation shows that the proposed ensemble improves nDCG@10 by 22% over embedding-only retrieval baselines, while the evolutionary optimization loop consistently yields monotonic improvements in recommender scores, exceeding 60% relative gain across evaluated profiles. We plan to release code and data upon publication.
As retrieval models converge on generic benchmarks, the pressing question is no longer "who scores higher" but rather "where do systems fail, and why?" Person-job matching is a domain that urgently demands such diagnostic capability -- it requires systems not only to verify explicit constraints but also to perform skill-transfer inference and job-competency reasoning, yet existing benchmarks provide no systematic diagnostic support for this task. We introduce PJB (Person-Job Benchmark), a reasoning-aware retrieval evaluation dataset that uses complete job descriptions as queries and complete resumes as documents, defines relevance through job-competency judgment, is grounded in real-world recruitment data spanning six industry domains and nearly 200,000 resumes, and upgrades evaluation from "who scores higher" to "where do systems differ, and why" through domain-family and reasoning-type diagnostic labels. Diagnostic experiments using dense retrieval reveal that performance heterogeneity across industry domains far exceeds the gains from module upgrades for the same model, indicating that aggregate scores alone can severely mislead optimization decisions. At the module level, reranking yields stable improvements while query understanding not only fails to help but actually degrades overall performance when combined with reranking -- the two modules face fundamentally different improvement bottlenecks. The value of PJB lies not in yet another leaderboard of average scores, but in providing recruitment retrieval systems with a capability map that pinpoints where to invest.