cs.CLMar 2, 2026

Beyond the Resumé: A Rubric-Aware Automatic Interview System for Information Elicitation

Authors: Harry Stuart, Masahiro Kaneko, Timothy Baldwin

Organizations: Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, United Arab Emirates

Abstract

Effective hiring is integral to the success of an organisation, but it is very challenging to find the most suitable candidates because expert evaluation (e.g.\ interviews conducted by a technical manager) are expensive to deploy at scale. Therefore, automated resume scoring and other applicant-screening methods are increasingly used to coarsely filter candidates, making decisions on limited information. We propose that large language models (LLMs) can play the role of subject matter experts to cost-effectively elicit information from each candidate that is nuanced and role-specific, thereby improving the quality of early-stage hiring decisions. We present a system that leverages an LLM interviewer to update belief over an applicant's rubric-oriented latent traits in a calibrated way. We evaluate our system on simulated interviews and show that belief converges towards the simulated applicants' artificially-constructed latent ability levels. We release code, a modest dataset of public-domain/anonymised resumes, belief calibration tests, and simulated interviews, at https://github.com/mbzuai-nlp/beyond-the-resume. Our demo is available at https://btr.hstu.net.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Synapse: Evolving Job-Person Fit with Explainable Two-phase Retrieval and LLM-guided Genetic Resume Optimization

    Apr 2, 2026Ansel Kaplan Erol, Seohee Yoon, Keenan Hom +1Job-Candidate MatchingRecommender Systems

  2. Agentic AI for Human Resources: LLM-Driven Candidate Assessment

    Mar 17, 2026Kamer Ali Yuksel, Abdul Basit Anees, Ashraf Elneima +3Learning to RankLLM-as-a-Judge