Do scores in the selection process for vocational general practice training predict scores in vocational examinations?

Abstract

AIM: Selection processes for vocational training are common and are intended to predict future examination performance (predictive validity). Comparison of selection scores with measures of competence during training can provide supporting evidence that both the examination process and selection process are valid and reliable. METHOD: Selection interview scores for vocational training in general practice were compared to summative examination scores eight months into training between 2003 and 2006. RESULTS: A moderately strong correlation (Spearman’s rho = 0.5) was found between selection interview scores and summative examination scores. CONCLUSION: The ability of a selection interview process to predict future performance in vocational training is highly dependent on careful design of both the assessment of performance and the selection process. The selection interview process of the RNZCGP compares well with international data. KEYWORDS: General practice; graduate medical education; professional competence; educational assessment; intake selection