Swiss general internal medicine board examination: quantitative effects of publicly available and unavailable questions on question difficulty and test performance.
Fiche du document
28 février 2022
- doi: 10.4414/smw.2022.w30118
- issn: 0036-7672
Ce document est lié à :
info:eu-repo/semantics/altIdentifier/doi/10.4414/smw.2022.w30118
Ce document est lié à :
info:eu-repo/semantics/altIdentifier/pmid/35429236
Ce document est lié à :
info:eu-repo/semantics/altIdentifier/eissn/1424-3997
Ce document est lié à :
info:eu-repo/semantics/altIdentifier/urn/urn:nbn:ch:serval-BIB_850A334010B88
info:eu-repo/semantics/openAccess , CC BY-NC-SA 4.0 , https://creativecommons.org/licenses/by-nc-sa/4.0/
Sujets proches
CompetenceCiter ce document
P. Ferrari Pedrini et al., « Swiss general internal medicine board examination: quantitative effects of publicly available and unavailable questions on question difficulty and test performance. », Serveur académique Lausannois, ID : 10.4414/smw.2022.w30118
Métriques
Partage / Export
Résumé
Formerly, a substantial number of the 120 multiple-choice questions of the Swiss Society of General Internal Medicine (SSGIM) board examination were derived from publicly available MKSAP questions (Medical Knowledge Self-Assessment Program®). The possibility to memorise publicly available questions may unduly influence the candidates' examination performance. Therefore, the examination board raised concerns that the examination did not meet the objective of evaluating the application of knowledge. The society decided to develop new, "Helvetic" questions to improve the examination. The aim of the present study was to quantitatively assess the degree of difficulty of the Helvetic questions (HQ) compared with publicly available and unavailable MKSAP questions and to investigate whether the degree of difficulty of MKSAP questions changed over time as their status changed from publicly available to unavailable. The November 2019 examination consisted of 40 Helvetic questions, 40 publicly available questions from MKSAP edition 17 (MKSAP-17) and 40 questions from MKSAP-15/16, which were no longer publicly available at the time of the examination. An one factorial univariate analysis of variance (ANOVA) examined question difficulty (lower values mean higher difficulty) between these three question sets. A repeated ANOVA compared the difficulty of MKSAP-15/16 questions in the November 2019 examination with the difficulty of the exact same questions from former examinations, when these questions belonged to the publicly available MKSAP edition. The publicly available MKSAP-17 and the publicly unavailable Helvetic questions served as control. The analysis of the November 2019 exam showed a significant difference in average item difficulty between Helvetic and MKSAP-17 questions (71% vs 86%, p