Scoring and Rescoring
Scoring Procedures Written Exam
The score forms (bubble sheets) are marked by computer and then the form of all unsuccessful Candidates is carefully reviewed by the psychometrician for any coding errors such as Candidate ID number, full name, Exam booklet version number and accurate coding of erasures.
Test items are subject to review and may be deleted from scoring for all candidates if they do not meet appropriate psychometric characteristics, for example, if the item fails to discriminate positively. A panel of optometrists under the guidance of the psychometrician participate in the review process. Deleted items are removed from scoring for all candidates thereby ensuring that reported results are valid and fair.
After an examination, all results are verified before being sent to candidates. Fail results undergo increased review. Given the additional scrutiny that OEBC applies to fail results, it is unlikely that rescoring the examination will produce a change in result. There are three potential outcomes following a rescoring of the examination: no change to score, change to score but no change in the fail status, or a change in score and a change from fail to pass status. If there are any scoring changes, OEBC will issue the candidate new exam results. Note that scoring changes may not lead to a change from fail to pass status.
A rescore of the written exam will be provided upon written request and fee received within 12 weeks of the exam date. Score forms will be reviewed again for coding errors.
Please see the fee schedule for the rescore request.
Scoring Procedures OSCE
The OSCE examination is composed of both interactive (stations that include a standardized patient) and non-interactive stations. For interactive stations, candidate performances are rated by examiners who have been trained in the use of the standardized checklist criteria for the station. The examiners rate candidate performance on domains of Outcome, Performance, and Communication. For non-interactive stations, candidate responses are either computer marked and ratings are generated for the Outcome and Performance domains, or candidate performance is rated on the Outcome and Performance domains by examiners trained in the use of the standardized checklist criteria for the station.
Outcome ratings reflect the degree to which station objectives are met and range from (1) Unsolved, (2) Uncertain, (3) Marginal Solved, and (4) Problem Solved.
Performance ratings reflect the overall depth, completeness, and quality of candidate performance in each station and range from (1) Unacceptable, (2) Marginal Unacceptable, (3) Marginal Acceptable, and (4) Acceptable.
Communication ratings reflect the degree to which communication competencies are met and range from (1) Unacceptable, (2) Marginal Unacceptable, (3) Marginal Acceptable, and (4) Acceptable. Communication ratings, used only for interactive stations, use a standardized rubric addressing a candidate’s understanding of and response to the patient’s feelings and needs, coherence of the interview (interaction), and verbal and non-verbal expression.
After an examination, all results are verified before being sent to candidates. Following the examination, a comprehensive psychometric review of all items is undertaken and items or stations that fail to meet minimum psychometric criteria are further reviewed and potentially deleted from scoring for all candidates. A candidate’s total raw score is calculated by the addition of all ratings across all stations and This raw score is then converted to a scaled score for the purposes of fail reporting.
Fail results undergo increased review. The results of all failed candidates are reviewed by a panel of at least three (3) optometrists to ensure that the score resulted from that candidate’s performance and not any other extraneous factor determined by the panel to be relevant. If an extraneous factor during the exam (e.g. documented in writing at the exam site in the form of an Incident Report) had an impact on the results of an individual candidate, scoring is adjusted for that candidate to establish a fair and valid result.
Given the additional scrutiny that OEBC applies to fail results, it is unlikely that rescoring the examination will produce a change in result.
The review of fail results during the exam scoring process takes into consideration all examination materials including documented extraordinary circumstances. Therefore a rescore has already been completed. Candidates may appeal the results of performance on the OSCE following the procedures of the Appeals Policy.