Scoring and Rescoring
Scoring Procedures Written Exam
The scores are marked electronically. The psychometrician carefully reviews all unsuccessful candidates’ scores for any coding errors such as Candidate ID number, full name and accurate coding of erasures.
A panel of optometrists under the guidance of the psychometrician complete a review of test items. Certain items may be deleted from scoring for all candidates if they do not meet appropriate psychometric characteristics. For example, if the item fails to discriminate positively. Deleted items are removed from scoring for all candidates, thereby ensuring that reported results are valid and fair.
After an examination, all results are verified before being sent to candidates.
Scoring Procedures OSCE
The OSCE examination has both interactive (stations that include a standardized patient) and non-interactive stations.
For interactive stations, candidate performances are rated by examiners who have been trained in the use of the standardized checklist criteria for the station. Examiners rate a candidate’s performance on domains of Outcome, Performance, and Communication.
For non-interactive stations, candidate responses are either computer marked, and ratings are generated for the Outcome and Performance domains, or candidate performance is rated on the Outcome and Performance domains by examiners trained in using the standardized checklist criteria for the station.
Outcome ratings reflect the degree to which station objectives are met and range from (1) Unsolved, (2) Uncertain, (3) Marginal Solved, and (4) Problem Solved.
Performance ratings reflect the overall depth, completeness, and quality of candidate performance in each station and range from (1) Unacceptable, (2) Marginal Unacceptable, (3) Marginal Acceptable, and (4) Acceptable.
Communication ratings reflect the degree to which communication competencies are met and range from (1) Unacceptable, (2) Marginal Unacceptable, (3) Marginal Acceptable, and (4) Acceptable. Communication ratings, used only for interactive stations, use a standardized rubric addressing a candidate’s understanding of and response to the patient’s feelings and needs, coherence of the interview (interaction), and verbal and non-verbal expression.
After an examination, all results are verified before being sent to candidates. A comprehensive psychometric review of all items is undertaken. Items or stations that fail to meet minimum psychometric criteria are further reviewed and potentially deleted from scoring for all candidates. A candidate’s total raw score is calculated by the addition of all ratings across all stations. This raw score is then converted to a scaled score for reporting.
Fail results undergo increased review. The results of all failed candidates are reviewed by a panel of at least three optometrists to ensure that the score resulted from that candidate’s performance and not any other extraneous factor determined by the panel to be relevant. If an extraneous factor during the exam (e.g. documented in writing at the exam site in the form of an Incident Report) had an impact on the results of an individual candidate. In that case, scoring is adjusted for that candidate to establish a fair and valid result.
There are three potential outcomes following a rescoring of an examination:
- no change to score,
- change to score but no change in the fail status, or
- a change in score and a change from fail to pass status.
The score forms will be reviewed again for coding errors. Please note any additional information provided by the candidate will not be forwarded with the rescore request. The candidate will receive the rescore results within 30 days of the deadline date posted on the website.
Please note, given the additional scrutiny that OEBC applies to fail results, it is unlikely that rescoring the examination will produce a change in result.
The Appeals Policy sets out the procedures a candidate must follow to appeal to their performance results on the OSCE or written exam.