The cut score for the Primary and Final SBA examinations is established by the Angoff referencing method. In following best practice, a dedicated Angoff referencing group of examiners use the Angoff process to determine a cut score. Training is given to all members of the Final and Primary MCQ Angoff reference groups in the process, and ensures that there is a collective understanding of the ‘minimally competent’ candidate, as defined below:
“For the purposes of the (Primary or Final) SBA examination, a ‘minimally competent’ candidate is one who has only just enough depth and breadth of knowledge stipulated within the (Stages 1 and 2) curriculum to underpin their current clinical practice and equip them for the next phase of their anaesthetic training. If they pass the written examination but do not undertake further preparation and gain more understanding, they are likely to fail any subsequent SOE or OSCE on the same curriculum areas.”
In determining the ‘minimally competent’ candidate, members of the Angoff referencing groups are encouraged to use personal experience of anaesthetists in training sitting the examination at the particular stage of training.
After each examination, an in-depth item analysis is conducted on items with unexpected performance statistics. Questions that are deemed problematic are removed from the paper before the cut score is finalised.
