In Farrell 2022 et al., on checklist reliability in OVH simulation, how many OSATS GRS items met the content validity criteria?
A. All 6
B. None
C. 4
D. 1
E. 2
Answer: 1
Explanation: Only “respect for tissue” met content validity criteria; the other 5 OSATS GRS items were excluded.
In Farrell 2022 et al., on checklist reliability in OVH simulation, what was the generalizability (G) coefficient for the 40-item checklist instrument used in the study?
A. 0.92
B. 0.85
C. 0.76
D. 0.64
E. 0.79
Answer: 0.85
Explanation: The G-coefficient for the checklist was 0.85, indicating good reliability for moderate-stakes exams.
In Farrell 2022 et al., on checklist reliability in OVH simulation, what was the main benefit of using digital recordings for student performance assessment?
A. Increased student stress
B. Allowed for reuse of models
C. Improved model accuracy
D. Enabled blinded multi-rater evaluation
E. Reduced faculty workload
Answer: Enabled blinded multi-rater evaluation
Explanation: Digital recordings allowed multiple raters to evaluate performance without introducing bias.
In Farrell 2022 et al., on checklist reliability in OVH simulation, what was the recommended number of raters needed to achieve acceptable reliability (G ≥ 0.76) for high-stakes use of the checklist?
A. 1
B. 2
C. 3
D. 4
E. 5
Answer: 2
Explanation: Two raters per student were needed to achieve a G-coefficient of 0.76, which is considered acceptable for high-stakes exams.
In Farrell 2022 et al., on checklist reliability in OVH simulation, what percentage of checklist items were deemed essential by expert surgical educators?
A. 75%
B. 85%
C. 90%
D. 95%
E. 98%
Answer: 98%
Explanation: Thirty-nine of 40 checklist items (98%) were validated by expert panel review.
