Investigation of Computer-Based Case Simulation (CCS) Case Management for United States Medical Licensing Examination Step 3 Examinees

• In Event: Fairmont Roundtable Session Six
  In Roundtable Session: Exploring New Worlds: Program Evaluation and Learner Assessment (Table 7)

Abstract

The Computer-based Case Simulation (CCS) portion of the USMLE Step 3 examination was developed to assess the decision-making and patient-management skills of physicians. Past research has demonstrated that CCS provides a unique opportunity to study the dangerous actions that examinees might take when managing a patient. This study expands that research by analyzing both the beneficial and dangerous actions that examinees take as well as response times for 33,482 examinees that completed CCS in 2021. Our analysis showed that the vast majority (93%) of ordered actions were beneficial. We also found that examinees’ USMLE examination scores tended to be positively correlated with their ordering of beneficial actions and negatively correlated with the time that they spent on CCS.

Authors

• Chunyan Liu, National Board of Medical Examiners
  Presenting Author

• Wenli Ouyang, National Board of Medical Examiners
  Non-Presenting Author

• Monica M. Cuddy, National Board of Medical Examiners
  Non-Presenting Author

• Polina Harik, NBME
  Non-Presenting Author

• Daniel Pacheco Jurich, National Board of Medical Examiners
  Non-Presenting Author