Relative Diagnostic Profile: An Alternative to Subscore Reporting in Licensure Tests

• In Event: Marriott Roundtable Session 29
  In Roundtable Session: Estimation and Reporting of Multidimensional Item Response Theory Models

Abstract

Diagnostic classification models (DCMs), providing master/non-master decisions on each subdomain, are promising alternatives for subscore reporting because of its higher reliability with short test length. However, it may not be appropriate to provide binary decisions to the examinees when 1) an overall score is provided with a pass/fail decision from standard-setting procedures or 2) an absolute decision is not the purpose of providing subscores. To satisfy such score reporting scenarios, the relative diagnostic profile (RDP) reporting framework, a subscore reporting framework based on DCMs, is proposed in this study. This framework partitions a person’s overall ability into slices where stronger domains are relatively bigger. The RDP framework aims to support individual learning and satisfy reporting requirements at the same time.

Authors

• Ren Liu, University of Florida

• Hong Qian, National Council of State Boards of Nursing

• Xiao Luo, Measured Progress

• Ada Woo, National Council of State Boards of Nursing