Development and Validation of Faculty Research Competence Test: A Cross-Analysis Using CTT and IRT

• In Event: AERA Poster Session Sunday 11:45 am
  In Poster Session: Faculty Teaching, Evaluation, and Development

Abstract

Measuring faculty research competence objectively is challenging and complex due to the nature of research, disciplinary differences, and job expectations. Current self-report competence measures contain over-reported/under-reported biases, which potentially misguide data-driven decisions. We aimed to develop and validate a more reliable and objective social science faculty research competence test (FRCT-SS). This study followed a cross-sectional survey design and collected data from 154 faculty at North American universities. We developed two sets of FRCT-SS (each set contained 18 items), considering AERA, NCME, and APA guidelines. Following classical test theory and item response theory, we found the items were acceptable to measure faculty research competence. Future researchers can use FRCT-SS in other disciplines, contexts, and populations too.

Authors

• Muhammad Salahuddin, University of North Dakota

• Robert H. Stupnisky, University of North Dakota