Building and Validating the Methodological Competency Scale (MCS)

• In Event: Research In Progress Roundtables Session 4
  In Invited Roundtable: Education Research and Psychometrics (Table 16)

Abstract

This paper outlines the design of the Methodological Competency Scale (MCS), which measures three factors: intrinsic (inherent worth), utility (usefulness), and attainment (identity importance) in social science researchers' self-perceptions of methodological competency. Items were developed using a Guttman-like response format (Wilson et al., 2023) with five statement-based options instead of a traditional Likert scale. Expert reviews by two faculty members and four PhD students led to substantial revisions, with a "Cost" construct deferred to a future iteration. The scale was piloted with 139 participants, followed by Exploratory Factor Analysis (EFA) and reliability analysis comparing coefficient alpha and omega. The final scale aligns closely with the intended three-factor structure.

Author

• Marcus A. Harris, University of Connecticut