Developing Measures of Abstract Constructs Using a Mixed Methods Approach: Introducing an Analytic Framework

• In Event: 52.084 - Roundtable Session 20
  In Roundtable Session: 52.084-8 - The Use of Mixed-Methods Research in Different Disciplinary and Methodological Contexts

Abstract

One of the challenges in assessment is the measurement of complex, abstract constructs that are important in education. Examples of such constructs include student creativity, mindfulness, stakeholder acceptability of a new intervention package, etc. We argue that Item Response Theory (IRT) and Classical Test Theory (ITT) applications can be enhanced via the incorporation of qualitative inquiry under a mixed methods framework. Doing so can provide vital insights about individual items and overall survey structure that might have been missed if relying on a single analytical method alone. The purpose of this paper is therefore to provide a general analytic mixed methods framework that integrates IRT, CTT, and qualitative methods that can guide future instrument development using mixed methods approaches.

Authors

• Shannon Lyn David, North Dakota State University

• John H. Hitchcock, Indiana University - Bloomington

• Anthony J. Onwuegbuzie, Sam Houston State University