Development of a Rubric to Qualify and Score Responses to the Views of Nature of Science (VNOS) Questionnaire (Poster 22)

• In Event: AERA Poster Session One
  In Poster Session: Division C Science Poster Session One

Abstract

The “VNOS Analysis and Scoring Rubric” (VAScoR) was developed to reliably qualify and score responses to the Views of Nature of Science Questionnaire (VNOS). VAScoR explicitly guides the qualitative analysis, and standardizes score assignment to nuanced categories, of VNOS responses. VAScoR reliability was examined in two studies: In study I, a single researcher analyzed 86 VNOS questionnaires to examine the rubric’s intra-rater reliability, resulting in a robust Cronbach’s alpha value of .81. In study II, four researchers analyzed a randomly generated set of 18 questionnaires to examine inter-rater reliability, resulting in substantial consensus (Cohen’s kappa of .71) and consistency (overall Pearson’s coefficient of .82) among all raters, and consistency among six possible rater pairings (Pearson’s coefficients from .77 to .89).

Authors

• Fouad S. Abd-El-Khalick, University of North Carolina - Chapel Hill
  Presenting Author

• Ryan Glenn Summers, University of North Dakota
  Presenting Author

• Jeanne L. Brunner, University of Massachusetts - Amherst
  Non-Presenting Author