Testing the Waters: Using Test Theory to Create the [REDACTED] Survey Instrument

• In Event: AERA Poster Session Wednesday 11:45am
  In Poster Session: Poster Session I -- AERA Division D Section 1: Measurement, Psychometrics, and Assessment

Abstract

Despite efforts to increase ocean science presence in K-12 education, teachers remain absent from most research. This study describes the development of a psychometrically validated instrument to understand how science teachers view the importance of including novel science content and confidence teaching ocean science. Following item generation, content validation, and revisions, we analyzed pilot data from 62 teachers and 421 teachers from the main data collection. Factor analysis confirmed unidimensionality for the Importance of Teaching Novel Science (α = 0.92) and Confidence in Teaching Ocean Science (α = 0.78) subscales. A weak correlation (r = 0.236, p < .001) between subscales provides evidence for two constructs. IRT analyses confirmed satisfactory model fit, supporting the instruments’ psychometric qualities for research applications.

Authors

• Ella Claire Walsh, Boston College

• Laura M. O'Dwyer, Boston College

• Victoria Centurino, Woods Hole Oceanographic Institution

• Nicholas Bates, Arizona State University - Bermuda Institute of Ocean Sciences

• Sonya Dyhrman, Columbia University

• Sheean Haley, Columbia University