Timing Is Everything—Or Is It? Comparing Survey Methods Used for Measuring Teachers’ Perceived Growth

• In Event: Survey Science in Education: Methods, Analysis, and Emerging Technologies

Abstract

Traditional pre-post and retrospective pre-post survey methods are commonly used for program evaluation. Drawing on data from a STEM professional development program for preschool teachers, this study explored whether the choice of survey method shaped the "story" of teacher growth. Paired samples t-tests were used to compare differences in participants’ teaching efficacy based on (a) pre-intervention and post-intervention survey results, (b) retrospective-pre and post-intervention survey results, and (c) pre-intervention and retrospective-pre survey results. Pre-post scores of participants’ teaching efficacy were statistically different regardless of method, with no significant differences between traditional pre-intervention and retrospective-pre survey scores. We discuss implications for survey method selection, emphasizing the importance of construct type, resource constraints, evaluation context, and the use of robust measurement instruments.

Authors

• Timothy D. Folger, Binghamton University - SUNY

• Yiyun Fan, Binghamton University - SUNY

• Casey E Hanna, Binghamton University - SUNY

• Toni A. May, Binghamton University - SUNY