Validity of a Computer-Analytic Writing Ability Developmental Scale

• In Event: Research in Reading and Literacy SIG: Paper Session 1: Reading and Writing

Abstract

The purpose of the present psychometric study was to explore the validity of a novel computer-analytic developmental scale for measuring individuals’ writing ability development over time. We examined the extent to which the scale produced predictable results as compared to human ratings, for a sample of 589 students and their compositions. Results supported the validity of the scale: a) Computer-analytic scale scores increased significantly across grades. b) The scale was sensitive to within-grade writer ability differences. c) The scale predicted human-rated scores well, sharing 90% of the variance. d) As compared to the human-rated scores, the scale showed similar mean differences for subgroups within ethnicity and socioeconomic status. e) The scale demonstrated similar measurement error as compared to human estimates.

Authors

• Hal Burdick, MetaMetrics

• Carl W. Swartz, MetaMetrics

• A. Jackson Stenner, MetaMetrics

• Jill Fitzgerald, MetaMetrics and UNC Emerita

• Don Burdick, MetaMetrics

• Sean Hanlon, MetaMetrics