The Comparable Validity of the Content of Two High-Stakes Teacher Tests

• In Event: 54.065 - The Testing of Prospective Teachers: Alternative Approaches and Comparable Validity

Abstract

For about 35 years, the Florida State Board of Education used a general knowledge test (GK test) as a required component of its teacher certification. The GK test is administered to prospective educators seeking initial teaching K-12 certification and contains four subtests: Essay, English Language Skills, Reading, and Mathematics. In 2014, the Florida legislature passed a law requiring the State Board to identify examinations demonstrating mastery of general knowledge at the same level as the General Knowledge (GK) test. Specifically, the State legislature identified the Graduate Record Examination (GRE) General Test to be used as an alternative assessment to the GK test. This paper provides evidence of the alignment processes used to determine the extent that the GRE aligned with the GK test.
This study documents the processes and findings of the content alignment study to the GRE. The study evaluated the degree of content and cognitive complexity alignment of GRE items/GRE Scoring Guides with GK Competencies and Skills. Study results provided information about the degree to which scores from the GRE and GK make similar inferences about teacher candidates’ mastery of general knowledge.
Three separate alignment rating processes were carried out: 1) content and cognitive complexity alignment of GRE items from the Quantitative Reasoning subtest with GK Competencies and Skills in Mathematics; 2) content and cognitive alignment of GRE items from the Verbal Reasoning subtest with GK Competencies and Skills in English Language and Reading; and 3) content alignment of two GRE Scoring Guides from the Analytical Writing subtest with GK Essay Skills.
Mixed results regarding the alignment of GRE subtests to the GK emerged. Alignment results for the Quantitative Reasoning and Analytical Writing subtests were generally positive, suggesting reasonable alignment with the corresponding the GK in Mathematics and Essay Writing subtests. In contrast, the GRE Verbal Reasoning subtest was found to be poorly aligned with the GK Skills in English Language and in Reading. Reviews of the Verbal Reasoning subtest strongly suggested that the GRE tests focused more on vocabulary than more general reading skills. Based on these findings, it appears that the GRE Verbal Reasoning subtest provides inadequate coverage of the English Language and Reading skills currently required for teacher certification.

Author

• Kurt F. Geisinger, University of Nebraska