Measuring Science Achievement in Large-Scale Assessment: The Interplay Between Domain-Specific and Domain-General Abilities

• In Event: Novel Approaches to Large-Scale Assessment Data Analysis and Practice

Abstract

The conceptualization of large-scale assessments (LSAs) has been criticized in the past for measuring domain-general instead of domain-specific abilities. Most studies provide evidence that mathematical and verbal LSAs measure both. We extend this research by analyzing different science abilities tests. A sample of 1722 students worked on a PISA science, an Educational Standards, and a general cognitive ability test. Different confirmatory factor analysis models showed that also in science, LSAs measure both, a domain-general and a domain-specific aspect. We related the factors to grades in various school subjects and found mixed results with regard to the domain-specificity of the factors. Our results are important for the reporting of LSAs as well as for teaching science.

Authors

• Nele Nicole Kampa, Leibniz Institute for Science and Mathematics Education

• Ronny Scherer, University of Oslo

• Steffani Sass, IPN - Leibniz Institute for Science and Mathematics Education

• Stefan Schipolowski, Humboldt University