Search
Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Committee or SIG
Browse By Session Type
Browse By Keywords
Browse By Geographic Descriptor
Partner Organizations
Search Tips
Personal Schedule
Sign In
International large-scale assessments (ISLA) have become increasingly used as tools for monitoring the effectiveness of educational systems. This paper considers some assumptions behind the inclusion of non-cognitive constructs in ILSAs. Identifying how learning contexts, processes, attitudes and other non-cognitive factors are associated with achievement can inform policy and practice in more productive ways. Garcia (2014) outlines the noncognitive skills that support the development of cognitive skills and that should be pursued by schools through instruction and social interaction: “patterns of thought, feelings and behavior …socio- emotional or behavioral characteristics that are not fixed traits of personality” (Garcia, 2014, p.6).
Understanding relations between attitudinal variables and achievement can be especially informative for future practice. However, these are not necessarily simple linear causal relations and other factors need to be considered for interpretation. Understanding these relations depends on well-developed theory to articulate the models that form the basis of any investigations and sound measurement of the constructs at the heart of those models. Multivariate modeling of the relations between attitudes and reading literacy performance, yielded patterns of association that were consistent across countries. Across both reading waves (PISA 2000 and PISA 2009) the focus on engagement as habits of reading behaviour suggests productive ways for understanding how students across all countries interact with and learn from reading materials.
One of the unexpected finding of achievement and attitudes in ISLA’s is referred to as the “attitude-achievement paradox.” In cross national studies, positive associations are found between non-cognitive variables and achievement at the student-level but these associations become negative in between-country comparison of means. This paradox has been documented across domains and replicated across assessment cohorts. Also, according to Van de gaer and colleagues, this attitude- achievement paradox has been observed in PISA, TIMSS and PIRLS and has “been found consistently across different subjects, grades, and cohorts” (Van de gaer, Grisay, Schulz, & Gebhardt, 2012, p.1206). Large-scale survey databases such as those generated by TIMSS and PISA provide researchers with opportunities to explore how countries differ in patterns of achievement, attitudes and values. We will use some of the findings of recent secondary analyses to explore both measurement and substantive cultural factors that might be contributing to this widely documented attitude-achievement paradox.
We consider research findings from both PISA and TIMMS in subjects of science, mathematics, and reading that offer some insights for disentangling strands of the paradox. Our consideration of the research literature attempting to disentangle the attitude-achievement paradox suggests that simple comparisons between countries are likely to be invalid, inappropriate, and misleading. Measurement issues affect some relationships. For example, self-concept items require students to generate their own frame of reference whereas self-efficacy items supply a concrete frame of reference. Across several PISA waves self-concept scores consistently have shown the attitude-achievement paradox effect while self-efficacy scores are positively associated with achievement at both the student-level and the country-level. These differential effects are attributed to the concreteness of the frame of reference. Other explanations for the paradox are explored more fully in the paper.