Measuring Noncognitive Facets in Computer-Based Problem-Solving Assessments by Using Embedded Experience Sampling

• In Event: Computerized Testing: New Developments and Comparability Issues

Abstract

Although non-cognitive facets—such as interest, attitudes, commitment, self-concept and so on—are prevalent in contemporary theoretical modeling of competence, they are often neglected in measurement approaches or measured only by distal self-report questionnaires. Based on the well-established experience sampling method (ESM) and following approaches to measure interest in PISA 2006, we developed a method—‘Embedded Experience Sampling’ (EES)—to measure non-cognitive facets of problem-solving competence in computer-based problem scenarios. In this paper, we describe the implementation of EES and present first empirical results by the example of self-concept. EES proofed to be sensible for situational and individual influences. As expected, a scale obtained from EES items correlated only moderately with a traditional self-report questionnaire on work-related self-concept.

Authors

• Andreas Rausch, University of Bamberg

• Juergen Seifried, University of Mannheim

• Kristina Koegler, University Frankfurt am Main

• Steffen Brandt, OpenCampus.sh, Germany

• Rebecca Eigenmann, University of Mannheim

• Christin Siegfried, Goethe University