Can Domain-Specific Problem-Solving Competence Be Validly Measured Using Computer-Based Assessment?

• In Event: Workplace Learning: Paper Session 2

Abstract

We examine whether it is possible to validly measure domain-specific problem-solving competence for the occupation of electronics technicians for automation technology (ETAT) using CBA. We assume that there is no difference between the competence assessment on the job and in the computer-based environment. To test this hypothesis, we drew a sample of 308 ETAT attending the German dual apprenticeship track. The apprentices worked on eight real-life problems (troubleshooting-scenarios). To compare the computer-based and real-life (troubleshooting on a real automation system) assessment, we created two groups: one group solved problems one to four in real-life, and problems five to eight computer-simulated; the second group solved the items vice versa. The data were analyzed applying a multigroup-structural-equation-approach and confirmed our hypothesis.

Author

• Felix Walker, Technical University of Kaiserslautern