Paper Summary
Share...

Direct link:

A Tutor Feedback Intervention in Problem-Based Learning and Its Effects on Student Learning

Sun, April 15, 12:25 to 1:55pm, Pan Pacific, Floor: Restaurant Level, Pacific Rim 1

Abstract

1. Objectives
The present study researches the effects of a course redesign which focuses on improving student learning outcomes through frequent and structured feedback in a PBL setting.

2. Theoretical Framework
Problem Based Learning (PBL) is known as an effective tool for shaping learning environments, where peers and tutors are used as a source of feedback (Barrett & Moore, 2011). In PBL, feedback is inherent for knowledge acquisition (Norman & Schmidt, 1992). However, its power lies in how it is optimized and explicitly used (Hattie, 2009). Attempts to realize the full potential of PBL focus on changing a number of design variables among which: tutoring behavior, problem design, and small group work (Segers, Van den Bossche & Teunissen, 2003). The importance of these factors for successful PBL implementation has been emphasized in many publications (e.g. Wilkerson & Gijselaers, 1996; Barrett & Moore, 2011). Despite our understanding concerning what optimizes PBL outcomes, it seems we are still underutilizing the learner’s potential. Especially how we encourage feedback giving behavior in the classroom has taken on added urgency (Hattie & Timperley, 2007). Provision of frequent feedback together with students giving self-explanations, seem to be instrumental interventions to optimize student learning (Arts, Gijselaers & Segers, 2006; Chi et al., 1995).
3. Method
We used an experimental design with a randomized control group (Campbell & Stanley, 1963) in which both students and tutors were randomly assigned to the conditions: 91 students in the control and 101 in the experimental group. In the experimental condition, tutors were instructed how to give feedback, while in the control condition, tutors were only informed about the intervention. For both conditions, we first introduced transfer tasks which reflect learning tasks as assessed at the final exam. Next, we assigned small groups of students to collaborate by jointly preparing the tasks before the tutorials. Finally, for the experimental condition only, the tutor provided structured feedback on the tasks.

4. Data Sources and Materials
The participants were freshmen enrolled in an Economics course at a Dutch University in 2010-2011. The outcome measure was student learning; standardized test scores on the final exam (ranging 1 to 10). Both students and tutors were asked about the level of feedback implementation. In the experimental groups, randomly selected sessions were video-recorded.

5. Results and Conclusions
The effect of the feedback intervention on the exam scores was tested in a UNI-ANOVA, after controlling for sufficient participation in the course. Results, F(5,192)=9.30, p<.001, η²=.20, show that students in the experimental condition (M=5.96, SE=.20) significantly outperformed students in the control group (M=5.42, SE=.22) on exam scores. This difference represented a medium effect size (Cohen’s d= .37).

6. Scientific Significance
This research demonstrates the effects of feedback on student learning as expressed in improved exam scores. This is in line with previous findings (Hattie & Timperley, 2007) and implies that the potential of PBL can be optimized through frequent and structured feedback. Future interventions should consider the provision of feedback next to changes in course design variables.

Authors