A Microscope for Lessons: Learning From the DARMA (Dual Axis Rating and Media Annotation) Method for Continuous Evaluation of Educational Experience

Session Type: Demonstration/Performance

Abstract

We often ask students to evaluate teachers, but it remains hard to use this information to improve teaching. We discuss educational uses of a new method (DARMA - Dual Axis Rating and Media Annotation) for collecting continuous evaluation of educational experiences. We will give a hands-on demonstration, discuss statistical issues with modeling these data, and consider two applications of this method – 1) understanding how first impressions and lesson quality affect student experience of learning, and 2) looking at how instructor gender affects student evaluation of instruction. The approach has the potential to help us improve student learning and engagement by connecting instructional moves with student evaluations in a way that may be more useful than summative evaluations.

Sub Unit

• Division D - Measurement and Research Methodologies / Division D - Section 1: Psychometrics, Measurement, and Assessment

Chair

• Hans Anand Pant, Humboldt University - Berlin

Papers

• Continuous Evaluation of Educational Experiences: Introduction to Dual Axis Rating and Media Annotation - Kevin F. Miller, University of Michigan - Ann Arbor

• Effects of First Impressions and Instructional Quality on Student Engagement: A Continuous Evaluation - Inah Park, University of Michigan; Yizhen Huang, University of Michigan - Ann Arbor; Xin Sun, University of Michigan - Ann Arbor

• Gender in the Classroom: The Influence of a Professor's Gender on a Student's Impression and Lecture Evaluation - Snehanjani Edupuganti; Kevin F. Miller, University of Michigan - Ann Arbor

• Time Series Analysis of Dual Axis Rating and Media Annotation Data - Kai S. Cortina, University of Michigan