Reliability of Teacher Ratings Under the University of California, Los Angeles, IMPACT Observation Framework: Conceptual Foundations and Generalizability Studies

• In Event: 31.036 - Evaluation of Teaching: Possibilities and Challenges

Abstract

The UCLA Teacher Education Program (TEP) provides support and structured feedback to novice teachers learning their craft in the field. Throughout the program, field supervisors provide feedback, structured around observation forms aligned with the California Standards for the Teaching Profession. Since 2009, the program set out to develop a new observation tool for secondary mathematics and science apprentices. Based on the research knowledge base on math and science teacher learning, and TEP’s social justice principles, a new framework and observation protocol were developed to assess the teaching quality and impact of teacher apprentices. This document describes the characteristics of the new framework, and the results of a pilot generalizability study conducted to investigate the psychometric properties of the observation protocol.

Authors

• Jaime Park, University of California - Los Angeles

• Imelda Nava, University of California - Los Angeles

• Jose Felipe Martinez, University of California - Los Angeles

• Daniel M. Dockterman, University of California - Los Angeles

• Karen Hunter Quartz, University of California - Los Angeles

• Jarod N. Kawasaki, University of California - Los Angeles