Validation of a Peer Observation for Teaching Evaluation Tool

• In Event: Validity and Instrument Development in Professions Education

Abstract

Peer review of lessons and instruction are helpful in promoting quality teaching practices. There is no validated and reliable single-lesson, peer evaluation instrument available for online instruction. Moreover, no observation tool exists for online instruction that includes criteria equivalent to that of an in-person peer evaluation. This lack of equity across in-person and online lessons poses a challenge for the peer evaluation process. Using Many-Facets Rasch Models, the proposed study focuses on establishing multifaceted reliability beyond inter-rater reliability, establishing validity beyond content validity, and developing teaching evaluation systems capable of producing reliable teaching evaluation scores for both asynchronous and synchronous lesson in an inter-professional education setting. The preliminary results demonstrated favorable evidence supporting its usage for peer evaluation.

Authors

• Yuane Jia, Rutgers University

• Amy Spagnolo

• Stuart Luther