- Browse
Search
On-Site Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Unit
Browse By Session Type
- Information Menu
Search Tips
Annual Meeting Housing and Travel
- Navigation and Settings Menu
Sign In
Examine the Mathematics Classroom Observation Protocol for Practices (MCOP2) Dimensionality Using the Many-Facet Rasch Modeling (Poster 4)
Thu, April 21, 4:15 to 5:45pm PDT (4:15 to 5:45pm PDT), Marriott Marquis San Diego Marina, Floor: North Tower, Ground Level, Pacific Ballroom 18Abstract
Rater-mediated classroom observation protocols are increasingly being used for teaching performance assessments. Due to the methodological limitations of the Classical Test Theory (CTT) approach for rater-mediated assessments, it is imperative to examine the 16-item Mathematics Classroom Observation Protocol for Practices (MCOP2) internal factor structure using the Many-Facet Rasch Modeling (MFRM) technique to implement dimensionality analysis with ratee and rater ability level calibration.
To that end, a combined, multiple-site sample of the MCOP2 classroom observation rating data were analyzed using MFRM. Results showed that both the MCOP2 subscales (i.e., Student Engagement & Teacher Facilitation) were valid, unidimensional, and highly reliable rater-mediated performance measures across raters, ratees, and study samples. However, rater-item bias analyses revealed a type of intra-rater inconsistency.