Search
Program Calendar
Browse By Day
Browse By Unit
Browse By Session Submission Type
Browse By Descriptors
Help
About Vancouver
Personal Schedule
Sign In
Objective
This paper introduces details of the intervention used to examine the impact of Educational Curriculum Materials (ECMs). As part of this presentation we describe the Semilla Classroom Observation Protocol (SCOP) (Cervetti, 2008) in an effort to illustrate how we gathered information about each teacher’s teaching and qualitatively analyzed treatment fidelity.
Theoretical Perspective
Research on teacher learning suggests that the most useful knowledge is integrally situated in application/instruction (Borko & Putnam, 1996). As a fundamental part of daily work, curriculum materials are uniquely positioned to support teachers’ engagement with ideas and practices (Ball & Cohen, 1996; Stein, Smith, & Silver, 1999). Research shows that curriculum materials can produce dramatic changes in some teachers’ attitudes toward and approaches to instruction, and can deepen understanding of content-area concepts (Collopy, 2003; Schneider, Krajcik, & Marx, 2000). Curriculum materials that include ECMs designed to support teacher’s knowledge about content, student learning in content domains, and pedagogical decision-making may offer a critical professional development opportunity for all teachers and may include positive outcomes for students (Ball & Cohen, 1996; Cohen & Hill, 1998). Examining the efficacy of such curricula requires research tools that are valid and reliable for measuring fidelity and validity of implementation.
Description of the intervention
The Components of the Intervention The intervention is a specially prepared version of the Seeds of Science/Roots of Reading Planets and Moons unit. Each of the unit’s 40 sessions includes two research-based accommodations for supporting ELLs in meeting language demands of science. The comparison intervention contained ECMs.
Description of the SCOP
No project can progress without examining sources of treatment validity and fidelity. The SCOP—an electronic data capture tool—was designed to document the array of teaching practices employed by teachers of elementary level science. The two-part protocol focuses on literacy and language development activities and instructional accommodations for ELLs. The first is a Classroom Observation Scheme designed to describe instruction using narrative notes and code instruction using a 5-level coding scheme during the observation. The second part is an Implementation Questionnaire—a series of questions that ask the observer to reflect on what was observed and document the implementation of ELL accommodations. Observations are 60 minutes with observers alternating between recording notes (7 minutes) and categorizing observations (3 minutes) for a total of six sets of notes and codes per observation. After two days of training observers interrater reliability for coding instruction was 90% agreement.
SCOP Observation records helped to examine qualitative aspects of the intervention and establish treatment validity. The observations were used with other data sources, (eg. the teacher interview teacher survey questions) to corroborate evidence from the observations.
Scholarly Significance
ELLs are the fastest growing sector of the school age population in the US (U.S. Census, 2009), and are among the most academically vulnerable students (Wong-Fillmore & Snow, 2000). According to Gandara, Maxwell-Jolly & Driscoll (2005) many teachers feel inadequately prepared to work effectively with ELLs, particularly in content areas. This implies a significant need for professional development and supportive curricular materials.