Search
Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Unit
Browse By Session Type
Browse By Descriptor
Search Tips
Annual Meeting Housing and Travel
Personal Schedule
Sign In
X (Twitter)
In contemplating a collaborative problem solving (CPS) assessment for the National Assessment of Educational Progress (NAEP), the design of the assessment is a paramount consideration. These design decisions are important because they would determine the kinds of inferences about students’ collaborative skills that would be made. The goal for this discussion is to identify the set of factors that have been shown to make a difference in collaboration, which will enable us to design a collaborative task that reflects these factors.
The key design decisions fall into four categories.
1) Human-agent or human-human collaborations: Technical and technology constraints and possibilities must be considered for both approaches. In addition, if an agent (i.e., a human or computer simulated participant) is used, the agent’s sex, ability level, and other background factors must be considered. If a human-human collaborative task is designed, the appropriate size of student groups assigned to a collaboration (pairs, groups of 3, or larger groups) must be determined.
2) The nature of the task: The content domain could cover areas already assessed in NAEP (such as math or science) or outside curricular areas, such as leisure time activities and social and interpersonal activities. In addition, tasks could be well-defined, comprising unambiguous procedures and a correct response or more ill-defined, such that they are more conceptual and contain open-ended responses.
3) Group composition: The performance of an individual inevitably depends on the composition of the group. Groups could be homogeneous or heterogeneous with respect to ability and knowledge, as well as characteristics such as gender or socioeconomic status. In addition, roles can either be assigned or spontaneous.
4) How collaborative problem solving ability will be evaluated: While NAEP only reports group scores, the outcomes of CPS could be evaluated at the individual level, the group level, or by process measures, such as the number of statements related to planning.
These design considerations, and the implications for the kinds of inferences that can be made in NAEP, will be discussed during the session.