Ratings Versus Rankings: How Should We Measure Principal Preferences?

• In Event: Roundtable Session 60
  In Roundtable Session: Collection of Behavioral Information

Abstract

This paper uses two data sources tapping similar constructs to examine how the type of measure used to collect survey data influences results. Using data from recent surveys of school principals about their preferences for teacher characteristics, we compare responses when principals are asked to rate their preferences using a Likert scale and then to rank the three most important characteristics from the same items. We use qualitative interview data collected in tandem with surveys to gain additional insight into principals’ responses. Results will inform survey research practices in measuring preferences in educational settings, particularly in regards to teacher quality and evaluation decisions, as well as in understanding preferences and values, which are the target of many recent policy debates.

Authors

• Mimi Engel, Vanderbilt University

• Marisa A. Cannata, Vanderbilt University