Rasch Analysis of Conference Proposal Ratings

• In Event: Poster Session 14
  In Poster Session: Topics in Survey Research

Abstract

Reviewers rate submitted proposals every year for the American Educational Research Association (AERA) using a rating scale on pre-determined categories. An overall score is produced by averaging out the raw scores or a weighted score. Here, an example is presented from an earlier conference for a special interest group submission process. Categories are sought to address the issues that were of importance to the group. The Rasch model was used to analyze the ratings to uncover additional information and assess reliability and validity of ratings. Establishing an effective method of determining the acceptance or rejection of proposals at any conference is beneficial. Given the rating scale framework, the survey research lens is ideal for the investigation.

Authors

• Kelly D. Bradley, University of Kentucky

• Richard Kweku Mensah, University of Kentucky