Making Use of Posttest Survey to Enhance Test Validity

• In Event: 49.088 - Roundtable Session 17
  In Roundtable Session: 49.088-22 - Concepts and Practices in Test Validity

Abstract

A post-test survey is often administered immediately after the completion of the test in many high-stake testing programs to gather feedbacks from the examinees about their test experiences. It sometimes reveals unexpected happenings or possible construct-irrelevant components of a test, which requires further validation analysis. This study demonstrated how to make use of post-test survey data to examine whether the presentation of the Perceptual Ability Test (PAT) items have influenced the examinees’ response selection if they are dissatisfied with it. The result indicated no Differential Item Functioning (DIF) was found among PAT items; gender was not related to the reporting of dissatisfaction but examinee’s test time management and technology may play a role.

Author

• Feng Tian, American Dental Association