Using Cognitve and Psychometric Theory to Inform Test Specifications

• In Event: Poster Session 10
  In Poster Session: Cognition and Assessment SIG Poster Session

Abstract

The objective of this work is to bring a large-scale, certification/licensure organization’s test specifications into alignment with the requirements of Assessment Engineering (AE; Luecht, 2008). Test specifications should reflect the purpose of the examination, and as such, the emphasis should not only be on content, but also the skills expected to be shown by proficient candidates. To pursue this endeavor, the Revised Bloom’s Taxonomy (Anderson and Krathwohl, 2001) and Cognitive Task Analysis (Clark et al., 2008) are employed to help clearly specify the particular skills germane to the profession. Findings indicate that it is possible to add value to assessment by engaging these frameworks. Also, a case is made that content concerns should make room for cognitive and psychometric concerns.

Authors

• Matthew Joseph Burke, American Institute of Certified Public Accountants

• Richard N. Devore, American Institute of Certified Public Accountants

• Joshua I. Stopek, American Institute of Certified Public Accountants