Principles of Developing and Validating Cognitive Diagnostic Assessments in a Computer Interface

• In Event: Developing and Establishing Validity Evidence: In Theory and Practice

Abstract

This paper discusses the principles of developing and validating cognitive diagnostic assessments (CDA) in a computer interface in order to inform and guide the future development of such cognitively-based tests in a rapidly evolving and emergent field. We illustrate these principles by describing the development and validation process through a specific example of a CDA that assesses French as a second language for academic purposes (FSL for AP) using a computer interface. While a few tests have explored the potential of such CBLTs to provide diagnostic information to test-takers for English language tests, to our knowledge, there are no diagnostic computer-based language tests that assess FSL for AP, and none that are based on CDA principles.

Authors

• Maryam Wagner, OISE/University of Toronto

• Maggie Dunlop, University of Toronto - OISE

• Eunice Eunhee Jang, University of Toronto

• Francoise Mougeon, York University