Generalizability Theory: Some History, Extensions, and Comparisons With Other Theories

• In Event: AERA Division D Robert L. Linn Distinguished Award Address by 2019 Awardee Robert L. Brennan

Abstract

This address begins with a brief consideration of the “big picture” of Generalizability (G) Theory and precursors to the theory. Major features of the conceptual framework of Univariate G Theory are discussed. An overview of Multivariate G theory (MGT) is provided, and certain extensions of MGT are proposed that enable modeling tables of content specifications for different types of tests. Finally, a conceptual framework is proposed that facilitates a coherent comparison of important aspects of Classical Test Theory, G theory, MGT, and Item Response Theory. Throughout this presentation, major attention is given to the conceptualization and estimation of standard errors of measurement.

Robert L. Brennan is E. F. Lindquist Chair, Emeritus, and Founding Director of the Center for Advanced Studies in Measurement and Assessment (CASMA), in the College of Education of The University of Iowa. He is the author or co-author of numerous journal articles and several books including Generalizability Theory (2001) and Test Equating, Scaling, and Linking: Methods and Practices (2014). Also, he is the editor of the fourth edition of Educational Measurement (2006). Dr. Brennan has served as Vice-President of Division D of AERA, and President of NCME. He is the co-recipient of the 2000 NCME Award for Career Contributions to Educational Measurement, recipient of the 2004 E. F. Lindquist Award sponsored by the AERA and ACT, and recipient of the 2011 Career Achievement Award from the Association of Test Publishers.

Author

• Robert L. Brennan, University of Iowa