Evolving Critiques and Innovations in International Large-Scale Assessments (ILSAs): Regional, Theoretical, and Practical Perspectives

Group Submission Type: Formal Panel Session

Proposal

Panel Overview:

International Large-Scale Assessments (ILSAs) have played a significant role in shaping educational policy worldwide by providing robust data that allows for cross-national comparisons of student achievement and other key indicators. However, as ILSAs continue to evolve, they face increasing scrutiny from both within and outside the assessment community. Criticisms range from concerns about their neoliberal ideological underpinnings to challenges in accommodating diverse local contexts within a global assessment framework. As ILSAs continue to influence educational reforms and policymaking, it is essential to critically engage with both their positive contributions and the valid concerns they raise.

This panel brings together leading experts from the field to explore the evolving critiques and innovations in ILSAs. Panelists will offer unique insights into different facets of ILSAs, including the development of non-traditional domains, the role of regional assessments, and the integration of new methodologies to better serve heterogeneous populations. The discussion will also address the growing influence of digital technologies in assessments and their implications for both data collection and policy impact.

By focusing on both the theoretical and practical dimensions of ILSAs, this panel aims to provide a balanced examination of the challenges and opportunities facing these assessments in the 21st century. Given the rapid technological advancements and the shifting needs of education systems globally, it is critical to reassess how ILSAs can continue to serve as effective tools for improving educational outcomes while also addressing concerns about inclusivity, validity, and the fair use of data. This panel is especially timely, as educational systems worldwide grapple with the post-pandemic shift toward digital learning environments and the increasing role of data in policy formation. The panel’s insights will be valuable to policymakers, educators, and researchers looking to navigate the future of global and regional assessments.
Panelists:

1. Dr. Dirk Hastedt
Affiliation: Executive Director, IEA
Contribution: As Executive Director of the IEA, Dr. Hastedt will discuss the decision-making process behind domain and instrument selection in large-scale assessments. He will reflect on how IEA studies have evolved over time and what challenges lie ahead in aligning assessments with the rapidly changing educational landscape. Dr. Hastedt will also provide a strategic overview of IEA's role in international educational policy discussions.
2. Dr. Maria Magdalena Isac
Affiliation: International Study Director, ICCS, University of Bath
Contribution: Dr. Isac will lend her expertise on measuring non-traditional domains within ILSAs, such as civic education, highlighting both the challenges and opportunities inherent in assessing these areas. She will discuss how these domains contribute to a more comprehensive understanding of educational outcomes and societal needs in a digital society.
3. Dr. Leslie Rutkowski
Affiliation: Professor, Indiana University
Contribution: Dr. Rutkowski will focus on the future of ILSAs, specifically how emerging methods, are transforming how we assess and understand educational outcomes. As chair of the PISA Technical Advisory Group, she will provide a forward-looking perspective on how new technologies and statistical innovations are shaping the future of international assessments.
4. Dr. Ernest Treviño
Affiliation: Associate Professor, Pontifical Catholic University of Chile
Contribution: Dr. Treviño will present on the role of regional assessments, focusing on his work with ERCE. He will explore how regional assessments contribute to educational policy formation and discuss both the advantages and limitations of these assessments in addressing local needs while fitting into a global educational framework.

Moderator:
Dr. David Rutkowski
Affiliation: Professor, Indiana University
Role: Dr. Rutkowski will moderate the panel, guiding the discussion and ensuring a broad exploration of the themes outlined. His expertise in ILSAs and global educational policy will help frame the conversation and engage the audience in a meaningful discussion.

Key Questions for Discussion:
1. How do ILSAs navigate the tension between global comparability and the diversity of local contexts? What steps can be taken to better accommodate context-specific educational needs within a global framework?
2. Non-traditional domains, such as civic education or social-emotional learning, are increasingly integrated into ILSAs. What are the key challenges in measuring these domains, and how can assessments balance rigor with flexibility in addressing context-specific variations?
3. Regional assessments, such as ERCE, offer a more contextually relevant view of education. What are the key strengths and limitations of regional assessments in shaping educational policy, and how can they address local needs while maintaining global credibility?
4. What are some of the most significant critiques of ILSAs, particularly in terms of their perceived ideological bias or their use in policy formation? How can these assessments evolve to address such criticisms and ensure they are seen as tools for improving educational outcomes?
5. With new methodologies and technologies being integrated into ILSAs, what are the ethical considerations related to data privacy, fairness, and inclusion that should guide future developments?

Relevance to CIES 2025 Theme:
This panel aligns closely with the CIES 2025 conference theme, "Envisioning Education in a Digital Society." By examining the role of large-scale assessments in an increasingly digital and connected world, the panel will explore how assessments can evolve to meet the needs of modern societies, while addressing the challenges posed by digital transformations. The panelists' diverse perspectives on ILSAs—from non-traditional domains to regional assessments—will ensure a comprehensive discussion on the future of education in a rapidly changing global landscape.

Sub Unit

• Large-Scale Cross-National Studies in Education SIG

Chair

• David Joseph Rutkowski, Indiana University

Individual Presentations

• Evolving Critiques and Innovations in International Large-Scale Assessments (ILSAs): Theoretical Perspectives - Maria Magdalena Isac, KU Leuven

• Evolving Critiques and Innovations in International Large-Scale Assessments (ILSAs): Practical Perspectives - Dirk Hastedt, IEA

• Evolving Critiques and Innovations in International Large-Scale Assessments (ILSAs): Regional Perspectives - Ernesto Treviño, Pontificia Universidad Catolica de Chile