Individual Submission Summary
Share...

Direct link:

Changing Performance-based Assessment Measures on Academics: A Case Study of a First-tier University in the Chinese Mainland

Mon, April 18, 6:00 to 7:30am CDT (6:00 to 7:30am CDT), Pajamas Sessions, VR 118

Proposal

Introduction
The ability of universities to efficiently produce high-standard knowledge has become an important goal in the policies of many developed countries. Thus, many countries nowadays steer universities based on performance monitoring and competition (Laura et al., 2009). Academics are the credibility of an institution and the source of its intellectual capital (Gappa et al., 2007). They are the essence of human resources and the principal endogenous force of promoting university development and the discipline construction. Therefore, to encourage efficient yet high-quality innovation of academics, a reasonable performance-based assessment system based on scientific methodology is needed.
Previous studies have pointed out that performance-based assessment inspired academics to work hard, inducing high-pressure competition among colleagues; and pressure to publish frequently in high-quality journals. Thus, excessive-performance orientation leads to expansion in publications yet dilution in research quality (Ingo, 2003). Performance-based assessment is wildly adopted in universities in China. The current implementation process of performance-based assessment measures in Chinese universities emphasizes scientific research rather than teaching, quantity rather than qualities, monodirectional rather than reciprocal, which affects the academics' work and their perception of university performance-based assessment measures. Acknowledge the issue at hand, in October 2020, the Chinese government issued the Overall Plan for Deepening the Reform of Education Evaluation in the New Era, aiming to advance the system by modifying the assessment standard.

Conceptual Framework
The influence of performance-based assessment measures has been examined to produce a diverse effect on academics (Patricia & Sherry, 2012; Ingo, 2003). Kevin et al. (Kevin et al., 2016) have identified three dimensions of analyzing performance funding for higher education: policy instruments, organizational obstacles, and impacts. Policy instruments mean specific performance funding policies; Organizational obstacle refers to universities' lack of organizational ability in implementing measures. And there are some expected and unexpected impacts of the measures after their implementation. According to these three dimensions, this study investigates academics' perceptions of the substantial content of university performance-based assessment measures, the implementation process, and how such process affects their work.

Research method
This study will adopt a qualitative research approach to investigate the perception of academics toward both normative and prescriptive aspects of university performance-based assessment measures. There are three research questions:
1.How do academics perceive the performance-based assessment measures at the universities level?
2.How do academics perceive the process of implementation of performance-based assessment measures at the faculty level?
3. How do the university performance-based assessment measures affect the academics' work at the individual level?
This study will conduct in-depth interviews with 20 academics from a first-tier university in the Chinese Mainland. The academics interviewed in this research will be divided into three categories by age, young, middle-aged, and senior. This study presumes age as a key factor of the sampling, as academics of different ages may be highly correlated with the stages of their careers. As the evaluation system applied different measurements according to these stages, diverse perceptions of university performance-based assessment are expected.
This study will use a semi-structured interview that focuses on academics' perceptions of the substantial content of university performance-based assessment measures, the implementation process, and how such process affects their work.

Findings
There are several preliminary observations:
First, when discussing the perception of university performance-based assessment measures, academics believe a reasonable and practical measure would substantially increase their career satisfaction; on the contrary, an unreasonable standard will undoubtedly negatively impact such feeling. For example, young academics in Mainland China enjoy lesser resources, intense competition, unstable and uncertain career positions, and low recognition. Numerous universities implement limitations to an academic career such as "Pre-employment" or "Quasi-employment" and "Promotion or leave" (If unable to be promoted in a certain period, a young academic would have to leave the university as the contract expired), those policies gravely aggravate work pressure of young academics. In addition, a development-oriented assessment may positively promote the performance of academics, while the assessment-oriented method will certainly inhibit their performance.
Second, when talking about the perception of the implementation process of performance-based assessment measures, the academics stressed that the administrators tend to take the assessment process lightly. For example, academics receive no information and feedback before and after the evaluation. Without guidance, they find it difficult to improve performance.
Finally, when asking about the impact of performance-based assessment measures on work, academics noted that they altered their academic activities according to their understanding of the measures. More specifically, the efforts and energy are to be invested into the following of the performance-based assessment measures, yet other objectively important aspects of academic purpose such as social, emotional, and moral development activities that are not directly integrated into the measures' factors. For example, most of the resources of academics (time, energy e.g.) will be poured into quantitative inspection, which is highly valued by the measures. On the other hand, the students' development which is not included in the measures is deemed insignificant and dispensable.

Author