The Evaluation Game: Why the Context of Implementation of Research Evaluation Systems Matters
- Emanuel Kulczycki, Adam Mickiewicz University in Poznań and West Pomeranian University of Technology in Szczecin (Poland)
Event Materials
This event is now archived and we are pleased to provide the following event media and assets, along with the original event overview.
Today, researchers are publishing more than ever before. New assistant professors have already published twice as much as their peers did in the early 1990s to secure a position in top departments or to achieve tenure. Nobel laureate Peter Higgs believes he wouldn’t be deemed “productive” enough for academia in today’s world. However, merely publishing more papers doesn’t suffice. The number of citations those papers receive is the true currency in science.
Rudolf Weigl, a Polish biologist who invented the first effective vaccine against typhus, described the practice of publishing many papers as ‘duck shit’: just as ducks leave a lot of traces while walking about in a yard, scientists hastily publish articles with partial results that are the product of underdeveloped thought. This is one of the unfortunate outcomes of the evaluation game in today’s science, where researchers attempt to follow various evaluation rules and meet metrics-based expectations.
Counting scholarly publications has been practiced for two centuries. In Russia from the 1830s, professors had to publish yearly to determine their salaries. The Soviet Union and various socialist countries developed national research evaluation systems before the Western world. The effects of those practices are still vital.
In my talk, I will use the concept of the ‘evaluation game’ developed in my recent book (The Evaluation Game: How Scholarly Metrics Shape Scholarly Communication, CUP 2023) to show how this concept can enrich our understanding of how researchers, institutions, and other stakeholders respond to pressures generated by metrics and research evaluation exercises.
I will offer a fresh take on the origins and effects of metrics in academia, as well as suggest ways to improve research evaluation. I will show why the phenomenon of predatory publishing has not only geopolitical aspects but that publishing in so-called predatory journals might be perceived at the (semi)periphery as a justified and rational way to in accordance with institutional loyalty.
Event Notes
Please find the General Privacy Policy of UCL, one of our partner universities, here: https://www.ucl.ac.uk/legal-services/privacy/general-privacy-notice
Share this event
Emanuel Kulczycki is Associate Professor of Scholarly Communication at the Adam Mickiewicz University in Poznań and Research Professor of Computer Science at the West Pomeranian University of Technology in Szczecin (Poland). He was the chair of the European Network for Research Evaluation in the Social Sciences and the Humanities (2018-2020) and a co-founder of the Helsinki Initiative on Multilingualism in Scholarly Communication. He recently published The Evaluation Game. How Publication Metrics Shape Scholarly Communication (Cambridge University Press, 2023) and coedited Handbook on Research Assessment in the Social Sciences (Edward Elgar Publishing, 2022). For more information, visit emanuelkulczycki.com
