Qualitative Judgement of Research Impact: Domain Taxonomy as a Fundamental Framework for Judgement of the Quality of Research

Fionn Murtagh, Michael Orlov, Boris Mirkin

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

The appeal of metric evaluation of research impact has attracted considerable interest in recent times. Although the public at large and administrative bodies are much interested in the idea, scientists and other researchers are much more cautious, insisting that metrics are but an auxiliary instrument to the qualitative peer-based judgement. The goal of this article is to propose availing of such a well positioned construct as domain taxonomy as a tool for directly assessing the scope and quality of research. We first show how taxonomies can be used to analyze the scope and perspectives of a set of research projects or papers. Then we proceed to define a research team or researcher’s rank by those nodes in the hierarchy that have been created or significantly transformed by the results of the researcher. An experimental test of the approach in the data analysis domain is described. Although the concept of taxonomy seems rather simplistic to describe all the richness of a research domain, its changes and use can be made transparent and subject to open discussions.

Original languageEnglish
Pages (from-to)5-28
Number of pages24
JournalJournal of Classification
Volume35
Issue number1
Early online date22 Mar 2018
DOIs
Publication statusPublished - Apr 2018
Externally publishedYes

    Fingerprint

Cite this