Investigating the role of contextual factors in effectively executing communication evaluation and measurement: A scoping review

Stefania Romenti, Grazia Murtarelli, Angelo Miglietta, Anne Gregory

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Purpose: Evaluation and measurement (E&M) remains a critical and debated topic among communication scholars and practice. Substantial research and professional efforts have been devoted to discussing what should be measured and which methods should be applied. Most of the E&M models seem to carry a positivist imprint. But, in real-life, organizations could not have clear aims, enough resources, or adequate informative systems to support E&M. Moreover, several contextual factors could affect the implementation of E&M management processes. The communication literature rarely highlights these factors. To fulfill this gap, the purpose of this paper is to theorize the contextual factors relevant to the management of the evaluation process. Design/methodology/approach: A scoping literature review was carried out exploring the role of contextual factors and impact of contextual factors on E&M management processes. More specifically, the review examines the contribution provided by program evaluation and performance measurement (PM) fields of research. Findings: The paper provides a scoping review of program evaluation and PM approaches. Additionally, it explains how both streams of thought argued the importance of contextual factors, such as organizational, relational, cultural and communicative factors, for the success of any evaluation processes. The study underlined that the main evaluation models used in the field of communication have overlooked these studies and put on evidence the role of contextual factors in effectively executing communication E&M. Originality/value: The paper enriches the dominant rationale concerning the E&M management processes by incorporating literature on: program evaluation; and PM. The analysis could provide useful insights also from a professional perspective, by helping practitioners for a contextual assessment of strategic communication programs and activities.

LanguageEnglish
Pages228-245
Number of pages18
JournalJournal of Communication Management
Volume23
Issue number3
Early online date3 Jul 2019
DOIs
Publication statusPublished - 5 Aug 2019

Fingerprint

communication
Communication
evaluation
process management
performance measurement
Evaluation
Contextual factors
methodology
Management process
Performance measurement
Program evaluation
management
resources
evidence
literature
Values
Factors

Cite this

@article{c3dcc8fabd2b4e24b531257c3d2d4d67,
title = "Investigating the role of contextual factors in effectively executing communication evaluation and measurement: A scoping review",
abstract = "Purpose: Evaluation and measurement (E&M) remains a critical and debated topic among communication scholars and practice. Substantial research and professional efforts have been devoted to discussing what should be measured and which methods should be applied. Most of the E&M models seem to carry a positivist imprint. But, in real-life, organizations could not have clear aims, enough resources, or adequate informative systems to support E&M. Moreover, several contextual factors could affect the implementation of E&M management processes. The communication literature rarely highlights these factors. To fulfill this gap, the purpose of this paper is to theorize the contextual factors relevant to the management of the evaluation process. Design/methodology/approach: A scoping literature review was carried out exploring the role of contextual factors and impact of contextual factors on E&M management processes. More specifically, the review examines the contribution provided by program evaluation and performance measurement (PM) fields of research. Findings: The paper provides a scoping review of program evaluation and PM approaches. Additionally, it explains how both streams of thought argued the importance of contextual factors, such as organizational, relational, cultural and communicative factors, for the success of any evaluation processes. The study underlined that the main evaluation models used in the field of communication have overlooked these studies and put on evidence the role of contextual factors in effectively executing communication E&M. Originality/value: The paper enriches the dominant rationale concerning the E&M management processes by incorporating literature on: program evaluation; and PM. The analysis could provide useful insights also from a professional perspective, by helping practitioners for a contextual assessment of strategic communication programs and activities.",
keywords = "Evaluation, Organizational effectiveness, Measurement, Organizational performance",
author = "Stefania Romenti and Grazia Murtarelli and Angelo Miglietta and Anne Gregory",
year = "2019",
month = "8",
day = "5",
doi = "10.1108/JCOM-12-2018-0131",
language = "English",
volume = "23",
pages = "228--245",
journal = "Journal of Communication Management",
issn = "1363-254X",
publisher = "Emerald Group Publishing Ltd.",
number = "3",

}

Investigating the role of contextual factors in effectively executing communication evaluation and measurement : A scoping review. / Romenti, Stefania; Murtarelli, Grazia; Miglietta, Angelo; Gregory, Anne.

In: Journal of Communication Management, Vol. 23, No. 3, 05.08.2019, p. 228-245.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Investigating the role of contextual factors in effectively executing communication evaluation and measurement

T2 - Journal of Communication Management

AU - Romenti, Stefania

AU - Murtarelli, Grazia

AU - Miglietta, Angelo

AU - Gregory, Anne

PY - 2019/8/5

Y1 - 2019/8/5

N2 - Purpose: Evaluation and measurement (E&M) remains a critical and debated topic among communication scholars and practice. Substantial research and professional efforts have been devoted to discussing what should be measured and which methods should be applied. Most of the E&M models seem to carry a positivist imprint. But, in real-life, organizations could not have clear aims, enough resources, or adequate informative systems to support E&M. Moreover, several contextual factors could affect the implementation of E&M management processes. The communication literature rarely highlights these factors. To fulfill this gap, the purpose of this paper is to theorize the contextual factors relevant to the management of the evaluation process. Design/methodology/approach: A scoping literature review was carried out exploring the role of contextual factors and impact of contextual factors on E&M management processes. More specifically, the review examines the contribution provided by program evaluation and performance measurement (PM) fields of research. Findings: The paper provides a scoping review of program evaluation and PM approaches. Additionally, it explains how both streams of thought argued the importance of contextual factors, such as organizational, relational, cultural and communicative factors, for the success of any evaluation processes. The study underlined that the main evaluation models used in the field of communication have overlooked these studies and put on evidence the role of contextual factors in effectively executing communication E&M. Originality/value: The paper enriches the dominant rationale concerning the E&M management processes by incorporating literature on: program evaluation; and PM. The analysis could provide useful insights also from a professional perspective, by helping practitioners for a contextual assessment of strategic communication programs and activities.

AB - Purpose: Evaluation and measurement (E&M) remains a critical and debated topic among communication scholars and practice. Substantial research and professional efforts have been devoted to discussing what should be measured and which methods should be applied. Most of the E&M models seem to carry a positivist imprint. But, in real-life, organizations could not have clear aims, enough resources, or adequate informative systems to support E&M. Moreover, several contextual factors could affect the implementation of E&M management processes. The communication literature rarely highlights these factors. To fulfill this gap, the purpose of this paper is to theorize the contextual factors relevant to the management of the evaluation process. Design/methodology/approach: A scoping literature review was carried out exploring the role of contextual factors and impact of contextual factors on E&M management processes. More specifically, the review examines the contribution provided by program evaluation and performance measurement (PM) fields of research. Findings: The paper provides a scoping review of program evaluation and PM approaches. Additionally, it explains how both streams of thought argued the importance of contextual factors, such as organizational, relational, cultural and communicative factors, for the success of any evaluation processes. The study underlined that the main evaluation models used in the field of communication have overlooked these studies and put on evidence the role of contextual factors in effectively executing communication E&M. Originality/value: The paper enriches the dominant rationale concerning the E&M management processes by incorporating literature on: program evaluation; and PM. The analysis could provide useful insights also from a professional perspective, by helping practitioners for a contextual assessment of strategic communication programs and activities.

KW - Evaluation

KW - Organizational effectiveness

KW - Measurement

KW - Organizational performance

UR - http://www.scopus.com/inward/record.url?scp=85068823387&partnerID=8YFLogxK

U2 - 10.1108/JCOM-12-2018-0131

DO - 10.1108/JCOM-12-2018-0131

M3 - Article

VL - 23

SP - 228

EP - 245

JO - Journal of Communication Management

JF - Journal of Communication Management

SN - 1363-254X

IS - 3

ER -