TY - JOUR
T1 - A contextual framework to standardise the communication of machine learning cyber security characteristics
AU - Alshaikh, Omar
AU - Parkinson, Simon
AU - Khan, Saad
N1 - Publisher Copyright:
© 2025 The Author(s)
PY - 2025/4/30
Y1 - 2025/4/30
N2 - The widespread integration of machine learning (ML) across diverse application domains has substantially impacted business and personnel. Notably, ML applications in cybersecurity have gained increased prominence, reflecting a discernible trend towards adoption. However, the decisions surrounding ML adoption are susceptible to external influences, potentially resulting in misinterpreting ML capabilities. The communication used when for incorporating ML into cybersecurity applications lacks standardisation and is influenced by various factors such as personal experience, organisational reputation, and marketing strategies. Furthermore, the application of metrics to assess model performance is characterised by dependence, disarray, and subjectivity, introducing probabilities, uncertainties, and the potential for misinterpretation. The different metrics allow for variability in how capability is communicated, often dependent on the restrictive use case, leading to a lack of certainty in their interpretation. Previous research has highlighted the need for a standardised approach. Building upon our earlier work, this paper aims to authenticate beneficiaries' perception of Machine Learning Cybersecurity (MLCS) capabilities, before consulting with domain experts through a focus group to elucidate a prototype standard for comprehending MLCS capabilities, offering a pivotal roadmap and an initial framework for a comprehensive understanding and effective communication of MLCS capabilities in practical implementations.
AB - The widespread integration of machine learning (ML) across diverse application domains has substantially impacted business and personnel. Notably, ML applications in cybersecurity have gained increased prominence, reflecting a discernible trend towards adoption. However, the decisions surrounding ML adoption are susceptible to external influences, potentially resulting in misinterpreting ML capabilities. The communication used when for incorporating ML into cybersecurity applications lacks standardisation and is influenced by various factors such as personal experience, organisational reputation, and marketing strategies. Furthermore, the application of metrics to assess model performance is characterised by dependence, disarray, and subjectivity, introducing probabilities, uncertainties, and the potential for misinterpretation. The different metrics allow for variability in how capability is communicated, often dependent on the restrictive use case, leading to a lack of certainty in their interpretation. Previous research has highlighted the need for a standardised approach. Building upon our earlier work, this paper aims to authenticate beneficiaries' perception of Machine Learning Cybersecurity (MLCS) capabilities, before consulting with domain experts through a focus group to elucidate a prototype standard for comprehending MLCS capabilities, offering a pivotal roadmap and an initial framework for a comprehensive understanding and effective communication of MLCS capabilities in practical implementations.
KW - Machine learning
KW - Cybersecurity
KW - Capabilities
KW - ML application
KW - Perception
KW - Cybercrime
KW - Template analysis
KW - Focus group
UR - http://www.scopus.com/inward/record.url?scp=105003800679&partnerID=8YFLogxK
U2 - 10.1016/j.csi.2025.104015
DO - 10.1016/j.csi.2025.104015
M3 - Article
VL - 94
JO - Computer Standards and Interfaces
JF - Computer Standards and Interfaces
SN - 0920-5489
M1 - 104015
ER -