Capability Assessment Methodology and Comparative Analysis of
Cybersecurity Training Platforms

J 2023

Capability Assessment Methodology and Comparative Analysis of Cybersecurity Training Platforms

BEURAN, Razvan, Jan VYKOPAL, Daniela BELAJOVÁ, Pavel ČELEDA, Yasuo TAN et. al.

Basic information

Original name

Capability Assessment Methodology and Comparative Analysis of Cybersecurity Training Platforms

Authors

BEURAN, Razvan, Jan VYKOPAL (203 Czech Republic, guarantor, belonging to the institution), Daniela BELAJOVÁ (703 Slovakia, belonging to the institution), Pavel ČELEDA (203 Czech Republic, belonging to the institution), Yasuo TAN and Yoichi SHINODA

Edition

Computers & Security, Elsevier, 2023, 0167-4048

Other information

Language

English

Type of outcome

Článek v odborném periodiku

Field of Study

10201 Computer sciences, information science, bioinformatics

Country of publisher

Netherlands

Confidentiality degree

není předmětem státního či obchodního tajemství

References:

Published version on Elsevier ScienceDirect

Impact factor

Impact factor: 5.600 in 2022

RIV identification code

RIV/00216224:14610/23:00130278

Organization unit

Institute of Computer Science

DOI

http://dx.doi.org/10.1016/j.cose.2023.103120

UT WoS

000934040600001

Keywords in English

capability assessment; comparative analysis; cybersecurity training platforms; cyber range; cybersecurity training exercises

Abstract

V originále

Cybersecurity training is a key endeavour for ensuring that the IT workforce possess the knowledge and practical skills required to counter the ever-increasing cybersecurity threats that our society is faced with. While some related systems, such as Capture The Flag platforms, have been available for almost one decade, platforms that support full-fledged cybersecurity training exercises have only been released as open source in recent years. Given the complexity of such cybersecurity training platforms, the question that arises is how to meaningfully evaluate and compare their capabilities in order to identify the most suitable solution for a given type of organization and/or training activity. In this paper, we introduce a capability assessment methodology for cybersecurity training platforms that focuses on the three key aspects of training: content representation, environment management, and training facilitation. The assessment tool that we developed is used to evaluate two open-source cybersecurity training platforms, CyTrONE and KYPO. We then conduct a comparative analysis of these two platforms based on our first-hand developer experience with them, and discuss the lessons learned from implementing, deploying and using these platforms. The assessment tool and the detailed technical comparative analysis that we conducted are intended as instruments and references for anyone who plans to deploy or develop cybersecurity training platforms.

Links

EF16_019/0000822, research and development project

Name: Centrum excelence pro kyberkriminalitu, kyberbezpečnost a ochranu kritických informačních infrastruktur

MUNI/A/1389/2022, interní kód MU

Name: Aplikovaný výzkum na FI: Bezpečnost počítačových systémů, softwarových architektur kritických infrastruktur s forenzními aspekty, zpracování dat pokročilých sensorů a algoritmy plánování v dopravě a logistice

Investor: Masaryk University

Citovat

BEURAN, Razvan, Jan VYKOPAL, Daniela BELAJOVÁ, Pavel ČELEDA, Yasuo TAN and Yoichi SHINODA. Capability Assessment Methodology and Comparative Analysis of Cybersecurity Training Platforms. Computers & Security. Elsevier, 2023, vol. 128, No 103120, p. 1-14. ISSN 0167-4048. Available from: https://dx.doi.org/10.1016/j.cose.2023.103120.

@article{2252358,
   author = {Beuran, Razvan and Vykopal, Jan and Belajová, Daniela and Čeleda, Pavel and Tan, Yasuo and Shinoda, Yoichi},
   article_number = {103120},
   doi = {http://dx.doi.org/10.1016/j.cose.2023.103120},
   keywords = {capability assessment; comparative analysis; cybersecurity training platforms; cyber range; cybersecurity training exercises},
   language = {eng},
   issn = {0167-4048},
   journal = {Computers & Security},
   title = {Capability Assessment Methodology and Comparative Analysis of Cybersecurity Training Platforms},
   url = {https://www.sciencedirect.com/science/article/pii/S0167404823000305},
   volume = {128},
   year = {2023}
}

TY  - JOUR
ID  - 2252358
AU  - Beuran, Razvan - Vykopal, Jan - Belajová, Daniela - Čeleda, Pavel - Tan, Yasuo - Shinoda, Yoichi
PY  - 2023
TI  - Capability Assessment Methodology and Comparative Analysis of Cybersecurity Training Platforms
JF  - Computers & Security
VL  - 128
IS  - 103120
SP  - 1-14
EP  - 1-14
PB  - Elsevier
SN  - 01674048
KW  - capability assessment
KW  - comparative analysis
KW  - cybersecurity training platforms
KW  - cyber range
KW  - cybersecurity training exercises
UR  - https://www.sciencedirect.com/science/article/pii/S0167404823000305
N2  - Cybersecurity training is a key endeavour for ensuring that the IT workforce possess the knowledge and practical skills required to counter the ever-increasing cybersecurity threats that our society is faced with. While some related systems, such as Capture The Flag platforms, have been available for almost one decade, platforms that support full-fledged cybersecurity training exercises have only been released as open source in recent years. Given the complexity of such cybersecurity training platforms, the question that arises is how to meaningfully evaluate and compare their capabilities in order to identify the most suitable solution for a given type of organization and/or training activity. In this paper, we introduce a capability assessment methodology for cybersecurity training platforms that focuses on the three key aspects of training: content representation, environment management, and training facilitation. The assessment tool that we developed is used to evaluate two open-source cybersecurity training platforms, CyTrONE and KYPO. We then conduct a comparative analysis of these two platforms based on our first-hand developer experience with them, and discuss the lessons learned from implementing, deploying and using these platforms. The assessment tool and the detailed technical comparative analysis that we conducted are intended as instruments and references for anyone who plans to deploy or develop cybersecurity training platforms.
ER  -

BEURAN, Razvan, Jan VYKOPAL, Daniela BELAJOVÁ, Pavel ČELEDA, Yasuo TAN and Yoichi SHINODA. Capability Assessment Methodology and Comparative Analysis of Cybersecurity Training Platforms. \textit{Computers \&{} Security}. Elsevier, 2023, vol.~128, No~103120, p.~1-14. ISSN~0167-4048. Available from: https://dx.doi.org/10.1016/j.cose.2023.103120.

Detailed Information on Publication Record