Automated Feedback for Participants of Hands-on Cybersecurity
Training

J 2023

Automated Feedback for Participants of Hands-on Cybersecurity Training

ŠVÁBENSKÝ, Valdemar, Jan VYKOPAL, Pavel ČELEDA a Ján DOVJAK

Základní údaje

Originální název

Automated Feedback for Participants of Hands-on Cybersecurity Training

Autoři

ŠVÁBENSKÝ, Valdemar (703 Slovensko, garant, domácí), Jan VYKOPAL (203 Česká republika, domácí), Pavel ČELEDA (203 Česká republika, domácí) a Ján DOVJAK (703 Slovensko, domácí)

Vydání

Education and Information Technologies, Springer, 2023, 1360-2357

Další údaje

Jazyk

angličtina

Typ výsledku

Článek v odborném periodiku

Obor

10201 Computer sciences, information science, bioinformatics

Stát vydavatele

Spojené státy

Utajení

není předmětem státního či obchodního tajemství

Odkazy

Open-access article

Impakt faktor

Impact factor: 5.500 v roce 2022

Kód RIV

RIV/00216224:14330/23:00131829

Organizační jednotka

Fakulta informatiky

DOI

http://dx.doi.org/10.1007/s10639-023-12265-8

UT WoS

001091913600002

Klíčová slova anglicky

cybersecurity education; interactive learning environments; hands-on training; virtual labs; shell commands

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 16. 3. 2024 14:22, doc. Ing. Pavel Čeleda, Ph.D.

Anotace

V originále

Computer-supported learning technologies are essential for conducting hands-on cybersecurity training. These technologies create environments that emulate a realistic IT infrastructure for the training. Within the environment, training participants use various software tools to perform offensive or defensive actions. Usage of these tools generates data that can be employed to support learning. This paper investigates innovative methods for leveraging the trainee data to provide automated feedback about the performed actions. We proposed and implemented feedback software with four modules that are based on analyzing command-line data captured during the training. The modules feature progress graphs, conformance analysis, activity timeline, and error analysis. Then, we performed field studies with 58 trainees who completed cybersecurity training, used the feedback modules, and rated them in a survey. Quantitative evaluation of responses from 45 trainees showed that the feedback is valuable and supports the training process, even though some features are not fine-tuned yet. The graph visualizations were perceived as the most understandable and useful. Qualitative evaluation of trainees' comments revealed specific aspects of feedback that can be improved. We publish the software as an open-source component of the KYPO Cyber Range Platform. Moreover, the principles of the automated feedback generalize to different learning contexts, such as operating systems, networking, databases, and other areas of computing. Our results contribute to applied research, the development of learning technologies, and the current teaching practice.

Návaznosti

101087529, interní kód MU

Název: Cyber-security Excellence Hub in Estonia and South Moravia (CHESS)

Investor: Evropská unie, Cyber-security Excellence Hub in Estonia and South Moravia (CHESS), Rozšiřování účasti a posílení ERA

Přiložené soubory

2023-EaIT-automated-feedback-participants-hands-on-cybersecurity-training-paper.pdf

Vyhledat podobné dokumenty

Citovat

ŠVÁBENSKÝ, Valdemar, Jan VYKOPAL, Pavel ČELEDA a Ján DOVJAK. Automated Feedback for Participants of Hands-on Cybersecurity Training. Education and Information Technologies. Springer, 2023, roč. 2023, č. 11, s. 1-30. ISSN 1360-2357. Dostupné z: https://dx.doi.org/10.1007/s10639-023-12265-8.

@article{2319997,
   author = {Švábenský, Valdemar and Vykopal, Jan and Čeleda, Pavel and Dovjak, Ján},
   article_number = {11},
   doi = {http://dx.doi.org/10.1007/s10639-023-12265-8},
   keywords = {cybersecurity education; interactive learning environments; hands-on training; virtual labs; shell commands},
   language = {eng},
   issn = {1360-2357},
   journal = {Education and Information Technologies},
   title = {Automated Feedback for Participants of Hands-on Cybersecurity Training},
   url = {https://link.springer.com/article/10.1007/s10639-023-12265-8},
   volume = {2023},
   year = {2023}
}

TY  - JOUR
ID  - 2319997
AU  - Švábenský, Valdemar - Vykopal, Jan - Čeleda, Pavel - Dovjak, Ján
PY  - 2023
TI  - Automated Feedback for Participants of Hands-on Cybersecurity Training
JF  - Education and Information Technologies
VL  - 2023
IS  - 11
SP  - 1-30
EP  - 1-30
PB  - Springer
SN  - 13602357
KW  - cybersecurity education
KW  - interactive learning environments
KW  - hands-on training
KW  - virtual labs
KW  - shell commands
UR  - https://link.springer.com/article/10.1007/s10639-023-12265-8
N2  - Computer-supported learning technologies are essential for conducting hands-on cybersecurity training. These technologies create environments that emulate a realistic IT infrastructure for the training. Within the environment, training participants use various software tools to perform offensive or defensive actions. Usage of these tools generates data that can be employed to support learning. This paper investigates innovative methods for leveraging the trainee data to provide automated feedback about the performed actions. We proposed and implemented feedback software with four modules that are based on analyzing command-line data captured during the training. The modules feature progress graphs, conformance analysis, activity timeline, and error analysis. Then, we performed field studies with 58 trainees who completed cybersecurity training, used the feedback modules, and rated them in a survey. Quantitative evaluation of responses from 45 trainees showed that the feedback is valuable and supports the training process, even though some features are not fine-tuned yet. The graph visualizations were perceived as the most understandable and useful. Qualitative evaluation of trainees' comments revealed specific aspects of feedback that can be improved. We publish the software as an open-source component of the KYPO Cyber Range Platform. Moreover, the principles of the automated feedback generalize to different learning contexts, such as operating systems, networking, databases, and other areas of computing. Our results contribute to applied research, the development of learning technologies, and the current teaching practice.
ER  -

ŠVÁBENSKÝ, Valdemar, Jan VYKOPAL, Pavel ČELEDA a Ján DOVJAK. Automated Feedback for Participants of Hands-on Cybersecurity Training. \textit{Education and Information Technologies}. Springer, 2023, roč.~2023, č.~11, s.~1-30. ISSN~1360-2357. Dostupné z: https://dx.doi.org/10.1007/s10639-023-12265-8.

Podrobný výpis o publikaci