Visual Feedback for Players of Multi-Level Capture the Flag
Games: Field Usability Study

D 2019

Visual Feedback for Players of Multi-Level Capture the Flag Games: Field Usability Study

OŠLEJŠEK, Radek; Vít RUSŇÁK; Karolína BURSKÁ; Valdemar ŠVÁBENSKÝ; Jan VYKOPAL et al.

Základní údaje

Originální název

Visual Feedback for Players of Multi-Level Capture the Flag Games: Field Usability Study

Autoři

OŠLEJŠEK, Radek; Vít RUSŇÁK; Karolína BURSKÁ; Valdemar ŠVÁBENSKÝ a Jan VYKOPAL

Vydání

Vancouver, BC, Canada, 2019 IEEE Symposium on Visualization for Cyber Security (VizSec), od s. 1-11, 11 s. 2019

Nakladatel

IEEE

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

10201 Computer sciences, information science, bioinformatics

Stát vydavatele

Kanada

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

elektronická verze "online"

Odkazy

Preprint na ArXiv.org, Permalink na archiv IEEE

Kód RIV

RIV/00216224:14330/19:00115069

Organizační jednotka

Fakulta informatiky

ISBN

978-1-7281-3876-3

DOI

https://doi.org/10.1109/VizSec48167.2019.9161386

UT WoS

000792443000001

EID Scopus

2-s2.0-85093098511

Klíčová slova anglicky

cybersecurity training; capture the flag games; visual feedback; trainees

Štítky

firank_B

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 3. 10. 2022 16:24, doc. RNDr. Radek Ošlejšek, Ph.D.

Anotace

V originále

Capture the Flag games represent a popular method of cybersecurity training. Providing meaningful insight into the training progress is essential for increasing learning impact and supporting participants' motivation, especially in advanced hands-on courses. In this paper, we investigate how to provide valuable post-game feedback to players of serious cybersecurity games through interactive visualizations. In collaboration with domain experts, we formulated user requirements that cover three cognitive perspectives: gameplay overview, person-centric view, and comparative feedback. Based on these requirements, we designed two interactive visualizations that provide complementary views on game results. They combine a known clustering and time-based visual approaches to show game results in a way that is easy to decode for players. The purposefulness of our visual feedback was evaluated in a usability field study with attendees of the Summer School in Cyber Security. The evaluation confirmed the adequacy of the two visualizations for instant post-game feedback. Despite our initial expectations, there was no strong preference for neither of the visualizations in solving different tasks.

Návaznosti

EF16_019/0000822, projekt VaV

Název: Centrum excelence pro kyberkriminalitu, kyberbezpečnost a ochranu kritických informačních infrastruktur

MUNI/A/1145/2018, interní kód MU

Název: Aplikovaný výzkum na FI: softwarové architektury kritických infrastruktur, bezpečnost počítačových systémů, techniky pro zpracování a vizualizaci velkých dat a rozšířená realita.

Investor: Masarykova univerzita, Aplikovaný výzkum na FI: softwarové architektury kritických infrastruktur, bezpečnost počítačových systémů, techniky pro zpracování a vizualizaci velkých dat a rozšířená realita., DO R. 2020_Kategorie A - Specifický výzkum - Studentské výzkumné projekty

Přiložené soubory

2019-VizSec-visual-feedback-players-multi-level-capture-flag-games-field-usability-study-presentation.pdf

2019-VizSec-visual-feedback-players-multi-level-capture-flag-games-field-usability-study-paper.pdf

Citovat

OŠLEJŠEK, Radek; Vít RUSŇÁK; Karolína BURSKÁ; Valdemar ŠVÁBENSKÝ a Jan VYKOPAL. Visual Feedback for Players of Multi-Level Capture the Flag Games: Field Usability Study. Online. In Gove R., Arendt D., Kohlhammer J., Angelini M., Lyn Paul, C., Bryan C. McKenna S., Prigent N., Najafi P., Sopan A. 2019 IEEE Symposium on Visualization for Cyber Security (VizSec). Vancouver, BC, Canada: IEEE, 2019, s. 1-11. ISBN 978-1-7281-3876-3. Dostupné z: https://doi.org/10.1109/VizSec48167.2019.9161386.

@inproceedings{1549817,
   author = {Ošlejšek, Radek and Rusňák, Vít and Burská, Karolína and Švábenský, Valdemar and Vykopal, Jan},
   address = {Vancouver, BC, Canada},
   booktitle = {2019 IEEE Symposium on Visualization for Cyber Security (VizSec)},
   doi = {https://doi.org/10.1109/VizSec48167.2019.9161386},
   editor = {Gove R., Arendt D., Kohlhammer J., Angelini M., Lyn Paul, C., Bryan C. McKenna S., Prigent N., Najafi P., Sopan A.},
   keywords = {cybersecurity training; capture the flag games; visual feedback; trainees},
   howpublished = {elektronická verze "online"},
   language = {eng},
   location = {Vancouver, BC, Canada},
   isbn = {978-1-7281-3876-3},
   pages = {1-11},
   publisher = {IEEE},
   title = {Visual Feedback for Players of Multi-Level Capture the Flag Games: Field Usability Study},
   url = {https://ieeexplore.ieee.org/document/9161386},
   year = {2019}
}

TY  - CONF
ID  - 1549817
AU  - Ošlejšek, Radek - Rusňák, Vít - Burská, Karolína - Švábenský, Valdemar - Vykopal, Jan
PY  - 2019
TI  - Visual Feedback for Players of Multi-Level Capture the Flag Games: Field Usability Study
PB  - IEEE
CY  - Vancouver, BC, Canada
SN  - 9781728138763
KW  - cybersecurity training
KW  - capture the flag games
KW  - visual feedback
KW  - trainees
UR  - https://ieeexplore.ieee.org/document/9161386
N2  - Capture the Flag games represent a popular method of cybersecurity training. Providing meaningful insight into the training progress is essential for increasing learning impact and supporting participants' motivation, especially in advanced hands-on courses. In this paper, we investigate how to provide valuable post-game feedback to players of serious cybersecurity games through interactive visualizations. In collaboration with domain experts, we formulated user requirements that cover three cognitive perspectives: gameplay overview, person-centric view, and comparative feedback. Based on these requirements, we designed two interactive visualizations that provide complementary views on game results. They combine a known clustering and time-based visual approaches to show game results in a way that is easy to decode for players. The purposefulness of our visual feedback was evaluated in a usability field study with attendees of the Summer School in Cyber Security. The evaluation confirmed the adequacy of the two visualizations for instant post-game feedback. Despite our initial expectations, there was no strong preference for neither of the visualizations in solving different tasks.
ER  -

OŠLEJŠEK, Radek; Vít RUSŇÁK; Karolína BURSKÁ; Valdemar ŠVÁBENSKÝ a Jan VYKOPAL. Visual Feedback for Players of Multi-Level Capture the Flag Games: Field Usability Study. Online. In Gove R., Arendt D., Kohlhammer J., Angelini M., Lyn Paul, C., Bryan C. McKenna S., Prigent N., Najafi P., Sopan A. \textit{2019 IEEE Symposium on Visualization for Cyber Security (VizSec)}. Vancouver, BC, Canada: IEEE, 2019, s.~1-11. ISBN~978-1-7281-3876-3. Dostupné z: https://doi.org/10.1109/VizSec48167.2019.9161386.

Přehled o publikaci