A Performance Benchmark of NetFlow Data Analysis on Distributed
Stream Processing Systems

D 2016

A Performance Benchmark of NetFlow Data Analysis on Distributed Stream Processing Systems

ČERMÁK, Milan; Daniel TOVARŇÁK; Martin LAŠTOVIČKA a Pavel ČELEDA

Základní údaje

Originální název

A Performance Benchmark of NetFlow Data Analysis on Distributed Stream Processing Systems

Název česky

Výkonnostní srovnání nástrojů pro distribuované zpracování dat na základě analýzy NetFlow

Autoři

ČERMÁK, Milan; Daniel TOVARŇÁK; Martin LAŠTOVIČKA a Pavel ČELEDA

Vydání

Istanbul, Turkey, NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium, od s. 919-924, 6 s. 2016

Nakladatel

IEEE Xplore Digital Library

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

10201 Computer sciences, information science, bioinformatics

Stát vydavatele

Spojené státy

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

paměťový nosič (CD, DVD, flash disk)

Odkazy

URL

Označené pro přenos do RIV

Ano

Kód RIV

RIV/00216224:14610/16:00087595

Organizační jednotka

Ústav výpočetní techniky

ISBN

978-1-5090-0223-8

Klíčová slova anglicky

Performance benchmark;NetFlow;Stream Processing

Štítky

rivok

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 23. 4. 2020 11:46, Mgr. Alena Mokrá

Anotace

V originále

Modern distributed stream processing systems can be potentially applied to real time network flow processing. However, differences in performance make some systems more suitable than others for being applied in this domain. We propose a novel performance benchmark which is based on a common security analysis algorithms of NetFlow data, to determine the suitability of distributed stream processing system. Three of the most used distributed stream processing systems are benchmarked and results are compared with identified NetFlow data processing challenges and requirements. Benchmark results show that each system reached a sufficient data processing speed using basic deployment scenario with little to no configuration tuning. Our benchmark, unlike any other, enables to determine a performance of processing small structured messages on any stream processing system.

Návaznosti

TA04010062, projekt VaV

Název: Technologie pro zpracování a analýzu síťových dat velkého rozsahu

Přiložené soubory

dsp-systems-benchmark.zip Verze souboru

presentation.pdf

paper.pdf

Citovat

ČERMÁK, Milan; Daniel TOVARŇÁK; Martin LAŠTOVIČKA a Pavel ČELEDA. A Performance Benchmark of NetFlow Data Analysis on Distributed Stream Processing Systems. In Sema Oktug, Mehmet Ulema, Cicek Cavdar, Lisandro Zambenedetti Granville, Carlos Raniery P. dos Santos. NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium. Istanbul, Turkey: IEEE Xplore Digital Library, 2016, s. 919-924. ISBN 978-1-5090-0223-8. Dostupné z: https://doi.org/10.1109/NOMS.2016.7502926.

@inproceedings{1323006,
   author = {Čermák, Milan and Tovarňák, Daniel and Laštovička, Martin and Čeleda, Pavel},
   address = {Istanbul, Turkey},
   booktitle = {NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium},
   doi = {https://doi.org/10.1109/NOMS.2016.7502926},
   editor = {Sema Oktug, Mehmet Ulema, Cicek Cavdar, Lisandro Zambenedetti Granville, Carlos Raniery P. dos Santos},
   keywords = {Performance benchmark;NetFlow;Stream Processing},
   howpublished = {paměťový nosič},
   language = {eng},
   location = {Istanbul, Turkey},
   isbn = {978-1-5090-0223-8},
   pages = {919-924},
   publisher = {IEEE Xplore Digital Library},
   title = {A Performance Benchmark of NetFlow Data Analysis on Distributed Stream Processing Systems},
   url = {http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7502926},
   year = {2016}
}

TY  - CONF
ID  - 1323006
AU  - Čermák, Milan - Tovarňák, Daniel - Laštovička, Martin - Čeleda, Pavel
PY  - 2016
TI  - A Performance Benchmark of NetFlow Data Analysis on Distributed Stream Processing Systems
PB  - IEEE Xplore Digital Library
CY  - Istanbul, Turkey
SN  - 9781509002238
KW  - Performance benchmark;NetFlow;Stream Processing
UR  - http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7502926
L2  - http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7502926
N2  - Modern distributed stream processing systems can be potentially applied to real time network flow processing. However, differences in performance make some systems more suitable than others for being applied in this domain. We propose a novel performance benchmark which is based on a common security analysis algorithms of NetFlow data, to determine the suitability of distributed stream processing system. Three of the most used distributed stream processing systems are benchmarked and results are compared with identified NetFlow data processing challenges and requirements. Benchmark results show that each system reached a sufficient data processing speed using basic deployment scenario with little to no configuration tuning. Our benchmark, unlike any other, enables to determine a performance of processing small structured messages on any stream processing system.
ER  -

ČERMÁK, Milan; Daniel TOVARŇÁK; Martin LAŠTOVIČKA a Pavel ČELEDA. A Performance Benchmark of NetFlow Data Analysis on Distributed Stream Processing Systems. In Sema Oktug, Mehmet Ulema, Cicek Cavdar, Lisandro Zambenedetti Granville, Carlos Raniery P. dos Santos. \textit{NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium}. Istanbul, Turkey: IEEE Xplore Digital Library, 2016, s.~919-924. ISBN~978-1-5090-0223-8. Dostupné z: https://doi.org/10.1109/NOMS.2016.7502926.

Přehled o publikaci