JIRSÍK, Tomáš. Stream4Flow: Real-time IP Flow Host Monitoring using Apache Spark. In NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium. Taipei, Taiwan: IEEE, 2018. p. 1-2. ISBN 978-1-5386-3416-5. doi:10.1109/NOMS.2018.8406132.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name Stream4Flow: Real-time IP Flow Host Monitoring using Apache Spark
Authors JIRSÍK, Tomáš (203 Czech Republic, guarantor, belonging to the institution).
Edition Taipei, Taiwan, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium, p. 1-2, 2 pp. 2018.
Publisher IEEE
Other information
Original language English
Type of outcome Proceedings paper
Field of Study 10201 Computer sciences, information science, bioinformatics
Confidentiality degree is not subject to a state or trade secret
Publication form electronic version available online
WWW URL
RIV identification code RIV/00216224:14610/18:00106894
Organization unit Institute of Computer Science
ISBN 978-1-5386-3416-5
Doi http://dx.doi.org/10.1109/NOMS.2018.8406132
Keywords in English host monitoring; situation awareness; real-time; Stream4Flow
Tags rivok
Tags International impact, Reviewed
Changed by Changed by: Mgr. Alena Mokrá, učo 362754. Changed: 10. 4. 2019 16:20.
Abstract
In this paper, we present Stream4Flow, a framework for cyber situational awareness based on Apache Spark Streaming. We demonstrate utilization of Stream4Flow for real-time IP flow host monitoring in a large campus network. Contemporary IP flow analysis systems are not designed for the continuous host monitoring. Gaining the detailed overview of each host is not straightforward with these systems due to connection-based paradigm and performance challenges. We show that distributed stream processing is a natural solution for detailed IP flow host monitoring. Moreover, we describe a real-time host monitoring workflow in data streams in detail and present advantages of flow-based host monitoring in Apache Spark including real-time host profiling, dynamic level of detail and granularity.
Links
VI20162019014, research and development projectName: Simulace, detekce a potlačení kybernetických hrozeb ohrožujících kritickou infrastrukturu (Acronym: KYPO II)
Investor: Ministry of the Interior of the CR, Simulation, Detection, and Mitigation of Cyber Threats Endangering Critical Infrastructure
Type Name Uploaded/Created by Uploaded/Created Rights
2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.pdf Licence Creative Commons  File version Jirsík, T. 14. 6. 2018

Properties

Address within IS
https://is.muni.cz/auth/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.pdf
Address for the users outside IS
https://is.muni.cz/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.pdf
Address within Manager
https://is.muni.cz/auth/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.pdf?info
Address within Manager for the users outside IS
https://is.muni.cz/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.pdf?info
Uploaded/Created
Thu 14. 6. 2018 14:18

Rights

Right to read
  • anyone on the Internet
  • a concrete person RNDr. Tomáš Jirsík, Ph.D., učo 211086
Right to upload
 
Right to administer:
  • a concrete person RNDr. Tomáš Jirsík, Ph.D., učo 211086
Attributes
 

2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.pdf

Application
Open the file
Download file.
Address within IS
https://is.muni.cz/auth/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.pdf
Address for the users outside IS
http://is.muni.cz/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.pdf
File type
PDF (application/pdf)
Size
209,8 KB
Hash md5
fcd004e8b58f39dcc459ad01d58ca080
Uploaded/Created
Thu 14. 6. 2018 14:18

2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.txt

Application
Open the file
Download file.
Address within IS
https://is.muni.cz/auth/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.txt
Address for the users outside IS
http://is.muni.cz/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-paper.txt
File type
plain text (text/plain)
Size
9,5 KB
Hash md5
e367b3bdad0be5888c1bd0c52f3409b4
Uploaded/Created
Thu 14. 6. 2018 14:30
2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.pdf Licence Creative Commons  File version Jirsík, T. 14. 6. 2018

Properties

Address within IS
https://is.muni.cz/auth/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.pdf
Address for the users outside IS
https://is.muni.cz/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.pdf
Address within Manager
https://is.muni.cz/auth/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.pdf?info
Address within Manager for the users outside IS
https://is.muni.cz/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.pdf?info
Uploaded/Created
Thu 14. 6. 2018 14:18

Rights

Right to read
  • anyone on the Internet
  • a concrete person RNDr. Tomáš Jirsík, Ph.D., učo 211086
Right to upload
 
Right to administer:
  • a concrete person RNDr. Tomáš Jirsík, Ph.D., učo 211086
Attributes
 

2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.pdf

Application
Open the file
Download file.
Address within IS
https://is.muni.cz/auth/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.pdf
Address for the users outside IS
http://is.muni.cz/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.pdf
File type
PDF (application/pdf)
Size
1,7 MB
Hash md5
ae41e23768ec373e9073afb0c5115d46
Uploaded/Created
Thu 14. 6. 2018 14:18

2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.txt

Application
Open the file
Download file.
Address within IS
https://is.muni.cz/auth/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.txt
Address for the users outside IS
http://is.muni.cz/publication/1420819/2018-NOMS-Stream4Flow-Real-time-IP-Flow-Host-Monitoring-Apache-Spark-poster.txt
File type
plain text (text/plain)
Size
3,4 KB
Uploaded/Created
Thu 14. 6. 2018 14:31
Print
Report a file uploaded without authorization. Displayed: 28. 3. 2023 02:07