Managed Kubernetes — Next Gen Academic Infrastructure?

a 2022

Managed Kubernetes — Next Gen Academic Infrastructure?

SPIŠAKOVÁ, Viktória, Adrián ROŠINEC, Lukáš HEJTMÁNEK and Matej ANTOL

Basic information

Original name

Managed Kubernetes — Next Gen Academic Infrastructure?

Name in Czech

Managed Kubernetes - akademická infrastruktura nové generace?

Authors

SPIŠAKOVÁ, Viktória, Adrián ROŠINEC, Lukáš HEJTMÁNEK and Matej ANTOL

Edition

EGI Conference 2022, 2022

Other information

Language

English

Type of outcome

Konferenční abstrakt

Field of Study

10201 Computer sciences, information science, bioinformatics

Country of publisher

Czech Republic

Confidentiality degree

není předmětem státního či obchodního tajemství

References:

URL

Organization unit

Institute of Computer Science

Abstract

V originále

Academic infrastructures and institutions continuously develop new computing services to support research and education. These services are traditionally based on HPC batch systems and cloud services. Recently, a new computing paradigm based on containerization of applications has been adopted across the scientific community. Computations executed in containers are becoming increasingly popular because of their ease of use – the user encapsulates the entire environment (including software, its dependencies, and optionally data) into a single package that can be run independently of hardware and operating system. Such computations can be run on traditional HPC systems and virtual servers. However, running containerized computations in the Kubernetes (K8S) orchestration tool simplifies the execution and management of containers significantly. Running the Kubernetes infrastructure is a challenging task that requires non-negligible know-how and resources dedicated to its operation and maintenance. Therefore, it is reasonable to offload this line of work to dedicated IT professionals positioned within research infrastructures, NRENs, and other similar institutions providing IT environments to support research. Czech NREN "CESNET" embraced the opportunity presented by containerization by offering its own managed Kubernetes platform. Resources required to develop and maintain the platform, together with the operation of all the underlying IT layers such as hardware and networking, are fully realized by CESNET. Such an environment allows the researchers to focus solely on executing the containerized computation workflows. The viability of the Kubernetes infrastructure for research was verified on several use-cases traditionally run on HPC or IaaS, demonstrating the advantages of the managed K8s infrastructure in research applications. It covers use-cases such as scalable Jupyter notebooks, RStudio servers, personalized storage, true 3D game streaming (low-latency virtual desktops), and more. These use-cases make a strong argument for establishing the federated managed Kubernetes sites, which could be provided within the EGI to the broad scientific community.

Links

LM2018140, research and development project

Name: e-Infrastruktura CZ (Acronym: e-INFRA CZ)

Investor: Ministry of Education, Youth and Sports of the CR

Citovat

SPIŠAKOVÁ, Viktória, Adrián ROŠINEC, Lukáš HEJTMÁNEK and Matej ANTOL. Managed Kubernetes — Next Gen Academic Infrastructure? In EGI Conference 2022. 2022.

@proceedings{2262057,
   author = {Spišaková, Viktória and Rošinec, Adrián and Hejtmánek, Lukáš and Antol, Matej},
   booktitle = {EGI Conference 2022},
   language = {eng},
   title = {Managed Kubernetes — Next Gen Academic Infrastructure?},
   url = {https://indico.egi.eu/event/5882/contributions/16666/},
   year = {2022}
}

TY  - CONF
ID  - 2262057
AU  - Spišaková, Viktória - Rošinec, Adrián - Hejtmánek, Lukáš - Antol, Matej
PY  - 2022
TI  - Managed Kubernetes — Next Gen Academic Infrastructure?
UR  - https://indico.egi.eu/event/5882/contributions/16666/
N2  - Academic infrastructures and institutions continuously develop new computing services to support research and education. These services are traditionally based on HPC batch systems and cloud services. Recently, a new computing paradigm based on containerization of applications has been adopted across the scientific community. Computations executed in containers are becoming increasingly popular because of their ease of use – the user encapsulates the entire environment (including software, its dependencies, and optionally data) into a single package that can be run independently of hardware and operating system. Such computations can be run on traditional HPC systems and virtual servers. However, running containerized computations in the Kubernetes (K8S) orchestration tool simplifies the execution and management of containers significantly. Running the Kubernetes infrastructure is a challenging task that requires non-negligible know-how and resources dedicated to its operation and maintenance. Therefore, it is reasonable to offload this line of work to dedicated IT professionals positioned within research infrastructures, NRENs, and other similar institutions providing IT environments to support research. Czech NREN "CESNET" embraced the opportunity presented by containerization by offering its own managed Kubernetes platform. Resources required to develop and maintain the platform, together with the operation of all the underlying IT layers such as hardware and networking, are fully realized by CESNET. Such an environment allows the researchers to focus solely on executing the containerized computation workflows. The viability of the Kubernetes infrastructure for research was verified on several use-cases traditionally run on HPC or IaaS, demonstrating the advantages of the managed K8s infrastructure in research applications. It covers use-cases such as scalable Jupyter notebooks, RStudio servers, personalized storage, true 3D game streaming (low-latency virtual desktops), and more. These use-cases make a strong argument for establishing the federated managed Kubernetes sites, which could be provided within the EGI to the broad scientific community.
ER  -

SPIŠAKOVÁ, Viktória, Adrián ROŠINEC, Lukáš HEJTMÁNEK and Matej ANTOL. Managed Kubernetes — Next Gen Academic Infrastructure? In \textit{EGI Conference 2022}. 2022.

Detailed Information on Publication Record