Real-life Experience with Private Cloud hosting Heterogeneous
Scientific Workloads

D 2018

Real-life Experience with Private Cloud hosting Heterogeneous Scientific Workloads

KLUSÁČEK, Dalibor, Boris PARÁK, Václav CHLUMSKÝ a Lukáš HEJTMÁNEK

Základní údaje

Originální název

Real-life Experience with Private Cloud hosting Heterogeneous Scientific Workloads

Autoři

KLUSÁČEK, Dalibor (203 Česká republika), Boris PARÁK (703 Slovensko), Václav CHLUMSKÝ (203 Česká republika) a Lukáš HEJTMÁNEK (203 Česká republika, garant, domácí)

Vydání

NEW YORK, 2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION), od s. 115-120, 6 s. 2018

Nakladatel

IEEE

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

10201 Computer sciences, information science, bioinformatics

Stát vydavatele

Spojené státy

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

elektronická verze "online"

Odkazy

URL

Kód RIV

RIV/00216224:14610/18:00113738

Organizační jednotka

Ústav výpočetní techniky

ISBN

978-1-72810-359-4

ISSN

DOI

http://dx.doi.org/10.1109/UCC-Companion.2018.00044

UT WoS

000458720100027

Klíčová slova česky

cloud; dávkoé zpracování; HPC; plánování; kontejner; Singularity; Docker

Klíčová slova anglicky

cloud; batch computing; HPC; scheduling; container; Singularity; Docker

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 23. 4. 2020 20:29, RNDr. Lukáš Hejtmánek, Ph.D.

Anotace

V originále

We present our experience with hosting scientific workloads in a private scientific cloud, where both the infrastructure as well as the workloads are heterogeneous. We support two major classes of workloads-classic virtual machines (VMs) and batch job computations. Furthermore, containerized applications and scientific portals such as Galaxy are also hosted in this infrastructure. Using our experience, we describe the system setup, the technologies used to run this heterogeneous system as well as some of the problems we have faced when managing this system throughout the years. Modern computing environments such as clouds, grids or HPC clusters are both complex and costly installations. Therefore, it has always been a major challenge to utilize them properly. Things like improper setup or bad scheduling policy may easily hamper overall performance of the whole system. We believe that our experience and observations may help other researchers and system administrators identify new research directions and/ or potential weak spots. Importantly, the problems discussed in this paper are based on real-life data from the CERIT Scientific Cloud that we freely offer for further analysis and/ or simulations.

Návaznosti

LM2015085, projekt VaV

Název: CERIT Scientific Cloud (Akronym: CERIT-SC)

Investor: Ministerstvo školství, mládeže a tělovýchovy ČR, CERIT Scientific Cloud

Citovat

KLUSÁČEK, Dalibor, Boris PARÁK, Václav CHLUMSKÝ a Lukáš HEJTMÁNEK. Real-life Experience with Private Cloud hosting Heterogeneous Scientific Workloads. Online. In 2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION). NEW YORK: IEEE, 2018, s. 115-120. ISBN 978-1-72810-359-4. Dostupné z: https://dx.doi.org/10.1109/UCC-Companion.2018.00044.

@inproceedings{1648760,
   author = {Klusáček, Dalibor and Parák, Boris and Chlumský, Václav and Hejtmánek, Lukáš},
   address = {NEW YORK},
   booktitle = {2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION)},
   doi = {http://dx.doi.org/10.1109/UCC-Companion.2018.00044},
   keywords = {cloud; batch computing; HPC; scheduling; container; Singularity; Docker},
   howpublished = {elektronická verze "online"},
   language = {eng},
   location = {NEW YORK},
   isbn = {978-1-72810-359-4},
   pages = {115-120},
   publisher = {IEEE},
   title = {Real-life Experience with Private Cloud hosting Heterogeneous Scientific Workloads},
   url = {https://ieeexplore.ieee.org/document/8605767},
   year = {2018}
}

TY  - JOUR
ID  - 1648760
AU  - Klusáček, Dalibor - Parák, Boris - Chlumský, Václav - Hejtmánek, Lukáš
PY  - 2018
TI  - Real-life Experience with Private Cloud hosting Heterogeneous Scientific Workloads
PB  - IEEE
CY  - NEW YORK
SN  - 9781728103594
KW  - cloud
KW  - batch computing
KW  - HPC
KW  - scheduling
KW  - container
KW  - Singularity
KW  - Docker
UR  - https://ieeexplore.ieee.org/document/8605767
L2  - https://ieeexplore.ieee.org/document/8605767
N2  - We present our experience with hosting scientific workloads in a private scientific cloud, where both the infrastructure as well as the workloads are heterogeneous. We support two major classes of workloads-classic virtual machines (VMs) and batch job computations. Furthermore, containerized applications and scientific portals such as Galaxy are also hosted in this infrastructure. Using our experience, we describe the system setup, the technologies used to run this heterogeneous system as well as some of the problems we have faced when managing this system throughout the years. Modern computing environments such as clouds, grids or HPC clusters are both complex and costly installations. Therefore, it has always been a major challenge to utilize them properly. Things like improper setup or bad scheduling policy may easily hamper overall performance of the whole system. We believe that our experience and observations may help other researchers and system administrators identify new research directions and/ or potential weak spots. Importantly, the problems discussed in this paper are based on real-life data from the CERIT Scientific Cloud that we freely offer for further analysis and/ or simulations.
ER  -

KLUSÁČEK, Dalibor, Boris PARÁK, Václav CHLUMSKÝ a Lukáš HEJTMÁNEK. Real-life Experience with Private Cloud hosting Heterogeneous Scientific Workloads. Online. In \textit{2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION)}. NEW YORK: IEEE, 2018, s.~115-120. ISBN~978-1-72810-359-4. Dostupné z: https://dx.doi.org/10.1109/UCC-Companion.2018.00044.

Podrobný výpis o publikaci