KLUSÁČEK, Dalibor, Boris PARÁK, Václav CHLUMSKÝ and Lukáš HEJTMÁNEK. Real-life Experience with Private Cloud hosting Heterogeneous Scientific Workloads. Online. In 2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION). NEW YORK: IEEE, 2018, p. 115-120. ISBN 978-1-72810-359-4. Available from: https://dx.doi.org/10.1109/UCC-Companion.2018.00044.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name Real-life Experience with Private Cloud hosting Heterogeneous Scientific Workloads
Authors KLUSÁČEK, Dalibor (203 Czech Republic), Boris PARÁK (703 Slovakia), Václav CHLUMSKÝ (203 Czech Republic) and Lukáš HEJTMÁNEK (203 Czech Republic, guarantor, belonging to the institution).
Edition NEW YORK, 2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION), p. 115-120, 6 pp. 2018.
Publisher IEEE
Other information
Original language English
Type of outcome Proceedings paper
Field of Study 10201 Computer sciences, information science, bioinformatics
Country of publisher United States of America
Confidentiality degree is not subject to a state or trade secret
Publication form electronic version available online
WWW URL
RIV identification code RIV/00216224:14610/18:00113738
Organization unit Institute of Computer Science
ISBN 978-1-72810-359-4
ISSN 2373-6860
Doi http://dx.doi.org/10.1109/UCC-Companion.2018.00044
UT WoS 000458720100027
Keywords (in Czech) cloud; dávkoé zpracování; HPC; plánování; kontejner; Singularity; Docker
Keywords in English cloud; batch computing; HPC; scheduling; container; Singularity; Docker
Tags International impact, Reviewed
Changed by Changed by: RNDr. Lukáš Hejtmánek, Ph.D., učo 3545. Changed: 23/4/2020 20:29.
Abstract
We present our experience with hosting scientific workloads in a private scientific cloud, where both the infrastructure as well as the workloads are heterogeneous. We support two major classes of workloads-classic virtual machines (VMs) and batch job computations. Furthermore, containerized applications and scientific portals such as Galaxy are also hosted in this infrastructure. Using our experience, we describe the system setup, the technologies used to run this heterogeneous system as well as some of the problems we have faced when managing this system throughout the years. Modern computing environments such as clouds, grids or HPC clusters are both complex and costly installations. Therefore, it has always been a major challenge to utilize them properly. Things like improper setup or bad scheduling policy may easily hamper overall performance of the whole system. We believe that our experience and observations may help other researchers and system administrators identify new research directions and/ or potential weak spots. Importantly, the problems discussed in this paper are based on real-life data from the CERIT Scientific Cloud that we freely offer for further analysis and/ or simulations.
Links
LM2015085, research and development projectName: CERIT Scientific Cloud (Acronym: CERIT-SC)
Investor: Ministry of Education, Youth and Sports of the CR, CERIT Scientific Cloud
PrintDisplayed: 18/7/2024 12:39