Job Centric Monitoring on the Grid 7 years of experience with L&B and JP services

RUDA, Miroslav, Jiri SITERA, Aleš KŘENEK, Luděk MATYSKA, Zdenek SUSTR and Michal VOCŮ. Job Centric Monitoring on the Grid 7 years of experience with L&B and JP services. In CESNET CONFERENCE 2008-SECURITY, MIDDLEWARE, AND VIRTUALIZATION-GLUE OF FUTURE NETWORKS. Praha: CESNET, 2008, p. 3-12. ISBN 978-80-904173-0-4.

Basic information

• Original name: Job Centric Monitoring on the Grid 7 years of experience with L&B and JP services
• Authors: RUDA, Miroslav (203 Czech Republic), Jiri SITERA (203 Czech Republic), Aleš KŘENEK (203 Czech Republic, guarantor, belonging to the institution), Luděk MATYSKA (203 Czech Republic), Zdenek SUSTR (203 Czech Republic) and Michal VOCŮ (203 Czech Republic, belonging to the institution).
• Edition: Praha, CESNET CONFERENCE 2008-SECURITY, MIDDLEWARE, AND VIRTUALIZATION-GLUE OF FUTURE NETWORKS, p. 3-12, 10 pp. 2008.
• Publisher: CESNET

Other information

• Original language: English
• Type of outcome: Proceedings paper
• Field of Study: 10201 Computer sciences, information science, bioinformatics
• Country of publisher: Czech Republic
• Confidentiality degree: is not subject to a state or trade secret
• RIV identification code: RIV/00216224:14610/08:00056812
• Organization unit: Institute of Computer Science
• ISBN: 978-80-904173-0-4
• UT WoS: 000271023300001
• Keywords in English: grid; job; provenance

Abstract

Users are approaching Grids with expectations of transparency and easy to use environment. They look for simple interface to submit a job and to retrieve results of its run, eventually following changes in job state. Logging and Bookkeeping service (L&B) introduced in the EU DataGrid project 7 years ago, replaces tedious inspection of log files at individual Grid components and provides job state information through a single interface. Based on a push model, L&B is an infrastructure that collects events from all Grid components job is passing through and process them in a fault tolerant way. Users can also add annotations, to further classify their jobs. As L&B is focused on running jobs, it is complemented by the Job Provenance service (JP) that provides a long term storage and access to the job information. While L&B is for several years in production use on the largest Grid infrastructure operated by the EGEE projects and has been already deployed in other environments, JP capabilities to support scientific workflows and enhance the ways scientists can deal with a Grid had been demonstrated recently at several occasions.

Abstract (in Czech)

Uživatelé očekávají od Gridu především transparentní a snadno použitelné prostředí. Hledají jednoduchá rozhraní k zadání úlohy a zjištění informací o jeho běhu. Služba Logging and Bookkeeping (L&B), zavedená v projektu EU DataGrid před sedmi lety, nahrazuje složité prohledávání logů jednotným rozhraním. Je založena na tzv. push modelu, a sbírá informace o úlohách na všech zůčastněných komponentách Gridu. Uživatelé také mohou přidávat anotace úloh. L&B je zaměřena na běžící úlohy a je dopněna službou Job Provenance (JP), která poskytuje dlouhodobé úložiště dat o úlohách. L&B je dlouhodobě v provozu na evropské infrastruktuře EGEE, možnosti JP byly v nedávné době při několika příležitostech předvedeny.

Links

• MSM0021622419, plan (intention): Name: Vysoce paralelní a distribuované výpočetní systémy

Investor: Ministry of Education, Youth and Sports of the CR, Highly Parallel and Distributed Computing Systems