D 2015

Optimal Continuous Time Markov Decisions

BUTKOVA, Yuliya, Hassan HATEFI, Holger HERMANNS and Jan KRČÁL

Basic information

Original name

Optimal Continuous Time Markov Decisions

Authors

BUTKOVA, Yuliya (643 Russian Federation), Hassan HATEFI (364 Islamic Republic of Iran), Holger HERMANNS (276 Germany) and Jan KRČÁL (203 Czech Republic, guarantor, belonging to the institution)

Edition

Shanghai, China, ATVA 2015, p. 166-182, 17 pp. 2015

Publisher

Springer

Other information

Language

English

Type of outcome

Stať ve sborníku

Field of Study

10201 Computer sciences, information science, bioinformatics

Country of publisher

Germany

Confidentiality degree

není předmětem státního či obchodního tajemství

Publication form

electronic version available online

Impact factor

Impact factor: 0.402 in 2005

RIV identification code

RIV/00216224:14330/15:00081290

Organization unit

Faculty of Informatics

ISBN

978-3-319-24952-0

ISSN

UT WoS

000374241600012

Keywords in English

Continuous time Markov decision process; time bounded reachability; uniformisation; experimental evaluation

Tags

International impact, Reviewed
Změněno: 28/4/2016 15:33, RNDr. Pavel Šmerk, Ph.D.

Abstract

V originále

In the context of Markov decision processes running in continuous time, one of the most intriguing challenges is the efficient approximation of finite horizon reachability objectives. A multitude of sophisticated model checking algorithms have been proposed for this. However, no proper benchmarking has been performed thus far. This paper presents a novel and yet simple solution: an algorithm originally developed for a restricted subclass of models and a subclass of schedulers can be twisted so as to become competitive with the more sophisticated algorithms in full generality. As the second main contribution, we perform a comparative evaluation of the core algorithmic concepts on an extensive set of benchmarks varying over all key parameters: model size, amount of non-determinism, time horizon, and precision.

Links

GBP202/12/G061, research and development project
Name: Centrum excelence - Institut teoretické informatiky (CE-ITI) (Acronym: CE-ITI)
Investor: Czech Science Foundation