Fuel in Markov Decision Processes (FiMDP): A Practical Approach
to Consumption

D 2021

Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption

BLAHOUDEK, František, Murat CUBUKTEPE, Petr NOVOTNÝ, Melkior ORNIK, Pranay THANGEDA et. al.

Základní údaje

Originální název

Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption

Autoři

BLAHOUDEK, František (203 Česká republika), Murat CUBUKTEPE (792 Turecko), Petr NOVOTNÝ (203 Česká republika, garant, domácí), Melkior ORNIK (191 Chorvatsko), Pranay THANGEDA (356 Indie) a Ufuk TOPCU (792 Turecko)

Vydání

Cham, Switzerland, 24th International Symposium on Formal Methods, FM 2021, od s. 640-656, 17 s. 2021

Nakladatel

Springer

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

10201 Computer sciences, information science, bioinformatics

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

elektronická verze "online"

Impakt faktor

Impact factor: 0.402 v roce 2005

Kód RIV

RIV/00216224:14330/21:00119269

Organizační jednotka

Fakulta informatiky

ISBN

978-3-030-90869-0

ISSN

DOI

http://dx.doi.org/10.1007/978-3-030-90870-6_34

UT WoS

000758218600034

Klíčová slova anglicky

resource constraints; planning under uncertainty; Markov decision processes

Štítky

core_A, firank_A, formela-ver

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 28. 4. 2022 10:03, RNDr. Pavel Šmerk, Ph.D.

Anotace

V originále

Consumption Markov Decision Processes (CMDPs) are prob- abilistic decision-making models of resource-constrained systems. We introduce FiMDP, a tool for controller synthesis in CMDPs with LTL objectives expressible by deterministic Büchi automata. The tool implements the recent algorithm for polynomial-time controller synthesis in CMDPs, but extends it with many additional features. On the conceptual level, the tool implements heuristics for improving the expected reachability times of accepting states, and a support for multi-agent task allocation. On the practical level, the tool offers (among other features) a new strategy simulation framework, integration with the Storm model checker, and FiMDPEnv - a new set of CMDPs that model real-world resource-constrained systems. We also present an evaluation of FiMDP on these real-world scenarios.

Návaznosti

GJ19-15134Y, projekt VaV

Název: Verifikace a analýza pravděpodobnostních programů

Citovat

BLAHOUDEK, František, Murat CUBUKTEPE, Petr NOVOTNÝ, Melkior ORNIK, Pranay THANGEDA a Ufuk TOPCU. Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption. Online. In 24th International Symposium on Formal Methods, FM 2021. Cham, Switzerland: Springer, 2021, s. 640-656. ISBN 978-3-030-90869-0. Dostupné z: https://dx.doi.org/10.1007/978-3-030-90870-6_34.

@inproceedings{1797367,
   author = {Blahoudek, František and Cubuktepe, Murat and Novotný, Petr and Ornik, Melkior and Thangeda, Pranay and Topcu, Ufuk},
   address = {Cham, Switzerland},
   booktitle = {24th International Symposium on Formal Methods, FM 2021},
   doi = {http://dx.doi.org/10.1007/978-3-030-90870-6_34},
   keywords = {resource constraints; planning under uncertainty; Markov decision processes},
   howpublished = {elektronická verze "online"},
   language = {eng},
   location = {Cham, Switzerland},
   isbn = {978-3-030-90869-0},
   pages = {640-656},
   publisher = {Springer},
   title = {Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption},
   year = {2021}
}

TY  - JOUR
ID  - 1797367
AU  - Blahoudek, František - Cubuktepe, Murat - Novotný, Petr - Ornik, Melkior - Thangeda, Pranay - Topcu, Ufuk
PY  - 2021
TI  - Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption
PB  - Springer
CY  - Cham, Switzerland
SN  - 9783030908690
KW  - resource constraints
KW  - planning under uncertainty
KW  - Markov decision processes
N2  - Consumption Markov Decision Processes (CMDPs) are prob- abilistic decision-making models of resource-constrained systems. We introduce FiMDP, a tool for controller synthesis in CMDPs with LTL objectives expressible by deterministic Büchi automata. The tool implements the recent algorithm for polynomial-time controller synthesis in CMDPs, but extends it with many additional features. On the conceptual level, the tool implements heuristics for improving the expected reachability times of accepting states, and a support for multi-agent task allocation. On the practical level, the tool offers (among other features) a new strategy simulation framework, integration with the Storm model checker, and FiMDPEnv - a new set of CMDPs that model real-world resource-constrained systems. We also present an evaluation of FiMDP on these real-world scenarios.
ER  -

BLAHOUDEK, František, Murat CUBUKTEPE, Petr NOVOTNÝ, Melkior ORNIK, Pranay THANGEDA a Ufuk TOPCU. Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption. Online. In \textit{24th International Symposium on Formal Methods, FM 2021}. Cham, Switzerland: Springer, 2021, s.~640-656. ISBN~978-3-030-90869-0. Dostupné z: https://dx.doi.org/10.1007/978-3-030-90870-6\_{}34.

Podrobný výpis o publikaci