KŘETÍNSKÝ, Jan and Tobias MEGGENDORFER. Conditional Value-at-Risk for Reachability and Mean Payoff in Markov Decision Processes. Online. In Proceedings of the 33rd Annual ACM/IEEE Symposium on Logic in Computer Science (LICS '18). New York, NY, USA: ACM, 2018, p. 609-618. ISBN 978-1-4503-5583-4. Available from: https://dx.doi.org/10.1145/3209108.3209176.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name Conditional Value-at-Risk for Reachability and Mean Payoff in Markov Decision Processes
Authors KŘETÍNSKÝ, Jan (203 Czech Republic, guarantor, belonging to the institution) and Tobias MEGGENDORFER (276 Germany).
Edition New York, NY, USA, Proceedings of the 33rd Annual ACM/IEEE Symposium on Logic in Computer Science (LICS '18), p. 609-618, 10 pp. 2018.
Publisher ACM
Other information
Original language English
Type of outcome Proceedings paper
Field of Study 10201 Computer sciences, information science, bioinformatics
Country of publisher United States of America
Confidentiality degree is not subject to a state or trade secret
Publication form electronic version available online
RIV identification code RIV/00216224:14330/18:00108288
Organization unit Faculty of Informatics
ISBN 978-1-4503-5583-4
ISSN 1043-6871
Doi http://dx.doi.org/10.1145/3209108.3209176
UT WoS 000545262800063
Keywords in English conditional value-at-risk; Markov chains; Markov decision processes; reachability; mean-payoff
Tags core_A, firank_1
Changed by Changed by: RNDr. Pavel Šmerk, Ph.D., učo 3880. Changed: 31/5/2022 12:24.
Abstract
We present the conditional value-at-risk (CVaR) in the context of Markov chains and Markov decision processes with reachability and mean-payoff objectives. CVaR quantifies risk by means of the expectation of the worst p-quantile. As such it can be used to design risk-averse systems. We consider not only CVaR constraints, but also introduce their conjunction with expectation constraints and quantile constraints (value-at-risk, VaR). We derive lower and upper bounds on the computational complexity of the respective decision problems and characterize the structure of the strategies in terms of memory and randomization.
Links
GA18-11193S, research and development projectName: Algoritmy pro diskrétní systémy a hry s nekonečně mnoha stavy
Investor: Czech Science Foundation
PrintDisplayed: 23/7/2024 06:29