Optimal Continuous Time Markov Decisions. Butkova, Y., Hatefi, H., Hermanns, H., & Krcál, J. In Automated Technology for Verification and Analysis - 13th International Symposium, ATVA 2015, 2015.
abstract   bibtex   
In the context of Markov decision processes running in continuous time, one of the most intriguing challenges is the efficient approximation of finite horizon reachability objectives. A multitude of sophisticated model checking algorithms have been proposed for this. However, no proper benchmarking has been performed thus far. This paper presents a novel and yet simple solution: an algorithm originally developed for a restricted subclass of models and a subclass of schedulers can be twisted so as to become competitive with the more sophisticated algorithms in full generality. As the second main contribution, we perform a comparative evaluation of the core algorithmic concepts on an extensive set of benchmarks varying over all key parameters: model size, amount of non-determinism, time horizon, and precision.
@inProceedings{
 title = {Optimal Continuous Time Markov Decisions},
 type = {inProceedings},
 year = {2015},
 id = {f63cbd26-7ae7-3e2a-b85b-335f74015587},
 created = {2015-07-05T19:44:15.000Z},
 file_attached = {false},
 profile_id = {4f325e21-a764-32ab-9623-e568e98285be},
 last_modified = {2017-03-25T21:52:16.230Z},
 read = {false},
 starred = {false},
 authored = {true},
 confirmed = {true},
 hidden = {false},
 citation_key = {ButkovaHHK15},
 source_type = {inproceedings},
 notes = {to appear},
 private_publication = {false},
 abstract = { In the context of Markov decision processes running in
continuous time, one of the most intriguing
challenges is the efficient approximation of finite
horizon reachability objectives. A multitude of
sophisticated model checking algorithms have been
proposed for this. However, no proper benchmarking
has been performed thus far. This paper presents a
novel and yet simple solution: an algorithm
originally developed for a restricted subclass of
models and a subclass of schedulers can be twisted
so as to become competitive with the more
sophisticated algorithms in full generality. As the
second main contribution, we perform a comparative
evaluation of the core algorithmic concepts on an
extensive set of benchmarks varying over all key
parameters: model size, amount of non-determinism,
time horizon, and precision. },
 bibtype = {inProceedings},
 author = {Butkova, Yuliya and Hatefi, Hassan and Hermanns, Holger and Krcál, Jan},
 booktitle = {Automated Technology for Verification and Analysis - 13th International Symposium, ATVA 2015}
}

Downloads: 0