Markov Chains and Markov Decision Processes in Isabelle/HOL

Holzl, J

Holzl, J (reprint author), Tech Univ Munich, Dept Informat, D-85748 Garching, Germany.

JOURNAL OF AUTOMATED REASONING, 2017; 59 (3): 345

Abstract

This paper presents an extensive formalization of Markov chains (MCs) and Markov decision processes (MDPs), with discrete time and (possibly infinite)......

Full Text Link