HIERARKI: A program demonstrating hierarchic Markov processes

For a discussion of the notion of a hierarchic Markov process, reference is made to:

Kristensen, A.R. 1993. Markov decision programming techniques applied to the animal replacement problem. Dissertation for the dr. agro. (D.Sc.) degree. Dina KVL, Department of Animal Science and Animal Health, Royal Veterinary and Agricultural University. ISBN 87 7026 332 9. 183pp.

The demonstration program available is running under DOS. It has facilities for defining, editing and solving problems using hierarchic Markov processes. It therefore illustrates the structure and parameter needs of such processes. Furthermore, the efficiency of the hierarchic algorithms may be compared to the efficiency of the traditional policy iteration and value iteration algorithms.

The program (including examples) comes as a ZIP-file , which just has to be un-zipped in an appropriate directory on the hard disk.