Learning partially observable Markov models from first passage times
(2007) Machine Learning: ECML 2007. 18th European Conference on Machine Learning — Location: Warsaw, Poland (17.September.2007)
Files
pommStruct_ecml_07.pdf
Restricted Access - Adobe PDF
- 574.24 KB
Details
- Authors
- Abstract
- We propose a novel approach to learn the structure of partially observable Markov models (POMMs) and to estimate jointly their parameters. POMMs are graphical models equivalent to hidden Markov models (HMMs). The model structure is built to support the first passage times (FPT) dynamics observed in the training sample. We argue that the FPT in POMMs are closely related to the model structure. Starting from a standard Markov chain, states are iteratively added to the model. A novel algorithm POMMPHit is proposed to estimate the POMM transition probabilities to fit the sample FPT dynamics. The transitions with the lowest expected passage times are trimmed off from the model. Practical evaluations on artificially generated data and on DNA sequence modeling show the benefits over Bayesian model induction or EM estimation of ergodic models with transition trimming.
- Affiliations
Citations
Callut, J., & Dupont, P. (2007). Learning partially observable Markov models from first passage times. In Kok, J.N.; Koronacki, J.; de Mantaras, R.L.; Matwin, S.; Mladenic, D.; Skowron, A.; (ed.), Machine Learning: ECML 2007. Proceedings 18th European Conference onMachine Learning. (Lecture Notes in Artificial Intelligence vol. 4701) (pp. 91-103). Springer-verlag. https://hdl.handle.net/2078.5/254817