An Empirical Transition Matrix for Non-homogeneous Markov Chains Based on Censored Observations

A product limit estimator is suggested for the transition probabilities of a non-homogeneous Markov chain with finitely many states. The estimator is expressed as a product integral and its properties are studied by means of the theory of square integrable martingales.