JournalVolume 3, №1Zero-sum games for nonhomogeneous Markov chains with an expected average payoff criterion (pages 10-22) Xianping Guo and Onésimo Hernández Abstract. This paper is concerned with two-person zero-sum games for nonhomogeneous discrete time Markov chains with Borel state and action spaces, and non-uniformly bounded payoff functions, under the long - run expected average payoff criterion. We give conditions ensuring the existence of both the value of the game and a pair of optimal Markov strategies for the expected average criterion by using the nonhomogeneous Shapley equations. Moreover, we present a martingale characterization of a pair of optimal Markov strategies. Finally, we use a water regulation problem to illustrate our results.
|
|