Authorization

 

Journal

Volume 3, №1


Zero-sum games for nonhomogeneous Markov chains with an expected average payoff criterion (pages 10-22)
Xianping Guo and Onésimo Hernández


Abstract. This paper is concerned with two-person zero-sum games for nonhomogeneous discrete time Markov chains with Borel state and action spaces, and non-uniformly bounded payoff functions, under the long - run expected average payoff criterion. We give conditions ensuring the existence of both the value of the game and a pair of optimal Markov strategies for the expected average criterion by using the nonhomogeneous Shapley equations. Moreover, we present a martingale characterization of a pair of optimal Markov strategies. Finally, we use a water regulation problem to illustrate our results.


Keywords:
Zero-Sum Stochastic Games, Nonhomogeneous Markov Chains, Average Payoff Criterion, Pairs of Optimal Markov Strategies, Martingale Characterization.

 



COIA 2027

7-9 July 2027
Baku, Azerbaijan

Search