Markov Decision Processes and Stochastic Positional Games Optimal Control on Complex Networks / [electronic resource] :
by Dmitrii Lozovanu, Stefan Wolfgang Pickl.
- 1st ed. 2024.
- XIX, 396 p. 41 illus. online resource.
- International Series in Operations Research & Management Science, 349 2214-7934 ; .
- International Series in Operations Research & Management Science, 349 .
Discrete Markov Processes and Numerical Algorithms for Markov Chains -- Markov Decision Processes and Stochastic Control Problems on Networks -- Stochastic Games and Positional Games on Networks.
This book presents recent findings and results concerning the solutions of especially finite state-space Markov decision problems and determining Nash equilibria for related stochastic games with average and total expected discounted reward payoffs. In addition, it focuses on a new class of stochastic games: stochastic positional games that extend and generalize the classic deterministic positional games. It presents new algorithmic results on the suitable implementation of quasi-monotonic programming techniques. Moreover, the book presents applications of positional games within a class of multi-objective discrete control problems and hierarchical control problems on networks. Given its scope, the book will benefit all researchers and graduate students who are interested in Markov theory, control theory, optimization and games.