Welcome to the Library Catalog of "Dunarea de Jos" University of Galati

Optimization and Games for Controllable Markov Chains (Record no. 56796)

MARC details
000 -LEADER
fixed length control field 04845nam a22005775i 4500
001 - CONTROL NUMBER
control field 978-3-031-43575-1
003 - CONTROL NUMBER IDENTIFIER
control field DE-He213
005 - DATE AND TIME OF LATEST TRANSACTION
control field 20251030110852.0
007 - PHYSICAL DESCRIPTION FIXED FIELD--GENERAL INFORMATION
fixed length control field cr nn 008mamaa
008 - FIXED-LENGTH DATA ELEMENTS--GENERAL INFORMATION
fixed length control field 231213s2024 sz | s |||| 0|eng d
020 ## - INTERNATIONAL STANDARD BOOK NUMBER
International Standard Book Number 9783031435751
-- 978-3-031-43575-1
024 7# - OTHER STANDARD IDENTIFIER
Standard number or code 10.1007/978-3-031-43575-1
Source of number or code doi
050 #4 - LIBRARY OF CONGRESS CALL NUMBER
Classification number TA329-348
050 #4 - LIBRARY OF CONGRESS CALL NUMBER
Classification number TA345-345.5
072 #7 - SUBJECT CATEGORY CODE
Subject category code TBJ
Source bicssc
072 #7 - SUBJECT CATEGORY CODE
Subject category code TEC009000
Source bisacsh
072 #7 - SUBJECT CATEGORY CODE
Subject category code TBJ
Source thema
100 1# - MAIN ENTRY--PERSONAL NAME
Personal name Clempner, Julio B.
Relator term author.
Relator code aut
-- http://id.loc.gov/vocabulary/relators/aut
9 (RLIN) 68170
245 10 - TITLE STATEMENT
Title Optimization and Games for Controllable Markov Chains
Medium [electronic resource] :
Remainder of title Numerical Methods with Application to Finance and Engineering /
Statement of responsibility, etc. by Julio B. Clempner, Alexander Poznyak.
250 ## - EDITION STATEMENT
Edition statement 1st ed. 2024.
264 #1 - PRODUCTION, PUBLICATION, DISTRIBUTION, MANUFACTURE, AND COPYRIGHT NOTICE
Place of production, publication, distribution, manufacture Cham :
Name of producer, publisher, distributor, manufacturer Springer Nature Switzerland :
-- Imprint: Springer,
Date of production, publication, distribution, manufacture, or copyright notice 2024.
300 ## - PHYSICAL DESCRIPTION
Extent XVIII, 332 p. 99 illus., 94 illus. in color.
Other physical details online resource.
336 ## - CONTENT TYPE
Content type term text
Content type code txt
Source rdacontent
337 ## - MEDIA TYPE
Media type term computer
Media type code c
Source rdamedia
338 ## - CARRIER TYPE
Carrier type term online resource
Carrier type code cr
Source rdacarrier
347 ## - DIGITAL FILE CHARACTERISTICS
File type text file
Encoding format PDF
Source rda
490 1# - SERIES STATEMENT
Series statement Studies in Systems, Decision and Control,
International Standard Serial Number 2198-4190 ;
Volume/sequential designation 504
505 0# - FORMATTED CONTENTS NOTE
Formatted contents note Controllable Markov Chains -- Multiobjective Control -- Partially Observable Markov Chains -- Continuous-Time Markov Chains -- Nash and Stackelberg Equilibrium -- Best-Reply Strategies in Repeated Games -- Mechanism design -- Joint Observer and Mechanism Design -- Bargaining Games or How to Negotiate -- Multi-Traffic Signal-Control Synchronization -- Non-cooperative bargaining with unsophisticated agents -- Transfer Pricing as Bargaining -- Index.
520 ## - SUMMARY, ETC.
Summary, etc. This book considers a class of ergodic finite controllable Markov's chains. The main idea behind the method, described in this book, is to develop the original discrete optimization problems (or game models) in the space of randomized formulations, where the variables stand in for the distributions (mixed strategies or preferences) of the original discrete (pure) strategies in the use. The following suppositions are made: a finite state space, a limited action space, continuity of the probabilities and rewards associated with the actions, and a necessity for accessibility. These hypotheses lead to the existence of an optimal policy. The best course of action is always stationary. It is either simple (i.e., nonrandomized stationary) or composed of two nonrandomized policies, which is equivalent to randomly selecting one of two simple policies throughout each epoch by tossing a biased coin. As a bonus, the optimization procedure just has to repeatedly solve the time-average dynamic programming equation, making it theoretically feasible to choose the optimum course of action under the global restriction. In the ergodic cases the state distributions, generated by the corresponding transition equations, exponentially quickly converge to their stationary (final) values. This makes it possible to employ all widely used optimization methods (such as Gradient-like procedures, Extra-proximal method, Lagrange's multipliers, Tikhonov's regularization), including the related numerical techniques. In the book we tackle different problems and theoretical Markov models like controllable and ergodic Markov chains, multi-objective Pareto front solutions, partially observable Markov chains, continuous-time Markov chains, Nash equilibrium and Stackelberg equilibrium, Lyapunov-like function in Markov chains, Best-reply strategy, Bayesian incentive-compatible mechanisms, Bayesian Partially Observable Markov Games, bargaining solutions for Nash and Kalai-Smorodinsky formulations, multi-traffic signal-control synchronization problem, Rubinstein's non-cooperative bargaining solutions, the transfer pricing problem as bargaining.
650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name as entry element
9 (RLIN) 64145
650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name as entry element
General subdivision Data processing.
650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name as entry element
9 (RLIN) 65524
650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name as entry element
9 (RLIN) 65525
650 14 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name as entry element
650 24 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name as entry element
9 (RLIN) 65530
650 24 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name as entry element
9 (RLIN) 64145
700 1# - ADDED ENTRY--PERSONAL NAME
Personal name Poznyak, Alexander.
Relator term author.
Relator code aut
-- http://id.loc.gov/vocabulary/relators/aut
9 (RLIN) 68171
710 2# - ADDED ENTRY--CORPORATE NAME
Corporate name or jurisdiction name as entry element SpringerLink (Online service)
773 0# - HOST ITEM ENTRY
Title Springer Nature eBook
776 08 - ADDITIONAL PHYSICAL FORM ENTRY
Relationship information Printed edition:
International Standard Book Number 9783031435744
776 08 - ADDITIONAL PHYSICAL FORM ENTRY
Relationship information Printed edition:
International Standard Book Number 9783031435768
776 08 - ADDITIONAL PHYSICAL FORM ENTRY
Relationship information Printed edition:
International Standard Book Number 9783031435775
830 #0 - SERIES ADDED ENTRY--UNIFORM TITLE
Uniform title Studies in Systems, Decision and Control,
International Standard Serial Number 2198-4190 ;
Volume number/sequential designation 504
856 40 - ELECTRONIC LOCATION AND ACCESS
Uniform Resource Identifier <a href="https://doi.org/10.1007/978-3-031-43575-1">https://doi.org/10.1007/978-3-031-43575-1</a>
912 ## -
-- ZDB-2-ENG
912 ## -
-- ZDB-2-SXE

No items available.

Biblioteca Universității "Dunărea de Jos" din Galați