0
Your cart

Your cart is empty

Books > Science & Mathematics > Mathematics > Applied mathematics > Stochastics

Buy Now

Constrained Markov Decision Processes - Stochastic Modeling (Hardcover) Loot Price: R5,525
Discovery Miles 55 250
Constrained Markov Decision Processes - Stochastic Modeling (Hardcover): Eitan Altman

Constrained Markov Decision Processes - Stochastic Modeling (Hardcover)

Eitan Altman

Series: Stochastic Modeling Series

 (sign in to rate)
Loot Price R5,525 Discovery Miles 55 250 | Repayment Terms: R518 pm x 12*

Bookmark and Share

Expected to ship within 12 - 19 working days

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction.
The book is then divided into three sections that build upon each other.
The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques.
In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework.
The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given.

General

Imprint: Chapman & Hall/CRC
Country of origin: United States
Series: Stochastic Modeling Series
Release date: March 1999
First published: 1999
Authors: Eitan Altman
Dimensions: 229 x 152 x 19mm (L x W x T)
Format: Hardcover
Pages: 256
ISBN-13: 978-0-8493-0382-1
Categories: Books > Science & Mathematics > Mathematics > Probability & statistics
Books > Science & Mathematics > Mathematics > Applied mathematics > Stochastics
Promotions
LSN: 0-8493-0382-6
Barcode: 9780849303821

Is the information for this product incomplete, wrong or inappropriate? Let us know about it.

Does this product have an incorrect or missing image? Send us a new image.

Is this product missing categories? Add more categories.

Review This Product

No reviews yet - be the first to create one!

You might also like..

Stochastic Analysis of Mixed Fractional…
Yuliya Mishura, Mounir Zili Hardcover R2,911 R2,732 Discovery Miles 27 320
Best Books gegradeerde leesreeks: Vlak 1…
Best Books Paperback R95 R90 Discovery Miles 900
Stochastic Processes and Their…
Christo Ananth, N. Anbazhagan, … Hardcover R7,253 Discovery Miles 72 530
Deep Learning, Volume 48
Arni S.R. Srinivasa Rao, Venu Govindaraju, … Hardcover R7,847 R6,560 Discovery Miles 65 600
Special Functions Of Fractional…
Trifce Sandev, Alexander Iomin Hardcover R2,577 Discovery Miles 25 770
Advancements in Bayesian Methods and…
Alastair G Young, Arni S.R. Srinivasa Rao, … Hardcover R7,879 R6,592 Discovery Miles 65 920
Geometry and Statistics, Volume 46
Frank Nielsen, Arni S.R. Srinivasa Rao, … Hardcover R7,871 R6,584 Discovery Miles 65 840
Stochastic Komatu-loewner Evolutions
Zhen-Qing Chen, Masatoshi Fukushima, … Hardcover R2,567 Discovery Miles 25 670
Data Science: Theory and Applications…
C.R. Rao, Arni S.R. Srinivasa Rao Hardcover R7,853 R6,566 Discovery Miles 65 660
Hidden Link Prediction in Stochastic…
Babita Pandey, Aditya Khamparia Hardcover R5,251 Discovery Miles 52 510
Stochastic Partial Differential…
Ciprian A. Tudor Hardcover R2,063 Discovery Miles 20 630
Stochastic Models of Financial…
Vigirdas Mackevicius Hardcover R2,608 R2,455 Discovery Miles 24 550

See more

Partners