This book is devoted to the systematic exposition of the contemporary theory of controlled Markov processes with discrete time parameter or in another termi nology multistage Markovian decision processes. We discuss the applications of this theory to various concrete problems. Particular attention is paid to mathe matical models of economic planning, taking account of stochastic factors. The authors strove to construct the exposition in such a way that a reader interested in the applications can get through the book with a minimal mathe matical apparatus. On the other hand, a mathematician will find, in the appropriate chapters, a rigorous theory of general control models, based on advanced measure theory, analytic set theory, measurable selection theorems, and so forth. We have abstained from the manner of presentation of many mathematical monographs, in which one presents immediately the most general situation and only then discusses simpler special cases and examples. Wishing to separate out difficulties, we introduce new concepts and ideas in the simplest setting, where they already begin to work. Thus, before considering control problems on an infinite time interval, we investigate in detail the case of the finite interval. Here we first study in detail models with finite state and action spaces-a case not requiring a departure from the realm of elementary mathematics, and at the same time illustrating the most important principles of the theory."

Eugene Dynkin is a rare example of a contemporary mathematician who has achieved outstanding results in two quite different areas of research: algebra and probability. In both areas, his ideas constitute an essential part of modern mathematical knowledge and form a basis for further development. Although his last work in algebra was published in 1955, his contributions continue to influence current research in algebra and in the physics of elementary particles. His work in probability is part of both the historical and the modern development of the topic. This volume presents Dynkin's scientific contributions in both areas. Included are commentary by recognized experts in the corresponding fields who describe the time, place, role, and impact of Dynkin's research and achievements. Biographical notes and the recollections of his students are also featured.