This book is devoted to the study and optimization of spatiotemporal stochastic processes, that is, processes which develop simultaneously in space and time under random influences. These processes are seen to occur almost everywhere when studying the global behavior of complex systems, including:

- Physical and technical systems

- Population dynamics

- Neural networks

- Computer and telecommunication networks

- Complex production networks

- Flexible manufacturing systems

- Logistic networks and transportation systems

-Environmental engineering

Climate modelling and prediction

Earth surface models

Classical stochastic dynamic optimization forms the framework of the book. Taken as a whole, the project undertaken in the book is to establish optimality or near-optimality for Markovian policies in the control of spatiotemporal Markovian processes. The authors apply this general principle to different frameworks of Markovian systems and processes. Depending on the structure of the systems and the surroundings of the model classes the authors arrive at different levels of simplicity for the policy classes which encompass optimal or nearly optimal policies. A set of examples accompanies the theoretical findings, and these examples should demonstrate some important application areas for the theorems discussed.

Building on classical queueing theory mainly dealing with single node queueing systems, networks of queues, or stochastic networks has been a field of intensive research over the last three decades. Whereas the first breakthrough in queueing network theory was initiated by problems and work in operations research, the second breakthrough, as well as subsequent major work in the area, was closely related to computer science, particularly to performance analysis of complex systems in computer and communication science.The text reports on recent research and development in the area. It is centered around explicit expressions for the steady behavior of discrete time queueing networks and gives a moderately positive answer to the question of whether there can be a product form calculus in discrete time. Originating from a course given by the author at Hamburg University, this book is ideally suited as a text for courses on discrete time stochastic networks.