The concept of a system as an entity in its own right has emerged with increasing force in the past few decades in, for example, the areas of electrical and control engineering, economics, ecology, urban structures, automaton theory, operational research and industry. The more definite concept of a large-scale system is implicit in these applications, but is particularly evident in fields such as the study of communication networks, computer networks and neural networks. The Wiley-Interscience Series in Systems and Optimization has been established to serve the needs of researchers in these rapidly developing fields. It is intended for works concerned with developments in quantitative systems theory, applications of such theory in areas of interest, or associated methodology. Of related interest Stochastic Programming Peter Kall, University of ZA1/4rich, Switzerland and Stein W. Wallace, University of Trondheim, Norway Stochastic Programming is the first textbook to provide a thorough and self-contained introduction to the subject. Carefully written to cover all necessary background material from both linear and non-linear programming, as well as probability theory, the book draws together the methods and techniques previously described in disparate sources. After introducing the terms and modelling issues when randomness is introduced in a deterministic mathematical programming model, the authors cover decision trees and dynamic programming, recourse problems, probabilistic constraints, preprocessing and network problems. Exercises are provided at the end of each chapter. Throughout, the emphasis is on the appropriate use of the techniques, rather than on the underlying mathematicalproofs and theories, making the book ideal for researchers and students in mathematical programming and operations research who wish to develop their skills in stochastic programming.

In recent years, random variables and stochastic processes have emerged as important factors in predicting outcomes in virtually every field of applied and social science. Ironically, according to Nicolas Bouleau and Dominique Lepingle, the presence of randomness in the model sometimes leads engineers to accept crude mathematical treatments that produce inaccurate results. The purpose of Numerical Methods for Stochastic Processes is to add greater rigor to numerical treatment of stochastic processes so that they produce results that can be relied upon when making decisions and assessing risks. Based on a postgraduate course given by the authors at Paris 6 University, the text emphasizes simulation methods, which can now be implemented with specialized computer programs. Specifically presented are the Monte Carlo and shift methods, which use an "imitation of randomness" and have a wide range of applications, and the so-called quasi-Monte Carlo methods, which are rigorous but less widely applicable. Offering a broad introduction to the field, this book presents the current state of the main methods and ideas and the cases for which they have been proved. Nevertheless, the authors do explore problems raised by these newer methods and suggest areas in which further research is needed. Extensive notes and a full bibliography give interested readers the option of delving deeper into stochastic numerical analysis. For professional statisticians, engineers, and physical and social scientists, Numerical Methods for Stochastic Processes provides both the theoretical background and the necessary practical tools to improve predictions based on randomness in the model. With its exercises andbroad-spectrum coverage, it is also an excellent textbook for introductory graduate-level courses in stochastic process mathematics.

This book provides a comprehensive introduction to the theory of stochastic calculus and some of its applications. It is the only textbook on the subject to include more than two hundred exercises with complete solutions. After explaining the basic elements of probability, the author introduces more advanced topics such as Brownian motion, martingales and Markov processes. The core of the book covers stochastic calculus, including stochastic differential equations, the relationship to partial differential equations, numerical methods and simulation, as well as applications of stochastic processes to finance. The final chapter provides detailed solutions to all exercises, in some cases presenting various solution techniques together with a discussion of advantages and drawbacks of the methods used. Stochastic Calculus will be particularly useful to advanced undergraduate and graduate students wishing to acquire a solid understanding of the subject through the theory and exercises. Including full mathematical statements and rigorous proofs, this book is completely self-contained and suitable for lecture courses as well as self-study.

The field of applied probability has changed profoundly in the past twenty years. The development of computational methods has greatly contributed to a better understanding of the theory. A First Course in Stochastic Models provides a self-contained introduction to the theory and applications of stochastic models. Emphasis is placed on establishing the theoretical foundations of the subject, thereby providing a framework in which the applications can be understood. Without this solid basis in theory no applications can be solved.

• Provides an introduction to the use of stochastic models through an integrated presentation of theory, algorithms and applications.

• Incorporates recent developments in computational probability.

• Includes a wide range of examples that illustrate the models and make the methods of solution clear.

• Features an abundance of motivating exercises that help the student learn how to apply the theory.

• Accessible to anyone with a basic knowledge of probability.

The mathematical theory of stochastic dynamics has become an important tool in the modeling of uncertainty in many complex biological, physical, and chemical systems and in engineering applications - for example, gene regulation systems, neuronal networks, geophysical flows, climate dynamics, chemical reaction systems, nanocomposites, and communication systems. It is now understood that these systems are often subject to random influences, which can significantly impact their evolution. This book serves as a concise introductory text on stochastic dynamics for applied mathematicians and scientists. Starting from the knowledge base typical for beginning graduate students in applied mathematics, it introduces the basic tools from probability and analysis and then develops for stochastic systems the properties traditionally calculated for deterministic systems. The book's final chapter opens the door to modeling in non-Gaussian situations, typical of many real-world applications. Rich with examples, illustrations, and exercises with solutions, this book is also ideal for self-study.

The mathematical theory of stochastic dynamics has become an important tool in the modeling of uncertainty in many complex biological, physical, and chemical systems and in engineering applications - for example, gene regulation systems, neuronal networks, geophysical flows, climate dynamics, chemical reaction systems, nanocomposites, and communication systems. It is now understood that these systems are often subject to random influences, which can significantly impact their evolution. This book serves as a concise introductory text on stochastic dynamics for applied mathematicians and scientists. Starting from the knowledge base typical for beginning graduate students in applied mathematics, it introduces the basic tools from probability and analysis and then develops for stochastic systems the properties traditionally calculated for deterministic systems. The book's final chapter opens the door to modeling in non-Gaussian situations, typical of many real-world applications. Rich with examples, illustrations, and exercises with solutions, this book is also ideal for self-study.

The book develops modern methods and in particular the "generic chaining" to bound stochastic processes. This methods allows in particular to get optimal bounds for Gaussian and Bernoulli processes. Applications are given to stable processes, infinitely divisible processes, matching theorems, the convergence of random Fourier series, of orthogonal series, and to functional analysis. The complete solution of a number of classical problems is given in complete detail, and an ambitious program for future research is laid out.

This book examines optimization problems that in practice involve random model parameters. It details the computation of robust optimal solutions, i.e., optimal solutions that are insensitive with respect to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems. Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures and differentiation formulas for probabilities and expectations. In the third edition, this book further develops stochastic optimization methods. In particular, it now shows how to apply stochastic optimization methods to the approximate solution of important concrete problems arising in engineering, economics and operations research.

Focusing on stochastic porous media equations, this book places an emphasis on existence theorems, asymptotic behavior and ergodic properties of the associated transition semigroup. Stochastic perturbations of the porous media equation have reviously been considered by physicists, but rigorous mathematical existence results have only recently been found. The porous media equation models a number of different physical phenomena, including the flow of an ideal gas and the diffusion of a compressible fluid through porous media, and also thermal propagation in plasma and plasma radiation. Another important application is to a model of the standard self-organized criticality process, called the "sand-pile model" or the "Bak-Tang-Wiesenfeld model". The book will be of interest to PhD students and researchers in mathematics, physics and biology.

This book gives a comprehensive introduction to numerical methods and analysis of stochastic processes, random fields and stochastic differential equations, and offers graduate students and researchers powerful tools for understanding uncertainty quantification for risk analysis. Coverage includes traditional stochastic ODEs with white noise forcing, strong and weak approximation, and the multi-level Monte Carlo method. Later chapters apply the theory of random fields to the numerical solution of elliptic PDEs with correlated random data, discuss the Monte Carlo method, and introduce stochastic Galerkin finite-element methods. Finally, stochastic parabolic PDEs are developed. Assuming little previous exposure to probability and statistics, theory is developed in tandem with state-of-the-art computational methods through worked examples, exercises, theorems and proofs. The set of MATLAB (R) codes included (and downloadable) allows readers to perform computations themselves and solve the test problems discussed. Practical examples are drawn from finance, mathematical biology, neuroscience, fluid flow modelling and materials science.

This book gives a comprehensive introduction to numerical methods and analysis of stochastic processes, random fields and stochastic differential equations, and offers graduate students and researchers powerful tools for understanding uncertainty quantification for risk analysis. Coverage includes traditional stochastic ODEs with white noise forcing, strong and weak approximation, and the multi-level Monte Carlo method. Later chapters apply the theory of random fields to the numerical solution of elliptic PDEs with correlated random data, discuss the Monte Carlo method, and introduce stochastic Galerkin finite-element methods. Finally, stochastic parabolic PDEs are developed. Assuming little previous exposure to probability and statistics, theory is developed in tandem with state-of-the-art computational methods through worked examples, exercises, theorems and proofs. The set of MATLAB (R) codes included (and downloadable) allows readers to perform computations themselves and solve the test problems discussed. Practical examples are drawn from finance, mathematical biology, neuroscience, fluid flow modelling and materials science.

In some cases, certain coherent structures can exist in stochastic dynamic systems almost in every particular realization of random parameters describing these systems. Dynamic localization in one-dimensional dynamic systems, vortexgenesis (vortex production) in hydrodynamic flows, and phenomenon of clustering of various fields in random media (i.e., appearance of small regions with enhanced content of the field against the nearly vanishing background of this field in the remaining portion of space) are examples of such structure formation. The general methodology presented in Volume 1 is used in Volume 2 Coherent Phenomena in Stochastic Dynamic Systems to expound the theory of these phenomena in some specific fields of stochastic science, among which are hydrodynamics, magnetohydrodynamics, acoustics, optics, and radiophysics. The material of this volume includes particle and field clustering in the cases of scalar (density field) and vector (magnetic field) passive tracers in a random velocity field, dynamic localization of plane waves in layered random media, as well as monochromatic wave propagation and caustic structure formation in random media in terms of the scalar parabolic equation.

Three coherent parts form the material covered in this text, portions of which have not been widely covered in traditional textbooks. In this coverage the reader is quickly introduced to several different topics enriched with 175 exercises which focus on real-world problems. Exercises range from the classics of probability theory to more exotic research-oriented problems based on numerical simulations. Intended for graduate students in mathematics and applied sciences, the text provides the tools and training needed to write and use programs for research purposes. The first part of the text begins with a brief review of measure theory and revisits the main concepts of probability theory, from random variables to the standard limit theorems. The second part covers traditional material on stochastic processes, including martingales, discrete-time Markov chains, Poisson processes, and continuous-time Markov chains. The theory developed is illustrated by a variety of examples surrounding applications such as the gambler's ruin chain, branching processes, symmetric random walks, and queueing systems. The third, more research-oriented part of the text, discusses special stochastic processes of interest in physics, biology, and sociology. Additional emphasis is placed on minimal models that have been used historically to develop new mathematical techniques in the field of stochastic processes: the logistic growth process, the Wright -Fisher model, Kingman's coalescent, percolation models, the contact process, and the voter model. Further treatment of the material explains how these special processes are connected to each other from a modeling perspective as well as their simulation capabilities in C and Matlab (TM).

Focusing on what actuaries need in practice, this introductory account provides readers with essential tools for handling complex problems and explains how simulation models can be created, used and re-used (with modifications) in related situations. The book begins by outlining the basic tools of modelling and simulation, including a discussion of the Monte Carlo method and its use. Part II deals with general insurance and Part III with life insurance and financial risk. Algorithms that can be implemented on any programming platform are spread throughout and a program library written in R is included. Numerous figures and experiments with R-code illustrate the text. The author's non-technical approach is ideal for graduate students, the only prerequisites being introductory courses in calculus and linear algebra, probability and statistics. The book will also be of value to actuaries and other analysts in the industry looking to update their skills.

Communication networks underpin our modern world, and provide fascinating and challenging examples of large-scale stochastic systems. Randomness arises in communication systems at many levels: for example, the initiation and termination times of calls in a telephone network, or the statistical structure of the arrival streams of packets at routers in the Internet. How can routing, flow control and connection acceptance algorithms be designed to work well in uncertain and random environments? This compact introduction illustrates how stochastic models can be used to shed light on important issues in the design and control of communication networks. It will appeal to readers with a mathematical background wishing to understand this important area of application, and to those with an engineering background who want to grasp the underlying mathematical theory. Each chapter ends with exercises and suggestions for further reading.

Stochastic scheduling is in the area of production scheduling. There is a dearth of work that analyzes the variability of schedules. In a stochastic environment, in which the processing time of a job is not known with certainty, a schedule is typically analyzed based on the expected value of a performance measure. This book addresses this problem and presents algorithms to determine the variability of a schedule under various machine configurations and objective functions. It is intended for graduate and advanced undergraduate students in manufacturing, operations management, applied mathematics, and computer science, and it is also a good reference book for practitioners. Computer software containing the algorithms is provided on an accompanying website for ease of student and user implementation.

This book studies some of the groundbreaking advances that have been made regarding analytic capacity and its relationship to rectifiability in the decade 1995-2005. The Cauchy transform plays a fundamental role in this area and is accordingly one of the main subjects covered. Another important topic, which may be of independent interest for many analysts, is the so-called non-homogeneous Calderon-Zygmund theory, the development of which has been largely motivated by the problems arising in connection with analytic capacity. The Painleve problem, which was first posed around 1900, consists in finding a description of the removable singularities for bounded analytic functions in metric and geometric terms. Analytic capacity is a key tool in the study of this problem. In the 1960s Vitushkin conjectured that the removable sets which have finite length coincide with those which are purely unrectifiable. Moreover, because of the applications to the theory of uniform rational approximation, he posed the question as to whether analytic capacity is semiadditive. This work presents full proofs of Vitushkin's conjecture and of the semiadditivity of analytic capacity, both of which remained open problems until very recently. Other related questions are also discussed, such as the relationship between rectifiability and the existence of principal values for the Cauchy transforms and other singular integrals. The book is largely self-contained and should be accessible for graduate students in analysis, as well as a valuable resource for researchers.

Direct and to the point, this book from one of the field's leaders covers Brownian motion and stochastic calculus at the graduate level, and illustrates the use of that theory in various application domains, emphasizing business and economics. The mathematical development is narrowly focused and briskly paced, with many concrete calculations and a minimum of abstract notation. The applications discussed include: the role of reflected Brownian motion as a storage model, queueing model, or inventory model; optimal stopping problems for Brownian motion, including the influential McDonald-Siegel investment model; optimal control of Brownian motion via barrier policies, including optimal control of Brownian storage systems; and Brownian models of dynamic inference, also called Brownian learning models, or Brownian filtering models.

Complexity science is the study of systems with many interdependent components. Such systems - and the self-organization and emergent phenomena they manifest - lie at the heart of many challenges of global importance. This book is a coherent introduction to the mathematical methods used to understand complexity, with plenty of examples and real-world applications. It starts with the crucial concepts of self-organization and emergence, then tackles complexity in dynamical systems using differential equations and chaos theory. Several classes of models of interacting particle systems are studied with techniques from stochastic analysis, followed by a treatment of the statistical mechanics of complex systems. Further topics include numerical analysis of PDEs, and applications of stochastic methods in economics and finance. The book concludes with introductions to space-time phases and selfish routing. The exposition is suitable for researchers, practitioners and students in complexity science and related fields at advanced undergraduate level and above.

An extension problem (often called a boundary problem) of Markov processes has been studied, particularly in the case of one-dimensional diffusion processes, by W. Feller, K. Ito, and H. P. McKean, among others. In this book, Ito discussed a case of a general Markov process with state space S and a specified point a S called a boundary. The problem is to obtain all possible recurrent extensions of a given minimal process (i.e., the process on S \ {a} which is absorbed on reaching the boundary a). The study in this lecture is restricted to a simpler case of the boundary a being a discontinuous entrance point, leaving a more general case of a continuous entrance point to future works. He established a one-to-one correspondence between a recurrent extension and a pair of a positive measure k(db) on S \ {a} (called the jumping-in measure and a non-negative number m< (called the stagnancy rate). The necessary and sufficient conditions for a pair k, m was obtained so that the correspondence is precisely described. For this, Ito used, as a fundamental tool, the notion of Poisson point processes formed of all excursions of the process on S \ {a}. This theory of Ito's of Poisson point processes of excursions is indeed a breakthrough. It has been expanded and applied to more general extension problems by many succeeding researchers. Thus we may say that this lecture note by Ito is really a memorial work in the extension problems of Markov processes. Especially in Chapter 1 of this note, a general theory of Poisson point processes is given that reminds us of Ito's beautiful and impressive lectures in his day.

Wiley-Interscience Series in Discrete Mathematics and Optimization Advisory Editors Ronald L. Graham Jan Karel Lenstra Robert E. Tarjan Discrete Mathematics and Optimization involves the study of finite structures. It is one of the fastest growing areas in mathematics today. The level and depth of recent advances in the area and the wide applicability of its evolving techniques point to the rapidity with which the field is moving from its beginnings to maturity and presage the ever-increasing interaction between it and computer science. The Series provides a broad coverage of discrete mathematics and optimization, ranging over such fields as combinatorics, graph theory, enumeration, mathematical programming and the analysis of algorithms, and including such topics as Ramsey theory, transversal theory, block designs, finite geometries, Polya theory, graph and matroid algorithms, network flows, polyhedral combinatorics and computational complexity. The Wiley - Interscience Series in Discrete Mathematics and Optimization will be a substantial part of the record of this extraordinary development. Recent titles in the Series: Search Problems Rudolf Ahlswede, University of Bielefeld, Federal Republic of Germany Ingo Wegener, Johann Wolfgang Goethe University, Frankfurt, Federal Republic of Germany The problems of search, exploration, discovery and identification are of key importance in a wide variety of applications. This book will be of great interest to all those concerned with searching, sorting, information processing, design of experiments and optimal allocation of resources. 1987 Introduction to Optimization E. M. L. Beale FRS, Scicon Ltd, Milton Keynes, and Imperial College, London This book is intended as an introduction to the many topics covered by the term 'optimization', with special emphasis on applications in industry. It is divided into three parts. The first part covers unconstrained optimization, the second describes the methods used to solve linear programming problems, and the third covers nonlinear programming, integer programming and dynamic programming. The book is intended for senior undergraduate and graduate students studying optimization as part of a course in mathematics, computer science or engineering. 1988

Networked control systems are increasingly ubiquitous today, with applications ranging from vehicle communication and adaptive power grids to space exploration and economics. The optimal design of such systems presents major challenges, requiring tools from various disciplines within applied mathematics such as decentralized control, stochastic control, information theory, and quantization. A thorough, self-contained book, Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints aims to connect these diverse disciplines with precision and rigor, while conveying design guidelines to controller architects. Unique in the literature, it lays a comprehensive theoretical foundation for the study of networked control systems, and introduces an array of concrete tools for work in the field. Salient features included: * Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. * Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. * Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. * Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. * Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end. * Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. * Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. * Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. * Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. * Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.

This book brings theories in nonlinear dynamics, stochastic processes, irreversible thermodynamics, physical chemistry and biochemistry together in an introductory but formal and comprehensive manner.Coupled with examples, the theories are developed stepwise, starting with the simplest concepts and building upon them into a more general framework.Furthermore, each new mathematical derivation is immediately applied to one or more biological systems.The last chapters focus on applying mathematical and physical techniques to study systems such as: gene regulatory networks and molecular motors.

The target audience of this book are mainly final year undergraduate and graduate students with a solid mathematical background (physicists, mathematicians and engineers), as well as with basic notions of biochemistry and cellular biology. This book can also be useful to students with a biological background who are interested in mathematical modeling and have a working knowledge of calculus, differential equations and a basic understanding of probability theory."

The monograph addresses a problem of stochastic analysis based on the uncertainty assessment by simulation and application of this method in ecology and steel industry under uncertainty. The first chapter defines the Monte Carlo (MC) method and random variables in stochastic models. Chapter two deals with the contamination transport in porous media. Stochastic approach for Municipal Solid Waste transit time contaminants modeling using MC simulation has been worked out. The third chapter describes the risk analysis of the waste to energy facility proposal for Konin city, including the financial aspects. Environmental impact assessment of the ArcelorMittal Steel Power Plant, in Krakow - in the chapter four - is given. Thus, four scenarios of the energy mix production processes were studied. Chapter five contains examples of using ecological Life Cycle Assessment (LCA) - a relatively new method of environmental impact assessment - which help in preparing pro-ecological strategy, and which can lead to reducing the amount of wastes produced in the ArcelorMittal Steel Plant production processes. Moreover, real input and output data of selected processes under uncertainty, mainly used in the LCA technique, have been examined. The last chapter of this monograph contains final summary. The log-normal probability distribution, widely used in risk analysis and environmental management, in order to develop a stochastic analysis of the LCA, as well as uniform distribution for stochastic approach of pollution transport in porous media has been proposed. The distributions employed in this monograph are assembled from site-specific data, data existing in the most current literature, and professional judgment.

Stochastic calculus provides a powerful description of a specific class of stochastic processes in physics and finance. However, many econophysicists struggle to understand it. This book presents the subject simply and systematically, giving graduate students and practitioners a better understanding and enabling them to apply the methods in practice. The book develops Ito calculus and Fokker-Planck equations as parallel approaches to stochastic processes, using those methods in a unified way. The focus is on nonstationary processes, and statistical ensembles are emphasized in time series analysis. Stochastic calculus is developed using general martingales. Scaling and fat tails are presented via diffusive models. Fractional Brownian motion is thoroughly analyzed and contrasted with Ito processes. The Chapman-Kolmogorov and Fokker-Planck equations are shown in theory and by example to be more general than a Markov process. The book also presents new ideas in financial economics and a critical survey of econometrics.