"Markov Chains: Analytic and Monte Carlo Computations" introduces the main notions related to Markov chains and provides explanations on how to characterize, simulate, and recognize them. Starting with basic notions, this book leads progressively to advanced and recent topics in the field, allowing the reader to master the main aspects of the classical theory. This book also features: Numerous exercises with solutions as well as extended case studies.A detailed and rigorous presentation of Markov chains with discrete time and state space.An appendix presenting probabilistic notions that are necessary to the reader, as well as giving more advanced measure-theoretic notions.

Optimal Control and Optimization of Stochastic Supply Chain Systems examines its subject the context of the presence of a variety of uncertainties. Numerous examples with intuitive illustrations and tables are provided, to demonstrate the structural characteristics of the optimal control policies in various stochastic supply chains and to show how to make use of these characteristics to construct easy-to-operate sub-optimal policies. In Part I, a general introduction to stochastic supply chain systems is provided. Analytical models for various stochastic supply chain systems are formulated and analysed in Part II. In Part III the structural knowledge of the optimal control policies obtained in Part II is utilized to construct easy-to-operate sub-optimal control policies for various stochastic supply chain systems accordingly. Finally, Part IV discusses the optimisation of threshold-type control policies and their robustness. A key feature of the book is its tying together of the complex analytical models produced by the requirements of operational practice, and the simple solutions needed for implementation. The analytical models and theoretical analysis propounded in this monograph will be of benefit to academic researchers and graduate students looking at logistics and supply chain management from standpoints in operations research or industrial, manufacturing, or control engineering. The practical tools and solutions and the qualitative insights into the ideas underlying functional supply chain systems will be of similar use to readers from more industrially-based backgrounds.

The study of M-matrices, their inverses and discrete potential theory is now a well-established part of linear algebra and the theory of Markov chains. The main focus of this monograph is the so-called inverse M-matrix problem, which asks for a characterization of nonnegative matrices whose inverses are M-matrices. We present an answer in terms of discrete potential theory based on the Choquet-Deny Theorem. A distinguished subclass of inverse M-matrices is ultrametric matrices, which are important in applications such as taxonomy. Ultrametricity is revealed to be a relevant concept in linear algebra and discrete potential theory because of its relation with trees in graph theory and mean expected value matrices in probability theory. Remarkable properties of Hadamard functions and products for the class of inverse M-matrices are developed and probabilistic insights are provided throughout the monograph.

Stochastic Analysis aims to provide mathematical tools to describe and model high dimensional random systems. Such tools arise in the study of Stochastic Differential Equations and Stochastic Partial Differential Equations, Infinite Dimensional Stochastic Geometry, Random Media and Interacting Particle Systems, Super-processes, Stochastic Filtering, Mathematical Finance, etc. Stochastic Analysis has emerged as a core area of late 20th century Mathematics and is currently undergoing a rapid scientific development. The special volume "Stochastic Analysis 2010" provides a sample of the current research in the different branches of the subject. It includes the collected works of the participants at the Stochastic Analysis section of the 7th ISAAC Congress organized at Imperial College London in July 2009.

This monograph is a presentation of a unified approach to a certain class of semimartingale inequalities, which can be regarded as probabilistic extensions of classical estimates for conjugate harmonic functions on the unit disc. The approach, which has its roots in the seminal works of Burkholder in the 80s, enables to deduce a given inequality for semimartingales from the existence of a certain special function with some convex-type properties. Remarkably, an appropriate application of the method leads to the sharp version of the estimate under investigation, which is particularly important for applications. These include the theory of quasiregular mappings (with deep implications to the geometric function theory); the boundedness of two-dimensional Hilbert transform and a more general class of Fourier multipliers; the theory of rank-one convex and quasiconvex functions; and more. The book is divided into a few separate parts. In the introductory chapter we present motivation for the results and relate them to some classical problems in harmonic analysis. The next part contains a general description of the method, which is applied in subsequent chapters to the study of sharp estimates for discrete-time martingales; discrete-time sub- and supermartingales; continuous time processes; the square and maximal functions. Each chapter contains additional bibliographical notes included for reference.

This comprehensive volume on ergodic control for diffusions highlights intuition alongside technical arguments. A concise account of Markov process theory is followed by a complete development of the fundamental issues and formalisms in control of diffusions. This then leads to a comprehensive treatment of ergodic control, a problem that straddles stochastic control and the ergodic theory of Markov processes. The interplay between the probabilistic and ergodic-theoretic aspects of the problem, notably the asymptotics of empirical measures on one hand, and the analytic aspects leading to a characterization of optimality via the associated Hamilton Jacobi Bellman equation on the other, is clearly revealed. The more abstract controlled martingale problem is also presented, in addition to many other related issues and models. Assuming only graduate-level probability and analysis, the authors develop the theory in a manner that makes it accessible to users in applied mathematics, engineering, finance and operations research.

This book brings theories in nonlinear dynamics, stochastic processes, irreversible thermodynamics, physical chemistry and biochemistry together in an introductory but formal and comprehensive manner.Coupled with examples, the theories are developed stepwise, starting with the simplest concepts and building upon them into a more general framework.Furthermore, each new mathematical derivation is immediately applied to one or more biological systems.The last chapters focus on applying mathematical and physical techniques to study systems such as: gene regulatory networks and molecular motors.

The target audience of this book are mainly final year undergraduate and graduate students with a solid mathematical background (physicists, mathematicians and engineers), as well as with basic notions of biochemistry and cellular biology. This book can also be useful to students with a biological background who are interested in mathematical modeling and have a working knowledge of calculus, differential equations and a basic understanding of probability theory."

The monograph addresses a problem of stochastic analysis based on the uncertainty assessment by simulation and application of this method in ecology and steel industry under uncertainty. The first chapter defines the Monte Carlo (MC) method and random variables in stochastic models. Chapter two deals with the contamination transport in porous media. Stochastic approach for Municipal Solid Waste transit time contaminants modeling using MC simulation has been worked out. The third chapter describes the risk analysis of the waste to energy facility proposal for Konin city, including the financial aspects. Environmental impact assessment of the ArcelorMittal Steel Power Plant, in Krakow - in the chapter four - is given. Thus, four scenarios of the energy mix production processes were studied. Chapter five contains examples of using ecological Life Cycle Assessment (LCA) - a relatively new method of environmental impact assessment - which help in preparing pro-ecological strategy, and which can lead to reducing the amount of wastes produced in the ArcelorMittal Steel Plant production processes. Moreover, real input and output data of selected processes under uncertainty, mainly used in the LCA technique, have been examined. The last chapter of this monograph contains final summary. The log-normal probability distribution, widely used in risk analysis and environmental management, in order to develop a stochastic analysis of the LCA, as well as uniform distribution for stochastic approach of pollution transport in porous media has been proposed. The distributions employed in this monograph are assembled from site-specific data, data existing in the most current literature, and professional judgment.

Random Fields on the Sphere presents a comprehensive analysis of isotropic spherical random fields. The main emphasis is on tools from harmonic analysis, beginning with the representation theory for the group of rotations SO(3). Many recent developments on the method of moments and cumulants for the analysis of Gaussian subordinated fields are reviewed. This background material is used to analyse spectral representations of isotropic spherical random fields and then to investigate in depth the properties of associated harmonic coefficients. Properties and statistical estimation of angular power spectra and polyspectra are addressed in full. The authors are strongly motivated by cosmological applications, especially the analysis of cosmic microwave background (CMB) radiation data, which has initiated a challenging new field of mathematical and statistical research. Ideal for mathematicians and statisticians interested in applications to cosmology, it will also interest cosmologists and mathematicians working in group representations, stochastic calculus and spherical wavelets.

This classic in stochastic network modelling broke new ground when it was published in 1979, and it remains a superb introduction to reversibility and its applications. The book concerns behaviour in equilibrium of vector stochastic processes or stochastic networks. When a stochastic network is reversible its analysis is greatly simplified, and the first chapter is devoted to a discussion of the concept of reversibility. The rest of the book focuses on the various applications of reversibility and the extent to which the assumption of reversibility can be relaxed without destroying the associated tractability. Now back in print for a new generation, this book makes enjoyable reading for anyone interested in stochastic processes thanks to the author's clear and easy-to-read style. Elementary probability is the only prerequisite and exercises are interspersed throughout.

Uncertainty is an inherent feature of both properties of physical systems and the inputs to these systems that needs to be quantified for cost effective and reliable designs. The states of these systems satisfy equations with random entries, referred to as stochastic equations, so that they are random functions of time and/or space. The solution of stochastic equations poses notable technical difficulties that are frequently circumvented by heuristic assumptions at the expense of accuracy and rigor. The main objective of "Stochastic Systems" is to promoting the development of accurate and efficient methods for solving stochastic equations and to foster interactions between engineers, scientists, and mathematicians. To achieve these objectives "Stochastic Systems "presents:

. A clear and brief review of essential concepts on probability theory, random functions, stochastic calculus, Monte Carlo simulation, and functional analysis

. ""Probabilistic models for random variables and functions needed to formulate stochastic equations describing realistic problems in engineering and applied sciences

. ""Practical methods for quantifying the uncertain parameters in the definition of stochastic equations, solving approximately these equations, and assessing the accuracy of approximate solutions

"Stochastic Systems "provides key information for researchers, graduate students, and engineers who are interested in the formulation and solution of stochastic problems encountered in a broad range of disciplines. Numerous examples are used to clarify and illustrate theoretical concepts and methods for solving stochastic equations. The extensive bibliography and index at the end of the book constitute an ideal resource for both theoreticians and practitioners.

"

"Potential Theory" presents a clear path from calculus to classical potential theory and beyond, with the aim of moving the reader into the area of mathematical research as quickly as possible. The subject matter is developed from first principles using only calculus. Commencing with the inverse square law for gravitational and electromagnetic forces and the divergence theorem, the author develops methods for constructing solutions of Laplace's equation on a region with prescribed values on the boundary of the region.

The latter half of the book addresses more advanced material aimed at those with the background of a senior undergraduate or beginning graduate course in real analysis. Starting with solutions of the Dirichlet problem subject to mixed boundary conditions on the simplest of regions, methods of morphing such solutions onto solutions of Poisson's equation on more general regions are developed using diffeomorphisms and the Perron-Wiener-Brelot method, culminating in application to Brownian motion.

In this new edition, many exercises have been added to reconnect the subject matter to the physical sciences. This book will undoubtedly be useful to graduate students and researchers in mathematics, physics and engineering.

In 2014, winner of "Outstanding Book Award" by The Japan Society for Fuzzy Theory and Intelligent Informatics. Covering in detail both theoretical and practical perspectives, this book is a self-contained and systematic depiction of current fuzzy stochastic optimization that deploys the fuzzy random variable as a core mathematical tool to model the integrated fuzzy random uncertainty. It proceeds in an orderly fashion from the requisite theoretical aspects of the fuzzy random variable to fuzzy stochastic optimization models and their real-life case studies. The volume reflects the fact that randomness and fuzziness (or vagueness) are two major sources of uncertainty in the real world, with significant implications in a number of settings. In industrial engineering, management and economics, the chances are high that decision makers will be confronted with information that is simultaneously probabilistically uncertain and fuzzily imprecise, and optimization in the form of a decision must be made in an environment that is doubly uncertain, characterized by a co-occurrence of randomness and fuzziness. This book begins by outlining the history and development of the fuzzy random variable before detailing numerous optimization models and applications that include the design of system controls for a dam.

Stochastic Optimal Control (SOC)-a mathematical theory concerned with minimizing a cost (or maximizing a payout) pertaining to a controlled dynamic processunder uncertainty-has proven incredibly helpful to understanding and predicting debt crises and evaluating proposed financial regulation and risk management."Stochastic Optimal Control and the U.S. Financial Debt Crisis"analyzes SOC in relation to the 2008 U.S. financial crisis, and offers a detailed framework depicting why such a methodology is best suited for reducing financial risk and addressing key regulatory issues. Topics discussed include the inadequacies of the current approaches underlying financial regulations, the use of SOC to explain debt crises and superiority over existing approaches to regulation, and the domestic and international applications of SOC to financial crises. Principles in this book will appeal to economists, mathematicians, and researchers interested in the U.S. financial debt crisis and optimal risk management."

Line and hyperplane location problems play an important role not only in operations research and location theory, but also in computational geometry and robust statistics. This book provides a survey on line and hyperplane location combining analytical and geometrical methods. The major portion of the text presents new results on this topic, including the extension of some special cases to all distances derived from norms and a discussion of restricted problems in the plane. Almost all results are proven in the text and most of them are illustrated by examples. Furthermore, relations to classical facility location and to problems in computational geometry are pointed out. Audience: The book is suitable for researchers, lecturers, and graduate students working in the fields of location theory or computational geometry.

This book explores the remarkable connections between two domains that, a priori, seem unrelated: Random matrices (together with associated random processes) and integrable systems. The relations between random matrix models and the theory of classical integrable systems have long been studied. These appear mainly in the deformation theory, when parameters characterizing the measures or the domain of localization of the eigenvalues are varied. The resulting differential equations determining the partition function and correlation functions are, remarkably, of the same type as certain equations appearing in the theory of integrable systems. They may be analyzed effectively through methods based upon the Riemann-Hilbert problem of analytic function theory and by related approaches to the study of nonlinear asymptotics in the large N limit. Associated with studies of matrix models are certain stochastic processes, the "Dyson processes", and their continuum diffusion limits, which govern the spectrum in random matrix ensembles, and may also be studied by related methods. Random Matrices, Random Processes and Integrable Systems provides an in-depth examination of random matrices with applications over a vast variety of domains, including multivariate statistics, random growth models, and many others. Leaders in the field apply the theory of integrable systems to the solution of fundamental problems in random systems and processes using an interdisciplinary approach that sheds new light on a dynamic topic of current research.

Reliability theory is of fundamental importance for engineers and managers involved in the manufacture of high-quality products and the design of reliable systems. In order to make sense of the theory, however, and to apply it to real systems, an understanding of the basic stochastic processes is indispensable. As well as providing readers with useful reliability studies and applications, Stochastic Processes also gives a basic treatment of such stochastic processes as: the Poisson process, the renewal process, the Markov chain, the Markov process, and the Markov renewal process. Many examples are cited from reliability models to show the reader how to apply stochastic processes. Furthermore, Stochastic Processes gives a simple introduction to other stochastic processes such as the cumulative process, the Wiener process, the Brownian motion and reliability applications. Stochastic Processes is suitable for use as a reliability textbook by advanced undergraduate and graduate students. It is also of interest to researchers, engineers and managers who study or practise reliability and maintenance.

Pluripotential theory is a very powerful tool in geometry, complex analysis and dynamics. This volume brings together the lectures held at the 2011 CIME session on "pluripotential theory" in Cetraro, Italy. This CIME course focused on complex Monge-Ampere equations, applications of pluripotential theory to Kahler geometry and algebraic geometry and to holomorphic dynamics. The contributions provide an extensive description of the theory and its very recent developments, starting from basic introductory materials and concluding with open questions in current research.

Stochastic processes with jumps and random measures are importance as drivers in applications like financial mathematics and signal processing. This 2002 text develops stochastic integration theory for both integrators (semimartingales) and random measures from a common point of view. Using some novel predictable controlling devices, the author furnishes the theory of stochastic differential equations driven by them, as well as their stability and numerical approximation theories. Highlights feature DCT and Egoroff's Theorem, as well as comprehensive analogs results from ordinary integration theory, for instance previsible envelopes and an algorithm computing stochastic integrals of caglad integrands pathwise. Full proofs are given for all results, and motivation is stressed throughout. A large appendix contains most of the analysis that readers will need as a prerequisite. This will be an invaluable reference for graduate students and researchers in mathematics, physics, electrical engineering and finance who need to use stochastic differential equations.

Univariate statistical analysis is concerned with techniques for the analysis of a single random variable. This book is about applied multivariate analysis. It was written to p- vide students and researchers with an introduction to statistical techniques for the ana- sis of continuous quantitative measurements on several random variables simultaneously. While quantitative measurements may be obtained from any population, the material in this text is primarily concerned with techniques useful for the analysis of continuous obser- tions from multivariate normal populations with linear structure. While several multivariate methods are extensions of univariate procedures, a unique feature of multivariate data an- ysis techniques is their ability to control experimental error at an exact nominal level and to provide information on the covariance structure of the data. These features tend to enhance statistical inference, making multivariate data analysis superior to univariate analysis. While in a previous edition of my textbook on multivariate analysis, I tried to precede a multivariate method with a corresponding univariate procedure when applicable, I have not taken this approach here. Instead, it is assumed that the reader has taken basic courses in multiple linear regression, analysis of variance, and experimental design. While students may be familiar with vector spaces and matrices, important results essential to multivariate analysis are reviewed in Chapter 2. I have avoided the use of calculus in this text.

Provides a Solid Foundation for Statistical Modeling and Inference and Demonstrates Its Breadth of Applicability Stochastic Modeling and Mathematical Statistics: A Text for Statisticians and Quantitative Scientists addresses core issues in post-calculus probability and statistics in a way that is useful for statistics and mathematics majors as well as students in the quantitative sciences. The book's conversational tone, which provides the mathematical justification behind widely used statistical methods in a reader-friendly manner, and the book's many examples, tutorials, exercises and problems for solution, together constitute an effective resource that students can read and learn from and instructors can count on as a worthy complement to their lectures. Using classroom-tested approaches that engage students in active learning, the text offers instructors the flexibility to control the mathematical level of their course. It contains the mathematical detail that is expected in a course for "majors" but is written in a way that emphasizes the intuitive content in statistical theory and the way theoretical results are used in practice. More than 1000 exercises and problems at varying levels of difficulty and with a broad range of topical focus give instructors many options in assigning homework and provide students with many problems on which to practice and from which to learn.

This volume provides a modern introduction to stochastic geometry, random fields and spatial statistics at a (post)graduate level. It is focused on asymptotic methods in geometric probability including weak and strong limit theorems for random spatial structures (point processes, sets, graphs, fields) with applications to statistics. Written as a contributed volume of lecture notes, it will be useful not only for students but also for lecturers and researchers interested in geometric probability and related subjects.

Methods of global analysis and stochastic analysis are most often applied in mathematical physics as separate entities, thus forming important directions in the field. However, while combination of the two subject areas is rare, it is fundamental for the consideration of a broader class of problems. This book develops methods of Global Analysis and Stochastic Analysis such that their combination allows one to have a more or less common treatment for areas of mathematical physics that traditionally are considered as divergent and requiring different methods of investigation. Global and Stochastic Analysis with Applications to Mathematical Physics covers branches of mathematics that are currently absent in monograph form. Through the demonstration of new topics of investigation and results, both in traditional and more recent problems, this book offers a fresh perspective on ordinary and stochastic differential equations and inclusions (in particular, given in terms of Nelson's mean derivatives) on linear spaces and manifolds. Topics covered include classical mechanics on non-linear configuration spaces, problems of statistical and quantum physics, and hydrodynamics. A self-contained book that provides a large amount of preliminary material and recent results which will serve to be a useful introduction to the subject and a valuable resource for further research. It will appeal to researchers, graduate and PhD students working in global analysis, stochastic analysis and mathematical physics.

The systematic study of existence, uniqueness, and properties of solutions to stochastic differential equations in infinite dimensions arising from practical problems characterizes this volume that is intended for graduate students and for pure and applied mathematicians, physicists, engineers, professionals working with mathematical models of finance. Major methods include compactness, coercivity, monotonicity, in a variety of set-ups. The authors emphasize the fundamental work of Gikhman and Skorokhod on the existence and uniqueness of solutions to stochastic differential equations and present its extension to infinite dimension. They also generalize the work of Khasminskii on stability and stationary distributions of solutions. New results, applications, and examples of stochastic partial differential equations are included. This clear and detailed presentation gives the basics of the infinite dimensional version of the classic books of Gikhman and Skorokhod and of Khasminskii in one concise volume that covers the main topics in infinite dimensional stochastic PDE's. By appropriate selection of material, the volume can be adapted for a 1- or 2-semester course, and can prepare the reader for research in this rapidly expanding area.

Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model the behavior of many systems including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems. Covering a wide range of areas of application of Markov processes, this second edition is revised to highlight the most important aspects as well as the most recent trends and applications of Markov processes. The author spent over 16 years in the industry before returning to academia, and he has applied many of the principles covered in this book in multiple research projects. Therefore, this is an applications-oriented book that also includes enough theory to provide a solid ground in the subject for the reader.