An extension problem (often called a boundary problem) of Markov processes has been studied, particularly in the case of one-dimensional diffusion processes, by W. Feller, K. Ito, and H. P. McKean, among others. In this book, Ito discussed a case of a general Markov process with state space S and a specified point a S called a boundary. The problem is to obtain all possible recurrent extensions of a given minimal process (i.e., the process on S \ {a} which is absorbed on reaching the boundary a). The study in this lecture is restricted to a simpler case of the boundary a being a discontinuous entrance point, leaving a more general case of a continuous entrance point to future works. He established a one-to-one correspondence between a recurrent extension and a pair of a positive measure k(db) on S \ {a} (called the jumping-in measure and a non-negative number m< (called the stagnancy rate). The necessary and sufficient conditions for a pair k, m was obtained so that the correspondence is precisely described. For this, Ito used, as a fundamental tool, the notion of Poisson point processes formed of all excursions of the process on S \ {a}. This theory of Ito's of Poisson point processes of excursions is indeed a breakthrough. It has been expanded and applied to more general extension problems by many succeeding researchers. Thus we may say that this lecture note by Ito is really a memorial work in the extension problems of Markov processes. Especially in Chapter 1 of this note, a general theory of Poisson point processes is given that reminds us of Ito's beautiful and impressive lectures in his day.

Networked control systems are increasingly ubiquitous today, with applications ranging from vehicle communication and adaptive power grids to space exploration and economics. The optimal design of such systems presents major challenges, requiring tools from various disciplines within applied mathematics such as decentralized control, stochastic control, information theory, and quantization. A thorough, self-contained book, Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints aims to connect these diverse disciplines with precision and rigor, while conveying design guidelines to controller architects. Unique in the literature, it lays a comprehensive theoretical foundation for the study of networked control systems, and introduces an array of concrete tools for work in the field. Salient features included: * Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. * Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. * Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. * Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. * Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end. * Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. * Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. * Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. * Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. * Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.

Stochastic calculus provides a powerful description of a specific class of stochastic processes in physics and finance. However, many econophysicists struggle to understand it. This book presents the subject simply and systematically, giving graduate students and practitioners a better understanding and enabling them to apply the methods in practice. The book develops Ito calculus and Fokker-Planck equations as parallel approaches to stochastic processes, using those methods in a unified way. The focus is on nonstationary processes, and statistical ensembles are emphasized in time series analysis. Stochastic calculus is developed using general martingales. Scaling and fat tails are presented via diffusive models. Fractional Brownian motion is thoroughly analyzed and contrasted with Ito processes. The Chapman-Kolmogorov and Fokker-Planck equations are shown in theory and by example to be more general than a Markov process. The book also presents new ideas in financial economics and a critical survey of econometrics.

This book brings theories in nonlinear dynamics, stochastic processes, irreversible thermodynamics, physical chemistry and biochemistry together in an introductory but formal and comprehensive manner.Coupled with examples, the theories are developed stepwise, starting with the simplest concepts and building upon them into a more general framework.Furthermore, each new mathematical derivation is immediately applied to one or more biological systems.The last chapters focus on applying mathematical and physical techniques to study systems such as: gene regulatory networks and molecular motors.

The target audience of this book are mainly final year undergraduate and graduate students with a solid mathematical background (physicists, mathematicians and engineers), as well as with basic notions of biochemistry and cellular biology. This book can also be useful to students with a biological background who are interested in mathematical modeling and have a working knowledge of calculus, differential equations and a basic understanding of probability theory."

The monograph addresses a problem of stochastic analysis based on the uncertainty assessment by simulation and application of this method in ecology and steel industry under uncertainty. The first chapter defines the Monte Carlo (MC) method and random variables in stochastic models. Chapter two deals with the contamination transport in porous media. Stochastic approach for Municipal Solid Waste transit time contaminants modeling using MC simulation has been worked out. The third chapter describes the risk analysis of the waste to energy facility proposal for Konin city, including the financial aspects. Environmental impact assessment of the ArcelorMittal Steel Power Plant, in Krakow - in the chapter four - is given. Thus, four scenarios of the energy mix production processes were studied. Chapter five contains examples of using ecological Life Cycle Assessment (LCA) - a relatively new method of environmental impact assessment - which help in preparing pro-ecological strategy, and which can lead to reducing the amount of wastes produced in the ArcelorMittal Steel Plant production processes. Moreover, real input and output data of selected processes under uncertainty, mainly used in the LCA technique, have been examined. The last chapter of this monograph contains final summary. The log-normal probability distribution, widely used in risk analysis and environmental management, in order to develop a stochastic analysis of the LCA, as well as uniform distribution for stochastic approach of pollution transport in porous media has been proposed. The distributions employed in this monograph are assembled from site-specific data, data existing in the most current literature, and professional judgment.

Over the last thirty years there has been extensive use of continuous time econometric methods in macroeconomic modelling. This monograph presents a continuous time macroeconometric model of the United Kingdom incorporating stochastic trends. Its development represents a major step forward in continuous time macroeconomic modelling. The book describes the model in detail and, like earlier models, it is designed in such a way as to permit a rigorous mathematical analysis of its steady-state and stability properties, thus providing a valuable check on the capacity of the model to generate plausible long-run behaviour. The model is estimated using newly developed exact Gaussian estimation methods for continuous time econometric models incorporating unobservable stochastic trends. The book also includes discussion of the application of the model to dynamic analysis and forecasting.

Stochastic resonance has been observed in many forms of systems, and has been hotly debated by scientists for over 30 years. Applications incorporating aspects of stochastic resonance may yet prove revolutionary in fields such as distributed sensor networks, nano-electronics, and biomedical prosthetics. Ideal for researchers in fields ranging from computational neuroscience through to electronic engineering, this book addresses in detail various theoretical aspects of stochastic quantization, in the context of the suprathreshold stochastic resonance effect. Initial chapters review stochastic resonance and outline some of the controversies and debates that have surrounded it. The book then discusses suprathreshold stochastic resonance, and its extension to more general models of stochastic signal quantization. Finally, it considers various constraints and tradeoffs in the performance of stochastic quantizers, before culminating with a chapter in the application of suprathreshold stochastic resonance to the design of cochlear implants.

This book is dedicated to the mathematical study of two-dimensional statistical hydrodynamics and turbulence, described by the 2D Navier-Stokes system with a random force. The authors' main goal is to justify the statistical properties of a fluid's velocity field u(t,x) that physicists assume in their work. They rigorously prove that u(t,x) converges, as time grows, to a statistical equilibrium, independent of initial data. They use this to study ergodic properties of u(t,x) - proving, in particular, that observables f(u(t,.)) satisfy the strong law of large numbers and central limit theorem. They also discuss the inviscid limit when viscosity goes to zero, normalising the force so that the energy of solutions stays constant, while their Reynolds numbers grow to infinity. They show that then the statistical equilibria converge to invariant measures of the 2D Euler equation and study these measures. The methods apply to other nonlinear PDEs perturbed by random forces.

This book was first published in 2004. Many observed phenomena, from the changing health of a patient to values on the stock market, are characterised by quantities that vary over time: stochastic processes are designed to study them. This book introduces practical methods of applying stochastic processes to an audience knowledgeable only in basic statistics. It covers almost all aspects of the subject and presents the theory in an easily accessible form that is highlighted by application to many examples. These examples arise from dozens of areas, from sociology through medicine to engineering. Complementing these are exercise sets making the book suited for introductory courses in stochastic processes. Software (available from www.cambridge.org) is provided for the freely available R system for the reader to apply to all the models presented.

The study of M-matrices, their inverses and discrete potential theory is now a well-established part of linear algebra and the theory of Markov chains. The main focus of this monograph is the so-called inverse M-matrix problem, which asks for a characterization of nonnegative matrices whose inverses are M-matrices. We present an answer in terms of discrete potential theory based on the Choquet-Deny Theorem. A distinguished subclass of inverse M-matrices is ultrametric matrices, which are important in applications such as taxonomy. Ultrametricity is revealed to be a relevant concept in linear algebra and discrete potential theory because of its relation with trees in graph theory and mean expected value matrices in probability theory. Remarkable properties of Hadamard functions and products for the class of inverse M-matrices are developed and probabilistic insights are provided throughout the monograph.

Line and hyperplane location problems play an important role not only in operations research and location theory, but also in computational geometry and robust statistics. This book provides a survey on line and hyperplane location combining analytical and geometrical methods. The major portion of the text presents new results on this topic, including the extension of some special cases to all distances derived from norms and a discussion of restricted problems in the plane. Almost all results are proven in the text and most of them are illustrated by examples. Furthermore, relations to classical facility location and to problems in computational geometry are pointed out. Audience: The book is suitable for researchers, lecturers, and graduate students working in the fields of location theory or computational geometry.

Optimal Control and Optimization of Stochastic Supply Chain Systems examines its subject the context of the presence of a variety of uncertainties. Numerous examples with intuitive illustrations and tables are provided, to demonstrate the structural characteristics of the optimal control policies in various stochastic supply chains and to show how to make use of these characteristics to construct easy-to-operate sub-optimal policies. In Part I, a general introduction to stochastic supply chain systems is provided. Analytical models for various stochastic supply chain systems are formulated and analysed in Part II. In Part III the structural knowledge of the optimal control policies obtained in Part II is utilized to construct easy-to-operate sub-optimal control policies for various stochastic supply chain systems accordingly. Finally, Part IV discusses the optimisation of threshold-type control policies and their robustness. A key feature of the book is its tying together of the complex analytical models produced by the requirements of operational practice, and the simple solutions needed for implementation. The analytical models and theoretical analysis propounded in this monograph will be of benefit to academic researchers and graduate students looking at logistics and supply chain management from standpoints in operations research or industrial, manufacturing, or control engineering. The practical tools and solutions and the qualitative insights into the ideas underlying functional supply chain systems will be of similar use to readers from more industrially-based backgrounds.

This comprehensive volume on ergodic control for diffusions highlights intuition alongside technical arguments. A concise account of Markov process theory is followed by a complete development of the fundamental issues and formalisms in control of diffusions. This then leads to a comprehensive treatment of ergodic control, a problem that straddles stochastic control and the ergodic theory of Markov processes. The interplay between the probabilistic and ergodic-theoretic aspects of the problem, notably the asymptotics of empirical measures on one hand, and the analytic aspects leading to a characterization of optimality via the associated Hamilton Jacobi Bellman equation on the other, is clearly revealed. The more abstract controlled martingale problem is also presented, in addition to many other related issues and models. Assuming only graduate-level probability and analysis, the authors develop the theory in a manner that makes it accessible to users in applied mathematics, engineering, finance and operations research.

Uncertainty is an inherent feature of both properties of physical systems and the inputs to these systems that needs to be quantified for cost effective and reliable designs. The states of these systems satisfy equations with random entries, referred to as stochastic equations, so that they are random functions of time and/or space. The solution of stochastic equations poses notable technical difficulties that are frequently circumvented by heuristic assumptions at the expense of accuracy and rigor. The main objective of "Stochastic Systems" is to promoting the development of accurate and efficient methods for solving stochastic equations and to foster interactions between engineers, scientists, and mathematicians. To achieve these objectives "Stochastic Systems "presents:

. A clear and brief review of essential concepts on probability theory, random functions, stochastic calculus, Monte Carlo simulation, and functional analysis

. ""Probabilistic models for random variables and functions needed to formulate stochastic equations describing realistic problems in engineering and applied sciences

. ""Practical methods for quantifying the uncertain parameters in the definition of stochastic equations, solving approximately these equations, and assessing the accuracy of approximate solutions

"Stochastic Systems "provides key information for researchers, graduate students, and engineers who are interested in the formulation and solution of stochastic problems encountered in a broad range of disciplines. Numerous examples are used to clarify and illustrate theoretical concepts and methods for solving stochastic equations. The extensive bibliography and index at the end of the book constitute an ideal resource for both theoreticians and practitioners.

"

This book explores the remarkable connections between two domains that, a priori, seem unrelated: Random matrices (together with associated random processes) and integrable systems. The relations between random matrix models and the theory of classical integrable systems have long been studied. These appear mainly in the deformation theory, when parameters characterizing the measures or the domain of localization of the eigenvalues are varied. The resulting differential equations determining the partition function and correlation functions are, remarkably, of the same type as certain equations appearing in the theory of integrable systems. They may be analyzed effectively through methods based upon the Riemann-Hilbert problem of analytic function theory and by related approaches to the study of nonlinear asymptotics in the large N limit. Associated with studies of matrix models are certain stochastic processes, the "Dyson processes", and their continuum diffusion limits, which govern the spectrum in random matrix ensembles, and may also be studied by related methods. Random Matrices, Random Processes and Integrable Systems provides an in-depth examination of random matrices with applications over a vast variety of domains, including multivariate statistics, random growth models, and many others. Leaders in the field apply the theory of integrable systems to the solution of fundamental problems in random systems and processes using an interdisciplinary approach that sheds new light on a dynamic topic of current research.

Random Fields on the Sphere presents a comprehensive analysis of isotropic spherical random fields. The main emphasis is on tools from harmonic analysis, beginning with the representation theory for the group of rotations SO(3). Many recent developments on the method of moments and cumulants for the analysis of Gaussian subordinated fields are reviewed. This background material is used to analyse spectral representations of isotropic spherical random fields and then to investigate in depth the properties of associated harmonic coefficients. Properties and statistical estimation of angular power spectra and polyspectra are addressed in full. The authors are strongly motivated by cosmological applications, especially the analysis of cosmic microwave background (CMB) radiation data, which has initiated a challenging new field of mathematical and statistical research. Ideal for mathematicians and statisticians interested in applications to cosmology, it will also interest cosmologists and mathematicians working in group representations, stochastic calculus and spherical wavelets.

Stochastic Analysis aims to provide mathematical tools to describe and model high dimensional random systems. Such tools arise in the study of Stochastic Differential Equations and Stochastic Partial Differential Equations, Infinite Dimensional Stochastic Geometry, Random Media and Interacting Particle Systems, Super-processes, Stochastic Filtering, Mathematical Finance, etc. Stochastic Analysis has emerged as a core area of late 20th century Mathematics and is currently undergoing a rapid scientific development. The special volume "Stochastic Analysis 2010" provides a sample of the current research in the different branches of the subject. It includes the collected works of the participants at the Stochastic Analysis section of the 7th ISAAC Congress organized at Imperial College London in July 2009.

This classic in stochastic network modelling broke new ground when it was published in 1979, and it remains a superb introduction to reversibility and its applications. The book concerns behaviour in equilibrium of vector stochastic processes or stochastic networks. When a stochastic network is reversible its analysis is greatly simplified, and the first chapter is devoted to a discussion of the concept of reversibility. The rest of the book focuses on the various applications of reversibility and the extent to which the assumption of reversibility can be relaxed without destroying the associated tractability. Now back in print for a new generation, this book makes enjoyable reading for anyone interested in stochastic processes thanks to the author's clear and easy-to-read style. Elementary probability is the only prerequisite and exercises are interspersed throughout.

This monograph is a presentation of a unified approach to a certain class of semimartingale inequalities, which can be regarded as probabilistic extensions of classical estimates for conjugate harmonic functions on the unit disc. The approach, which has its roots in the seminal works of Burkholder in the 80s, enables to deduce a given inequality for semimartingales from the existence of a certain special function with some convex-type properties. Remarkably, an appropriate application of the method leads to the sharp version of the estimate under investigation, which is particularly important for applications. These include the theory of quasiregular mappings (with deep implications to the geometric function theory); the boundedness of two-dimensional Hilbert transform and a more general class of Fourier multipliers; the theory of rank-one convex and quasiconvex functions; and more. The book is divided into a few separate parts. In the introductory chapter we present motivation for the results and relate them to some classical problems in harmonic analysis. The next part contains a general description of the method, which is applied in subsequent chapters to the study of sharp estimates for discrete-time martingales; discrete-time sub- and supermartingales; continuous time processes; the square and maximal functions. Each chapter contains additional bibliographical notes included for reference.

Methods of global analysis and stochastic analysis are most often applied in mathematical physics as separate entities, thus forming important directions in the field. However, while combination of the two subject areas is rare, it is fundamental for the consideration of a broader class of problems. This book develops methods of Global Analysis and Stochastic Analysis such that their combination allows one to have a more or less common treatment for areas of mathematical physics that traditionally are considered as divergent and requiring different methods of investigation. Global and Stochastic Analysis with Applications to Mathematical Physics covers branches of mathematics that are currently absent in monograph form. Through the demonstration of new topics of investigation and results, both in traditional and more recent problems, this book offers a fresh perspective on ordinary and stochastic differential equations and inclusions (in particular, given in terms of Nelson's mean derivatives) on linear spaces and manifolds. Topics covered include classical mechanics on non-linear configuration spaces, problems of statistical and quantum physics, and hydrodynamics. A self-contained book that provides a large amount of preliminary material and recent results which will serve to be a useful introduction to the subject and a valuable resource for further research. It will appeal to researchers, graduate and PhD students working in global analysis, stochastic analysis and mathematical physics.

Many phenomena in engineering and mathematical physics can be modeled by means of boundary value problems for a certain elliptic differential operator in a given domain. When the differential operator under discussion is of second order a variety of tools are available for dealing with such problems, including boundary integral methods, variational methods, harmonic measure techniques, and methods based on classical harmonic analysis. When the differential operator is of higher-order (as is the case, e.g., with anisotropic plate bending when one deals with a fourth order operator) only a few options could be successfully implemented. In the 1970s Alberto Calderon, one of the founders of the modern theory of Singular Integral Operators, advocated the use of layer potentials for the treatment of higher-order elliptic boundary value problems. The present monograph represents the first systematic treatment based on this approach.

This research monograph lays, for the first time, the mathematical foundation aimed at solving boundary value problems for higher-order elliptic operators in non-smooth domains using the layer potential method and addresses a comprehensive range of topics, dealing with elliptic boundary value problems in non-smooth domains including layer potentials, jump relations, non-tangential maximal function estimates, multi-traces and extensions, boundary value problems with data in Whitney-Lebesque spaces, Whitney-Besov spaces, Whitney-Sobolev- based Lebesgue spaces, Whitney-Triebel-Lizorkin spaces, Whitney-Sobolev-based Hardy spaces, Whitney-BMO and Whitney-VMO spaces."

"Potential Theory" presents a clear path from calculus to classical potential theory and beyond, with the aim of moving the reader into the area of mathematical research as quickly as possible. The subject matter is developed from first principles using only calculus. Commencing with the inverse square law for gravitational and electromagnetic forces and the divergence theorem, the author develops methods for constructing solutions of Laplace's equation on a region with prescribed values on the boundary of the region.

The latter half of the book addresses more advanced material aimed at those with the background of a senior undergraduate or beginning graduate course in real analysis. Starting with solutions of the Dirichlet problem subject to mixed boundary conditions on the simplest of regions, methods of morphing such solutions onto solutions of Poisson's equation on more general regions are developed using diffeomorphisms and the Perron-Wiener-Brelot method, culminating in application to Brownian motion.

In this new edition, many exercises have been added to reconnect the subject matter to the physical sciences. This book will undoubtedly be useful to graduate students and researchers in mathematics, physics and engineering.

Stochastic Optimal Control (SOC)-a mathematical theory concerned with minimizing a cost (or maximizing a payout) pertaining to a controlled dynamic processunder uncertainty-has proven incredibly helpful to understanding and predicting debt crises and evaluating proposed financial regulation and risk management."Stochastic Optimal Control and the U.S. Financial Debt Crisis"analyzes SOC in relation to the 2008 U.S. financial crisis, and offers a detailed framework depicting why such a methodology is best suited for reducing financial risk and addressing key regulatory issues. Topics discussed include the inadequacies of the current approaches underlying financial regulations, the use of SOC to explain debt crises and superiority over existing approaches to regulation, and the domestic and international applications of SOC to financial crises. Principles in this book will appeal to economists, mathematicians, and researchers interested in the U.S. financial debt crisis and optimal risk management."

In 2014, winner of "Outstanding Book Award" by The Japan Society for Fuzzy Theory and Intelligent Informatics. Covering in detail both theoretical and practical perspectives, this book is a self-contained and systematic depiction of current fuzzy stochastic optimization that deploys the fuzzy random variable as a core mathematical tool to model the integrated fuzzy random uncertainty. It proceeds in an orderly fashion from the requisite theoretical aspects of the fuzzy random variable to fuzzy stochastic optimization models and their real-life case studies. The volume reflects the fact that randomness and fuzziness (or vagueness) are two major sources of uncertainty in the real world, with significant implications in a number of settings. In industrial engineering, management and economics, the chances are high that decision makers will be confronted with information that is simultaneously probabilistically uncertain and fuzzily imprecise, and optimization in the form of a decision must be made in an environment that is doubly uncertain, characterized by a co-occurrence of randomness and fuzziness. This book begins by outlining the history and development of the fuzzy random variable before detailing numerous optimization models and applications that include the design of system controls for a dam.

The theory of risk already has its traditions. A review of its classical results is contained in Bohlmann (1909). This classical theory was associated with life insurance mathematics, and dealt mainly with deviations which were expected to be produced by random fluctua tions in individual policies. According to this theory, these deviations are discounted to some initial instant; the square root of the sum of the squares of the capital values calculated in this way then gives a measure for the stability of the portfolio. A theory constituted in this manner is not, however, very appropriate for practical purposes. The fact is that it does not give an answer to such questions as, for example, within what limits a company's probable gain or loss will lie during different periods. Further, non-life insurance, to which risk theory has, in fact, its most rewarding applications, was mainly outside the field of interest of the risk theorists. Thus it is quite understandable that this theory did not receive very much attention and that its applications to practical problems of insurance activity remained rather unimportant. A new phase of development began following the studies of Filip Lundberg (1909, 1919), which, thanks to H. Cramer (1926), e.O.