This book was first published in 2006. Written by two of the foremost researchers in the field, this book studies the local times of Markov processes by employing isomorphism theorems that relate them to certain associated Gaussian processes. It builds to this material through self-contained but harmonized 'mini-courses' on the relevant ingredients, which assume only knowledge of measure-theoretic probability. The streamlined selection of topics creates an easy entrance for students and experts in related fields. The book starts by developing the fundamentals of Markov process theory and then of Gaussian process theory, including sample path properties. It then proceeds to more advanced results, bringing the reader to the heart of contemporary research. It presents the remarkable isomorphism theorems of Dynkin and Eisenbaum and then shows how they can be applied to obtain new properties of Markov processes by using well-established techniques in Gaussian process theory. This original, readable book will appeal to both researchers and advanced graduate students.

The book provides a general introduction to the theory of large deviations and a wide overview of the metastable behaviour of stochastic dynamics. With only minimal prerequisites, the book covers all the main results and brings the reader to the most recent developments. Particular emphasis is given to the fundamental Freidlin-Wentzell results on small random perturbations of dynamical systems. Metastability is first described on physical grounds, following which more rigorous approaches to its description are developed. Many relevant examples are considered from the point of view of the so-called pathwise approach. The first part of the book develops the relevant tools including the theory of large deviations which are then used to provide a physically relevant dynamical description of metastability. Written to be accessible to graduate students, this book provides an excellent route into contemporary research.

This book discusses quantum theory as the theory of random (Brownian) motion of small particles (electrons etc.) under external forces. Implying that the Schroedinger equation is a complex-valued evolution equation and the Schroedinger function is a complex-valued evolution function, important applications are given. Readers will learn about new mathematical methods (theory of stochastic processes) in solving problems of quantum phenomena. Readers will also learn how to handle stochastic processes in analyzing physical phenomena.

This textbook, now in its fourth edition, offers a rigorous and self-contained introduction to the theory of continuous-time stochastic processes, stochastic integrals, and stochastic differential equations. Expertly balancing theory and applications, it features concrete examples of modeling real-world problems from biology, medicine, finance, and insurance using stochastic methods. No previous knowledge of stochastic processes is required. Unlike other books on stochastic methods that specialize in a specific field of applications, this volume examines the ways in which similar stochastic methods can be applied across different fields. Beginning with the fundamentals of probability, the authors go on to introduce the theory of stochastic processes, the Ito Integral, and stochastic differential equations. The following chapters then explore stability, stationarity, and ergodicity. The second half of the book is dedicated to applications to a variety of fields, including finance, biology, and medicine. Some highlights of this fourth edition include a more rigorous introduction to Gaussian white noise, additional material on the stability of stochastic semigroups used in models of population dynamics and epidemic systems, and the expansion of methods of analysis of one-dimensional stochastic differential equations. An Introduction to Continuous-Time Stochastic Processes, Fourth Edition is intended for graduate students taking an introductory course on stochastic processes, applied probability, stochastic calculus, mathematical finance, or mathematical biology. Prerequisites include knowledge of calculus and some analysis; exposure to probability would be helpful but not required since the necessary fundamentals of measure and integration are provided. Researchers and practitioners in mathematical finance, biomathematics, biotechnology, and engineering will also find this volume to be of interest, particularly the applications explored in the second half of the book.

This book is aimed at researchers, graduate students and engineers who would like to be initiated to Piecewise Deterministic Markov Processes (PDMPs). A PDMP models a deterministic mechanism modified by jumps that occur at random times. The fields of applications are numerous : insurance and risk, biology, communication networks, dependability, supply management, etc. Indeed, the PDMPs studied so far are in fact deterministic functions of CSMPs (Completed Semi-Markov Processes), i.e. semi-Markov processes completed to become Markov processes. This remark leads to considerably broaden the definition of PDMPs and allows their properties to be deduced from those of CSMPs, which are easier to grasp. Stability is studied within a very general framework. In the other chapters, the results become more accurate as the assumptions become more precise. Generalized Chapman-Kolmogorov equations lead to numerical schemes. The last chapter is an opening on processes for which the deterministic flow of the PDMP is replaced with a Markov process. Marked point processes play a key role throughout this book.

The book contains two contributions about the work of Emmanuele DiBenedetto and a selection of original papers. The authors are some of the main experts in Harnack's inequalities and nonlinear operators. These papers are part of the contributions presented during the conference to celebrate the 70th birthday of Prof. Emmanuele DiBenedetto, which was held at "Il Palazzone" in Cortona from June 18th to 24th, 2017. The papers are focused on current research topics regarding the qualitative properties of solutions, connections with calculus of variations, Harnack inequality and regularity theory. Some papers are also related to various applications. Many of the authors have shared with Prof. DiBenedetto an intense scientific and personal collaboration, while many others have taken inspiration from and further developed his field of research. The topics of the conference are certainly of great interest for the international mathematical community.

This monograph presents the geoscientific context arising in decorrelative gravitational exploration to determine the mass density distribution inside the Earth. First, an insight into the current state of research is given by reducing gravimetry to mathematically accessible, and thus calculable, decorrelated models. In this way, the various unresolved questions and problems of gravimetry are made available to a broad scientific audience and the exploration industry. New theoretical developments will be given, and innovative ways of modeling geologic layers and faults by mollifier regularization techniques are shown. This book is dedicated to surface as well as volume geology with potential data primarily of terrestrial origin. For deep geology, the geomathematical decorrelation methods are to be designed in such a way that depth information (e.g., in boreholes) may be canonically entered. Bridging several different geo-disciplines, this book leads in a cycle from the potential measurements made by geoengineers, to the cleansing of data by geophysicists and geoengineers, to the subsequent theory and model formation, computer-based implementation, and numerical calculation and simulations made by geomathematicians, to interpretation by geologists, and, if necessary, back. It therefore spans the spectrum from geoengineering, especially geodesy, via geophysics to geomathematics and geology, and back. Using the German Saarland area for methodological tests, important new fields of application are opened, particularly for regions with mining-related cavities or dense development in today's geo-exploration.

The theory of large deviations deals with rates at which probabilities of certain events decay as a natural parameter in the problem varies. This book, which is based on a graduate course on large deviations at the Courant Institute, focuses on three concrete sets of examples: (i) diffusions with small noise and the exit problem, (ii) large time behavior of Markov processes and their connection to the Feynman-Kac formula and the related large deviation behavior of the number of distinct sites visited by a random walk, and (iii) interacting particle systems, their scaling limits, and large deviations from their expected limits. For the most part the examples are worked out in detail, and in the process the subject of large deviations is developed. The book will give the reader a flavor of how large deviation theory can help in problems that are not posed directly in terms of large deviations. The reader is assumed to have some familiarity with probability, Markov processes, and interacting particle systems.

This concise and up-to-date textbook provides an accessible introduction to the core concepts of nonlinear dynamics as well as its existing and potential applications. The book is aimed at students and researchers in all the diverse fields in which nonlinear phenomena are important. Since most tasks in nonlinear dynamics cannot be treated analytically, skills in using numerical simulations are crucial for analyzing these phenomena. The text therefore addresses in detail appropriate computational methods as well as identifying the pitfalls of numerical simulations. It includes numerous executable code snippets referring to open source Julia software packages. Each chapter includes a selection of exercises with which students can test and deepen their skills.

This book is a collection of selected papers presented at the International Conference on Semigroups and Applications, held at the Cochin University of Science and Technology, India, from December 9-12, 2019. This book discusses the recent developments in semigroups theory, category theory and the applications of these in various areas of research, including structure theory of semigroups, lattices, rings and partial algebras. This book presents chapters on ordering orders and quotient rings, block groups and Hall's relations, quotients of the Booleanization of inverse semigroup, Markov chains through semigroup graph expansions, polycyclic inverse monoids and Thompson group, balanced category and bundle category. This book will be of much value to researchers working in areas of semigroup and operator theory.

This collection of contributions originates from the well-established conference series "Fractal Geometry and Stochastics" which brings together researchers from different fields using concepts and methods from fractal geometry. Carefully selected papers from keynote and invited speakers are included, both discussing exciting new trends and results and giving a gentle introduction to some recent developments. The topics covered include Assouad dimensions and their connection to analysis, multifractal properties of functions and measures, renewal theorems in dynamics, dimensions and topology of random discrete structures, self-similar trees, p-hyperbolicity, phase transitions from continuous to discrete scale invariance, scaling limits of stochastic processes, stemi-stable distributions and fractional differential equations, and diffusion limited aggregation. Representing a rich source of ideas and a good starting point for more advanced topics in fractal geometry, the volume will appeal to both established experts and newcomers.

This book is dedicated to the systematization and development of models, methods, and algorithms for queuing systems with correlated arrivals. After first setting up the basic tools needed for the study of queuing theory, the authors concentrate on complicated systems: multi-server systems with phase type distribution of service time or single-server queues with arbitrary distribution of service time or semi-Markovian service. They pay special attention to practically important retrial queues, tandem queues, and queues with unreliable servers. Mathematical models of networks and queuing systems are widely used for the study and optimization of various technical, physical, economic, industrial, and administrative systems, and this book will be valuable for researchers, graduate students, and practitioners in these domains.

This book provides, as simply as possible, sound foundations for an in-depth understanding of reliability engineering with regard to qualitative analysis, modelling, and probabilistic calculations of safety and production systems. Drawing on the authors' extensive experience within the field of reliability engineering, it addresses and discusses a variety of topics, including: * Background and overview of safety and dependability studies; * Explanation and critical analysis of definitions related to core concepts; * Risk identification through qualitative approaches (preliminary hazard analysis, HAZOP, FMECA, etc.); * Modelling of industrial systems through static (fault tree, reliability block diagram), sequential (cause-consequence diagrams, event trees, LOPA, bowtie), and dynamic (Markov graphs, Petri nets) approaches; * Probabilistic calculations through state-of-the-art analytical or Monte Carlo simulation techniques; * Analysis, modelling, and calculations of common cause failure and uncertainties; * Linkages and combinations between the various modelling and calculation approaches; * Reliability data collection and standardization. The book features illustrations, explanations, examples, and exercises to help readers gain a detailed understanding of the topic and implement it into their own work. Further, it analyses the production availability of production systems and the functional safety of safety systems (SIL calculations), showcasing specific applications of the general theory discussed. Given its scope, this book is a valuable resource for engineers, software designers, standard developers, professors, and students.

A nonmeasure theoretic introduction to stochastic processes. Considers its diverse range of applications and provides readers with probabilistic intuition and insight in thinking about problems. This revised edition contains additional material on compound Poisson random variables including an identity which can be used to efficiently compute moments; a new chapter on Poisson approximations; and coverage of the mean time spent in transient states as well as examples relating to the Gibb's sampler, the Metropolis algorithm and mean cover time in star graphs. Numerous exercises and problems have been added throughout the text.

This book discusses recent developments in dynamic reliability in multi-state systems (MSS), addressing such important issues as reliability and availability analysis of aging MSS, the impact of initial conditions on MSS reliability and availability, changing importance of components over time in MSS with aging components, and the determination of age-replacement policies. It also describes modifications of traditional methods, such as Markov processes with rewards, as well as a modern mathematical method based on the extended universal generating function technique, the Lz-transform, presenting various successful applications and demonstrating their use in real-world problems. This book provides theoretical insights, information on practical applications, and real-world case studies that are of interest to engineers and industrial managers as well as researchers. It also serves as a textbook or supporting text for graduate and postgraduate courses in industrial, electrical, and mechanical engineering.

The second volume concentrates on stochastic integrals, stochastic differential equations, excursion theory and the general theory of processes. These subjects are made accessible in the many concrete examples that illustrate techniques of calculation, and in the treatment of all topics from the ground up, starting from simple cases. Many of the examples and proofs are new; some important calculational techniques appear for the first time in this book.

This monograph applies the relative optimization approach to time nonhomogeneous continuous-time and continuous-state dynamic systems. The approach is intuitively clear and does not require deep knowledge of the mathematics of partial differential equations. The topics covered have the following distinguishing features: long-run average with no under-selectivity, non-smooth value functions with no viscosity solutions, diffusion processes with degenerate points, multi-class optimization with state classification, and optimization with no dynamic programming. The book begins with an introduction to relative optimization, including a comparison with the traditional approach of dynamic programming. The text then studies the Markov process, focusing on infinite-horizon optimization problems, and moves on to discuss optimal control of diffusion processes with semi-smooth value functions and degenerate points, and optimization of multi-dimensional diffusion processes. The book concludes with a brief overview of performance derivative-based optimization. Among the more important novel considerations presented are: the extension of the Hamilton-Jacobi-Bellman optimality condition from smooth to semi-smooth value functions by derivation of explicit optimality conditions at semi-smooth points and application of this result to degenerate and reflected processes; proof of semi-smoothness of the value function at degenerate points; attention to the under-selectivity issue for the long-run average and bias optimality; discussion of state classification for time nonhomogeneous continuous processes and multi-class optimization; and development of the multi-dimensional Tanaka formula for semi-smooth functions and application of this formula to stochastic control of multi-dimensional systems with degenerate points. The book will be of interest to researchers and students in the field of stochastic control and performance optimization alike.

This important work addresses problems in financial mathematics of pricing and hedging derivative securities in an environment of uncertain and changing market volatility. These problems are important to investors from large trading institutions to pension funds. The authors present mathematical and statistical tools that exploit the volatile nature of the market. The mathematics is introduced through examples and illustrated with simulations and the modeling approach that is described is validated and tested on market data. The material is suitable for a one-semester course for graduate students with some exposure to methods of stochastic modeling and arbitrage pricing theory in finance. The volume is easily accessible to derivatives practitioners in the financial engineering industry.

The purpose of this book is twofold: first, it sets out to equip the reader with a sound understanding of the foundations of probability theory and stochastic processes, offering step-by-step guidance from basic probability theory to advanced topics, such as stochastic differential equations, which typically are presented in textbooks that require a very strong mathematical background. Second, while leading the reader on this journey, it aims to impart the knowledge needed in order to develop algorithms that simulate realistic physical systems. Connections with several fields of pure and applied physics, from quantum mechanics to econophysics, are provided. Furthermore, the inclusion of fully solved exercises will enable the reader to learn quickly and to explore topics not covered in the main text. The book will appeal especially to graduate students wishing to learn how to simulate physical systems and to deepen their knowledge of the mathematical framework, which has very deep connections with modern quantum field theory.

Now available in paperback, this celebrated book remains a key systematic guide to a large part of the modern theory of Probability. The authors not only present the subject of Brownian motion as a dry part of mathematical analysis, but convey its real meaning and fascination. The opening, heuristic chapter does just this, and it is followed by a comprehensive and self-contained account of the foundations of theory of stochastic processes. Chapter 3 is a lively presentation of the theory of Markov processes. Together with its companion volume, this book equips graduate students for research into a subject of great intrinsic interest and wide applications.

The theory of holomorphic dynamical systems is a subject of increasing interest in mathematics, both for its challenging problems and for its connections with other branches of pure and applied mathematics. A holomorphic dynamical system is the datum of a complex variety and a holomorphic object (such as a self-map or a vector ?eld) acting on it. The study of a holomorphic dynamical system consists in describing the asymptotic behavior of the system, associating it with some invariant objects (easy to compute) which describe the dynamics and classify the possible holomorphic dynamical systems supported by a given manifold. The behavior of a holomorphic dynamical system is pretty much related to the geometry of the ambient manifold (for instance, - perbolic manifolds do no admit chaotic behavior, while projective manifolds have a variety of different chaotic pictures). The techniques used to tackle such pr- lems are of variouskinds: complexanalysis, methodsof real analysis, pluripotential theory, algebraic geometry, differential geometry, topology. To cover all the possible points of view of the subject in a unique occasion has become almost impossible, and the CIME session in Cetraro on Holomorphic Dynamical Systems was not an exception.

This book gives a concise introduction to the classical theory of stochastic partial differential equations (SPDEs). It begins by describing the classes of equations which are studied later in the book, together with a list of motivating examples of SPDEs which are used in physics, population dynamics, neurophysiology, finance and signal processing. The central part of the book studies SPDEs as infinite-dimensional SDEs, based on the variational approach to PDEs. This extends both the classical Ito formulation and the martingale problem approach due to Stroock and Varadhan. The final chapter considers the solution of a space-time white noise-driven SPDE as a real-valued function of time and (one-dimensional) space. The results of J. Walsh's St Flour notes on the existence, uniqueness and Hoelder regularity of the solution are presented. In addition, conditions are given under which the solution remains nonnegative, and the Malliavin calculus is applied. Lastly, reflected SPDEs and their connection with super Brownian motion are considered. At a time when new sophisticated branches of the subject are being developed, this book will be a welcome reference on classical SPDEs for newcomers to the theory.

Stochastic differential equations are differential equations whose solutions are stochastic processes. They exhibit appealing mathematical properties that are useful in modeling uncertainties and noisy phenomena in many disciplines. This book is motivated by applications of stochastic differential equations in target tracking and medical technology and, in particular, their use in methodologies such as filtering, smoothing, parameter estimation, and machine learning. It builds an intuitive hands-on understanding of what stochastic differential equations are all about, but also covers the essentials of Ito calculus, the central theorems in the field, and such approximation schemes as stochastic Runge-Kutta. Greater emphasis is given to solution methods than to analysis of theoretical properties of the equations. The book's practical approach assumes only prior understanding of ordinary differential equations. The numerous worked examples and end-of-chapter exercises include application-driven derivations and computational assignments. MATLAB/Octave source code is available for download, promoting hands-on work with the methods.

This book is specially designed to refresh and elevate the level of understanding of the foundational background in probability and distributional theory required to be successful in a graduate-level statistics program. Advanced undergraduate students and introductory graduate students from a variety of quantitative backgrounds will benefit from the transitional bridge that this volume offers, from a more generalized study of undergraduate mathematics and statistics to the career-focused, applied education at the graduate level. In particular, it focuses on growing fields that will be of potential interest to future M.S. and Ph.D. students, as well as advanced undergraduates heading directly into the workplace: data analytics, statistics and biostatistics, and related areas.