This book aims to position itself between the level of elementary probability texts and advanced works on stochastic processes. The pre-requisites to consult this book are a course on elementary probability theory and statistics, and a course on advanced calculus. In this book numberous examples have been given, based on theories discussed and a large number of problems along with their answers have also been provided. This revised edition further updates the materials and references and some new chapters have been introduced. The text has been designed particularly for advanced undergraduate, postgraduate and research level courses in applied maths, statistics, operations research, computer science, different branches of engineering, telecommunications, business and management, economics and life sciences.

Stochastic processes have a wide range of applications ranging from image processing, neuroscience, bioinformatics, financial management, and statistics. Mathematical, physical, and engineering systems use stochastic processes for modeling and reasoning phenomena. While comparing AI-stochastic systems with other counterpart systems, we are able to understand their significance, thereby applying new techniques to obtain new real-time results and solutions. Stochastic Processes and Their Applications in Artificial Intelligence opens doors for artificial intelligence experts to use stochastic processes as an effective tool in real-world problems in computational biology, speech recognition, natural language processing, and reinforcement learning. Covering key topics such as social media, big data, and artificial intelligence models, this reference work is ideal for mathematicians, industry professionals, researchers, scholars, academicians, practitioners, instructors, and students.

This book aims to provide an overview of the special functions of fractional calculus and their applications in diffusion and random search processes. The book contains detailed calculations for various examples of anomalous diffusion, random search and stochastic resetting processes, which can be easily followed by the reader, who will be able to reproduce the obtained results. The book will be intended for advanced undergraduate and graduate students and researchers in physics, mathematics and other natural sciences due to the various examples which will be provided in the book.

The present monograph on stochastic Komatu-Loewner evolutions (SKLEs) provides the first systematic extension of the Schramm-Loewner evolution (SLE) theory from a simply connected planar domain to multiply connected domains by using the Brownian motion with darning (BMD) that has arisen in a recent study of the boundary theory of symmetric Markov processes.This volume is presented in an accessible manner for the interested researchers and graduate students. It also brings new insights into SLEs as special cases of SKLEs. Mathematically, it can be viewed as a powerful application of stochastic analysis via BMDs to complex analysis.

Advancements in Bayesian Methods and Implementation, Volume 47 in the Handbook of Statistics series, highlights new advances in the field, with this new volume presenting interesting chapters on a variety of timely topics, including Fisher Information, Cramer-Rao and Bayesian Paradigm, Compound beta binomial distribution functions, MCMC for GLMMS, Signal Processing and Bayesian, Mathematical theory of Bayesian statistics where all models are wrong, Machine Learning and Bayesian, Non-parametric Bayes, Bayesian testing, and Data Analysis with humans, Variational inference or Functional horseshoe, Generalized Bayes.

Link prediction is required to understand the evolutionary theory of computing for different social networks. However, the stochastic growth of the social network leads to various challenges in identifying hidden links, such as representation of graph, distinction between spurious and missing links, selection of link prediction techniques comprised of network features, and identification of network types. Hidden Link Prediction in Stochastic Social Networks concentrates on the foremost techniques of hidden link predictions in stochastic social networks including methods and approaches that involve similarity index techniques, matrix factorization, reinforcement, models, and graph representations and community detections. The book also includes miscellaneous methods of different modalities in deep learning, agent-driven AI techniques, and automata-driven systems and will improve the understanding and development of automated machine learning systems for supervised, unsupervised, and recommendation-driven learning systems. It is intended for use by data scientists, technology developers, professionals, students, and researchers.

The stochastic partial differential equations (SPDEs) arise in many applications of the probability theory. This monograph will focus on two particular (and probably the most known) equations: the stochastic heat equation and the stochastic wave equation.The focus is on the relationship between the solutions to the SPDEs and the fractional Brownian motion (and related processes). An important point of the analysis is the study of the asymptotic behavior of the p-variations of the solutions to the heat or wave equations driven by space-time Gaussian noise or by a Gaussian noise with a non-trivial correlation in space.The book is addressed to public with a reasonable background in probability theory. The idea is to keep it self-contained and avoid using of complex techniques. We also chose to insist on the basic properties of the random noise and to detail the construction of the Wiener integration with respect to them. The intention is to present the proofs complete and detailed.

Stochastic Numerical Methods introduces at Master level the numerical methods that use probability or stochastic concepts to analyze random processes. The book aims at being rather general and is addressed at students of natural sciences (Physics, Chemistry, Mathematics, Biology, etc.) and Engineering, but also social sciences (Economy, Sociology, etc.) where some of the techniques have been used recently to numerically simulate different agent-based models. Examples included in the book range from phase-transitions and critical phenomena, including details of data analysis (extraction of critical exponents, finite-size effects, etc.), to population dynamics, interfacial growth, chemical reactions, etc. Program listings are integrated in the discussion of numerical algorithms to facilitate their understanding. From the contents: * Review of Probability Concepts * Monte Carlo Integration * Generation of Uniform and Non-uniform * Random Numbers: Non-correlated Values * Dynamical Methods * Applications to Statistical Mechanics * Introduction to Stochastic Processes * Numerical Simulation of Ordinary and * Partial Stochastic Differential Equations * Introduction to Master Equations * Numerical Simulations of Master Equations * Hybrid Monte Carlo * Generation of n-Dimensional Correlated * Gaussian Variables * Collective Algorithms for Spin Systems * Histogram Extrapolation * Multicanonical Simulations

Geometry and Statistics, Volume 46 in the Handbook of Statistics series, highlights new advances in the field, with this new volume presenting interesting chapters written by an international board of authors.

This book presents a short introduction to continuous-time financial models. An overview of the basics of stochastic analysis precedes a focus on the Black-Scholes and interest rate models. Other topics covered include self-financing strategies, option pricing, exotic options and risk-neutral probabilities. Vasicek, Cox-Ingersoll-Ross, and Heath-Jarrow-Morton interest rate models are also explored. The author presents practitioners with a basic introduction, with more rigorous information provided for mathematicians. The reader is assumed to be familiar with the basics of probability theory. Some basic knowledge of stochastic integration and differential equations theory is preferable, although all preliminary information is given in the first part of the book. Some relatively simple theoretical exercises are also provided.

A First Course in Stochastic Calculus is a complete guide for advanced undergraduate students to take the next step in exploring probability theory and for master's students in mathematical finance who would like to build an intuitive and theoretical understanding of stochastic processes. This book is also an essential tool for finance professionals who wish to sharpen their knowledge and intuition about stochastic calculus. Louis-Pierre Arguin offers an exceptionally clear introduction to Brownian motion and to random processes governed by the principles of stochastic calculus. The beauty and power of the subject are made accessible to readers with a basic knowledge of probability, linear algebra, and multivariable calculus. This is achieved by emphasizing numerical experiments using elementary Python coding to build intuition and adhering to a rigorous geometric point of view on the space of random variables. This unique approach is used to elucidate the properties of Gaussian processes, martingales, and diffusions. One of the book's highlights is a detailed and self-contained account of stochastic calculus applications to option pricing in finance.

The aim of this book is to provide methods and algorithms for the optimization of input signals so as to estimate parameters in systems described by PDE's as accurate as possible under given constraints. The optimality conditions have their background in the optimal experiment design theory for regression functions and in simple but useful results on the dependence of eigenvalues of partial differential operators on their parameters. Examples are provided that reveal sometimes intriguing geometry of spatiotemporal input signals and responses to them. An introduction to optimal experimental design for parameter estimation of regression functions is provided. The emphasis is on functions having a tensor product (Kronecker) structure that is compatible with eigenfunctions of many partial differential operators. New optimality conditions in the time domain and computational algorithms are derived for D-optimal input signals when parameters of ordinary differential equations are estimated. They are used as building blocks for constructing D-optimal spatio-temporal inputs for systems described by linear partial differential equations of the parabolic and hyperbolic types with constant parameters. Optimality conditions for spatially distributed signals are also obtained for equations of elliptic type in those cases where their eigenfunctions do not depend on unknown constant parameters. These conditions and the resulting algorithms are interesting in their own right and, moreover, they are second building blocks for optimality of spatio-temporal signals. A discussion of the generalizability and possible applications of the results obtained is presented.

The goal of this book is to present Stochastic Calculus at an introductory level and not at its maximum mathematical detail. The author aims to capture as much as possible the spirit of elementary deterministic Calculus, at which students have been already exposed. This assumes a presentation that mimics similar properties of deterministic Calculus, which facilitates understanding of more complicated topics of Stochastic Calculus.

The goal of this book is to present Stochastic Calculus at an introductory level and not at its maximum mathematical detail. The author aims to capture as much as possible the spirit of elementary deterministic Calculus, at which students have been already exposed. This assumes a presentation that mimics similar properties of deterministic Calculus, which facilitates understanding of more complicated topics of Stochastic Calculus.

Probability theory has diverse applications in a plethora of fields, including physics, engineering, computer science, chemistry, biology and economics. This book will familiarize students with various applications of probability theory, stochastic modeling and random processes, using examples from all these disciplines and more. The reader learns via case studies and begins to recognize the sort of problems that are best tackled probabilistically. The emphasis is on conceptual understanding, the development of intuition and gaining insight, keeping technicalities to a minimum. Nevertheless, a glimpse into the depth of the topics is provided, preparing students for more specialized texts while assuming only an undergraduate-level background in mathematics. The wide range of areas covered - never before discussed together in a unified fashion - includes Markov processes and random walks, Langevin and Fokker-Planck equations, noise, generalized central limit theorem and extreme values statistics, random matrix theory and percolation theory.

This graduate-level textbook covers modelling, programming and analysis of stochastic computer simulation experiments, including the mathematical and statistical foundations of simulation and why it works. The book is rigorous and complete, but concise and accessible, providing all necessary background material. Object-oriented programming of simulations is illustrated in Python, while the majority of the book is programming language independent. In addition to covering the foundations of simulation and simulation programming for applications, the text prepares readers to use simulation in their research. A solutions manual for end-of-chapter exercises is available for instructors.

Deep Learning, Volume 48 in the Handbook of Statistics series, highlights new advances in the field, with this new volume presenting interesting chapters on a variety of timely topics, including Generative Adversarial Networks for Biometric Synthesis, Data Science and Pattern Recognition, Facial Data Analysis, Deep Learning in Electronics, Pattern Recognition, Computer Vision and Image Processing, Mechanical Systems, Crop Technology and Weather, Manipulating Faces for Identity Theft via Morphing and Deepfake, Biomedical Engineering, and more.

The main subject of this introductory book is simple random walk on the integer lattice, with special attention to the two-dimensional case. This fascinating mathematical object is the point of departure for an intuitive and richly illustrated tour of related topics at the active edge of research. It starts with three different proofs of the recurrence of the two-dimensional walk, via direct combinatorial arguments, electrical networks, and Lyapunov functions. After reviewing some relevant potential-theoretic tools, the reader is guided toward the relatively new topic of random interlacements - which can be viewed as a 'canonical soup' of nearest-neighbour loops through infinity - again with emphasis on two dimensions. On the way, readers will visit conditioned simple random walks - which are the 'noodles' in the soup - and also discover how Poisson processes of infinite objects are constructed and review the recently introduced method of soft local times. Each chapter ends with many exercises, making it suitable for courses and independent study.

This book discusses quantum theory as the theory of random (Brownian) motion of small particles (electrons etc.) under external forces. Implying that the Schroedinger equation is a complex-valued evolution equation and the Schroedinger function is a complex-valued evolution function, important applications are given. Readers will learn about new mathematical methods (theory of stochastic processes) in solving problems of quantum phenomena. Readers will also learn how to handle stochastic processes in analyzing physical phenomena.

Interest rate modeling and the pricing of related derivatives remain subjects of increasing importance in financial mathematics and risk management. This book provides an accessible introduction to these topics by a step-by-step presentation of concepts with a focus on explicit calculations. Each chapter is accompanied with exercises and their complete solutions, making the book suitable for advanced undergraduate and graduate level students.This second edition retains the main features of the first edition while incorporating a complete revision of the text as well as additional exercises with their solutions, and a new introductory chapter on credit risk. The stochastic interest rate models considered range from standard short rate to forward rate models, with a treatment of the pricing of related derivatives such as caps and swaptions under forward measures. Some more advanced topics including the BGM model and an approach to its calibration are also covered.

The main goal of this book is to systematically address the mathematical methods that are applied in the study of synchronization of infinite-dimensional evolutionary dissipative or partially dissipative systems. It bases its unique monograph presentation on both general and abstract models and covers several important classes of coupled nonlinear deterministic and stochastic PDEs which generate infinite-dimensional dissipative systems. This text, which adapts readily to advanced graduate coursework in dissipative dynamics, requires some background knowledge in evolutionary equations and introductory functional analysis as well as a basic understanding of PDEs and the theory of random processes. Suitable for researchers in synchronization theory, the book is also relevant to physicists and engineers interested in both the mathematical background and the methods for the asymptotic analysis of coupled infinite-dimensional dissipative systems that arise in continuum mechanics.

This book discusses recent developments in dynamic reliability in multi-state systems (MSS), addressing such important issues as reliability and availability analysis of aging MSS, the impact of initial conditions on MSS reliability and availability, changing importance of components over time in MSS with aging components, and the determination of age-replacement policies. It also describes modifications of traditional methods, such as Markov processes with rewards, as well as a modern mathematical method based on the extended universal generating function technique, the Lz-transform, presenting various successful applications and demonstrating their use in real-world problems. This book provides theoretical insights, information on practical applications, and real-world case studies that are of interest to engineers and industrial managers as well as researchers. It also serves as a textbook or supporting text for graduate and postgraduate courses in industrial, electrical, and mechanical engineering.

Applications of queueing network models have multiplied in the last generation, including scheduling of large manufacturing systems, control of patient flow in health systems, load balancing in cloud computing, and matching in ride sharing. These problems are too large and complex for exact solution, but their scale allows approximation. This book is the first comprehensive treatment of fluid scaling, diffusion scaling, and many-server scaling in a single text presented at a level suitable for graduate students. Fluid scaling is used to verify stability, in particular treating max weight policies, and to study optimal control of transient queueing networks. Diffusion scaling is used to control systems in balanced heavy traffic, by solving for optimal scheduling, admission control, and routing in Brownian networks. Many-server scaling is studied in the quality and efficiency driven Halfin-Whitt regime and applied to load balancing in the supermarket model and to bipartite matching in ride-sharing applications.

This book provides the reader with a background on simulating copulas and multivariate distributions in general. It unifies the scattered literature on the simulation of various families of copulas (elliptical, Archimedean, Marshall-Olkin type, etc.) as well as on different construction principles (factor models, pair-copula construction, etc.). The book is self-contained and unified in presentation and can be used as a textbook for advanced undergraduate or graduate students with a firm background in stochastics. Alongside the theoretical foundation, ready-to-implement algorithms and many examples make this book a valuable tool for anyone who is applying the methodology.