In this monograph stochastic models of systems analysis are discussed. It covers many aspects and different stages from the construction of mathematical models of real systems, through mathematical analysis of models based on simplification methods, to the interpretation of real stochastic systems. The stochastic models described here share the property that their evolutionary aspects develop under the influence of random factors. It has been assumed that the evolution takes place in a random medium, i.e. unilateral interaction between the system and the medium. As only Markovian models of random medium are considered in this book, the stochastic models described here are determined by two processes, a switching process describing the evolution of the systems and a switching process describing the changes of the random medium. Audience: This book will be of interest to postgraduate students and researchers whose work involves probability theory, stochastic processes, mathematical systems theory, ordinary differential equations, operator theory, or mathematical modelling and industrial mathematics.

This book provides an extensive, systematic overview of the modern theory of telegraph processes and their multidimensional counterparts, together with numerous fruitful applications in financial modelling. Focusing on stochastic processes of bounded variation instead of classical diffusion, or more generally, Levy processes, has two obvious benefits. First, the mathematical technique is much simpler, which helps to concentrate on the key problems of stochastic analysis and applications, including financial market modelling. Second, this approach overcomes some shortcomings of the (parabolic) nature of classical diffusions that contradict physical intuition, such as infinite propagation velocity and infinite total variation of paths. In this second edition, some sections of the previous text are included without any changes, while most others have been expanded and significantly revised. These are supplemented by predominantly new results concerning piecewise linear processes with arbitrary sequences of velocities, jump amplitudes, and switching intensities. The chapter on functionals of the telegraph process has been significantly expanded by adding sections on exponential functionals, telegraph meanders and running extrema, the times of the first passages of telegraph processes with alternating random jumps, and distribution of the Euclidean distance between two independent telegraph processes. A new chapter on the multidimensional counterparts of the telegraph processes is also included. The book is intended for graduate students in mathematics, probability, statistics and quantitative finance, and for researchers working at academic institutions, in industry and engineering. It can also be used by university lecturers and professionals in various applied areas.

This book covers a wide range of problems involving the applications of stochastic processes, stochastic calculus, large deviation theory, group representation theory and quantum statistics to diverse fields in dynamical systems, electromagnetics, statistical signal processing, quantum information theory, quantum neural network theory, quantum filtering theory, quantum electrodynamics, quantum general relativity, string theory, problems in biology and classical and quantum fluid dynamics. The selection of the problems has been based on courses taught by the author to undergraduates and postgraduates in Electronics and Communications Engineering. Print edition not for sale in South Asia (India, Sri Lanka, Nepal, Bangladesh, Pakistan or Bhutan).

Ruin Probabilities: Smoothness, Bounds, Supermartingale Approach deals with continuous-time risk models and covers several aspects of risk theory. The first of them is the smoothness of the survival probabilities. In particular, the book provides a detailed investigation of the continuity and differentiability of the infinite-horizon and finite-horizon survival probabilities for different risk models. Next, it gives some possible applications of the results concerning the smoothness of the survival probabilities. Additionally, the book introduces the supermartingale approach, which generalizes the martingale one introduced by Gerber, to get upper exponential bounds for the infinite-horizon ruin probabilities in some generalizations of the classical risk model with risky investments.

This book contains articles arising from a conference in honour of mathematician-statistician Mikl s Csoergo on the occasion of his 80th birthday, held in Ottawa in July 2012. It comprises research papers and overview articles, which provide a substantial glimpse of the history and state-of-the-art of the field of asymptotic methods in probability and statistics, written by leading experts. The volume consists of twenty articles on topics on limit theorems for self-normalized processes, planar processes, the central limit theorem and laws of large numbers, change-point problems, short and long range dependent time series, applied probability and stochastic processes, and the theory and methods of statistics. It also includes Csoergo's list of publications during more than 50 years, since 1962.

This book provides a comprehensive up-to-date presentation of some of the classical areas of reliability, based on a more advanced probabilistic framework using the modern theory of stochastic processes. This framework allows analysts to formulate general failure models, establish formulae for computing various performance measures, as well as determine how to identify optimal replacement policies in complex situations.

In this second edition of the book, two major topics have been added to the original version: copula models which are used to study the effect of structural dependencies on the system reliability; and maintenance optimization which highlights delay time models under safety constraints.

Terje Aven is Professor of Reliability and Risk Analysis at University of Stavanger, Norway. Uwe Jensen is working as a Professor at the Institute of Applied Mathematics and Statistics of the University of Hohenheim in Stuttgart, Germany.

Review of first edition:

"This is an excellent book on mathematical, statistical and stochastic models in reliability. The authors have done an excellent job of unifying some of the stochastic models in reliability. The book is a good reference book but may not be suitable as a textbook for students in professional fields such as engineering. This book may be used for graduate level seminar courses for students who have had at least the first course in stochastic processes and some knowledge of reliability mathematics. It should be a good reference book for researchers in reliability mathematics."

--Mathematical Reviews (2000)

"

Stochastic resonance has been observed in many forms of systems, and has been hotly debated by scientists for over 30 years. Applications incorporating aspects of stochastic resonance may yet prove revolutionary in fields such as distributed sensor networks, nano-electronics, and biomedical prosthetics. Ideal for researchers in fields ranging from computational neuroscience through to electronic engineering, this book addresses in detail various theoretical aspects of stochastic quantization, in the context of the suprathreshold stochastic resonance effect. Initial chapters review stochastic resonance and outline some of the controversies and debates that have surrounded it. The book then discusses suprathreshold stochastic resonance, and its extension to more general models of stochastic signal quantization. Finally, it considers various constraints and tradeoffs in the performance of stochastic quantizers, before culminating with a chapter in the application of suprathreshold stochastic resonance to the design of cochlear implants.

This simple, compact toolkit for designing and analyzing stochastic approximation algorithms requires only basic literacy in probability and differential equations. Yet these algorithms have powerful applications in control and communications engineering, artificial intelligence and economic modelling. The dynamical systems viewpoint treats an algorithm as a noisy discretization of a limiting differential equation and argues that, under reasonable hypotheses, it tracks the asymptotic behaviour of the differential equation with probability one. The differential equation, which can usually be obtained by inspection, is easier to analyze. Novel topics include finite-time behaviour, multiple timescales and asynchronous implementation. There is a useful taxonomy of applications, with concrete examples from engineering and economics. Notably it covers variants of stochastic gradient-based optimization schemes, fixed-point solvers, which are commonplace in learning algorithms for approximate dynamic programming, and some models of collective behaviour. Three appendices give background on differential equations and probability.

The volume includes a collection of peer-reviewed contributions from among those presented at the main conference organized yearly by the Mexican Statistical Association (AME) and every two years by a Latin-American Confederation of Statistical Societies. For the 2018 edition, particular attention was placed on the analysis of highly complex or large data sets, which have come to be known as "big data". Statistical research in Latin America is prolific and research networks span within and outside the region. The goal of this volume is to provide access to selected works from Latin-American collaborators and their research networks to a wider audience. New methodological advances, motivated in part by the challenges of a data-driven world and the Latin American context, will be of interest to academics and practitioners around the world.

This book aims to provide an overview of the special functions of fractional calculus and their applications in diffusion and random search processes. The book contains detailed calculations for various examples of anomalous diffusion, random search and stochastic resetting processes, which can be easily followed by the reader, who will be able to reproduce the obtained results. The book will be intended for advanced undergraduate and graduate students and researchers in physics, mathematics and other natural sciences due to the various examples which will be provided in the book.

The present monograph on stochastic Komatu-Loewner evolutions (SKLEs) provides the first systematic extension of the Schramm-Loewner evolution (SLE) theory from a simply connected planar domain to multiply connected domains by using the Brownian motion with darning (BMD) that has arisen in a recent study of the boundary theory of symmetric Markov processes.This volume is presented in an accessible manner for the interested researchers and graduate students. It also brings new insights into SLEs as special cases of SKLEs. Mathematically, it can be viewed as a powerful application of stochastic analysis via BMDs to complex analysis.

In this book, Professor Pinsky gives a self-contained account of the theory of positive harmonic functions for second order elliptic operators, using an integrated probabilistic and analytic approach. The book begins with a treatment of the construction and basic properties of diffusion processes. This theory then serves as a vehicle for studying positive harmonic funtions. Starting with a rigorous treatment of the spectral theory of elliptic operators with nice coefficients on smooth, bounded domains, the author then develops the theory of the generalized principal eigenvalue, and the related criticality theory for elliptic operators on arbitrary domains. Martin boundary theory is considered, and the Martin boundary is explicitly calculated for several classes of operators. The book provides an array of criteria for determining whether a diffusion process is transient or recurrent. Also introduced are the theory of bounded harmonic functions, and Brownian motion on manifolds of negative curvature. Many results that form the folklore of the subject are here given a rigorous exposition, making this book a useful reference for the specialist, and an excellent guide for the graduate student.

This book presents in-depth coverage of laboratory experiments, theories, modeling techniques, and practices for the analysis and design of rock slopes in complex geological settings. It addresses new concepts in connection with the kinematical element method, discontinuity kinematical element method, integrated karst cave stochastic model-limit equilibrium method, improved strength reduction method, and fracture mechanics method, taking into account the relevant geological features. The book is chiefly intended as a reference guide for geotechnical engineering and engineering geology professionals, and as a textbook for related graduate courses.

Since the parameters in dynamical systems of biological interest are inherently positive and bounded, bounded noises are a natural way to model the realistic stochastic fluctuations of a biological system that are caused by its interaction with the external world. Bounded Noises in Physics, Biology, and Engineering is the first contributed volume devoted to the modeling of bounded noises in theoretical and applied statistical mechanics, quantitative biology, and mathematical physics. It gives an overview of the current state-of-the-art and is intended to stimulate further research. The volume is organized in four parts. The first part presents the main kinds of bounded noises and their applications in theoretical physics. The theory of bounded stochastic processes is intimately linked to its applications to mathematical and statistical physics, and it would be difficult and unnatural to separate the theory from its physical applications. The second is devoted to framing bounded noises in the theory of random dynamical systems and random bifurcations, while the third is devoted to applications of bounded stochastic processes in biology, one of the major areas of potential applications of this subject. The final part concerns the application of bounded stochastic processes in mechanical and structural engineering, the area where the renewed interest for non-Gaussian bounded noises started. Pure mathematicians working on stochastic calculus will find here a rich source of problems that are challenging from the point of view of contemporary nonlinear analysis. Bounded Noises in Physics, Biology, and Engineering is intended for scientists working on stochastic processes with an interest in both fundamental issues and applications. It will appeal to a broad range of applied mathematicians, mathematical biologists, physicists, engineers, and researchers in other fields interested in complexity theory. It is accessible to anyone with a working knowledge of stochastic modeling, from advanced undergraduates to senior researchers.

Over the course of his distinguished career, Vladimir Maz'ya has made a number of groundbreaking contributions to numerous areas of mathematics, including partial differential equations, function theory, and harmonic analysis. The chapters in this volume - compiled on the occasion of his 80th birthday - are written by distinguished mathematicians and pay tribute to his many significant and lasting achievements.

This work contains a collection of lectures on stochastic processes. The material is arranged in such a way to fit a lecture time of one-and-a-half hours, in order to make the book convenient for lecturers and students. The book can be used in the preparation of courses in stochastic processes for which an understanding of basic notions of mathematical analysis, theory of complex functions, theory of differential equations and probability theory is required. The subjects in the book have different levels of abstraction.

Discrete stochastic models are tools that allow us to understand, control, and optimize engineering systems and processes. This book provides real-life examples and illustrations of models in reliability engineering and statistical quality control and establishes a connection between the theoretical framework and their engineering applications. The book describes discrete stochastic models along with real-life examples and explores not only well-known models, but also comparatively lesser known ones. It includes definitions, concepts, and methods with a clear understanding of their use in reliability engineering and statistical quality control fields. Also covered are the recent advances and established connections between the theoretical framework of discrete stochastic models and their engineering applications. An ideal reference for researchers in academia and graduate students working in the fields of operations research, reliability engineering, quality control, and probability and statistics.

This book presents classical Markov Decision Processes (MDP) for real-life applications and optimization. MDP allows users to develop and formally support approximate and simple decision rules, and this book showcases state-of-the-art applications in which MDP was key to the solution approach. The book is divided into six parts. Part 1 is devoted to the state-of-the-art theoretical foundation of MDP, including approximate methods such as policy improvement, successive approximation and infinite state spaces as well as an instructive chapter on Approximate Dynamic Programming. It then continues with five parts of specific and non-exhaustive application areas. Part 2 covers MDP healthcare applications, which includes different screening procedures, appointment scheduling, ambulance scheduling and blood management. Part 3 explores MDP modeling within transportation. This ranges from public to private transportation, from airports and traffic lights to car parking or charging your electric car . Part 4 contains three chapters that illustrates the structure of approximate policies for production or manufacturing structures. In Part 5, communications is highlighted as an important application area for MDP. It includes Gittins indices, down-to-earth call centers and wireless sensor networks. Finally Part 6 is dedicated to financial modeling, offering an instructive review to account for financial portfolios and derivatives under proportional transactional costs. The MDP applications in this book illustrate a variety of both standard and non-standard aspects of MDP modeling and its practical use. This book should appeal to readers for practitioning, academic research and educational purposes, with a background in, among others, operations research, mathematics, computer science, and industrial engineering.

The stochastic partial differential equations (SPDEs) arise in many applications of the probability theory. This monograph will focus on two particular (and probably the most known) equations: the stochastic heat equation and the stochastic wave equation.The focus is on the relationship between the solutions to the SPDEs and the fractional Brownian motion (and related processes). An important point of the analysis is the study of the asymptotic behavior of the p-variations of the solutions to the heat or wave equations driven by space-time Gaussian noise or by a Gaussian noise with a non-trivial correlation in space.The book is addressed to public with a reasonable background in probability theory. The idea is to keep it self-contained and avoid using of complex techniques. We also chose to insist on the basic properties of the random noise and to detail the construction of the Wiener integration with respect to them. The intention is to present the proofs complete and detailed.

'Et moi, ..., si j'avait su comment en revenir, One service mathematics has rendered the je n'y serais point aile.' human race. It has put common sense back Jules Verne where it belongs, on the topmost shelf next to the dusty canister labelled 'discarded n- sense'. The series is divergent; therefore we may be able to do something with it. Eric T. Bell O. Heaviside Mathematics is a tool for thought. A highly necessary tool in a world where both feedback and non linearities abound. Similarly, all kinds of parts of mathematics serve as tools for other parts and for other sciences. Applying a simple rewriting rule to the quote on the right above one finds such statements as: 'One service topology has rendered mathematical physics ... '; 'One service logic has rendered com puter science .. .'; 'One service category theory has rendered mathematics .. .'. All arguably true. And all statements obtainable this way form part of the raison d'etre of this series."

Networked control systems are increasingly ubiquitous today, with applications ranging from vehicle communication and adaptive power grids to space exploration and economics. The optimal design of such systems presents major challenges, requiring tools from various disciplines within applied mathematics such as decentralized control, stochastic control, information theory, and quantization.

A thorough, self-contained book, "Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints" aims to connect these diverse disciplines with precision and rigor, while conveying design guidelines to controller architects. Unique in the literature, it lays a comprehensive theoretical foundation for the study of networked control systems, and introduces an array of concrete tools for work in the field. Salient features included:

. Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems.

. Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods.

. Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems.

. Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models.

. Decentralized agreement and dynamic optimization under information constraints.

This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.

. Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems.

. Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods.

. Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems.

. Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models.

. Decentralized agreement and dynamic optimization under information constraints.

This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.

2020 Taylor & Francis Award Winner for Outstanding New Textbook! Featuring recent advances in the field, this new textbook presents probability and statistics, and their applications in stochastic processes. This book presents key information for understanding the essential aspects of basic probability theory and concepts of reliability as an application. The purpose of this book is to provide an option in this field that combines these areas in one book, balances both theory and practical applications, and also keeps the practitioners in mind. Features Includes numerous examples using current technologies with applications in various fields of study Offers many practical applications of probability in queueing models, all of which are related to the appropriate stochastic processes (continuous time such as waiting time, and fuzzy and discrete time like the classic Gambler's Ruin Problem) Presents different current topics like probability distributions used in real-world applications of statistics such as climate control and pollution Different types of computer software such as MATLAB (R), Minitab, MS Excel, and R as options for illustration, programing and calculation purposes and data analysis Covers reliability and its application in network queues

This book provides a thorough conversation on the underpinnings of Covid-19 spread modelling by using stochastics nonlocal differential and integral operators with singular and non-singular kernels. The book presents the dynamic of Covid-19 spread behaviour worldwide. It is noticed that the spread dynamic followed process with nonlocal behaviours which resemble power law, fading memory, crossover and stochastic behaviours. Fractional stochastic differential equations are therefore used to model spread behaviours in different parts of the worlds. The content coverage includes brief history of Covid-19 spread worldwide from December 2019 to September 2021, followed by statistical analysis of collected data for infected, death and recovery classes.

With the boom of big data and machine learning and the subsequent need for parallel processing technologies, fork-join queues are more relevant now than ever before. In this book, new estimates of the average response time in fork-join queues are proposed, which form the basis for new research opportunities. Analysis of Fork-Join Systems: Network of Queues with Precedence Constraints explores numerical approaches to estimate the average response time of fork-join queueing networks and offers never before published simple expressions for the mean response time as conjectures. Extensive experiments are included to demonstrate the remarkable accuracy of the conjectures and algorithms used in the estimation of the average response time. Graduate students, professors, and researchers in the fields of operations research, management science, industrial engineering, computer science, and electrical engineering will find this book very useful. Students, as well as researchers in both academia and industry, will also find this book of great help when looking for results related to fork-join queues

Stochastic approximation is a relatively new technique for studying the properties of an experimental situation; it has important applications in fields such as medicine and engineering. The subject can be treated either largely as a branch of pure mathematics, or else from an empirical and practical angle. In this book, Dr Wasan gives a rigorous mathematical treatment of the subject, drawing together the scattered results of a number of authors. He discusses the conditions under which the method gives a valid approximation to the required solution; methods for optimal choice of parameters to hasten convergence; the comparison of the method with other techniques. The discussion and proofs of theorems are given in enough detail to make them easy to follow, while a number of interesting examples show how the techniques may be applied in many fields.