In this monograph stochastic models of systems analysis are discussed. It covers many aspects and different stages from the construction of mathematical models of real systems, through mathematical analysis of models based on simplification methods, to the interpretation of real stochastic systems. The stochastic models described here share the property that their evolutionary aspects develop under the influence of random factors. It has been assumed that the evolution takes place in a random medium, i.e. unilateral interaction between the system and the medium. As only Markovian models of random medium are considered in this book, the stochastic models described here are determined by two processes, a switching process describing the evolution of the systems and a switching process describing the changes of the random medium. Audience: This book will be of interest to postgraduate students and researchers whose work involves probability theory, stochastic processes, mathematical systems theory, ordinary differential equations, operator theory, or mathematical modelling and industrial mathematics.

The volume includes a collection of peer-reviewed contributions from among those presented at the main conference organized yearly by the Mexican Statistical Association (AME) and every two years by a Latin-American Confederation of Statistical Societies. For the 2018 edition, particular attention was placed on the analysis of highly complex or large data sets, which have come to be known as "big data". Statistical research in Latin America is prolific and research networks span within and outside the region. The goal of this volume is to provide access to selected works from Latin-American collaborators and their research networks to a wider audience. New methodological advances, motivated in part by the challenges of a data-driven world and the Latin American context, will be of interest to academics and practitioners around the world.

In some cases, certain coherent structures can exist in stochastic dynamic systems almost in every particular realization of random parameters describing these systems. Dynamic localization in one-dimensional dynamic systems, vortexgenesis (vortex production) in hydrodynamic flows, and phenomenon of clustering of various fields in random media (i.e., appearance of small regions with enhanced content of the field against the nearly vanishing background of this field in the remaining portion of space) are examples of such structure formation. The general methodology presented in Volume 1 is used in Volume 2 Coherent Phenomena in Stochastic Dynamic Systems to expound the theory of these phenomena in some specific fields of stochastic science, among which are hydrodynamics, magnetohydrodynamics, acoustics, optics, and radiophysics. The material of this volume includes particle and field clustering in the cases of scalar (density field) and vector (magnetic field) passive tracers in a random velocity field, dynamic localization of plane waves in layered random media, as well as monochromatic wave propagation and caustic structure formation in random media in terms of the scalar parabolic equation.

This book contains articles arising from a conference in honour of mathematician-statistician Mikl s Csoergo on the occasion of his 80th birthday, held in Ottawa in July 2012. It comprises research papers and overview articles, which provide a substantial glimpse of the history and state-of-the-art of the field of asymptotic methods in probability and statistics, written by leading experts. The volume consists of twenty articles on topics on limit theorems for self-normalized processes, planar processes, the central limit theorem and laws of large numbers, change-point problems, short and long range dependent time series, applied probability and stochastic processes, and the theory and methods of statistics. It also includes Csoergo's list of publications during more than 50 years, since 1962.

This book provides a comprehensive up-to-date presentation of some of the classical areas of reliability, based on a more advanced probabilistic framework using the modern theory of stochastic processes. This framework allows analysts to formulate general failure models, establish formulae for computing various performance measures, as well as determine how to identify optimal replacement policies in complex situations.

In this second edition of the book, two major topics have been added to the original version: copula models which are used to study the effect of structural dependencies on the system reliability; and maintenance optimization which highlights delay time models under safety constraints.

Terje Aven is Professor of Reliability and Risk Analysis at University of Stavanger, Norway. Uwe Jensen is working as a Professor at the Institute of Applied Mathematics and Statistics of the University of Hohenheim in Stuttgart, Germany.

Review of first edition:

"This is an excellent book on mathematical, statistical and stochastic models in reliability. The authors have done an excellent job of unifying some of the stochastic models in reliability. The book is a good reference book but may not be suitable as a textbook for students in professional fields such as engineering. This book may be used for graduate level seminar courses for students who have had at least the first course in stochastic processes and some knowledge of reliability mathematics. It should be a good reference book for researchers in reliability mathematics."

--Mathematical Reviews (2000)

"

This book provides a thorough conversation on the underpinnings of Covid-19 spread modelling by using stochastics nonlocal differential and integral operators with singular and non-singular kernels. The book presents the dynamic of Covid-19 spread behaviour worldwide. It is noticed that the spread dynamic followed process with nonlocal behaviours which resemble power law, fading memory, crossover and stochastic behaviours. Fractional stochastic differential equations are therefore used to model spread behaviours in different parts of the worlds. The content coverage includes brief history of Covid-19 spread worldwide from December 2019 to September 2021, followed by statistical analysis of collected data for infected, death and recovery classes.

This simple, compact toolkit for designing and analyzing stochastic approximation algorithms requires only basic literacy in probability and differential equations. Yet these algorithms have powerful applications in control and communications engineering, artificial intelligence and economic modelling. The dynamical systems viewpoint treats an algorithm as a noisy discretization of a limiting differential equation and argues that, under reasonable hypotheses, it tracks the asymptotic behaviour of the differential equation with probability one. The differential equation, which can usually be obtained by inspection, is easier to analyze. Novel topics include finite-time behaviour, multiple timescales and asynchronous implementation. There is a useful taxonomy of applications, with concrete examples from engineering and economics. Notably it covers variants of stochastic gradient-based optimization schemes, fixed-point solvers, which are commonplace in learning algorithms for approximate dynamic programming, and some models of collective behaviour. Three appendices give background on differential equations and probability.

A unique, integrated treatment of computer modeling and simulation "The future of science belongs to those willing to make the shift to simulation-based modeling," predicts Rice Professor James Thompson, a leading modeler and computational statistician widely known for his original ideas and engaging style. He discusses methods, available to anyone with a fast desktop computer, for integrating simulation into the modeling process in order to create meaningful models of real phenomena. Drawing from a wealth of experience, he gives examples from trading markets, oncology, epidemiology, statistical process control, physics, public policy, combat, real-world optimization, Bayesian analyses, and population dynamics. Dr. Thompson believes that, so far from liberating us from the necessity of modeling, the fast computer enables us to engage in realistic models of processes in , for example, economics, which have not been possible earlier because simple stochastic models in the forward temporal direction generally become quite unmanageably complex when one is looking for such things as likelihoods. Thompson shows how simulation may be used to bypass the necessity of obtaining likelihood functions or moment-generating functions as a precursor to parameter estimation. Simulation: A Modeler’s Approach is a provocative and practical guide for professionals in applied statistics as well as engineers, scientists, computer scientists, financial analysts, and anyone with an interest in the synergy between data, models, and the digital computer.

In this book, Professor Pinsky gives a self-contained account of the theory of positive harmonic functions for second order elliptic operators, using an integrated probabilistic and analytic approach. The book begins with a treatment of the construction and basic properties of diffusion processes. This theory then serves as a vehicle for studying positive harmonic funtions. Starting with a rigorous treatment of the spectral theory of elliptic operators with nice coefficients on smooth, bounded domains, the author then develops the theory of the generalized principal eigenvalue, and the related criticality theory for elliptic operators on arbitrary domains. Martin boundary theory is considered, and the Martin boundary is explicitly calculated for several classes of operators. The book provides an array of criteria for determining whether a diffusion process is transient or recurrent. Also introduced are the theory of bounded harmonic functions, and Brownian motion on manifolds of negative curvature. Many results that form the folklore of the subject are here given a rigorous exposition, making this book a useful reference for the specialist, and an excellent guide for the graduate student.

Environmental Data Analysis with MatLab is a new edition that expands fundamentally on the original with an expanded tutorial approach, new crib sheets, and problem sets providing a clear learning path for students and researchers working to analyze real data sets in the environmental sciences. Since publication of the bestselling Environmental Data Analysis with MATLAB (R), many advances have been made in environmental data analysis. One only has to consider the global warming debate to realize how critically important it is to be able to derive clear conclusions from often noisy data drawn from a broad range of sources. The work teaches the basics of the underlying theory of data analysis and then reinforces that knowledge with carefully chosen, realistic scenarios. MATLAB (R), a commercial data processing environment, is used in these scenarios. Significant content is devoted to teaching how it can be effectively used in an environmental data analysis setting. This new edition, though written in a self-contained way, is supplemented with data and MATLAB (R) scripts that can be used as a data analysis tutorial. New features include boxed crib sheets to help identify major results and important formulas and give brief advice on how and when they should be used. Numerical derivatives and integrals are derived and illustrated. Includes log-log plots with further examples of their use. Discusses new datasets on precipitation and stream flow. Topical enhancement applies the chi-squared test to the results of the generalized least squares method. New coverage of cluster analysis and approximation techniques that are widely applied in data analysis, including Taylor Series and low-order polynomial approximations; non-linear least-squares with Newton's method; and pre-calculation and updating techniques applicable to real time data acquisition.

This book presents in-depth coverage of laboratory experiments, theories, modeling techniques, and practices for the analysis and design of rock slopes in complex geological settings. It addresses new concepts in connection with the kinematical element method, discontinuity kinematical element method, integrated karst cave stochastic model-limit equilibrium method, improved strength reduction method, and fracture mechanics method, taking into account the relevant geological features. The book is chiefly intended as a reference guide for geotechnical engineering and engineering geology professionals, and as a textbook for related graduate courses.

Since the parameters in dynamical systems of biological interest are inherently positive and bounded, bounded noises are a natural way to model the realistic stochastic fluctuations of a biological system that are caused by its interaction with the external world. Bounded Noises in Physics, Biology, and Engineering is the first contributed volume devoted to the modeling of bounded noises in theoretical and applied statistical mechanics, quantitative biology, and mathematical physics. It gives an overview of the current state-of-the-art and is intended to stimulate further research. The volume is organized in four parts. The first part presents the main kinds of bounded noises and their applications in theoretical physics. The theory of bounded stochastic processes is intimately linked to its applications to mathematical and statistical physics, and it would be difficult and unnatural to separate the theory from its physical applications. The second is devoted to framing bounded noises in the theory of random dynamical systems and random bifurcations, while the third is devoted to applications of bounded stochastic processes in biology, one of the major areas of potential applications of this subject. The final part concerns the application of bounded stochastic processes in mechanical and structural engineering, the area where the renewed interest for non-Gaussian bounded noises started. Pure mathematicians working on stochastic calculus will find here a rich source of problems that are challenging from the point of view of contemporary nonlinear analysis. Bounded Noises in Physics, Biology, and Engineering is intended for scientists working on stochastic processes with an interest in both fundamental issues and applications. It will appeal to a broad range of applied mathematicians, mathematical biologists, physicists, engineers, and researchers in other fields interested in complexity theory. It is accessible to anyone with a working knowledge of stochastic modeling, from advanced undergraduates to senior researchers.

This work contains a collection of lectures on stochastic processes. The material is arranged in such a way to fit a lecture time of one-and-a-half hours, in order to make the book convenient for lecturers and students. The book can be used in the preparation of courses in stochastic processes for which an understanding of basic notions of mathematical analysis, theory of complex functions, theory of differential equations and probability theory is required. The subjects in the book have different levels of abstraction.

This book presents classical Markov Decision Processes (MDP) for real-life applications and optimization. MDP allows users to develop and formally support approximate and simple decision rules, and this book showcases state-of-the-art applications in which MDP was key to the solution approach. The book is divided into six parts. Part 1 is devoted to the state-of-the-art theoretical foundation of MDP, including approximate methods such as policy improvement, successive approximation and infinite state spaces as well as an instructive chapter on Approximate Dynamic Programming. It then continues with five parts of specific and non-exhaustive application areas. Part 2 covers MDP healthcare applications, which includes different screening procedures, appointment scheduling, ambulance scheduling and blood management. Part 3 explores MDP modeling within transportation. This ranges from public to private transportation, from airports and traffic lights to car parking or charging your electric car . Part 4 contains three chapters that illustrates the structure of approximate policies for production or manufacturing structures. In Part 5, communications is highlighted as an important application area for MDP. It includes Gittins indices, down-to-earth call centers and wireless sensor networks. Finally Part 6 is dedicated to financial modeling, offering an instructive review to account for financial portfolios and derivatives under proportional transactional costs. The MDP applications in this book illustrate a variety of both standard and non-standard aspects of MDP modeling and its practical use. This book should appeal to readers for practitioning, academic research and educational purposes, with a background in, among others, operations research, mathematics, computer science, and industrial engineering.

Discrete stochastic models are tools that allow us to understand, control, and optimize engineering systems and processes. This book provides real-life examples and illustrations of models in reliability engineering and statistical quality control and establishes a connection between the theoretical framework and their engineering applications. The book describes discrete stochastic models along with real-life examples and explores not only well-known models, but also comparatively lesser known ones. It includes definitions, concepts, and methods with a clear understanding of their use in reliability engineering and statistical quality control fields. Also covered are the recent advances and established connections between the theoretical framework of discrete stochastic models and their engineering applications. An ideal reference for researchers in academia and graduate students working in the fields of operations research, reliability engineering, quality control, and probability and statistics.

Networked control systems are increasingly ubiquitous today, with applications ranging from vehicle communication and adaptive power grids to space exploration and economics. The optimal design of such systems presents major challenges, requiring tools from various disciplines within applied mathematics such as decentralized control, stochastic control, information theory, and quantization.

A thorough, self-contained book, "Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints" aims to connect these diverse disciplines with precision and rigor, while conveying design guidelines to controller architects. Unique in the literature, it lays a comprehensive theoretical foundation for the study of networked control systems, and introduces an array of concrete tools for work in the field. Salient features included:

. Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems.

. Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods.

. Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems.

. Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models.

. Decentralized agreement and dynamic optimization under information constraints.

This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.

. Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems.

. Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods.

. Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems.

. Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models.

. Decentralized agreement and dynamic optimization under information constraints.

This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.

'Et moi, ..., si j'avait su comment en revenir, One service mathematics has rendered the je n'y serais point aile.' human race. It has put common sense back Jules Verne where it belongs, on the topmost shelf next to the dusty canister labelled 'discarded n- sense'. The series is divergent; therefore we may be able to do something with it. Eric T. Bell O. Heaviside Mathematics is a tool for thought. A highly necessary tool in a world where both feedback and non linearities abound. Similarly, all kinds of parts of mathematics serve as tools for other parts and for other sciences. Applying a simple rewriting rule to the quote on the right above one finds such statements as: 'One service topology has rendered mathematical physics ... '; 'One service logic has rendered com puter science .. .'; 'One service category theory has rendered mathematics .. .'. All arguably true. And all statements obtainable this way form part of the raison d'etre of this series."

Completely revised and greatly expanded, the new edition of this text takes readers who have been exposed to only basic courses in analysis through the modern general theory of random processes and stochastic integrals as used by systems theorists, electronic engineers and, more recently, those working in quantitative and mathematical finance. Building upon the original release of this title, this text will be of great interest to research mathematicians and graduate students working in those fields, as well as quants in the finance industry. New features of this edition include: End of chapter exercises; New chapters on basic measure theory and Backward SDEs; Reworked proofs, examples and explanatory material; Increased focus on motivating the mathematics; Extensive topical index. "Such a self-contained and complete exposition of stochastic calculus and applications fills an existing gap in the literature. The book can be recommended for first-year graduate studies. It will be useful for all who intend to work with stochastic calculus as well as with its applications."-Zentralblatt (from review of the First Edition)

2020 Taylor & Francis Award Winner for Outstanding New Textbook! Featuring recent advances in the field, this new textbook presents probability and statistics, and their applications in stochastic processes. This book presents key information for understanding the essential aspects of basic probability theory and concepts of reliability as an application. The purpose of this book is to provide an option in this field that combines these areas in one book, balances both theory and practical applications, and also keeps the practitioners in mind. Features Includes numerous examples using current technologies with applications in various fields of study Offers many practical applications of probability in queueing models, all of which are related to the appropriate stochastic processes (continuous time such as waiting time, and fuzzy and discrete time like the classic Gambler's Ruin Problem) Presents different current topics like probability distributions used in real-world applications of statistics such as climate control and pollution Different types of computer software such as MATLAB (R), Minitab, MS Excel, and R as options for illustration, programing and calculation purposes and data analysis Covers reliability and its application in network queues

With the boom of big data and machine learning and the subsequent need for parallel processing technologies, fork-join queues are more relevant now than ever before. In this book, new estimates of the average response time in fork-join queues are proposed, which form the basis for new research opportunities. Analysis of Fork-Join Systems: Network of Queues with Precedence Constraints explores numerical approaches to estimate the average response time of fork-join queueing networks and offers never before published simple expressions for the mean response time as conjectures. Extensive experiments are included to demonstrate the remarkable accuracy of the conjectures and algorithms used in the estimation of the average response time. Graduate students, professors, and researchers in the fields of operations research, management science, industrial engineering, computer science, and electrical engineering will find this book very useful. Students, as well as researchers in both academia and industry, will also find this book of great help when looking for results related to fork-join queues

Stochastic orders are important approximation tools that provide valuable insight into the behaviour of complex stochastic models. Research into stochastic orders is blossoming, with many open problems being studied and a wide range of applications explored. In this book the authors explore the most important concepts of the field, from the basic univariate theory through to the most current applications.

• Comprehensive coverage of the theory and applications of stochastic orders.

• Employs a systematic approach with detailed explanation of each concept.

• Features coverage of univariate and multivariate stochastic orders.

• Covers a range of applications, from queueing theory, reliability theory, statistical physics, actuarial and financial risk, and economics.

• Written by authors with many years experience in researching stochastic orders.

It is well-known that modern stochastic calculus has been exhaustively developed under usual conditions. Despite such a well-developed theory, there is evidence to suggest that these very convenient technical conditions cannot necessarily be fulfilled in real-world applications. Optional Processes: Theory and Applications seeks to delve into the existing theory, new developments and applications of optional processes on "unusual" probability spaces. The development of stochastic calculus of optional processes marks the beginning of a new and more general form of stochastic analysis. This book aims to provide an accessible, comprehensive and up-to-date exposition of optional processes and their numerous properties. Furthermore, the book presents not only current theory of optional processes, but it also contains a spectrum of applications to stochastic differential equations, filtering theory and mathematical finance. Features Suitable for graduate students and researchers in mathematical finance, actuarial science, applied mathematics and related areas Compiles almost all essential results on the calculus of optional processes in unusual probability spaces Contains many advanced analytical results for stochastic differential equations and statistics pertaining to the calculus of optional processes Develops new methods in finance based on optional processes such as a new portfolio theory, defaultable claim pricing mechanism, etc.

Features Quickly and concisely builds from basic probability theory to advanced topics Suitable as a primary text for an advanced course in diffusion processes and stochastic differential equations Useful as supplementary reading across a range of topics.

Most branches of science involving random fluctuations can be approached by Stochastic Calculus. These include, but are not limited to, signal processing, noise filtering, stochastic control, optimal stopping, electrical circuits, financial markets, molecular chemistry, population dynamics, etc. All these applications assume a strong mathematical background, which in general takes a long time to develop. Stochastic Calculus is not an easy to grasp theory, and in general, requires acquaintance with the probability, analysis and measure theory.The goal of this book is to present Stochastic Calculus at an introductory level and not at its maximum mathematical detail. The author's goal was to capture as much as possible the spirit of elementary deterministic Calculus, at which students have been already exposed. This assumes a presentation that mimics similar properties of deterministic Calculus, which facilitates understanding of more complicated topics of Stochastic Calculus.The second edition contains several new features that improved the first edition both qualitatively and quantitatively. First, two more chapters have been added, Chapter 12 and Chapter 13, dealing with applications of stochastic processes in Electrochemistry and global optimization methods.This edition contains also a final chapter material containing fully solved review problems and provides solutions, or at least valuable hints, to all proposed problems. The present edition contains a total of about 250 exercises.This edition has also improved presentation from the first edition in several chapters, including new material.

At the dawn of the 21st century, computational stochastic dynamics is an emerging research frontier. This book focuses on advanced computational methods and software tools which can highly assist in tackling complex problems in stochastic dynamic/seismic analysis and design of structures. The book is primarily intended for researchers and post-graduate students in the fields of computational mechanics and stochastic structural dynamics. Nevertheless, practice engineers as well could benefit from it as most code provisions tend to incorporate probabilistic concepts in the analysis and design of structures. The book addresses mathematical and numerical issues in stochastic structural dynamics and connects them to real-world applications. It consists of 16 chapters dealing with recent advances in a wide range of related topics (dynamic response variability and reliability of stochastic systems, risk assessment, stochastic simulation of earthquake ground motions, efficient solvers for the analysis of stochastic systems, dynamic stability, stochastic modelling of heterogeneous materials). Numerical examples demonstrating the significance of the proposed methods are presented in each chapter.