This book is concerned with the theory of stochastic processes and the theoretical aspects of statistics for stochastic processes. It combines classic topics such as construction of stochastic processes, associated filtrations, processes with independent increments, Gaussian processes, martingales, Markov properties, continuity and related properties of trajectories with contemporary subjects: integration with respect to Gaussian processes, Ito integration, stochastic analysis, stochastic differential equations, fractional Brownian motion and parameter estimation in diffusion models.

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It first examines in detail two important examples (gambling processes and random walks) before presenting the general theory itself in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 138 exercises and 9 problems with their solutions.

Now in its second edition, this popular textbook on game theory is unrivalled in the breadth of its coverage, the thoroughness of technical explanations and the number of worked examples included. Covering non-cooperative and cooperative games, this introduction to game theory includes advanced chapters on auctions, games with incomplete information, games with vector payoffs, stable matchings and the bargaining set. This edition contains new material on stochastic games, rationalizability, and the continuity of the set of equilibrium points with respect to the data of the game. The material is presented clearly and every concept is illustrated with concrete examples from a range of disciplines. With numerous exercises, and the addition of a solution manual for instructors with this edition, the book is an extensive guide to game theory for undergraduate through graduate courses in economics, mathematics, computer science, engineering and life sciences, and will also serve as useful reference for researchers.

The relatively young theory of structured dependence between stochastic processes has many real-life applications in areas including finance, insurance, seismology, neuroscience, and genetics. With this monograph, the first to be devoted to the modeling of structured dependence between random processes, the authors not only meet the demand for a solid theoretical account but also develop a stochastic processes counterpart of the classical copula theory that exists for finite-dimensional random variables. Presenting both the technical aspects and the applications of the theory, this is a valuable reference for researchers and practitioners in the field, as well as for graduate students in pure and applied mathematics programs. Numerous theoretical examples are included, alongside examples of both current and potential applications, aimed at helping those who need to model structured dependence between dynamic random phenomena.

Now in its second edition, this popular textbook on game theory is unrivalled in the breadth of its coverage, the thoroughness of technical explanations and the number of worked examples included. Covering non-cooperative and cooperative games, this introduction to game theory includes advanced chapters on auctions, games with incomplete information, games with vector payoffs, stable matchings and the bargaining set. This edition contains new material on stochastic games, rationalizability, and the continuity of the set of equilibrium points with respect to the data of the game. The material is presented clearly and every concept is illustrated with concrete examples from a range of disciplines. With numerous exercises, and the addition of a solution manual for instructors with this edition, the book is an extensive guide to game theory for undergraduate through graduate courses in economics, mathematics, computer science, engineering and life sciences, and will also serve as useful reference for researchers.

One of the first books to provide in-depth and systematic application of finite element methods to the field of stochastic structural dynamics The parallel developments of the Finite Element Methods in the 1950 s and the engineering applications of stochastic processes in the 1940 s provided a combined numerical analysis tool for the studies of dynamics of structures and structural systems under random loadings. In the open literature, there are books on statistical dynamics of structures and books on structural dynamics with chapters dealing with random response analysis. However, a systematic treatment of stochastic structural dynamics applying the finite element methods seems to be lacking. Aimed at advanced and specialist levels, the author presents and illustrates analytical and direct integration methods for analyzing the statistics of the response of structures to stochastic loads. The analysis methods are based on structural models represented via the Finite Element Method. In addition to linear problems the text also addresses nonlinear problems and non-stationary random excitation with systems having large spatially stochastic property variations. * A systematic treatment of stochastic structural dynamics applying the finite element methods * Highly illustrated throughout and aimed at advanced and specialist levels, it focuses on computational aspects instead of theory * Emphasizes results mainly in the time domain with limited contents in the time-frequency domain * Presents and illustrates direction integration methods for analyzing the statistics of the response of linear and nonlinear structures to stochastic loads Under Author Information - one change of word to existing text: He is a Fellow of the American Society of Mechanical Engineers (ASME)...

An introduction to the basic theory of stochastic calculus and its applications. Examples are given throughout the text, in order to motivate and illustrate the theory and show its importance for many applications in e.g. economics, biology and physics. The basic idea of the presentation is to start from some basic results (without proofs) of the easier cases and develop the theory from there, and to concentrate on the proofs of the easier case in order to quickly progress to the parts of the theory that are most important for the applications. For the 6th edition the author has added further exercises and, for the first time, solutions to many of the exercises are provided.

Random walks, Markov chains and electrical networks serve as an introduction to the study of real-valued functions on finite or infinite graphs, with appropriate interpretations using probability theory and current-voltage laws. The relation between this type of function theory and the (Newton) potential theory on the Euclidean spaces is well-established. The latter theory has been variously generalized, one example being the axiomatic potential theory on locally compact spaces developed by Brelot, with later ramifications from Bauer, Constantinescu and Cornea. A network is a graph with edge-weights that need not be symmetric. This book presents an autonomous theory of harmonic functions and potentials defined on a finite or infinite network, on the lines of axiomatic potential theory. Random walks and electrical networks are important sources for the advancement of the theory.

Inequalities and Extremal Problems in Probability and Statistics: Selected Topics presents various kinds of useful inequalities that are applicable in many areas of mathematics, the sciences, and engineering. The book enables the reader to grasp the importance of inequalities and how they relate to probability and statistics. This will be an extremely useful book for researchers and graduate students in probability, statistics, and econometrics, as well as specialists working across sciences, engineering, financial mathematics, insurance, and mathematical modeling of large risks.

This is the first book to promote the use of stochastic, or random, processes to understand, model and predict our climate system. One of the most important applications of this technique is in the representation of comprehensive climate models of processes which, although crucial, are too small or fast to be explicitly modelled. The book shows how stochastic methods can lead to improvements in climate simulation and prediction, compared with more conventional bulk-formula parameterization procedures. Beginning with expositions of the relevant mathematical theory, the book moves on to describe numerous practical applications. It covers the complete range of time scales of climate variability, from seasonal to decadal, centennial, and millennial. With contributions from leading experts in climate physics, this book is invaluable to anyone working on climate models, including graduate students and researchers in the atmospheric and oceanic sciences, numerical weather forecasting, climate prediction, climate modelling, and climate change.

This rigorous introduction to network science presents random graphs as models for real-world networks. Such networks have distinctive empirical properties and a wealth of new models have emerged to capture them. Classroom tested for over ten years, this text places recent advances in a unified framework to enable systematic study. Designed for a master's-level course, where students may only have a basic background in probability, the text covers such important preliminaries as convergence of random variables, probabilistic bounds, coupling, martingales, and branching processes. Building on this base - and motivated by many examples of real-world networks, including the Internet, collaboration networks, and the World Wide Web - it focuses on several important models for complex networks and investigates key properties, such as the connectivity of nodes. Numerous exercises allow students to develop intuition and experience in working with the models.

Probability comes of age with this, the first dictionary of probability and its applications in English, which supplies a guide to the concepts and vocabulary of this rapidly expanding field. Besides the basic theory of probability and random processes, applications covered here include financial and insurance mathematics, operations research (including queueing, reliability, and inventories), decision and game theory, optimization, time series, networks, and communication theory, as well as classic problems and paradoxes. The dictionary is reliable, stable, concise, and cohesive. Each entry provides a rigorous definition, a sketch of the context, and a reference pointing the reader to the wider literature. Judicious use of figures makes complex concepts easier to follow without oversimplifying. As the only dictionary on the market, this will be a guiding reference for all those working in, or learning, probability together with its applications.

Geographical Models with Mathematica provides a fairly comprehensive overview of the types of models necessary for the development of new geographical knowledge, including stochastic models, models for data analysis, for geostatistics, for networks, for dynamic systems, for cellular automata and for multi-agent systems, all discussed in their theoretical context. The author then provides over 65 programs, written in the Mathematica language, that formalize these models. Case studies are provided to help the reader apply these programs to their own studies.

The present monograph on stochastic Komatu-Loewner evolutions (SKLEs) provides the first systematic extension of the Schramm-Loewner evolution (SLE) theory from a simply connected planar domain to multiply connected domains by using the Brownian motion with darning (BMD) that has arisen in a recent study of the boundary theory of symmetric Markov processes.This volume is presented in an accessible manner for the interested researchers and graduate students. It also brings new insights into SLEs as special cases of SKLEs. Mathematically, it can be viewed as a powerful application of stochastic analysis via BMDs to complex analysis.

The fourth edition of this successful text provides an introduction to probability and random processes, with many practical applications. It is aimed at mathematics undergraduates and postgraduates, and has four main aims. US BL To provide a thorough but straightforward account of basic probability theory, giving the reader a natural feel for the subject unburdened by oppressive technicalities. BE BL To discuss important random processes in depth with many examples.BE BL To cover a range of topics that are significant and interesting but less routine. BE BL To impart to the beginner some flavour of advanced work.BE UE OP The book begins with the basic ideas common to most undergraduate courses in mathematics, statistics, and science. It ends with material usually found at graduate level, for example, Markov processes, (including Markov chain Monte Carlo), martingales, queues, diffusions, (including stochastic calculus with Ito's formula), renewals, stationary processes (including the ergodic theorem), and option pricing in mathematical finance using the Black-Scholes formula. Further, in this new revised fourth edition, there are sections on coupling from the past, Levy processes, self-similarity and stability, time changes, and the holding-time/jump-chain construction of continuous-time Markov chains. Finally, the number of exercises and problems has been increased by around 300 to a total of about 1300, and many of the existing exercises have been refreshed by additional parts. The solutions to these exercises and problems can be found in the companion volume, One Thousand Exercises in Probability, third edition, (OUP 2020).CP

Stochastic processes have a wide range of applications ranging from image processing, neuroscience, bioinformatics, financial management, and statistics. Mathematical, physical, and engineering systems use stochastic processes for modeling and reasoning phenomena. While comparing AI-stochastic systems with other counterpart systems, we are able to understand their significance, thereby applying new techniques to obtain new real-time results and solutions. Stochastic Processes and Their Applications in Artificial Intelligence opens doors for artificial intelligence experts to use stochastic processes as an effective tool in real-world problems in computational biology, speech recognition, natural language processing, and reinforcement learning. Covering key topics such as social media, big data, and artificial intelligence models, this reference work is ideal for mathematicians, industry professionals, researchers, scholars, academicians, practitioners, instructors, and students.

Computational neuroscience is the theoretical study of the brain to uncover the principles and mechanisms that guide the development, organization, information processing, and mental functions of the nervous system. Although not a new area, it is only recently that enough knowledge has been gathered to establish computational neuroscience as a scientific discipline in its own right. Given the complexity of the field, and its increasing importance in progressing our understanding of how the brain works, there has long been a need for an introductory text on what is often assumed to be an impenetrable topic. The new edition of Fundamentals of Computational Neuroscience build on the success and strengths of the previous editions. It introduces the theoretical foundations of neuroscience with a focus on the nature of information processing in the brain. The book covers the introduction and motivation of simplified models of neurons that are suitable for exploring information processing in large brain-like networks. Additionally, it introduces several fundamental network architectures and discusses their relevance for information processing in the brain, giving some examples of models of higher-order cognitive functions to demonstrate the advanced insight that can be gained with such studies. Each chapter starts by introducing its topic with experimental facts and conceptual questions related to the study of brain function. An additional feature is the inclusion of simple Matlab programs that can be used to explore many of the mechanisms explained in the book. An accompanying webpage includes programs for download. The book will be the essential text for anyone in the brain sciences who wants to get to grips with this topic.

This sequel to volume 19 of Handbook on Statistics on Stochastic Processes: Modelling and Simulation is concerned mainly with the theme of reviewing and, in some cases, unifying with new ideas the different lines of research and developments in stochastic processes of applied flavour. This volume consists of 23 chapters addressing various topics in stochastic processes. These include, among others, those on manufacturing systems, random graphs, reliability, epidemic modelling, self-similar processes, empirical processes, time series models, extreme value therapy, applications of Markov chains, modelling with Monte Carlo techniques, and stochastic processes in subjects such as engineering, telecommunications, biology, astronomy and chemistry. particular with modelling, simulation techniques and numerical methods concerned with stochastic processes. The scope of the project involving this volume as well as volume 19 is already clarified in the preface of volume 19. The present volume completes the aim of the project and should serve as an aid to students, teachers, researchers and practitioners interested in applied stochastic processes.

Hardbound. J. Neyman, one of the pioneers in laying the foundations of modern statistical theory, stressed the importance of stochastic processes in a paper written in 1960 in the following terms: Currently in the period of dynamic indeterminism in science, there is hardly a serious piece of research, if treated realistically, does not involve operations on stochastic processes. Arising from the need to solve practical problems, several major advances have taken place in the theory of stochastic processes and their applications. Books by Doob (1953; J. Wiley and Sons), Feller (1957, 1966; J. Wiley and Sons) and Loeve (1960; D. van Nostrand and Col., Inc.) among others, have created growing awareness and interest in the use of stochastic processes in scientific and technological studies.The literature on stochastic processes is very extensive and is distributed in several books and journals. There is a need to review the different lines of

This book aims to provide an overview of the special functions of fractional calculus and their applications in diffusion and random search processes. The book contains detailed calculations for various examples of anomalous diffusion, random search and stochastic resetting processes, which can be easily followed by the reader, who will be able to reproduce the obtained results. The book will be intended for advanced undergraduate and graduate students and researchers in physics, mathematics and other natural sciences due to the various examples which will be provided in the book.

The book contains two contributions about the work of Emmanuele DiBenedetto and a selection of original papers. The authors are some of the main experts in Harnack's inequalities and nonlinear operators. These papers are part of the contributions presented during the conference to celebrate the 70th birthday of Prof. Emmanuele DiBenedetto, which was held at "Il Palazzone" in Cortona from June 18th to 24th, 2017. The papers are focused on current research topics regarding the qualitative properties of solutions, connections with calculus of variations, Harnack inequality and regularity theory. Some papers are also related to various applications. Many of the authors have shared with Prof. DiBenedetto an intense scientific and personal collaboration, while many others have taken inspiration from and further developed his field of research. The topics of the conference are certainly of great interest for the international mathematical community.

Serving as the foundation for a one-semester course in stochastic processes for students familiar with elementary probability theory and calculus, "Introduction to Stochastic Modeling, 4e, " bridges the gap between basic probability and an intermediate level course in stochastic processes. The objectives of the text are to introduce students to the standard concepts and methods of stochastic modeling, to illustrate the rich diversity of applications of stochastic processes in the applied sciences, and to provide exercises in the application of simple stochastic analysis to realistic problems.

New to this edition: Realistic applications from a variety of disciplines integrated throughout the text, including more biological applicationsPlentiful, completely updated problemsCompletely updated and reorganized end-of-chapter exercise sets, 250 exercises with answersNew chapters of stochastic differential equations and Brownian motion and related processesAdditional sections on Martingale and Poisson process

Realistic applications from a variety of disciplines integrated throughout the text.

Extensive end of chapter exercises sets, 250 with answers

Chapter 1-9 of the new edition are identical to the previous edition

New Chapter 10 - Random Evolutions

New Chapter 11- Characteristic functions and Their Applications "

This book presents state-of-the-art solution methods and applications of stochastic optimal control. It is a collection of extended papers discussed at the traditional Liverpool workshop on controlled stochastic processes with participants from both the east and the west. New problems are formulated, and progresses of ongoing research are reported. Topics covered in this book include theoretical results and numerical methods for Markov and semi-Markov decision processes, optimal stopping of Markov processes, stochastic games, problems with partial information, optimal filtering, robust control, Q-learning, and self-organizing algorithms. Real-life case studies and applications, e.g., queueing systems, forest management, control of water resources, marketing science, and healthcare, are presented. Scientific researchers and postgraduate students interested in stochastic optimal control,- as well as practitioners will find this book appealing and a valuable reference.

The stochastic partial differential equations (SPDEs) arise in many applications of the probability theory. This monograph will focus on two particular (and probably the most known) equations: the stochastic heat equation and the stochastic wave equation.The focus is on the relationship between the solutions to the SPDEs and the fractional Brownian motion (and related processes). An important point of the analysis is the study of the asymptotic behavior of the p-variations of the solutions to the heat or wave equations driven by space-time Gaussian noise or by a Gaussian noise with a non-trivial correlation in space.The book is addressed to public with a reasonable background in probability theory. The idea is to keep it self-contained and avoid using of complex techniques. We also chose to insist on the basic properties of the random noise and to detail the construction of the Wiener integration with respect to them. The intention is to present the proofs complete and detailed.

The stability of stochastic differential equations in abstract, mainly Hilbert, spaces receives a unified treatment in this self-contained book. It covers basic theory as well as computational techniques for handling the stochastic stability of systems from mathematical, physical and biological problems. Its core material is divided into three parts devoted respectively to the stochastic stability of linear systems, non-linear systems, and time-delay systems. The focus is on stability of stochastic dynamical processes affected by white noise, which are described by partial differential equations such as the Navier-Stokes equations. A range of mathematicians and scientists, including those involved in numerical computation, will find this book useful. It is also ideal for engineers working on stochastic systems and their control, and researchers in mathematical physics or biology.