This rigorous, self-contained book describes mathematical and, in particular, stochastic and graph theoretic methods to assess the performance of complex networks and systems. It comprises three parts: the first is a review of probability theory; Part II covers the classical theory of stochastic processes (Poisson, Markov and queueing theory), which are considered to be the basic building blocks for performance evaluation studies; Part III focuses on the rapidly expanding new field of network science. This part deals with the recently obtained insight that many very different large complex networks - such as the Internet, World Wide Web, metabolic and human brain networks, utility infrastructures, social networks - evolve and behave according to general common scaling laws. This understanding is useful when assessing the end-to-end quality of Internet services and when designing robust and secure networks. Containing problems and solved solutions, the book is ideal for graduate students taking courses in performance analysis.

Communication networks underpin our modern world, and provide fascinating and challenging examples of large-scale stochastic systems. Randomness arises in communication systems at many levels: for example, the initiation and termination times of calls in a telephone network, or the statistical structure of the arrival streams of packets at routers in the Internet. How can routing, flow control and connection acceptance algorithms be designed to work well in uncertain and random environments? This compact introduction illustrates how stochastic models can be used to shed light on important issues in the design and control of communication networks. It will appeal to readers with a mathematical background wishing to understand this important area of application, and to those with an engineering background who want to grasp the underlying mathematical theory. Each chapter ends with exercises and suggestions for further reading.

This definitive textbook provides a solid introduction to discrete and continuous stochastic processes, tackling a complex field in a way that instils a deep understanding of the relevant mathematical principles, and develops an intuitive grasp of the way these principles can be applied to modelling real-world systems. It includes a careful review of elementary probability and detailed coverage of Poisson, Gaussian and Markov processes with richly varied queuing applications. The theory and applications of inference, hypothesis testing, estimation, random walks, large deviations, martingales and investments are developed. Written by one of the world's leading information theorists, evolving over twenty years of graduate classroom teaching and enriched by over 300 exercises, this is an exceptional resource for anyone looking to develop their understanding of stochastic processes.

Provides a modern mathematical approach to the design of communication networks for graduate students, blending control, optimization, and stochastic network theories. A broad range of performance analysis tools are discussed, including important advanced topics that have been made accessible to students for the first time. Taking a top-down approach to network protocol design, the authors begin with the deterministic model and progress to more sophisticated models. Network algorithms and protocols are tied closely to the theory, illustrating the practical engineering applications of each topic. The background behind the mathematical analyses is given before the formal proofs and is supported by worked examples, enabling students to understand the big picture before going into the detailed theory. End-of-chapter problems cover a range of difficulties, with complex problems broken into several parts, and hints to many problems are provided to guide students. Full solutions are available online for instructors.

The field of stochastic processes and Random Matrix Theory (RMT) has been a rapidly evolving subject during the last fifteen years. The continuous development and discovery of new tools, connections and ideas have led to an avalanche of new results. These breakthroughs have been made possible thanks, to a large extent, to the recent development of various new techniques in RMT. Matrix models have been playing an important role in theoretical physics for a long time and they are currently also a very active domain of research in mathematics. An emblematic example of these recent advances concerns the theory of growth phenomena in the Kardar-Parisi-Zhang (KPZ) universality class where the joint efforts of physicists and mathematicians during the last twenty years have unveiled the beautiful connections between this fundamental problem of statistical mechanics and the theory of random matrices, namely the fluctuations of the largest eigenvalue of certain ensembles of random matrices. This text not only covers this topic in detail but also presents more recent developments that have emerged from these discoveries, for instance in the context of low dimensional heat transport (on the physics side) or integrable probability (on the mathematical side).

From classical foundations to advanced modern theory, this self-contained and comprehensive guide to probability weaves together mathematical proofs, historical context and richly detailed illustrative applications. A theorem discovery approach is used throughout, setting each proof within its historical setting and is accompanied by a consistent emphasis on elementary methods of proof. Each topic is presented in a modular framework, combining fundamental concepts with worked examples, problems and digressions which, although mathematically rigorous, require no specialised or advanced mathematical background. Augmenting this core material are over 80 richly embellished practical applications of probability theory, drawn from a broad spectrum of areas both classical and modern, each tailor-made to illustrate the magnificent scope of the formal results. Providing a solid grounding in practical probability, without sacrificing mathematical rigour or historical richness, this insightful book is a fascinating reference and essential resource, for all engineers, computer scientists and mathematicians.

Covering point process theory, random geometric graphs and coverage processes, this rigorous introduction to stochastic geometry will enable you to obtain powerful, general estimates and bounds of wireless network performance and make good design choices for future wireless architectures and protocols that efficiently manage interference effects. Practical engineering applications are integrated with mathematical theory, with an understanding of probability the only prerequisite. At the same time, stochastic geometry is connected to percolation theory and the theory of random geometric graphs and accompanied by a brief introduction to the R statistical computing language. Combining theory and hands-on analytical techniques with practical examples and exercises, this is a comprehensive guide to the spatial stochastic models essential for modelling and analysis of wireless network performance.

This book develops the theory of continuous and discrete stochastic processes within the context of cell biology. In the second edition the material has been significantly expanded, particularly within the context of nonequilibrium and self-organizing systems. Given the amount of additional material, the book has been divided into two volumes, with volume I mainly covering molecular processes and volume II focusing on cellular processes. A wide range of biological topics are covered in the new edition, including stochastic ion channels and excitable systems, molecular motors, stochastic gene networks, genetic switches and oscillators, epigenetics, normal and anomalous diffusion in complex cellular environments, stochastically-gated diffusion, active intracellular transport, signal transduction, cell sensing, bacterial chemotaxis, intracellular pattern formation, cell polarization, cell mechanics, biological polymers and membranes, nuclear structure and dynamics, biological condensates, molecular aggregation and nucleation, cellular length control, cell mitosis, cell motility, cell adhesion, cytoneme-based morphogenesis, bacterial growth, and quorum sensing. The book also provides a pedagogical introduction to the theory of stochastic and nonequilibrium processes - Fokker Planck equations, stochastic differential equations, stochastic calculus, master equations and jump Markov processes, birth-death processes, Poisson processes, first passage time problems, stochastic hybrid systems, queuing and renewal theory, narrow capture and escape, extreme statistics, search processes and stochastic resetting, exclusion processes, WKB methods, large deviation theory, path integrals, martingales and branching processes, numerical methods, linear response theory, phase separation, fluctuation-dissipation theorems, age-structured models, and statistical field theory. This text is primarily aimed at graduate students and researchers working in mathematical biology, statistical and biological physicists, and applied mathematicians interested in stochastic modeling. Applied probabilists should also find it of interest. It provides significant background material in applied mathematics and statistical physics, and introduces concepts in stochastic and nonequilibrium processes via motivating biological applications. The book is highly illustrated and contains a large number of examples and exercises that further develop the models and ideas in the body of the text. It is based on a course that the author has taught at the University of Utah for many years.

This book develops the theory of continuous and discrete stochastic processes within the context of cell biology. In the second edition the material has been significantly expanded, particularly within the context of nonequilibrium and self-organizing systems. Given the amount of additional material, the book has been divided into two volumes, with volume I mainly covering molecular processes and volume II focusing on cellular processes. A wide range of biological topics are covered in the new edition, including stochastic ion channels and excitable systems, molecular motors, stochastic gene networks, genetic switches and oscillators, epigenetics, normal and anomalous diffusion in complex cellular environments, stochastically-gated diffusion, active intracellular transport, signal transduction, cell sensing, bacterial chemotaxis, intracellular pattern formation, cell polarization, cell mechanics, biological polymers and membranes, nuclear structure and dynamics, biological condensates, molecular aggregation and nucleation, cellular length control, cell mitosis, cell motility, cell adhesion, cytoneme-based morphogenesis, bacterial growth, and quorum sensing. The book also provides a pedagogical introduction to the theory of stochastic and nonequilibrium processes - Fokker Planck equations, stochastic differential equations, stochastic calculus, master equations and jump Markov processes, birth-death processes, Poisson processes, first passage time problems, stochastic hybrid systems, queuing and renewal theory, narrow capture and escape, extreme statistics, search processes and stochastic resetting, exclusion processes, WKB methods, large deviation theory, path integrals, martingales and branching processes, numerical methods, linear response theory, phase separation, fluctuation-dissipation theorems, age-structured models, and statistical field theory. This text is primarily aimed at graduate students and researchers working in mathematical biology, statistical and biological physicists, and applied mathematicians interested in stochastic modeling. Applied probabilists should also find it of interest. It provides significant background material in applied mathematics and statistical physics, and introduces concepts in stochastic and nonequilibrium processes via motivating biological applications. The book is highly illustrated and contains a large number of examples and exercises that further develop the models and ideas in the body of the text. It is based on a course that the author has taught at the University of Utah for many years.

Dedicated to one of the most outstanding researchers in the field of statistics, this volume in honor of C.R. Rao, on the occasion of his 100th birthday, provides a bird's-eye view of a broad spectrum of research topics, paralleling C.R. Rao's wide-ranging research interests. The book's contributors comprise a representative sample of the countless number of researchers whose careers have been influenced by C.R. Rao, through his work or his personal aid and advice. As such, written by experts from more than 15 countries, the book's original and review contributions address topics including statistical inference, distribution theory, estimation theory, multivariate analysis, hypothesis testing, statistical modeling, design and sampling, shape and circular analysis, and applications. The book will appeal to statistics researchers, theoretical and applied alike, and PhD students. Happy Birthday, C.R. Rao!

This book provides an accessible overview concerning the stochastic numerical methods inheriting long-time dynamical behaviours of finite and infinite-dimensional stochastic Hamiltonian systems. The long-time dynamical behaviours under study involve symplectic structure, invariants, ergodicity and invariant measure. The emphasis is placed on the systematic construction and the probabilistic superiority of stochastic symplectic methods, which preserve the geometric structure of the stochastic flow of stochastic Hamiltonian systems. The problems considered in this book are related to several fascinating research hotspots: numerical analysis, stochastic analysis, ergodic theory, stochastic ordinary and partial differential equations, and rough path theory. This book will appeal to researchers who are interested in these topics.

This book puts forward a new mathematical theory to study chaotic phenomenon. The uniform theory is established on the basis of two elementary concept of circle and externally tangent square in mathematics. The author studies the uniformity of a finite set of points distributed in space by uniform theory. This book also illustrates that uniform theory performs better than other indices such as entropy and Lyapunov exponent in chaos measurement by numerous examples. This book develops a new mathematical tool for studying chaos so it will be appealing to students and researchers interested in theory of chaos. It also has potential applications in various fields such as Engineering, Forestry and Ecology.

A comprehensive resource that draws a balance between theory and applications of nonlinear time series analysis Nonlinear Time Series Analysis offers an important guide to both parametric and nonparametric methods, nonlinear state-space models, and Bayesian as well as classical approaches to nonlinear time series analysis. The authors--noted experts in the field--explore the advantages and limitations of the nonlinear models and methods and review the improvements upon linear time series models. The need for this book is based on the recent developments in nonlinear time series analysis, statistical learning, dynamic systems and advanced computational methods. Parametric and nonparametric methods and nonlinear and non-Gaussian state space models provide a much wider range of tools for time series analysis. In addition, advances in computing and data collection have made available large data sets and high-frequency data. These new data make it not only feasible, but also necessary to take into consideration the nonlinearity embedded in most real-world time series. This vital guide: - Offers research developed by leading scholars of time series analysis - Presents R commands making it possible to reproduce all the analyses included in the text - Contains real-world examples throughout the book - Recommends exercises to test understanding of material presented - Includes an instructor solutions manual and companion website Written for students, researchers, and practitioners who are interested in exploring nonlinearity in time series, Nonlinear Time Series Analysis offers a comprehensive text that explores the advantages and limitations of the nonlinear models and methods and demonstrates the improvements upon linear time series models.

This is a concise and elementary introduction to stochastic control and mathematical modelling. This book is designed for researchers in stochastic control theory studying its application in mathematical economics and those in economics who are interested in mathematical theory in control. It is also a good guide for graduate students studying applied mathematics, mathematical economics, and non-linear PDE theory. Contents include the basics of analysis and probability, the theory of stochastic differential equations, variational problems, problems in optimal consumption and in optimal stopping, optimal pollution control, and solving the Hamilton-Jacobi-Bellman (HJB) equation with boundary conditions. Major mathematical prerequisites are contained in the preliminary chapters or in the appendix so that readers can proceed without referring to other materials.

This book provides an essential introduction to Stochastic Programming, especially intended for graduate students. The book begins by exploring a linear programming problem with random parameters, representing a decision problem under uncertainty. Several models for this problem are presented, including the main ones used in Stochastic Programming: recourse models and chance constraint models. The book not only discusses the theoretical properties of these models and algorithms for solving them, but also explains the intrinsic differences between the models. In the book's closing section, several case studies are presented, helping students apply the theory covered to practical problems. The book is based on lecture notes developed for an Econometrics and Operations Research course for master students at the University of Groningen, the Netherlands - the longest-standing Stochastic Programming course worldwide.

This is the first book to promote the use of stochastic, or random, processes to understand, model and predict our climate system. One of the most important applications of this technique is in the representation of comprehensive climate models of processes which, although crucial, are too small or fast to be explicitly modelled. The book shows how stochastic methods can lead to improvements in climate simulation and prediction, compared with more conventional bulk-formula parameterization procedures. Beginning with expositions of the relevant mathematical theory, the book moves on to describe numerous practical applications. It covers the complete range of time scales of climate variability, from seasonal to decadal, centennial, and millennial. With contributions from leading experts in climate physics, this book is invaluable to anyone working on climate models, including graduate students and researchers in the atmospheric and oceanic sciences, numerical weather forecasting, climate prediction, climate modelling, and climate change.

Simulation, Sixth Edition continues to introduce aspiring and practicing actuaries, engineers, computer scientists and others to the practical aspects of constructing computerized simulation studies to analyze and interpret real phenomena. Readers will learn to apply the results of these analyses to problems in a wide variety of fields to obtain effective, accurate solutions and make predictions. By explaining how a computer can be used to generate random numbers and how to use these random numbers to generate the behavior of a stochastic model over time, this book presents the statistics needed to analyze simulated data and validate simulation models.

Meyn & Tweedie is back The bible on Markov chains in general state spaces has been brought up to date to reflect developments in the field since 1996 - many of them sparked by publication of the first edition. The pursuit of more efficient simulation algorithms for complex Markovian models, or algorithms for computation of optimal policies for controlled Markov models, has opened new directions for research on Markov chains. As a result, new applications have emerged across a wide range of topics including optimisation, statistics, and economics. New commentary and an epilogue by Sean Meyn summarise recent developments and references have been fully updated. This second edition reflects the same discipline and style that marked out the original and helped it to become a classic: proofs are rigorous and concise, the range of applications is broad and knowledgeable, and key ideas are accessible to practitioners with limited mathematical background.

This textbook, now in its fourth edition, offers a rigorous and self-contained introduction to the theory of continuous-time stochastic processes, stochastic integrals, and stochastic differential equations. Expertly balancing theory and applications, it features concrete examples of modeling real-world problems from biology, medicine, finance, and insurance using stochastic methods. No previous knowledge of stochastic processes is required. Unlike other books on stochastic methods that specialize in a specific field of applications, this volume examines the ways in which similar stochastic methods can be applied across different fields. Beginning with the fundamentals of probability, the authors go on to introduce the theory of stochastic processes, the Ito Integral, and stochastic differential equations. The following chapters then explore stability, stationarity, and ergodicity. The second half of the book is dedicated to applications to a variety of fields, including finance, biology, and medicine. Some highlights of this fourth edition include a more rigorous introduction to Gaussian white noise, additional material on the stability of stochastic semigroups used in models of population dynamics and epidemic systems, and the expansion of methods of analysis of one-dimensional stochastic differential equations. An Introduction to Continuous-Time Stochastic Processes, Fourth Edition is intended for graduate students taking an introductory course on stochastic processes, applied probability, stochastic calculus, mathematical finance, or mathematical biology. Prerequisites include knowledge of calculus and some analysis; exposure to probability would be helpful but not required since the necessary fundamentals of measure and integration are provided. Researchers and practitioners in mathematical finance, biomathematics, biotechnology, and engineering will also find this volume to be of interest, particularly the applications explored in the second half of the book.

This book is aimed at researchers, graduate students and engineers who would like to be initiated to Piecewise Deterministic Markov Processes (PDMPs). A PDMP models a deterministic mechanism modified by jumps that occur at random times. The fields of applications are numerous : insurance and risk, biology, communication networks, dependability, supply management, etc. Indeed, the PDMPs studied so far are in fact deterministic functions of CSMPs (Completed Semi-Markov Processes), i.e. semi-Markov processes completed to become Markov processes. This remark leads to considerably broaden the definition of PDMPs and allows their properties to be deduced from those of CSMPs, which are easier to grasp. Stability is studied within a very general framework. In the other chapters, the results become more accurate as the assumptions become more precise. Generalized Chapman-Kolmogorov equations lead to numerical schemes. The last chapter is an opening on processes for which the deterministic flow of the PDMP is replaced with a Markov process. Marked point processes play a key role throughout this book.

This book presents state-of-the-art solution methods and applications of stochastic optimal control. It is a collection of extended papers discussed at the traditional Liverpool workshop on controlled stochastic processes with participants from both the east and the west. New problems are formulated, and progresses of ongoing research are reported. Topics covered in this book include theoretical results and numerical methods for Markov and semi-Markov decision processes, optimal stopping of Markov processes, stochastic games, problems with partial information, optimal filtering, robust control, Q-learning, and self-organizing algorithms. Real-life case studies and applications, e.g., queueing systems, forest management, control of water resources, marketing science, and healthcare, are presented. Scientific researchers and postgraduate students interested in stochastic optimal control,- as well as practitioners will find this book appealing and a valuable reference.

The book contains two contributions about the work of Emmanuele DiBenedetto and a selection of original papers. The authors are some of the main experts in Harnack's inequalities and nonlinear operators. These papers are part of the contributions presented during the conference to celebrate the 70th birthday of Prof. Emmanuele DiBenedetto, which was held at "Il Palazzone" in Cortona from June 18th to 24th, 2017. The papers are focused on current research topics regarding the qualitative properties of solutions, connections with calculus of variations, Harnack inequality and regularity theory. Some papers are also related to various applications. Many of the authors have shared with Prof. DiBenedetto an intense scientific and personal collaboration, while many others have taken inspiration from and further developed his field of research. The topics of the conference are certainly of great interest for the international mathematical community.

Over the last thirty years there has been extensive use of continuous time econometric methods in macroeconomic modelling. This monograph presents the first continuous time macroeconometric model of the United Kingdom incorporating stochastic trends. Its development represents a major step forward in continuous time macroeconomic modelling. The book describes the new model in detail and, like earlier models, it is designed in such a way as to permit a rigorous mathematical analysis of its steady-state and stability properties, thus providing a valuable check on the capacity of the model to generate plausible long-run behaviour. The model is estimated using newly developed exact Gaussian estimation methods for continuous time econometric models incorporating unobservable stochastic trends. The book also includes discussion of the application of the model to dynamic analysis and forecasting.

This book discusses quantum theory as the theory of random (Brownian) motion of small particles (electrons etc.) under external forces. Implying that the Schroedinger equation is a complex-valued evolution equation and the Schroedinger function is a complex-valued evolution function, important applications are given. Readers will learn about new mathematical methods (theory of stochastic processes) in solving problems of quantum phenomena. Readers will also learn how to handle stochastic processes in analyzing physical phenomena.

This book provides, as simply as possible, sound foundations for an in-depth understanding of reliability engineering with regard to qualitative analysis, modelling, and probabilistic calculations of safety and production systems. Drawing on the authors' extensive experience within the field of reliability engineering, it addresses and discusses a variety of topics, including: * Background and overview of safety and dependability studies; * Explanation and critical analysis of definitions related to core concepts; * Risk identification through qualitative approaches (preliminary hazard analysis, HAZOP, FMECA, etc.); * Modelling of industrial systems through static (fault tree, reliability block diagram), sequential (cause-consequence diagrams, event trees, LOPA, bowtie), and dynamic (Markov graphs, Petri nets) approaches; * Probabilistic calculations through state-of-the-art analytical or Monte Carlo simulation techniques; * Analysis, modelling, and calculations of common cause failure and uncertainties; * Linkages and combinations between the various modelling and calculation approaches; * Reliability data collection and standardization. The book features illustrations, explanations, examples, and exercises to help readers gain a detailed understanding of the topic and implement it into their own work. Further, it analyses the production availability of production systems and the functional safety of safety systems (SIL calculations), showcasing specific applications of the general theory discussed. Given its scope, this book is a valuable resource for engineers, software designers, standard developers, professors, and students.