The theory of stochastic integration, also called the Ito calculus, has a large spectrum of applications in virtually every scientific area involving random functions, but it can be a very difficult subject for people without much mathematical background. The Ito calculus was originally motivated by the construction of Markov diffusion processes from infinitesimal generators. Previously, the construction of such processes required several steps, whereas Ito constructed these diffusion processes directly in a single step as the solutions of stochastic integral equations associated with the infinitesimal generators. Moreover, the properties of these diffusion processes can be derived from the stochastic integral equations and the Ito formula. This introductory textbook on stochastic integration provides a concise introduction to the Ito calculus, and covers the following topics:

* Constructions of Brownian motion;

* Stochastic integrals for Brownian motion and martingales;

* The Ito formula;

* Multiple Wiener-Ito integrals;

* Stochastic differential equations;

* Applications to finance, filtering theory, and electric circuits.

The reader should have a background in advanced calculus and elementary probability theory, as well as a basic knowledge of measure theory and Hilbert spaces. Each chapter ends with a variety of exercises designed to help the reader further understand the material.

Hui-Hsiung Kuo is the Nicholson Professor of Mathematics at Louisiana State University. He has delivered lectures on stochastic integration at Louisiana State University, Cheng Kung University, Meijo University, and University of Rome "Tor Vergata," among others. He is also theauthor of Gaussian Measures in Banach Spaces (Springer 1975), and White Noise Distribution Theory (CRC Press 1996), and a memoir of his childhood growing up in Taiwan, An Arrow Shot into the Sun (Abridge Books 2004).

In his seminal 1982 paper, Robert F. Engle described a time series model with a time-varying volatility. Engle showed that this model, which he called ARCH (autoregressive conditionally heteroscedastic), is well-suited for the description of economic and financial price. Nowadays ARCH has been replaced by more general and more sophisticated models, such as GARCH (generalized autoregressive heteroscedastic).

This monograph concentrates on mathematical statistical problems associated with fitting conditionally heteroscedastic time series models to data. This includes the classical statistical issues of consistency and limiting distribution of estimators. Particular attention is addressed to (quasi) maximum likelihood estimation and misspecified models, along to phenomena due to heavy-tailed innovations. The used methods are based on techniques applied to the analysis of stochastic recurrence equations. Proofs and arguments are given wherever possible in full mathematical rigour. Moreover, the theory is illustrated by examples and simulation studies.

Stochastic approximation is a relatively new technique for studying the properties of an experimental situation; it has important applications in fields such as medicine and engineering. The subject can be treated either largely as a branch of pure mathematics, or else from an empirical and practical angle. In this book, Dr Wasan gives a rigorous mathematical treatment of the subject, drawing together the scattered results of a number of authors. He discusses the conditions under which the method gives a valid approximation to the required solution; methods for optimal choice of parameters to hasten convergence; the comparison of the method with other techniques. The discussion and proofs of theorems are given in enough detail to make them easy to follow, while a number of interesting examples show how the techniques may be applied in many fields.

The purpose of this book is to present the theory of general irreducible Markov chains and to point out the connection between this and the Perron-Frobenius theory of nonnegative operators. The author begins by providing some basic material designed to make the book self-contained, yet his principal aim throughout is to emphasize recent developments. The technique of embedded renewal processes, common in the study of discrete Markov chains, plays a particularly important role. The examples discussed indicate applications to such topics as queueing theory, storage theory, autoregressive processes and renewal theory. The book will therefore be useful to researchers in the theory and applications of Markov chains. It could also be used as a graduate-level textbook for courses on Markov chains or aspects of operator theory.

The main focus of this book is on the development of the theory of Graph Directed Markov Systems. This far-reaching generalization of the theory of conformal iterated systems can be applied in many situations, including the theory of dynamical systems. Dan Mauldin and Mariusz Urbanski include much of the necessary background material to increase the appeal of this book to graduate students as well as researchers. They also include an extensive list of references for further reading.

This book is dedicated to the systematization and development of models, methods, and algorithms for queuing systems with correlated arrivals. After first setting up the basic tools needed for the study of queuing theory, the authors concentrate on complicated systems: multi-server systems with phase type distribution of service time or single-server queues with arbitrary distribution of service time or semi-Markovian service. They pay special attention to practically important retrial queues, tandem queues, and queues with unreliable servers. Mathematical models of networks and queuing systems are widely used for the study and optimization of various technical, physical, economic, industrial, and administrative systems, and this book will be valuable for researchers, graduate students, and practitioners in these domains.

All populations fluctuate stochastically, creating a risk of extinction that does not exist in deterministic models, with fundamental consequences for both pure and applied ecology. This book provides the most comprehensive introduction to stochastic population dynamics, combining classical background material with a variety of modern approaches, including new and previously unpublished results by the authors, illustrated with examples from bird and mammal populations, and insect communities.

This text is ideal for advanced undergraduate or beginning graduate students. The author first develops the necessary background in probability theory and Markov chains before using it to study a range of randomized algorithms with important applications in optimization and other problems in computing. The book will appeal not only to mathematicians, but to students of computer science who will discover much useful material. This clear and concise introduction to the subject has numerous exercises that will help students to deepen their understanding.

First-passage properties underlie a wide range of stochastic processes, such as diffusion-limited growth, neuron firing, and the triggering of stock options. This book provides a unified presentation of first-passage processes, which highlights its interrelations with electrostatics and the resulting powerful consequences. The author begins with a modern presentation of fundamental theory including the connection between the occupation and first-passage probabilities of a random walk, and the connection to electrostatics and current flows in resistor networks. The consequences of this theory are then developed for simple, illustrative geometries including the finite and semi-infinite intervals, fractal networks, spherical geometries and the wedge. Various applications are presented including neuron dynamics, self-organized criticality, diffusion-limited aggregation, the dynamics of spin systems, and the kinetics of diffusion-controlled reactions. Examples discussed include neuron dynamics, self-organized criticality, kinetics of spin systems, and stochastic resonance.

The principles of symmetry and self-similarity structure nature's most beautiful creations. For example, they are expressed in fractals, famous for their beautiful but complicated geometric structure, which is the subject of study in dimension theory. And in dynamics the presence of invariant fractals often results in unstable "turbulent-like" motions and is associated with "chaotic" behavior.
In this book, Yakov Pesin introduces a new area of research that has recently appeared in the interface between dimension theory and the theory of dynamical systems. Focusing on invariant fractals and their influence on stochastic properties of systems, Pesin provides a comprehensive and systematic treatment of modern dimension theory in dynamical systems, summarizes the current state of research, and describes the most important accomplishments of this field.
Pesin's synthesis of these subjects of broad current research interest will be appreciated both by advanced mathematicians and by a wide range of scientists who depend upon mathematical modeling of dynamical processes.

This unique book combines lucid and engaging exposition, graphic and poignantly applied examples, and realistic exercises to take readers beyond the mechanics of statistical techniques. The result is a journey into the realm of practical data analysis and inference-based problem solving.

The modeling of stochastic dependence is fundamental for understanding random systems evolving in time. When measured through linear correlation, many of these systems exhibit a slow correlation decay--a phenomenon often referred to as long-memory or long-range dependence. An example of this is the absolute returns of equity data in finance. Selfsimilar stochastic processes (particularly fractional Brownian motion) have long been postulated as a means to model this behavior, and the concept of selfsimilarity for a stochastic process is now proving to be extraordinarily useful. Selfsimilarity translates into the equality in distribution between the process under a linear time change and the same process properly scaled in space, a simple scaling property that yields a remarkably rich theory with far-flung applications.

After a short historical overview, this book describes the current state of knowledge about selfsimilar processes and their applications. Concepts, definitions and basic properties are emphasized, giving the reader a road map of the realm of selfsimilarity that allows for further exploration. Such topics as noncentral limit theory, long-range dependence, and operator selfsimilarity are covered alongside statistical estimation, simulation, sample path properties, and stochastic differential equations driven by selfsimilar processes. Numerous references point the reader to current applications.

Though the text uses the mathematical language of the theory of stochastic processes, researchers and end-users from such diverse fields as mathematics, physics, biology, telecommunications, finance, econometrics, and environmental science will find it an ideal entry point for studying the already extensive theory and applications of selfsimilarity.

In this book, Professor Pinsky gives a self-contained account of the theory of positive harmonic functions for second order elliptic operators, using an integrated probabilistic and analytic approach. The book begins with a treatment of the construction and basic properties of diffusion processes. This theory then serves as a vehicle for studying positive harmonic funtions. Starting with a rigorous treatment of the spectral theory of elliptic operators with nice coefficients on smooth, bounded domains, the author then develops the theory of the generalized principal eigenvalue, and the related criticality theory for elliptic operators on arbitrary domains. Martin boundary theory is considered, and the Martin boundary is explicitly calculated for several classes of operators. The book provides an array of criteria for determining whether a diffusion process is transient or recurrent. Also introduced are the theory of bounded harmonic functions, and Brownian motion on manifolds of negative curvature. Many results that form the folklore of the subject are here given a rigorous exposition, making this book a useful reference for the specialist, and an excellent guide for the graduate student.

In this rigorous account the author studies both discrete-time and continuous-time chains. A distinguishing feature is an introduction to more advanced topics such as martingales and potentials, in the established context of Markov chains. There are applications to simulation, economics, optimal control, genetics, queues and many other topics, and a careful selection of exercises and examples drawn both from theory and practice. This is an ideal text for seminars on random processes or for those that are more oriented towards applications, for advanced undergraduates or graduate students with some background in basic probability theory.

This collection of papers gives a representative cross-selectional view of recent developments in the field. After a survey paper by C. Lefevre, 17 other research papers look at stochastic modeling of epidemics, both from a theoretical and a statistical point of view. Some look more specifically at a particular disease such as AIDS, malaria, schistosomiasis and diabetes."

Stochastic differential equations are differential equations whose solutions are stochastic processes. They exhibit appealing mathematical properties that are useful in modeling uncertainties and noisy phenomena in many disciplines. This book is motivated by applications of stochastic differential equations in target tracking and medical technology and, in particular, their use in methodologies such as filtering, smoothing, parameter estimation, and machine learning. It builds an intuitive hands-on understanding of what stochastic differential equations are all about, but also covers the essentials of Ito calculus, the central theorems in the field, and such approximation schemes as stochastic Runge-Kutta. Greater emphasis is given to solution methods than to analysis of theoretical properties of the equations. The book's practical approach assumes only prior understanding of ordinary differential equations. The numerous worked examples and end-of-chapter exercises include application-driven derivations and computational assignments. MATLAB/Octave source code is available for download, promoting hands-on work with the methods.

Through examples of large complex graphs in realistic networks, research in graph theory has been forging ahead into exciting new directions. Graph theory has emerged as a primary tool for detecting numerous hidden structures in various information networks, including Internet graphs, social networks, biological networks, or, more generally, any graph representing relations in massive data sets. How will we explain from first principles the universal and ubiquitous coherence in the structure of these realistic but complex networks? In order to analyze these large sparse graphs, we use combinatorial, probabilistic, and spectral methods, as well as new and improved tools to analyze these networks. The examples of these networks have led us to focus on new, general, and powerful ways to look at graph theory.The book, based on lectures given at the CBMS Workshop on the Combinatorics of Large Sparse Graphs, presents new perspectives in graph theory and helps to contribute to a sound scientific foundation for our understanding of discrete networks that permeate this information age.

Computational neuroscience is the theoretical study of the brain to uncover the principles and mechanisms that guide the development, organization, information processing, and mental functions of the nervous system. Although not a new area, it is only recently that enough knowledge has been gathered to establish computational neuroscience as a scientific discipline in its own right. Given the complexity of the field, and its increasing importance in progressing our understanding of how the brain works, there has long been a need for an introductory text on what is often assumed to be an impenetrable topic. The new edition of Fundamentals of Computational Neuroscience build on the success and strengths of the previous editions. It introduces the theoretical foundations of neuroscience with a focus on the nature of information processing in the brain. The book covers the introduction and motivation of simplified models of neurons that are suitable for exploring information processing in large brain-like networks. Additionally, it introduces several fundamental network architectures and discusses their relevance for information processing in the brain, giving some examples of models of higher-order cognitive functions to demonstrate the advanced insight that can be gained with such studies. Each chapter starts by introducing its topic with experimental facts and conceptual questions related to the study of brain function. An additional feature is the inclusion of simple Matlab programs that can be used to explore many of the mechanisms explained in the book. An accompanying webpage includes programs for download. The book will be the essential text for anyone in the brain sciences who wants to get to grips with this topic.

This text introduces engineering students to probability theory and stochastic processes. Along with thorough mathematical development of the subject, the book presents intuitive explanations of key points in order to give students the insights they need to apply math to practical engineering problems. The first seven chapters contain the core material that is essential to any introductory course. In one-semester undergraduate courses, instructors can select material from the remaining chapters to meet their individual goals. Graduate courses can cover all chapters in one semester.

An interdisciplinary approach to understanding queueing and graphical networks

In today's era of interdisciplinary studies and research activities, network models are becoming increasingly important in various areas where they have not regularly been used. Combining techniques from stochastic processes and graph theory to analyze the behavior of networks, "Fundamentals of Stochastic Networks" provides an interdisciplinary approach by including practical applications of these stochastic networks in various fields of study, from engineering and operations management to communications and the physical sciences.

The author uniquely unites different types of stochastic, queueing, and graphical networks that are typically studied independently of each other. With balanced coverage, the book is organized into three succinct parts:

Part I introduces basic concepts in probability and stochastic processes, with coverage on counting, Poisson, renewal, and Markov processes

Part II addresses basic queueing theory, with a focus on Markovian queueing systems and also explores advanced queueing theory, queueing networks, and approximations of queueing networks

Part III focuses on graphical models, presenting an introduction to graph theory along with Bayesian, Boolean, and random networks

The author presents the material in a self-contained style that helps readers apply the presented methods and techniques to science and engineering applications. Numerous practical examples are also provided throughout, including all related mathematical details.

Featuring basic results without heavy emphasis on proving theorems, "Fundamentals of Stochastic Networks" is a suitable book for courses on probability and stochastic networks, stochastic network calculus, and stochastic network optimization at the upper-undergraduate and graduate levels. The book also serves as a reference for researchers and network professionals who would like to learn more about the general principles of stochastic networks.

The book provides a sound mathematical base for life insurance mathematics and applies the underlying concepts to concrete examples. Moreover the models presented make it possible to model life insurance policies by means of Markov chains. Two chapters covering ALM and abstract valuation concepts on the background of Solvency II complete this volume. Numerous examples and a parallel treatment of discrete and continuous approaches help the reader to implement the theory directly in practice.

The Routledge Companion to Intelligence Studies provides a broad overview of the growing field of intelligence studies. The recent growth of interest in intelligence and security studies has led to an increased demand for popular depictions of intelligence and reference works to explain the architecture and underpinnings of intelligence activity. Divided into five comprehensive sections, this Companion provides a strong survey of the cutting-edge research in the field of intelligence studies: Part I: The evolution of intelligence studies; Part II: Abstract approaches to intelligence; Part III: Historical approaches to intelligence; Part IV: Systems of intelligence; Part V: Contemporary challenges. With a broad focus on the origins, practices and nature of intelligence, the book not only addresses classical issues, but also examines topics of recent interest in security studies. The overarching aim is to reveal the rich tapestry of intelligence studies in both a sophisticated and accessible way. This Companion will be essential reading for students of intelligence studies and strategic studies, and highly recommended for students of defence studies, foreign policy, Cold War studies, diplomacy and international relations in general.

This volume in the Mastering Mathematical Finance series strikes just the right balance between mathematical rigour and practical application. Existing books on the challenging subject of stochastic interest rate models are often too advanced for Master's students or fail to include practical examples. Stochastic Interest Rates covers practical topics such as calibration, numerical implementation and model limitations in detail. The authors provide numerous exercises and carefully chosen examples to help students acquire the necessary skills to deal with interest rate modelling in a real-world setting. In addition, the book's webpage at www.cambridge.org/9781107002579 provides solutions to all of the exercises as well as the computer code (and associated spreadsheets) for all numerical work, which allows students to verify the results.

This book explains the notion of Brakke's mean curvature flow and its existence and regularity theories without assuming familiarity with geometric measure theory. The focus of study is a time-parameterized family of k-dimensional surfaces in the n-dimensional Euclidean space (1 k < n). The family is the mean curvature flow if the velocity of motion of surfaces is given by the mean curvature at each point and time. It is one of the simplest and most important geometric evolution problems with a strong connection to minimal surface theory. In fact, equilibrium of mean curvature flow corresponds precisely to minimal surface. Brakke's mean curvature flow was first introduced in 1978 as a mathematical model describing the motion of grain boundaries in an annealing pure metal. The grain boundaries move by the mean curvature flow while retaining singularities such as triple junction points. By using a notion of generalized surface called a varifold from geometric measure theory which allows the presence of singularities, Brakke successfully gave it a definition and presented its existence and regularity theories. Recently, the author provided a complete proof of Brakke's existence and regularity theorems, which form the content of the latter half of the book. The regularity theorem is also a natural generalization of Allard's regularity theorem, which is a fundamental regularity result for minimal surfaces and for surfaces with bounded mean curvature. By carefully presenting a minimal amount of mathematical tools, often only with intuitive explanation, this book serves as a good starting point for the study of this fascinating object as well as a comprehensive introduction to other important notions from geometric measure theory.

Stochastic differential equations are differential equations whose solutions are stochastic processes. They exhibit appealing mathematical properties that are useful in modeling uncertainties and noisy phenomena in many disciplines. This book is motivated by applications of stochastic differential equations in target tracking and medical technology and, in particular, their use in methodologies such as filtering, smoothing, parameter estimation, and machine learning. It builds an intuitive hands-on understanding of what stochastic differential equations are all about, but also covers the essentials of Ito calculus, the central theorems in the field, and such approximation schemes as stochastic Runge-Kutta. Greater emphasis is given to solution methods than to analysis of theoretical properties of the equations. The book's practical approach assumes only prior understanding of ordinary differential equations. The numerous worked examples and end-of-chapter exercises include application-driven derivations and computational assignments. MATLAB/Octave source code is available for download, promoting hands-on work with the methods.