An introduction to general theories of stochastic processes and modern martingale theory. The volume focuses on consistency, stability and contractivity under geometric invariance in numerical analysis, and discusses problems related to implementation, simulation, variable step size algorithms, and random number generation.

An up-to-date survey of mathematical models of carcinogenesis, providing the most recent findings of cancer biology as evidence of the models, as well as extensive bibliographies of cancer biology and in-depth mathematical analyses for each of the models. May be used as a reference for courses on st

Financial, Macro and Micro Econometrics Using R, Volume 42, provides state-of-the-art information on important topics in econometrics, including multivariate GARCH, stochastic frontiers, fractional responses, specification testing and model selection, exogeneity testing, causal analysis and forecasting, GMM models, asset bubbles and crises, corporate investments, classification, forecasting, nonstandard problems, cointegration, financial market jumps and co-jumps, among other topics.

This book opens a novel dimension in the 50 year history of mathematical theory of "information" since the birth of Shannon theory. First of all, it introduces, in place of the traditional notion of entropy and mutual information, the completely new and highly unconventional approach of "information-spectrum" as a basic but powerful tool for constructing the general theory of information. Reconstructing step-by-step all the essential major topics in information theory from the viewpoint of such an "information-spectrum", this comprehensive work provides an accessible introduction to the new type of mathematical theory of information that focuses mainly on general nonstationary and /or nonergodic sources and channels, in clear contrast with the traditional theories of information. This book is a new non-traditional theoretical reference for communication professionals and statisticians specializing in information theory.

This book covers the history and recent developments of stochastic computing. Stochastic computing (SC) was first introduced in the 1960s for logic circuit design, but its origin can be traced back to von Neumann's work on probabilistic logic. In SC, real numbers are encoded by random binary bit streams, and information is carried on the statistics of the binary streams. SC offers advantages such as hardware simplicity and fault tolerance. Its promise in data processing has been shown in applications including neural computation, decoding of error-correcting codes, image processing, spectral transforms and reliability analysis. There are three main parts to this book. The first part, comprising Chapters 1 and 2, provides a history of the technical developments in stochastic computing and a tutorial overview of the field for both novice and seasoned stochastic computing researchers. In the second part, comprising Chapters 3 to 8, we review both well-established and emerging design approaches for stochastic computing systems, with a focus on accuracy, correlation, sequence generation, and synthesis. The last part, comprising Chapters 9 and 10, provides insights into applications in machine learning and error-control coding.

Thiscollectionofproblemsisplannedasatextbookforuniversitycoursesinthe theoryofstochasticprocessesandrelatedspecialcourses. Theproblemsinthebook haveawidespectrumofthelevelofdif cultyandcanbeusefulforreaderswith variouslevelsofmasteringinthetheoryofstochasticprocesses. Togetherwithte- nicalandillustrativeproblemsintendedforbeginners,thebookcontainsanumber ofproblemsoftheoreticalnaturethatcanbeusefulforstudentsandundergraduate studentsthatpursueadvancedstudiesinthetheoryofstochasticprocessesandits- plications. Amongothers,theimportantaimofthebookistoprovideateachingstaff anef cienttoolforpreparingseminarstudies,tests,andexamsconcerninguniversity coursesinthetheoryofstochasticprocessesandrelatedtopics. Whilecomposingthe book,theauthorshavepartiallyusedthecollectionsofproblemsinprobabilityt- ory[16,65,75,83]. Also,someexercisesandproblemsfromthemonographsand textbooks[4,9,19,22,82]wereused. Atthesametime,alargepartofourproblem bookcontainsoriginalmaterial. Thebookisorganizedasfollows. Theproblemsarecollectedintochapters,each chapterbeingdevotedtoacertaintopic. Atthebeginningofeachchapter,theth- reticalgroundsforthecorrespondingtopicaregivenbrie ytogetherwiththelistof bibliography,whichthereadercanuseinordertostudythistopicinmoredetail. For themostoftheproblems,eitherhintsorcompletesolutions(oranswers)aregiven, andsomeoftheproblemsareprovidedwithbothhintsandsolutions(answers). H- ever,theauthorsdonotrecommendthatareaderusethehintssystematically,because solvingaproblemwithoutassistanceismuchmoreusefulthanusingaready-made idea. Somestatementsthathaveaparticulartheoreticalinterestareformulatedon theoreticalgrounds,andtheirproofsareformulatedasproblemsforthereader. Such problemsaresuppliedwitheithercompletesolutionsordetailedhints. Inordertoworkwiththeproblembookef ciently,areadershouldbeacquainted withprobabilitytheory,calculus,andmeasuretheorywithinthescopeofresp- tiveuniversity courses. Standard notions, suchas random variable, measurability, independence, Lebesgue measure and integral, and so on are used without ad- tionaldiscussion. Allthenewnotionsandstatementsrequiredforsolvingthepr- lemsaregiveneitherontheoreticalgroundsorintheformulationsoftheproblems vii viii Preface straightforwardly. However,sometimesanotionisusedinthetextbeforeitsformal de nition. Forinstance,theWienerandPoissonprocessesareprocesseswithin- pendentincrementsandthusareformallyintroducedinaTheoreticalgroundsfor Chapter5,buttheseprocessesareusedwidelyintheproblemsofChapters2to4. Theauthorsrecommendthatareaderwhocomestoanunknownnotionorobject usetheIndexinorderto ndthecorrespondingformalde nition. Thesamerec- mendationconcernssomestandardabbreviationsandsymbolslistedattheendofthe book. Someproblemsinthebookformcycles:solutionstooneofthemaregrounded onstatementsofothersoronauxiliaryconstructionsdescribedinsomepreceding solutions. Sometimes,onthecontrary,itisproposedtoprovethesamestatement withindifferentproblemsusingessentiallydifferenttechniques. Theauthorsrec- mendareaderpayspeci cattentiontothesefruitfulinternallinksbetweenvarious topicsofthetheoryofstochasticprocesses. Everypartofthebookwascomposedsubstantiallybyoneauthor. Chapters1-6, and16arecomposedbyA. Kulik,Chapters7,12-15,18,and19byYu. Mishura, Chapters 8-10 by A. Pilipenko, Chapter 17 by A. Kukush, and Chapter 20 by D. Gusak. Chapter11waspreparedjointlybyD. GusakandA. Pilipenko. Atthe sametime,everyauthorhasmadeacontributiontootherpartsofthebookbyprop- ingseparateproblemsorcyclesofproblems,improvingpreliminaryversionsoft- oreticalgrounds,andeditingthe naltext. The authors would like to express their deep gratitude to M. Portenko and A. Ivanovfortheircarefulreadingofapreliminaryversionofthebookandva- ablecommentsthatledtosigni cantimprovementofthetext. Theauthorsarealso gratefultoT. Yakovenko,G. Shevchenko,O. Soloveyko, Yu. Kartashov, Yu. K- menko,A. Malenko,andN. Ryabovafortheirassistanceintranslation,preparing lesandpictures,andcomposingthesubjectindexandreferences. Thetheoryofstochasticprocessesisanextendeddiscipline,andtheauthors- derstandthattheproblembookinitscurrentformmaycausecriticalremarksfrom readers,concerningeitherthestructureofthebookorthecontentofseparatech- ters. Whilepublishingtheproblembookinitscurrentform,theauthorsareopenfor remarks,comments,andpropositions,andexpressinadvancetheirgratitudetoall theircorrespondents. Kyiv DmytroGusak December2008 AlexanderKukush AlexeyKulik YuliyaMishura AndreyPilipenko Contents 1 De?nition of stochastic process. Cylinder?-algebra, ?nite-dimensional distributions, the Kolmogorov theorem...1 Theoreticalgrounds ...1 Bibliography...3 Problems...3 Hints...7 AnswersandSolutions...9 2 Characteristics of a stochastic process. Mean and covariance functions. Characteristic functions...11 Theoreticalgrounds ...11 Bibliography...13 Problems...13 Hints...16 AnswersandSolutions...17 3 Trajectories. Modi?cations. Filtrations...21 Theoreticalgrounds ...21 Bibliography...24 Problems...24 Hints...29 AnswersandSolutions...31 4 Continuity. Differentiability. Integrability...33 Theoreticalgrounds ...33 Bibliography...34 Problems...34 Hints...38 AnswersandSolutions...40 ix x Contents 5 Stochastic processes with independent increments. Wiener and Poisson processes. Poisson point measures...

Sojourns and Extremes of Stochastic Processes is a research monograph in the area of probability theory. During the past thirty years Berman has made many contributions to the theory of the extreme values and sojourn times of the sample functions of broad classes of stochastic processes. These processes arise in theoretical and applied models, and are presented here in a unified exposition.

Sequential Stochastic Optimization provides mathematicians and applied researchers with a well-developed framework in which stochastic optimization problems can be formulated and solved. Offering much material that is either new or has never before appeared in book form, it lucidly presents a unified theory of optimal stopping and optimal sequential control of stochastic processes. This book has been carefully organized so that little prior knowledge of the subject is assumed; its only prerequisites are a standard graduate course in probability theory and some familiarity with discrete-parameter martingales.

Major topics covered in Sequential Stochastic Optimization include:

• Fundamental notions, such as essential supremum, stopping points, accessibility, martingales and supermartingales indexed by INd
• Conditions which ensure the integrability of certain suprema of partial sums of arrays of independent random variables
• The general theory of optimal stopping for processes indexed by Ind
• Structural properties of information flows
• Sequential sampling and the theory of optimal sequential control
• Multi-armed bandits, Markov chains and optimal switching between random walks

Drawing on advanced probability theory, Ambit Stochastics is used to model stochastic processes which depend on both time and space. This monograph, the first on the subject, provides a reference for this burgeoning field, complete with the applications that have driven its development. Unique to Ambit Stochastics are ambit sets, which allow the delimitation of space-time to a zone of interest, and ambit fields, which are particularly well-adapted to modelling stochastic volatility or intermittency. These attributes lend themselves notably to applications in the statistical theory of turbulence and financial econometrics. In addition to the theory and applications of Ambit Stochastics, the book also contains new theory on the simulation of ambit fields and a comprehensive stochastic integration theory for Volterra processes in a non-semimartingale context. Written by pioneers in the subject, this book will appeal to researchers and graduate students interested in empirical stochastic modelling.

Complex stochastic systems comprises a vast area of research, from modelling specific applications to model fitting, estimation procedures, and computing issues. The exponential growth in computing power over the last two decades has revolutionized statistical analysis and led to rapid developments and great progress in this emerging field. In Complex Stochastic Systems, leading researchers address various statistical aspects of the field, illustrated by some very concrete applications. A Primer on Markov Chain Monte Carlo by Peter J. Green provides a wide-ranging mixture of the mathematical and statistical ideas, enriched with concrete examples and more than 100 references. Causal Inference from Graphical Models by Steffen L. Lauritzen explores causal concepts in connection with modelling complex stochastic systems, with focus on the effect of interventions in a given system. State Space and Hidden Markov Models by Hans R. Kunschshows the variety of applications of this concept to time series in engineering, biology, finance, and geophysics. Monte Carlo Methods on Genetic Structures by Elizabeth A. Thompson investigates special complex systems and gives a concise introduction to the relevant biological methodology. Renormalization of Interacting Diffusions by Frank den Hollander presents recent results on the large space-time behavior of infinite systems of interacting diffusions. Stein's Method for Epidemic Processes by Gesine Reinert investigates the mean field behavior of a general stochastic epidemic with explicit bounds. Individually, these articles provide authoritative, tutorial-style exposition and recent results from various subjects related to complex stochastic systems. Collectively, they link these separate areas of study to form the first comprehensive overview of this rapidly developing field.

Stochastic differential equations in infinite dimensional spaces are motivated by the theory and analysis of stochastic processes and by applications such as stochastic control, population biology, and turbulence, where the analysis and control of such systems involves investigating their stability. While the theory of such equations is well established, the study of their stability properties has grown rapidly only in the past 20 years, and most results have remained scattered in journals and conference proceedings. This book offers a systematic presentation of the modern theory of the stability of stochastic differential equations in infinite dimensional spaces - particularly Hilbert spaces. The treatment includes a review of basic concepts and investigation of the stability theory of linear and nonlinear stochastic differential equations and stochastic functional differential equations in infinite dimensions. The final chapter explores topics and applications such as stochastic optimal control and feedback stabilization, stochastic reaction-diffusion, Navier-Stokes equations, and stochastic population dynamics. In recent years, this area of study has become the focus of increasing attention, and the relevant literature has expanded greatly. Stability of Infinite Dimensional Stochastic Differential Equations with Applications makes up-to-date material in this important field accessible even to newcomers and lays the foundation for future advances.

In this monograph the narrow topology on random probability measures on Polish spaces is investigated in a thorough and comprehensive way. As a special feature, no additional assumptions on the probability space in the background, such as completeness or a countable generated algebra, are made. One of the main results is a direct proof of the random analog of the Prohorov theorem, which is obtained without invoking an embedding of the Polish space into a compact space. Further, the narrow topology is examined and other natural topologies on random measures are compared. In addition, it is shown that the topology of convergence in law-which relates to the "statistical equilibrium"-and the narrow topology are incompatible. A brief section on random sets on Polish spaces provides the fundamentals of this theory. In a final section, the results are applied to random dynamical systems to obtain existence results for invariant measures on compact random sets, as well as uniformity results in the individual ergodic theorem. This clear and incisive volume is useful for graduate students and researchers in mathematical analysis and its applications.

Collecting information previously scattered throughout the vast literature, including the author's own research, Stochastic Relations: Foundations for Markov Transition Systems develops the theory of stochastic relations as a basis for Markov transition systems. After an introduction to the basic mathematical tools from topology, measure theory, and categories, the book examines the central topics of congruences and morphisms, applies these to the monoidal structure, and defines bisimilarity and behavioral equivalence within this framework. The author views developments from the general theory of coalgebras in the context of the subprobability functor. These tools show that bisimilarity and behavioral and logical equivalence are the same for general modal logics and for continuous time stochastic logic with and without a fixed point operator. With numerous problems and several case studies, this book is an invaluable study of an important aspect of computer science theory.

This volume comprises selected papers presented at the 12th Winter School on Stochastic Processes and their Applications, which was held in Siegmundsburg, Germany, in March 2000. The contents include Backward Stochastic Differential Equations; Semilinear PDE and SPDE; Arbitrage Theory; Credit Derivatives and Models for Correlated Defaults; Three Intertwined Brownian Topics: Exponential Functionals, Winding Numbers and Local Times. A unique opportunity to read ideas from all the top experts on the subject, Stochastic Processes and Related Topics is intended for postgraduates and researchers working in this area of mathematics and provides a useful source of reference.

This book is about discrete-time, time-homogeneous, Markov chains (Mes) and their ergodic behavior. To this end, most of the material is in fact about stable Mes, by which we mean Mes that admit an invariant probability measure. To state this more precisely and give an overview of the questions we shall be dealing with, we will first introduce some notation and terminology. Let (X,B) be a measurable space, and consider a X-valued Markov chain ~. = {~k' k = 0, 1, ... } with transition probability function (t.pJ.) P(x, B), i.e., P(x, B) := Prob (~k+1 E B I ~k = x) for each x E X, B E B, and k = 0,1, .... The Me ~. is said to be stable if there exists a probability measure (p.m.) /.l on B such that (*) VB EB. /.l(B) = Ix /.l(dx) P(x, B) If (*) holds then /.l is called an invariant p.m. for the Me ~. (or the t.p.f. P).

We present an improved and enlarged version of our book Nonlinear - namics of Chaotic and Stochastic Systems published by Springer in 2002. Basically, the new edition of the book corresponds to its ?rst version. While preparingthiseditionwemadesomeclari?cationsinseveralsectionsandalso corrected the misprints noticed in some formulas. Besides, three new sections have been added to Chapter 2. They are "Statistical Properties of Dynamical Chaos," "E?ects of Synchronization in Extended Self-Sustained Oscillatory Systems," and "Synchronization in Living Systems." The sections indicated re?ect the most interesting results obtained by the authors after publication of the ?rst edition. We hope that the new edition of the book will be of great interest for a widesectionofreaderswhoarealreadyspecialistsorthosewhoarebeginning research in the ?elds of nonlinear oscillation and wave theory, dynamical chaos, synchronization, and stochastic process theory. Saratov, Berlin, and St. Louis V.S. Anishchenko November 2006 A.B. Neiman T.E. Vadiavasova V.V. Astakhov L. Schimansky-Geier Preface to the First Edition Thisbookisdevotedtotheclassicalbackgroundandtocontemporaryresults on nonlinear dynamics of deterministic and stochastic systems. Considerable attentionisgiventothee?ectsofnoiseonvariousregimesofdynamicsystems with noise-induced order. On the one hand, there exists a rich literature of excellent books on n- linear dynamics and chaos; on the other hand, there are many marvelous monographs and textbooks on the statistical physics of far-from-equilibrium andstochasticprocesses.Thisbookisanattempttocombinetheapproachof nonlinear dynamics based on the deterministic evolution equations with the approach of statistical physics based on stochastic or kinetic equations. One of our main aims is to show the important role of noise in the organization and properties of dynamic regimes of nonlinear dissipative systems.

This work considers Kronecker-based models with finite as well as countably infinite state spaces for multidimensional Markovian systems by paying particular attention to those whose reachable state spaces are smaller than their product state spaces. Numerical methods for steady-state and transient analysis of Kronecker-based multidimensional Markovian models are discussed in detail together with implementation issues. Case studies are provided to explain concepts and motivate use of methods. Having grown out of research from the past twenty years, this book expands upon the author's previously published book Analyzing Markov Chains using Kronecker Products (Springer, 2012). The subject matter is interdisciplinary and at the intersection of applied mathematics and computer science. The book will be of use to researchers and graduate students with an understanding of basic linear algebra, probability, and discrete mathematics.

This monograph focuses on those stochastic quickest detection tasks in disorder problems that arise in the dynamical analysis of statistical data. These include quickest detection of randomly appearing targets, of spontaneously arising effects, and of arbitrage (in financial mathematics). There is also currently great interest in quickest detection methods for randomly occurring intrusions in information systems and in the design of defense methods against cyber-attacks. The author shows that the majority of quickest detection problems can be reformulated as optimal stopping problems where the stopping time is the moment the occurrence of disorder is signaled. Thus, considerable attention is devoted to the general theory of optimal stopping rules, and to its concrete problem-solving methods. The exposition covers both the discrete time case, which is in principle relatively simple and allows step-by-step considerations, and the continuous-time case, which often requires more technical machinery such as martingales, supermartingales, and stochastic integrals. There is a focus on the well-developed apparatus of Brownian motion, which enables the exact solution of many problems. The last chapter presents applications to financial markets. Researchers and graduate students interested in probability, decision theory and statistical sequential analysis will find this book useful.

Technical analysis points out that the best source of information to beat the market is the price itself. Introducing readers to technical analysis in a more succinct and practical way, Ramlall focuses on the key aspects, benefits, drawbacks, and the main tools of technical analysis. Chart Patterns, Point & Figure, Stochastics, Sentiment indicators, Elliot Wave Theory, RSI, R, Candlesticks and more are covered, including both the concepts and the practical applications. Also including programming technical analysis tools, this book is a valuable tool for both researchers and practitioners.

Most of the natural and biological phenomena such as solute transport in porous media exhibit variability which can not be modeled by using deterministic approaches. There is evidence in natural phenomena to suggest that some of the observations can not be explained by using the models which give deterministic solutions. Stochastic processes have a rich repository of objects which can be used to express the randomness inherent in the system and the evolution of the system over time. The attractiveness of the stochastic differential equations (SDE) and stochastic partial differential equations (SPDE) come from the fact that we can integrate the variability of the system along with the scientific knowledge pertaining to the system. One of the aims of this book is to explaim some useufl concepts in stochastic dynamics so that the scientists and engineers with a background in undergraduate differential calculus could appreciate the applicability and appropriateness of these developments in mathematics. The ideas are explained in an intuitive manner wherever possible with out compromising rigor.
The solute transport problem in porous media saturated with water had been used as a natural setting to discuss the approaches based on stochastic dynamics. The work is also motivated by the need to have more sophisticated mathematical and computational frameworks to model the variability one encounters in natural and industrial systems. This book presents the ideas, models and computational solutions pertaining to a single problem: stochastic flow of contaminant transport in the saturated porous media such as that we find in underground aquifers. In attempting to solve this problem using stochastic concepts, different ideas and new concepts have been explored, and mathematical and computational frameworks have been developed in the process. Some of these concepts, arguments and mathematical and computational constructs are discussed in an intuititve manner in this book.

This textbook explores probability and stochastic processes at a level that does not require any prior knowledge except basic calculus. It presents the fundamental concepts in a step-by-step manner, and offers remarks and warnings for deeper insights. The chapters include basic examples, which are revisited as the new concepts are introduced. To aid learning, figures and diagrams are used to help readers grasp the concepts, and the solutions to the exercises and problems. Further, a table format is also used where relevant for better comparison of the ideas and formulae. The first part of the book introduces readers to the essentials of probability, including combinatorial analysis, conditional probability, and discrete and continuous random variable. The second part then covers fundamental stochastic processes, including point, counting, renewal and regenerative processes, the Poisson process, Markov chains, queuing models and reliability theory. Primarily intended for undergraduate engineering students, it is also useful for graduate-level students wanting to refresh their knowledge of the basics of probability and stochastic processes.

Fractional Brownian Motion (FBM) is a very classical continuous self-similar Gaussian field with stationary increments. In 1940, some works of Kolmogorov on turbulence led him to introduce this quite natural extension of Brownian Motion, which, in contrast with the latter, has correlated increments. However, the denomination FBM is due to a very famous article by Mandelbrot and Van Ness, published in 1968. Not only in it, but also in several of his following works, Mandelbrot emphasized the importance of FBM as a model in several applied areas, and thus he made it to be known by a wide community. Therefore, FBM has been studied by many authors, and used in a lot of applications.In spite of the fact that FBM is a very useful model, it does not always fit to real data. This is the reason why, for at least two decades, there has been an increasing interest in the construction of new classes of random models extending it, which offer more flexibility. A paradigmatic example of them is the class of Multifractional Fields. Multifractional means that fractal properties of models, typically, roughness of paths and self-similarity of probability distributions, are locally allowed to change from place to place.In order to sharply determine path behavior of Multifractional Fields, a wavelet strategy, which can be considered to be new in the probabilistic framework, has been developed since the end of the 90's. It is somehow inspired by some rather non-standard methods, related to the fine study of Brownian Motion roughness, through its representation in the Faber-Schauder system. The main goal of the book is to present the motivations behind this wavelet strategy, and to explain how it can be applied to some classical examples of Multifractional Fields. The book also discusses some topics concerning them which are not directly related to the wavelet strategy.

Since the pioneering work of Black, Scholes, and Merton in the field of financial mathematics, research has led to the rapid development of a substantial body of knowledge, with plenty of applications to the common functioning of the world 's financial institutions.

Mathematics, as the language of science, has always played a role in the development of knowledge and technology. Presently, the high-tech character of modern business has increased the need for advanced methods, which rely to a large extent on mathematical techniques. It has become essential for the financial analyst to possess a high degree of proficiency in these mathematical techniques.

Praise for THE SECOND EDITION

"A valuable contribution . . . rigorous and carefully thought out."
–Zeitschrift fur Operations Research

A state-of-the-art text on stochastic models and their applications

Much has changed in the field of stochastic modeling since the highly successful Second Edition of this popular text. In response, the authors have significantly revised their book to deliver a thoroughly up-to-date overview of the field.

This Third Edition of Elements of Applied Stochastic Processes provides a basic understanding of the fundamental theory of stochastic processes. Topics include Markov chains, and Markov, branching, renewal, and stationary processes, all of which are illustrated with the rich diversity of actual applications. Restructured to enhance the book’s usefulness for practicing professionals, students, and instructors, this edition features two chapters dedicated entirely to applications from journal articles and new material on statistical inference for stochastic processes, with inference on queues as an area of application. Also new is a chapter on simulation and Markov Chain Monte Carlo.

This updated new edition:

• Retains the bridge between theory and application while improving teachability
• Integrates a broad set of applications into the text
• Provides expanded coverage on statistical inference for stochastic processes
• Utilizes a wealth of examples from research papers and monographs
• Offers a comprehensive introduction to stationary processes and time series analysis

There has been extensive research in the past twenty years devoted to a better understanding of the stable and other closely related infinitely divisible models. The late Professor Stamatis Cambanis, a distinguished educator and researcher, played a special leadership role in the development of these fields from the early seventies until his untimely death in April 1995. This commemorative volume honoring Stamatis Cambanis consists of a collection of research articles devoted to review the state of the art in rapidly developing research areas in Stochastic Processes and to explore new directions of research. The volume is a tribute to the life and work of Stamatis by his students, friends, and colleagues whose personal and professional lives he deeply touched through his generous insights and dedication to his profession.