This graduate-level text covers modeling, programming and analysis of simulation experiments and provides a rigorous treatment of the foundations of simulation and why it works. It introduces object-oriented programming for simulation, covers both the probabilistic and statistical basis for simulation in a rigorous but accessible manner (providing all necessary background material); and provides a modern treatment of experiment design and analysis that goes beyond classical statistics. The book emphasizes essential foundations throughout, rather than providing a compendium of algorithms and theorems and prepares the reader to use simulation in research as well as practice.

The book is a rigorous, but concise treatment, emphasizing lasting principles but also providing specific training in modeling, programming and analysis. In addition to teaching readers how to do simulation, it also prepares them to use simulation in their research; no other book does this. An online solutions manual for end of chapter exercises is also be provided. "

Sampling-based computational methods have become a fundamental part of the numerical toolset of practitioners and researchers across an enormous number of different applied domains and academic disciplines. This book provides a broad treatment of such sampling-based methods, as well as accompanying mathematical analysis of the convergence properties of the methods discussed. The reach of the ideas is illustrated by discussing a wide range of applications and the models that have found wide usage. The first half of the book focuses on general methods; the second half discusses model-specific algorithms. Exercises and illustrations are included.

This volume presents a collection of papers covering applications from a wide range of systems with infinitely many degrees of freedom studied using techniques from stochastic and infinite dimensional analysis, e.g. Feynman path integrals, the statistical mechanics of polymer chains, complex networks, and quantum field theory. Systems of infinitely many degrees of freedom create their particular mathematical challenges which have been addressed by different mathematical theories, namely in the theories of stochastic processes, Malliavin calculus, and especially white noise analysis. These proceedings are inspired by a conference held on the occasion of Prof. Ludwig Streit's 75th birthday and celebrate his pioneering and ongoing work in these fields.

This book presents a treatise on the theory and modeling of second-order stationary processes, including an exposition on selected application areas that are important in the engineering and applied sciences. The foundational issues regarding stationary processes dealt with in the beginning of the book have a long history, starting in the 1940s with the work of Kolmogorov, Wiener, Cramer and his students, in particular Wold, and have since been refined and complemented by many others. Problems concerning the filtering and modeling of stationary random signals and systems have also been addressed and studied, fostered by the advent of modern digital computers, since the fundamental work of R.E. Kalman in the early 1960s. The book offers a unified and logically consistent view of the subject based on simple ideas from Hilbert space geometry and coordinate-free thinking. In this framework, the concepts of stochastic state space and state space modeling, based on the notion of the conditional independence of past and future flows of the relevant signals, are revealed to be fundamentally unifying ideas. The book, based on over 30 years of original research, represents a valuable contribution that will inform the fields of stochastic modeling, estimation, system identification, and time series analysis for decades to come. It also provides the mathematical tools needed to grasp and analyze the structures of algorithms in stochastic systems theory.

Networks of Learning Automata: Techniques for Online Stochastic Optimization is a comprehensive account of learning automata models with emphasis on multiautomata systems. It considers synthesis of complex learning structures from simple building blocks and uses stochastic algorithms for refining probabilities of selecting actions. Mathematical analysis of the behavior of games and feedforward networks is provided. Algorithms considered here can be used for online optimization of systems based on noisy measurements of performance index. Also, algorithms that assure convergence to the global optimum are presented. Parallel operation of automata systems for improving speed of convergence is described. The authors also include extensive discussion of how learning automata solutions can be constructed in a variety of applications.

Dedicated to the Russian mathematician Albert Shiryaev on his 70th birthday, this is a collection of papers written by his former students, co-authors and colleagues. The book represents the modern state of art of a quickly maturing theory and will be an essential source and reading for researchers in this area. Diversity of topics and comprehensive style of the papers make the book attractive for PhD students and young researchers.

This book adresses the needs of both researchers and practitioners. It combines a rigorous overview of the mathematics of financial markets with an insight into the practical application of these models to the risk and portfolio management of interest-rate derivatives. It can also serve as a valuable textbook for graduate and PhD students in mathematics who want to get some knowledge about financial markets. The first part of the book is an exposition of advanced stochastic calculus. It defines the theoretical framework for the pricing and hedging of contingent claims with a special focus on interest-rate markets. The second part covers a selection of short and long-term oriented risk measures as well as their application to the risk management of interest -rate portfolios. Interesting and comprehensive case studies are provided to illustrate the theoretical concepts.

This monograph is intended to be a complete treatment of the metrical the ory of the (regular) continued fraction expansion and related representations of real numbers. We have attempted to give the best possible results known so far, with proofs which are the simplest and most direct. The book has had a long gestation period because we first decided to write it in March 1994. This gave us the possibility of essentially improving the initial versions of many parts of it. Even if the two authors are different in style and approach, every effort has been made to hide the differences. Let 0 denote the set of irrationals in I = [0,1]. Define the (reg ular) continued fraction transformation T by T (w) = fractional part of n 1/w, w E O. Write T for the nth iterate of T, n E N = {O, 1, ... }, n 1 with TO = identity map. The positive integers an(w) = al(T - (W)), n E N+ = {1,2*** }, where al(w) = integer part of 1/w, w E 0, are called the (regular continued fraction) digits of w. Writing . for arbitrary indeterminates Xi, 1 :::; i :::; n, we have w = lim [al(w),*** , an(w)], w E 0, n--->oo thus explaining the name of T. The above equation will be also written as w = lim [al(w), a2(w),***], w E O.

The numerical analysis of stochastic differential equations (SDEs) differs significantly from that of ordinary differential equations. This book provides an easily accessible introduction to SDEs, their applications and the numerical methods to solve such equations.

From the reviews:

"The authors draw upon their own research and experiences in obviously many disciplines... considerable time has obviously been spent writing this in the simplest language possible." --ZAMP

Stochastic switching systems represent an interesting class of systems that can be used to model a variety of systems having abrupt random changes in their dynamics. Such systems may be found in the fields of manufacturing, communications, aerospace, power, and economics. This work presents stochastic switching systems and provides up-to-date methods and techniques for the analysis and design of various control systems with or without uncertainties. An introductory chapter highlights basic concepts and practical models, which are then used to solve more advanced problems throughout the book. Included are many numerical examples as well as LMI analysis methods and design approaches to supplement the developed results. Stochastic Switching Systems may be used as a supplementary textbook for graduate-level engineering courses, or as a reference for control engineers, graduate students, and researchers in systems and control. Prerequisites include elementary courses in matrix theory, probability, optimization techniques, and control systems theory.

This book compiles and critically discusses modern engineering system degradation models and their impact on engineering decisions. In particular, the authors focus on modeling the uncertain nature of degradation considering both conceptual discussions and formal mathematical formulations. It also describes the basics concepts and the various modeling aspects of life-cycle analysis (LCA). It highlights the role of degradation in LCA and defines optimum design and operation parameters. Given the relationship between operational decisions and the performance of the system's condition over time, maintenance models are also discussed. The concepts and models presented have applications in a large variety of engineering fields such as Civil, Environmental, Industrial, Electrical and Mechanical engineering. However, special emphasis is given to problems related to large infrastructure systems. The book is intended to be used both as a reference resource for researchers and practitioners and as an academic text for courses related to risk and reliability, infrastructure performance modeling and life-cycle assessment.

This book, which is based on several courses of lectures given by the author at the Independent University of Moscow, is devoted to Sobolev-type spaces and boundary value problems for linear elliptic partial differential equations. Its main focus is on problems in non-smooth (Lipschitz) domains for strongly elliptic systems. The author, who is a prominent expert in the theory of linear partial differential equations, spectral theory and pseudodifferential operators, has included his own very recent findings in the present book. The book is well suited as a modern graduate textbook, utilizing a thorough and clear format that strikes a good balance between the choice of material and the style of exposition. It can be used both as an introduction to recent advances in elliptic equations and boundary value problems and as a valuable survey and reference work. It also includes a good deal of new and extremely useful material not available in standard textbooks to date. Graduate and post-graduate students, as well as specialists working in the fields of partial differential equations, functional analysis, operator theory and mathematical physics will find this book particularly valuable.

Stochastic differential equations (SDEs) are a powerful tool in science, mathematics, economics and finance. This book will help the reader to master the basic theory and learn some applications of SDEs. In particular, the reader will be provided with the backward SDE technique for use in research when considering financial problems in the market, and with the reflecting SDE technique to enable study of optimal stochastic population control problems. These two techniques are powerful and efficient, and can also be applied to research in many other problems in nature, science and elsewhere.

The theory of stochastic processes, for science and engineering, can be considered as an extension of probability theory allowing modeling of the evolution of systems over time. The modern theory of Markov processes has its origins in the studies of A.A. Markov (1856-1922) on sequences of experiments "connected in a chain" and in the attempts to describe mathematically the physical phenomenon Brownian motion. The theory of stochastic processes entered in a period of intensive development when the idea of Markov property was brought in. This book is a modern overall view of semi-Markov processes and its applications in reliability. It is accessible to readers with a first course in Probability theory (including the basic notions of Markov chain). The text contains many examples which aid in the understanding of the theoretical notions and shows how to apply them to concrete physical situations including algorithmic simulations. Many examples of the concrete applications in reliability are given. Features: * Processes associated to semi-Markov kernel for general and discrete state spaces * Asymptotic theory of processes and of additive functionals * Statistical estimation of semi-Markov kernel and of reliability function * Monte Carlo simulation * Applications in reliability and maintenance The book is a valuable resource for understanding the latest developments in Semi-Markov Processes and reliability. Practitioners, researchers and professionals in applied mathematics, control and engineering who work in areas of reliability, lifetime data analysis, statistics, probability, and engineering will find this book an up-to-date overview of the field.

From the Reviews:

"Gihman and Skorohod have done an excellent job of presenting the theory in its present state of rich imperfection."
D.W. Stroock in Bulletin of the American Mathematical Society, 1980

"To call this work encyclopedic would not give an accurate picture of its content and style. Some parts read like a textbook, but others are more technical and contain relatively new results. ... The exposition is robust and explicit, as one has come to expect of the Russian tradition of mathematical writing. The set when completed will be an invaluable source of information and reference in this ever-expanding field"
K.L. Chung in American Scientist, 1977

"The dominant impression is of the authors' mastery of their material, and of their confident insight into its underlying structure. ..."
J.F.C. Kingman in Bulletin of the London Mathematical Society, 1977

Stochastic Methods for Flow in Porous Media: Coping with Uncertainties explores fluid flow in complex geologic environments. The parameterization of uncertainty into flow models is important for managing water resources, preserving subsurface water quality, storing energy and wastes, and improving the safety and economics of extracting subsurface mineral and energy resources.
This volume systematically introduces a number of stochastic methods used by researchers in the community in a tutorial way and presents methodologies for spatially and temporally stationary as well as nonstationary flows. The author compiles a number of well-known results and useful formulae and includes exercises at the end of each chapter.

* As never seen before:
* Balanced viewpoint of several stochastic methods, including Greens' function, perturbative expansion, spectral, Feynman diagram, adjoint state, Monte Carlo simulation, and renormalization group methods
* Tutorial style of presentation will facilitate use by readers without a prior in-depth knowledge of Stochastic processes
* Practical examples throughout the text
* Exercises at the end of each chapter reinforce specific concepts and techniques
* For the reader who is interested in hands-on experience, a number of computer codes are included and discussed

This book contains the lectures given at the Conference on Dynamics and Randomness held at the Centro de Modelamiento Matematico of the Universidad de Chile from December 11th to 15th, 2000. This meeting brought together mathematicians, theoretical physicists and theoretical computer scientists, and graduate students interested in fields re lated to probability theory, ergodic theory, symbolic and topological dynam ics. We would like to express our gratitude to all the participants of the con ference and to the people who contributed to its organization. In particular, to Pierre Collet, Bernard Host and Mike Keane for their scientific advise. VVe want to thank especially the authors of each chapter for their well prepared manuscripts and the stimulating conferences they gave at Santiago. We are also indebted to our sponsors and supporting institutions, whose interest and help was essential to organize this meeting: ECOS-CONICYT, FONDAP Program in Applied Mathematics, French Cooperation, Fundacion Andes, Presidential Fellowship and Universidad de Chile. We are grateful to Ms. Gladys Cavallone for their excellent work during the preparation of the meeting as well as for the considerable task of unifying the typography of the different chapters of this book."

Featuring the clearly presented and expertly-refereed contributions of leading researchers in the field of approximation theory, this volume is a collection of the best contributions at the Third International Conference on Applied Mathematics and Approximation Theory, an international conference held at TOBB University of Economics and Technology in Ankara, Turkey, on May 28-31, 2015. The goal of the conference, and this volume, is to bring together key work from researchers in all areas of approximation theory, covering topics such as ODEs, PDEs, difference equations, applied analysis, computational analysis, signal theory, positive operators, statistical approximation, fuzzy approximation, fractional analysis, semigroups, inequalities, special functions and summability. These topics are presented both within their traditional context of approximation theory, while also focusing on their connections to applied mathematics. As a result, this collection will be an invaluable resource for researchers in applied mathematics, engineering and statistics.

Stochastic discrete-event systems (SDES) capture the randomness in choices due to activity delays and the probabilities of decisions.

This book delivers a comprehensive overview on modeling with a quantitative evaluation of SDES. It presents an abstract model class for SDES as a pivotal unifying result and details important model classes. The book also includes nontrivial examples to explain real-world applications of SDES.

This accessible introduction to the theory of stochastic processes emphasizes Levy processes and Markov processes. It gives a thorough treatment of the decomposition of paths of processes with independent increments (the Levy-Ito decomposition). It also contains a detailed treatment of time-homogeneous Markov processes from the viewpoint of probability measures on path space. In addition, 70 exercises and their complete solutions are included."

Interactive Particle Systems is a branch of Probability Theory with close connections to Mathematical Physics and Mathematical Biology. In 1985, the author wrote a book (T. Liggett, Interacting Particle System, ISBN 3-540-96069) that treated the subject as it was at that time. The present book takes three of the most important models in the area, and traces advances in our understanding of them since 1985. In so doing, many of the most useful techniques in the field are explained and developed, so that they can be applied to other models and in other contexts. Extensive Notes and References sections discuss other work on these and related models. Readers are expected to be familiar with analysis and probability at the graduate level, but it is not assumed that they have mastered the material in the 1985 book. This book is intended for graduate students and researchers in Probability Theory, and in related areas of Mathematics, Biology and Physics.

Devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes, the text is mainly confined to MCPs with Borel state and control spaces. Although the book follows on from the author's earlier work, an important feature of this volume is that it is self-contained and can thus be read independently of the first.
The control model studied is sufficiently general to include virtually all the usual discrete-time stochastic control models that appear in applications to engineering, economics, mathematical population processes, operations research, and management science.

This book covers the broad range of research in stochastic models and optimization. Applications covered include networks, financial engineering, production planning and supply chain management. Each contribution is aimed at graduate students working in operations research, probability, and statistics.

Thiscollectionofproblemsisplannedasatextbookforuniversitycoursesinthe theoryofstochasticprocessesandrelatedspecialcourses. Theproblemsinthebook haveawidespectrumofthelevelofdif cultyandcanbeusefulforreaderswith variouslevelsofmasteringinthetheoryofstochasticprocesses. Togetherwithte- nicalandillustrativeproblemsintendedforbeginners,thebookcontainsanumber ofproblemsoftheoreticalnaturethatcanbeusefulforstudentsandundergraduate studentsthatpursueadvancedstudiesinthetheoryofstochasticprocessesandits- plications. Amongothers,theimportantaimofthebookistoprovideateachingstaff anef cienttoolforpreparingseminarstudies,tests,andexamsconcerninguniversity coursesinthetheoryofstochasticprocessesandrelatedtopics. Whilecomposingthe book,theauthorshavepartiallyusedthecollectionsofproblemsinprobabilityt- ory[16,65,75,83]. Also,someexercisesandproblemsfromthemonographsand textbooks[4,9,19,22,82]wereused. Atthesametime,alargepartofourproblem bookcontainsoriginalmaterial. Thebookisorganizedasfollows. Theproblemsarecollectedintochapters,each chapterbeingdevotedtoacertaintopic. Atthebeginningofeachchapter,theth- reticalgroundsforthecorrespondingtopicaregivenbrie ytogetherwiththelistof bibliography,whichthereadercanuseinordertostudythistopicinmoredetail. For themostoftheproblems,eitherhintsorcompletesolutions(oranswers)aregiven, andsomeoftheproblemsareprovidedwithbothhintsandsolutions(answers). H- ever,theauthorsdonotrecommendthatareaderusethehintssystematically,because solvingaproblemwithoutassistanceismuchmoreusefulthanusingaready-made idea. Somestatementsthathaveaparticulartheoreticalinterestareformulatedon theoreticalgrounds,andtheirproofsareformulatedasproblemsforthereader. Such problemsaresuppliedwitheithercompletesolutionsordetailedhints. Inordertoworkwiththeproblembookef ciently,areadershouldbeacquainted withprobabilitytheory,calculus,andmeasuretheorywithinthescopeofresp- tiveuniversity courses. Standard notions, suchas random variable, measurability, independence, Lebesgue measure and integral, and so on are used without ad- tionaldiscussion. Allthenewnotionsandstatementsrequiredforsolvingthepr- lemsaregiveneitherontheoreticalgroundsorintheformulationsoftheproblems vii viii Preface straightforwardly. However,sometimesanotionisusedinthetextbeforeitsformal de nition. Forinstance,theWienerandPoissonprocessesareprocesseswithin- pendentincrementsandthusareformallyintroducedinaTheoreticalgroundsfor Chapter5,buttheseprocessesareusedwidelyintheproblemsofChapters2to4. Theauthorsrecommendthatareaderwhocomestoanunknownnotionorobject usetheIndexinorderto ndthecorrespondingformalde nition. Thesamerec- mendationconcernssomestandardabbreviationsandsymbolslistedattheendofthe book. Someproblemsinthebookformcycles:solutionstooneofthemaregrounded onstatementsofothersoronauxiliaryconstructionsdescribedinsomepreceding solutions. Sometimes,onthecontrary,itisproposedtoprovethesamestatement withindifferentproblemsusingessentiallydifferenttechniques. Theauthorsrec- mendareaderpayspeci cattentiontothesefruitfulinternallinksbetweenvarious topicsofthetheoryofstochasticprocesses. Everypartofthebookwascomposedsubstantiallybyoneauthor. Chapters1-6, and16arecomposedbyA. Kulik,Chapters7,12-15,18,and19byYu. Mishura, Chapters 8-10 by A. Pilipenko, Chapter 17 by A. Kukush, and Chapter 20 by D. Gusak. Chapter11waspreparedjointlybyD. GusakandA. Pilipenko. Atthe sametime,everyauthorhasmadeacontributiontootherpartsofthebookbyprop- ingseparateproblemsorcyclesofproblems,improvingpreliminaryversionsoft- oreticalgrounds,andeditingthe naltext. The authors would like to express their deep gratitude to M. Portenko and A. Ivanovfortheircarefulreadingofapreliminaryversionofthebookandva- ablecommentsthatledtosigni cantimprovementofthetext. Theauthorsarealso gratefultoT. Yakovenko,G. Shevchenko,O. Soloveyko, Yu. Kartashov, Yu. K- menko,A. Malenko,andN. Ryabovafortheirassistanceintranslation,preparing lesandpictures,andcomposingthesubjectindexandreferences. Thetheoryofstochasticprocessesisanextendeddiscipline,andtheauthors- derstandthattheproblembookinitscurrentformmaycausecriticalremarksfrom readers,concerningeitherthestructureofthebookorthecontentofseparatech- ters. Whilepublishingtheproblembookinitscurrentform,theauthorsareopenfor remarks,comments,andpropositions,andexpressinadvancetheirgratitudetoall theircorrespondents. Kyiv DmytroGusak December2008 AlexanderKukush AlexeyKulik YuliyaMishura AndreyPilipenko Contents 1 De?nition of stochastic process. Cylinder?-algebra, ?nite-dimensional distributions, the Kolmogorov theorem...1 Theoreticalgrounds ...1 Bibliography...3 Problems...3 Hints...7 AnswersandSolutions...9 2 Characteristics of a stochastic process. Mean and covariance functions. Characteristic functions...11 Theoreticalgrounds ...11 Bibliography...13 Problems...13 Hints...16 AnswersandSolutions...17 3 Trajectories. Modi?cations. Filtrations...21 Theoreticalgrounds ...21 Bibliography...24 Problems...24 Hints...29 AnswersandSolutions...31 4 Continuity. Differentiability. Integrability...33 Theoreticalgrounds ...33 Bibliography...34 Problems...34 Hints...38 AnswersandSolutions...40 ix x Contents 5 Stochastic processes with independent increments. Wiener and Poisson processes. Poisson point measures...

The aim of this book is to present graduate students with a thorough survey of reference probability models and their applications to optimal estimation and control. These new and powerful methods are particularly useful in signal processing applications where signal models are only partially known and are in noisy environments. Well-known results, including Kalman filters and the Wonheim filter emerge as special cases. The authors begin with discrete time and discrete state spaces. From there, they proceed to cover continuous time, and progress from linear models to non-linear models, and from completely known models to only partially known models. Readers are assumed to have basic grounding in probability and systems theory as might be gained from the first year of graduate study, but otherwise this account is self-contained. Throughout, the authors have taken care to demonstrate engineering applications which show the usefulness of these methods.