This handbook, now available in paperback, brings together a comprehensive collection of mathematical material in one location. It also offers a variety of new results interpreted in a form that is particularly useful to engineers, scientists, and applied mathematicians. The handbook is not specific to fixed research areas, but rather it has a generic flavor that can be applied by anyone working with probabilistic and stochastic analysis and modeling. Classic results are presented in their final form without derivation or discussion, allowing for much material to be condensed into one volume.

Although three decades have passed since first publication of this book reprinted now as a result of popular demand, the content remains up-to-date and interesting for many researchers as is shown by the many references to it in current publications.

The "ground floor" of Optimal Stopping Theory was constructed by A.Wald in his sequential analysis in connection with the testing of statistical hypotheses by non-traditional (sequential) methods.

It was later discovered that these methods have, in idea, a close connection to the general theory of stochastic optimization for random processes.

The area of application of the Optimal Stopping Theory is very broad. It is sufficient at this point to emphasise that its methods are well tailored to the study of American (-type) options (in mathematics of finance and financial engineering), where a buyer has the freedom to exercise an option at any stopping time.

In this book, the general theory of the construction of optimal stopping policies is developed for the case of Markov processes in discrete and continuous time.

One chapter is devoted specially to the applications that address problems of the testing of statistical hypotheses, and quickest detection of the time of change of the probability characteristics of the observable processes.

The author, A.N.Shiryaev, is one of the leading experts of the field and gives an authoritative treatment of a subject that, 30 years after original publication of this book, is proving increasingly important.

Updated to conform to Mathematica (R) 7.0, Introduction to Probability with Mathematica (R), Second Edition continues to show students how to easily create simulations from templates and solve problems using Mathematica. It provides a real understanding of probabilistic modeling and the analysis of data and encourages the application of these ideas to practical problems. The accompanyingdownloadable resources offer instructors the option of creating class notes, demonstrations, and projects. New to the Second Edition Expanded section on Markov chains that includes a study of absorbing chains New sections on order statistics, transformations of multivariate normal random variables, and Brownian motion More example data of the normal distribution More attention on conditional expectation, which has become significant in financial mathematics Additional problems from Actuarial Exam P New appendix that gives a basic introduction to Mathematica New examples, exercises, and data sets, particularly on the bivariate normal distribution New visualization and animation features from Mathematica 7.0 Updated Mathematica notebooks on the downloadable resources. After covering topics in discrete probability, the text presents a fairly standard treatment of common discrete distributions. It then transitions to continuous probability and continuous distributions, including normal, bivariate normal, gamma, and chi-square distributions. The author goes on to examine the history of probability, the laws of large numbers, and the central limit theorem. The final chapter explores stochastic processes and applications, ideal for students in operations research and finance.

This book constitutes the refereed proceedings of the 4th International Symposium on Stochastic Algorithms: Foundations and Applications, SAGA 2007. The nine revised full papers and five invited papers presented were carefully selected for inclusion in the book. The contributed papers included in this volume cover both theoretical as well as applied aspects of stochastic computations with a special focus on investigating the power of randomization in algorithmics.

First-passage properties underlie a wide range of stochastic processes, such as diffusion-limited growth, neuron firing, and the triggering of stock options. This book provides a unified presentation of first-passage processes, which highlights its interrelations with electrostatics and the resulting powerful consequences. The author begins with a modern presentation of fundamental theory including the connection between the occupation and first-passage probabilities of a random walk, and the connection to electrostatics and current flows in resistor networks. The consequences of this theory are then developed for simple, illustrative geometries including the finite and semi-infinite intervals, fractal networks, spherical geometries and the wedge. Various applications are presented including neuron dynamics, self-organized criticality, diffusion-limited aggregation, the dynamics of spin systems, and the kinetics of diffusion-controlled reactions. Examples discussed include neuron dynamics, self-organized criticality, kinetics of spin systems, and stochastic resonance.

This work presents the theory of stochastic processes in its present state of rich imperfection. To describe this work as encyclopedic does not give an accurate picture of its content and style. Some parts read like a textbook, but others are more technical and contain relatively new results. The exposition is robust and explicit, as one has come to expect of the Russian tradition of mathematical writing.

The authors' display mastery of their material, and demonstrate their confident insight into its underlying structure. The set when completed will be an invaluable source of information and reference in this ever-expanding field.

This book is intended to give an introduction to the theory of forwa- backward stochastic di erential equations (FBSDEs, for short) which has received strong attention in recent years because of its interesting structure and its usefulness in various applied elds. The motivation for studying FBSDEs comes originally from stochastic optimal control theory, that is, the adjoint equation in the Pontryagin-type maximum principle. The earliest version of such an FBSDE was introduced by Bismut 1] in 1973, with a decoupled form, namely, a system of a usual (forward)stochastic di erential equation and a (linear) backwardstochastic dieren tial equation (BSDE, for short). In 1983, Bensoussan 1] proved the well-posedness of general linear BSDEs by using martingale representation theorem. The r st well-posedness result for nonlinear BSDEs was proved in 1990 by Pardoux{Peng 1], while studying the general Pontryagin-type maximum principle for stochastic optimal controls. A little later, Peng 4] discovered that the adapted solution of a BSDE could be used as a pr- abilistic interpretation of the solutions to some semilinear or quasilinear parabolic partial dieren tial equations (PDE, for short), in the spirit of the well-known Feynman-Kac formula. After this, extensive study of BSDEs was initiated, and potential for its application was found in applied and t- oretical areas such as stochastic control, mathematical n ance, dieren tial geometry, to mention a few. The study of (strongly) coupled FBSDEs started in early 90s. In his Ph.

Point process statistics is successfully used in fields such as material science, human epidemiology, social sciences, animal epidemiology, biology, and seismology. Its further application depends greatly on good software and instructive case studies that show the way to successful work. This book satisfies this need by a presentation of the spatstat package and many statistical examples.

Researchers, spatial statisticians and scientists from biology, geosciences, materials sciences and other fields will use this book as a helpful guide to the application of point process statistics. No other book presents so many well-founded point process case studies.

From the reviews:

"For those interested in analyzing their spatial data, the wide variatey of examples and approaches here give a good idea of the possibilities and suggest reasonable paths to explore." Michael Sherman for the Journal of the American Statistical Association, December 2006

This volume constitutes the proceedings of the 3rd Symposium on Stochastic Algorithms, Foundations and Applications (SAGA 2005), held in Moscow, R- sia, at Moscow State University on October 20-22, 2005. The symposium was organized by the Department of Discrete Mathematics, Faculty of Mechanics and Mathematics of Moscow State University and was partially supported by the Russian Foundation for Basic Research under Project No. 05-01-10140-?. The SAGA symposium series is a biennial meeting which started in 2001 in Berlin, Germany(LNCS vol. 2264). The second symposium was held in Sept- ber 2003 at the University of Hertfordshire, Hat?eld, UK (LNCS vol. 2827). Sincethe?rstsymposiuminBerlinin2001, anincreasedinterestintheSAGA series can be noticed. For SAGA 2005, we received submissions from China, the European Union, Iran, Japan, Korea, Russia, SAR Hong Kong, Taiwan, and USA, fromwhich 14 papers were?nally selected for publication after a thorough reviewing process. The contributed papers included in this volume cover both theoretical as well as applied aspects of stochastic computations, which is one of the main aims of the SAGA series. Furthermore, ?ve invited lectures were delivered at SAGA 2005: The talk by Alexander A. Sapozhenko (Moscow State University) summarizes results on the container method, a technique that is used to solve enumeration problems for various combinatorial structures and which has - merous applications in the design andanalysisof stochasticalgorithms. Christos D. Zaroliagis (University of Patras) presented recent advances in multiobjective optimization

This book is a photographic reproduction of the book of the same title published in 1981, for which there has been continuing demand on account of its accessible technical level. Its appearance also helped generate considerable subsequent work on inhomogeneous products of matrices. This printing adds an additional bibliography on coefficients of ergodicity and a list of corrigenda.

Eugene Seneta received his Ph.D. in 1968 from the Australian National University. He left Canberra in 1979 to become Professor and Head of the Department of Mathematical Statistics at the University of Sydney. He has been a regular visitor to the United States, most frequently to the University of Virginia. Now Emeritus Professor at the University of Sydney, he has recently developed a renewed interest in financial mathematics. He was elected Fellow of the Australian Academy of Science in 1985 and awarded the Pitman Medal of the Statistical Society of Australia for his distinguished research contributions.

The first edition of this book, entitled Non-Negative Matrices, appeared in 1973, and was followed in 1976 by his Regularly Varying Functions in the Springer Lecture Notes in Mathematics, later translated into Russian. Both books were pioneering in their fields. In 1977, Eugene Seneta coauthored (with C. C. Heyde ) I.J. BienaymA(c): Statistical Theory Anticipated, which is effectively a history of probability and statistics in the 19th century, and in 2001 co-edited with the same colleague Statisticians of the Centuries, both published by Springer. Having served on the editorial board of the Encyclopedia of Statistical Science, he is currently Joint Editor of the International Statistical Review.

Das Buch liefert die Werkzeuge, um den Gesetzmassigkeiten der Stochastik auf die Spur zu kommen. Dafur wird, ausgehend von der elementaren beschreibenden Statistik, die Wahrscheinlichkeitstheorie bis hin zum Zentralen Grenzwertsatz entwickelt. Ein weiterer Schwerpunkt liegt in der Einfuhrung in aktuelle stochastische Fragestellungen - von der Informationstheorie bis zur Finanzmathematik

Provides a more accessible introduction than other books on Markov processes by emphasizing the structure of the subject and avoiding sophisticated measure theory

Leads the reader to a rigorous understanding of basic theory

From the Reviews: "Gihman and Skorohod have done an excellent job of presenting the theory in its present state of rich imperfection." --D.W. Stroock, Bulletin of the American Mathematical Society, 1980

This volume includes the five lecture courses given at the CIME-EMS School on "Stochastic Methods in Finance" held in Bressanone/Brixen, Italy 2003. It deals with innovative methods, mainly from stochastic analysis, that play a fundamental role in the mathematical modelling of finance and insurance: the theory of stochastic processes, optimal and stochastic control, stochastic differential equations, convex analysis and duality theory. Five topics are treated in detail: Utility maximization in incomplete markets; the theory of nonlinear expectations and its relationship with the theory of risk measures in a dynamic setting; credit risk modelling; the interplay between finance and insurance; incomplete information in the context of economic equilibrium and insider trading.

This thesis summarizes most of my recent research in the field of portfolio optimization. The main topics which I have addressed are portfolio problems with stochastic interest rates and portfolio problems with defaultable assets. The starting point for my research was the paper "A stochastic control ap proach to portfolio problems with stochastic interest rates" (jointly with Ralf Korn), in which we solved portfolio problems given a Vasicek term structure of the short rate. Having considered the Vasicek model, it was obvious that I should analyze portfolio problems where the interest rate dynamics are gov erned by other common short rate models. The relevant results are presented in Chapter 2. The second main issue concerns portfolio problems with default able assets modeled in a firm value framework. Since the assets of a firm then correspond to contingent claims on firm value, I searched for a way to easily deal with such claims in portfolio problems. For this reason, I developed the elasticity approach to portfolio optimization which is presented in Chapter 3. However, this way of tackling portfolio problems is not restricted to portfolio problems with default able assets only, but it provides a general framework allowing for a compact formulation of portfolio problems even if interest rates are stochastic."

This volume provides a systematic mathematical exposition of the conceptual problems of nonequilibrium statistical physics, such as entropy production, irreversibility, and ordered phenomena. Markov chains, diffusion processes, and hyperbolic dynamical systems are used as mathematical models of physical systems. A measure-theoretic definition of entropy production rate and its formulae in various cases are given. It vanishes if and only if the stationary system is reversible and in equilibrium. Moreover, in the cases of Markov chains and diffusion processes on manifolds, it can be expressed in terms of circulations on directed cycles. Regarding entropy production fluctuations, the Gallavotti-Cohen fluctuation theorem is rigorously proved.

Quantum probability and the theory of operator algebras are both concerned with the study of noncommutative dynamics. Focusing on stationary processes with discrete-time parameter, this book presents (without many prerequisites) some basic problems of interest to both fields, on topics including extensions and dilations of completely positive maps, Markov property and adaptedness, endomorphisms of operator algebras and the applications arising from the interplay of these themes. Much of the material is new, but many interesting questions are accessible even to the reader equipped only with basic knowledge of quantum probability and operator algebras.

This book is the first comprehensive treatment of rational matrix equations in stochastic systems, including various aspects of the field, previously unpublished results and explicit examples. Topics include modelling with stochastic differential equations, stochastic stability, reformulation of stochastic control problems, analysis of the rational matrix equation and numerical solutions. Primarily a survey in character, this monograph is intended for researchers, graduate students and engineers in control theory and applied linear algebra.

The second Symposium on Stochastic Algorithms, Foundations and Applications (SAGA 2003), took place on September 22 23,2003, in Hat?eld, England.The present volume comprises 12 contributed papers and 3 invited talks. The contributed papers included in the proceedings present results in the following areas: ant colony optimization; randomized algorithmsfor the intersection problem; - cal search for constraint satisfaction problems; randomized local search methods for combinatorial optimization, in particular, simulated annealing techniques; probabilistic global search algorithms; network communication complexity; open shop scheduling; aircraft routing; traf?c control; randomized straight-line programs; and stochastic - tomata and probabilistic transformations. TheinvitedtalkbyRolandKirschnerprovidesabriefintroductiontoquantuminf- matics. The requirements and the prospects of the physical implementation of a qu- tum computer are addressed. Lucila Ohno-Machado and Winston P. Kuo describe the factors that make the an- ysis of high-throughput gene expression data especially challenging, and indicate why properly evaluated stochastic algorithms can play a particularly important role in this process. John Vaccaro et al. review a fundamental element of quantum information theory, source coding, which entails the compression of quantum data. A recent experiment that demonstrates this fundamental principle is presented and discussed. Our special thanks go to all who supported SAGA 2003, to all authors who subm- ted papers, to the members of the program committee, to the invited speakers, and to the members of the organizing committee. Andreas Albrecht Kathleen Steinhofel ] Organization SAGA2003wasorganizedbytheUniversityofHertfordshire, DepartmentofComputer Science, Hat?eld, Hertfordshire AL10 9AB, United Kingdom."

The theory of stochastic processes indexed by a partially ordered set has been the subject of much research over the past twenty years. The objective of this CIME International Summer School was to bring to a large audience of young probabilists the general theory of spatial processes, including the theory of set-indexed martingales and to present the different branches of applications of this theory, including stochastic geometry, spatial statistics, empirical processes, spatial estimators and survival analysis. This theory has a broad variety of applications in environmental sciences, social sciences, structure of material and image analysis. In this volume, the reader will find different approaches which foster the development of tools to modelling the spatial aspects of stochastic problems.

This book contains the proceedings of the conference "Fractals in Graz 2001 - Analysis, Dynamics, Geometry, Stochastics" that was held in the second week of June 2001 at Graz University of Technology, in the capital of Styria, southeastern province of Austria. The scientific committee of the meeting consisted of M. Barlow (Vancouver), R. Strichartz (Ithaca), P. Grabner and W. Woess (both Graz), the latter two being the local organizers and editors of this volume. We made an effort to unite in the conference as well as in the present pro ceedings a multitude of different directions of active current work, and to bring together researchers from various countries as well as research fields that all are linked in some way with the modern theory of fractal structures. Although (or because) in Graz there is only a very small group working on fractal structures, consisting of "non-insiders," we hope to have been successful with this program of wide horizons. All papers were written upon explicit invitation by the editors, and we are happy to be able to present this representative panorama of recent work on poten tial theory, random walks, spectral theory, fractal groups, dynamic systems, fractal geometry, and more. The papers presented here underwent a refereeing process."

This graduate-level textbook covers modelling, programming and analysis of stochastic computer simulation experiments, including the mathematical and statistical foundations of simulation and why it works. The book is rigorous and complete, but concise and accessible, providing all necessary background material. Object-oriented programming of simulations is illustrated in Python, while the majority of the book is programming language independent. In addition to covering the foundations of simulation and simulation programming for applications, the text prepares readers to use simulation in their research. A solutions manual for end-of-chapter exercises is available for instructors.

The book provides an easily accessible computationally oriented introduction into the numerical solution of stochastic differential equations using computer experiments. It develops in the reader an ability to apply numerical methods solving stochastic differential equations in their own fields. Furthermore, it creates an intuitive understanding of the necessary theoretical background from stochastic and numeric analysis. The book is related to the more theoretical monograph P.E. Kloeden and E. Platen, Numerical Solution of Stochastic Differential Equations, 1992, but can be independently used. It provides solutions to over 100 exercises used in this monograph to illustrate the theory. Corresponding Turbo Pascal programs are given on a floppy disk; furthermore commentaries on the programs and their use are carefully worked out in the book.

This book presents a new method for the diagnosis and observation of dynamical systems. This approach is presented with a strong theoretical background. The given methods are developed for engineering applications and are illustrated with numerous graphic and practical examples. In the first part of the book, new results in the area of automata theory, such as the solution to supervision problems for stochastic automata, are presented as well as an elaborated study on automata networks. The second part presents a new approach to qualitative modelling of dynamical systems based on quantized systems. This methodology opens the path towards application and is described and illustrated in detail. In conclusion practical applications of the developed methods are demonstrated.

Markov Chains are widely used as stochastic models to study a broad spectrum of system performance and dependability characteristics. This monograph is devoted to compositional specification and analysis of Markov chains.Based on principles known from process algebra, the author systematically develops an algebra of interactive Markov chains. By presenting a number of distinguishing results, of both theoretical and practical nature, the author substantiates the claim that interactive Markov chains are more than just another formalism: Among other, an algebraic theory of interactive Markov chains is developed, devise algorithms to mechanize compositional aggregation are presented, and state spaces of several million states resulting from the study of an ordinary telefone system are analyzed.