This research monograph develops the Hamilton-Jacobi-Bellman theory via dynamic programming principle for a class of optimal control problems for stochastic hereditary differential equations (SHDEs) driven by a standard Brownian motion and with a bounded or an infinite but fading memory. These equations represent a class of stochastic infinite-dimensional systems that become increasingly important and have wide range of applications in physics, chemistry, biology, engineering and economics/finance. This monograph can be used as a research reference for researchers and advanced graduate students who have special interest in optimal control theory and applications of stochastic hereditary systems.

"Markov Chains: Analytic and Monte Carlo Computations" introduces the main notions related to Markov chains and provides explanations on how to characterize, simulate, and recognize them. Starting with basic notions, this book leads progressively to advanced and recent topics in the field, allowing the reader to master the main aspects of the classical theory. This book also features: Numerous exercises with solutions as well as extended case studies.A detailed and rigorous presentation of Markov chains with discrete time and state space.An appendix presenting probabilistic notions that are necessary to the reader, as well as giving more advanced measure-theoretic notions.

Offering a viable solution to the long-standing problem of estimating the abundance of rare, clustered populations, adaptive sampling designs are rapidly gaining prominence in the natural and social sciences as well as in other fields with inherently difficult sampling situations. In marked contrast to conventional sampling designs, in which the entire sample of units to be observed is fixed prior to the survey, adaptive sampling strategies allow for increased sampling intensity depending upon observations made during the survey. For example, in a survey to assess the abundance of a rare animal species, neighboring sites may be added to the sample whenever the species is encountered during the survey. In an epidemiological survey of a contagious or genetically linked disease, sampling intensity may be increased whenever prevalence of the disease is encountered.

Written by two acknowledged experts in this emerging field, this book offers researchers their first comprehensive introduction to adaptive sampling. An ideal reference for statisticians conducting research in survey designs and spatial statistics as well as researchers working in the environmental, ecological, public health, and biomedical sciences.

Adaptive Sampling:

• Provides a comprehensive, fully integrated introduction to adaptive sampling theory and practice
• Describes recent research findings
• Introduces readers to a wide range of adaptive sampling strategies and techniques
• Includes numerous real-world examples from environmental pollution studies, surveys of rare animal and plant species, studies of contagious diseases, marketing surveys, mineral and fossil-fuel assessments, and more

This book provides a concise introduction to the mathematical foundations of time series analysis, with an emphasis on mathematical clarity. The text is reduced to the essential logical core, mostly using the symbolic language of mathematics, thus enabling readers to very quickly grasp the essential reasoning behind time series analysis. It appeals to anybody wanting to understand time series in a precise, mathematical manner. It is suitable for graduate courses in time series analysis but is equally useful as a reference work for students and researchers alike.

This is a volume consisting of selected papers that were presented at the 3rd St. Petersburg Workshop on Simulation held at St. Petersburg, Russia, during June 28-July 3, 1998. The Workshop is a regular international event devoted to mathematical problems of simulation and applied statistics organized by the Department of Stochastic Simulation at St. Petersburg State University in cooperation with INFORMS College on Simulation (USA). Its main purpose is to exchange ideas between researchers from Russia and from the West as well as from other coun tries throughout the World. The 1st Workshop was held during May 24-28, 1994, and the 2nd workshop was held during June 18-21, 1996. The selected proceedings of the 2nd Workshop was published as a special issue of the Journal of Statistical Planning and Inference. Russian mathematical tradition has been formed by such genius as Tchebysh eff, Markov and Kolmogorov whose ideas have formed the basis for contempo rary probabilistic models. However, for many decades now, Russian scholars have been isolated from their colleagues in the West and as a result their mathe matical contributions have not been widely known. One of the primary reasons for these workshops is to bring the contributions of Russian scholars into lime light and we sincerely hope that this volume helps in this specific purpose."

Stochastic modeling is a set of quantitative techniques for analyzing practical systems with random factors. This area is highly technical and mainly developed by mathematicians. Most existing books are for those with extensive mathematical training; this book minimizes that need and makes the topics easily understandable. Fundamentals of Stochastic Models offers many practical examples and applications and bridges the gap between elementary stochastics process theory and advanced process theory. It addresses both performance evaluation and optimization of stochastic systems and covers different modern analysis techniques such as matrix analytical methods and diffusion and fluid limit methods. It goes on to explore the linkage between stochastic models, machine learning, and artificial intelligence, and discusses how to make use of intuitive approaches instead of traditional theoretical approaches. The goal is to minimize the mathematical background of readers that is required to understand the topics covered in this book. Thus, the book is appropriate for professionals and students in industrial engineering, business and economics, computer science, and applied mathematics.

This book is aimed at researchers, graduate students and engineers who would like to be initiated to Piecewise Deterministic Markov Processes (PDMPs). A PDMP models a deterministic mechanism modified by jumps that occur at random times. The fields of applications are numerous : insurance and risk, biology, communication networks, dependability, supply management, etc. Indeed, the PDMPs studied so far are in fact deterministic functions of CSMPs (Completed Semi-Markov Processes), i.e. semi-Markov processes completed to become Markov processes. This remark leads to considerably broaden the definition of PDMPs and allows their properties to be deduced from those of CSMPs, which are easier to grasp. Stability is studied within a very general framework. In the other chapters, the results become more accurate as the assumptions become more precise. Generalized Chapman-Kolmogorov equations lead to numerical schemes. The last chapter is an opening on processes for which the deterministic flow of the PDMP is replaced with a Markov process. Marked point processes play a key role throughout this book.

This collection of contributions originates from the well-established conference series "Fractal Geometry and Stochastics" which brings together researchers from different fields using concepts and methods from fractal geometry. Carefully selected papers from keynote and invited speakers are included, both discussing exciting new trends and results and giving a gentle introduction to some recent developments. The topics covered include Assouad dimensions and their connection to analysis, multifractal properties of functions and measures, renewal theorems in dynamics, dimensions and topology of random discrete structures, self-similar trees, p-hyperbolicity, phase transitions from continuous to discrete scale invariance, scaling limits of stochastic processes, stemi-stable distributions and fractional differential equations, and diffusion limited aggregation. Representing a rich source of ideas and a good starting point for more advanced topics in fractal geometry, the volume will appeal to both established experts and newcomers.

This comprehensive guide to stochastic processes gives a complete overview of the theory and addresses the most important applications. Pitched at a level accessible to beginning graduate students and researchers from applied disciplines, it is both a course book and a rich resource for individual readers. Subjects covered include Brownian motion, stochastic calculus, stochastic differential equations, Markov processes, weak convergence of processes and semigroup theory. Applications include the Black-Scholes formula for the pricing of derivatives in financial mathematics, the Kalman-Bucy filter used in the US space program and also theoretical applications to partial differential equations and analysis. Short, readable chapters aim for clarity rather than full generality. More than 350 exercises are included to help readers put their new-found knowledge to the test and to prepare them for tackling the research literature.

Stochastic Differential Equations for Science and Engineering is aimed at students at the M.Sc. and PhD level. The book describes the mathematical construction of stochastic differential equations with a level of detail suitable to the audience, while also discussing applications to estimation, stability analysis, and control. The book includes numerous examples and challenging exercises. Computational aspects are central to the approach taken in the book, so the text is accompanied by a repository on GitHub containing a toolbox in R which implements algorithms described in the book, code that regenerates all figures, and solutions to exercises. Features: Contains numerous exercises, examples, and applications Suitable for science and engineering students at Master's or PhD level Thorough treatment of the mathematical theory combined with an accessible treatment of motivating examples GitHub repository available at: https://github.com/Uffe-H-Thygesen/SDEbook and https://github.com/Uffe-H-Thygesen/SDEtools

A collection of 20 refereed research or review papers presented at a six-day seminar in Switzerland. The contributions focus on stochastic analysis, its applications to the engineering sciences, and stochastic methods in financial models, which was the subject of a minisymposium.

It is frequently observed that most decision-making problems involve several objectives, and the aim of the decision makers is to find the best decision by fulfilling the aspiration levels of all the objectives. Multi-objective decision making is especially suitable for the design and planning steps and allows a decision maker to achieve the optimal or aspired goals by considering the various interactions of the given constraints. Multi-Objective Stochastic Programming in Fuzzy Environments discusses optimization problems with fuzzy random variables following several types of probability distributions and different types of fuzzy numbers with different defuzzification processes in probabilistic situations. The content within this publication examines such topics as waste management, agricultural systems, and fuzzy set theory. It is designed for academicians, researchers, and students.

This book explains in detail the generalized Fourier series technique for the approximate solution of a mathematical model governed by a linear elliptic partial differential equation or system with constant coefficients. The power, sophistication, and adaptability of the method are illustrated in application to the theory of plates with transverse shear deformation, chosen because of its complexity and special features. In a clear and accessible style, the authors show how the building blocks of the method are developed, and comment on the advantages of this procedure over other numerical approaches. An extensive discussion of the computational algorithms is presented, which encompasses their structure, operation, and accuracy in relation to several appropriately selected examples of classical boundary value problems in both finite and infinite domains. The systematic description of the technique, complemented by explanations of the use of the underlying software, will help the readers create their own codes to find approximate solutions to other similar models. The work is aimed at a diverse readership, including advanced undergraduates, graduate students, general scientific researchers, and engineers. The book strikes a good balance between the theoretical results and the use of appropriate numerical applications. The first chapter gives a detailed presentation of the differential equations of the mathematical model, and of the associated boundary value problems with Dirichlet, Neumann, and Robin conditions. The second chapter presents the fundamentals of generalized Fourier series, and some appropriate techniques for orthonormalizing a complete set of functions in a Hilbert space. Each of the remaining six chapters deals with one of the combinations of domain-type (interior or exterior) and nature of the prescribed conditions on the boundary. The appendices are designed to give insight into some of the computational issues that arise from the use of the numerical methods described in the book. Readers may also want to reference the authors' other books Mathematical Methods for Elastic Plates, ISBN: 978-1-4471-6433-3 and Boundary Integral Equation Methods and Numerical Solutions: Thin Plates on an Elastic Foundation, ISBN: 978-3-319-26307-6.

Stochastic portfolio theory is a mathematical methodology for constructing stock portfolios, analyzing the behavior of portfolios, and understanding the structure of equity markets. Stochastic portfolio theory has both theoretical and practical applications: as a theoretical tool it can be used to construct examples of theoretical portfolios with specified characteristics, and to determine the distributional component of portfolio return. On a practical level, stochastic portfolio theory has been the basis for strategies used for over a decade by the institutional equity manager INTECH, where the author has served as chief investment officer. This book is an introduction to stochastic portfolio theory for investment professionals and for students of mathematical finance. Each chapter includes a number of problems of varying levels of difficulty and a brief summary of the principal results of the chapter, without proofs.

In some cases, certain coherent structures can exist in stochastic dynamic systems almost in every particular realization of random parameters describing these systems. Dynamic localization in one-dimensional dynamic systems, vortexgenesis (vortex production) in hydrodynamic flows, and phenomenon of clustering of various fields in random media (i.e., appearance of small regions with enhanced content of the field against the nearly vanishing background of this field in the remaining portion of space) are examples of such structure formation. The general methodology presented in Volume 1 is used in Volume 2 Coherent Phenomena in Stochastic Dynamic Systems to expound the theory of these phenomena in some specific fields of stochastic science, among which are hydrodynamics, magnetohydrodynamics, acoustics, optics, and radiophysics. The material of this volume includes particle and field clustering in the cases of scalar (density field) and vector (magnetic field) passive tracers in a random velocity field, dynamic localization of plane waves in layered random media, as well as monochromatic wave propagation and caustic structure formation in random media in terms of the scalar parabolic equation.

In this monograph stochastic models of systems analysis are discussed. It covers many aspects and different stages from the construction of mathematical models of real systems, through mathematical analysis of models based on simplification methods, to the interpretation of real stochastic systems. The stochastic models described here share the property that their evolutionary aspects develop under the influence of random factors. It has been assumed that the evolution takes place in a random medium, i.e. unilateral interaction between the system and the medium. As only Markovian models of random medium are considered in this book, the stochastic models described here are determined by two processes, a switching process describing the evolution of the systems and a switching process describing the changes of the random medium. Audience: This book will be of interest to postgraduate students and researchers whose work involves probability theory, stochastic processes, mathematical systems theory, ordinary differential equations, operator theory, or mathematical modelling and industrial mathematics.

This book provides an extensive, systematic overview of the modern theory of telegraph processes and their multidimensional counterparts, together with numerous fruitful applications in financial modelling. Focusing on stochastic processes of bounded variation instead of classical diffusion, or more generally, Levy processes, has two obvious benefits. First, the mathematical technique is much simpler, which helps to concentrate on the key problems of stochastic analysis and applications, including financial market modelling. Second, this approach overcomes some shortcomings of the (parabolic) nature of classical diffusions that contradict physical intuition, such as infinite propagation velocity and infinite total variation of paths. In this second edition, some sections of the previous text are included without any changes, while most others have been expanded and significantly revised. These are supplemented by predominantly new results concerning piecewise linear processes with arbitrary sequences of velocities, jump amplitudes, and switching intensities. The chapter on functionals of the telegraph process has been significantly expanded by adding sections on exponential functionals, telegraph meanders and running extrema, the times of the first passages of telegraph processes with alternating random jumps, and distribution of the Euclidean distance between two independent telegraph processes. A new chapter on the multidimensional counterparts of the telegraph processes is also included. The book is intended for graduate students in mathematics, probability, statistics and quantitative finance, and for researchers working at academic institutions, in industry and engineering. It can also be used by university lecturers and professionals in various applied areas.

This is the second updated and extended edition of the successful book on Feynman-Kac theory. It offers a state-of-the-art mathematical account of functional integration methods in the context of self-adjoint operators and semigroups using the concepts and tools of modern stochastic analysis. In the second volume, these ideas are applied principally to a rigorous treatment of some fundamental models of quantum field theory.

This book covers a wide range of problems involving the applications of stochastic processes, stochastic calculus, large deviation theory, group representation theory and quantum statistics to diverse fields in dynamical systems, electromagnetics, statistical signal processing, quantum information theory, quantum neural network theory, quantum filtering theory, quantum electrodynamics, quantum general relativity, string theory, problems in biology and classical and quantum fluid dynamics. The selection of the problems has been based on courses taught by the author to undergraduates and postgraduates in Electronics and Communications Engineering. Print edition not for sale in South Asia (India, Sri Lanka, Nepal, Bangladesh, Pakistan or Bhutan).

Ruin Probabilities: Smoothness, Bounds, Supermartingale Approach deals with continuous-time risk models and covers several aspects of risk theory. The first of them is the smoothness of the survival probabilities. In particular, the book provides a detailed investigation of the continuity and differentiability of the infinite-horizon and finite-horizon survival probabilities for different risk models. Next, it gives some possible applications of the results concerning the smoothness of the survival probabilities. Additionally, the book introduces the supermartingale approach, which generalizes the martingale one introduced by Gerber, to get upper exponential bounds for the infinite-horizon ruin probabilities in some generalizations of the classical risk model with risky investments.

This book contains articles arising from a conference in honour of mathematician-statistician Mikl s Csoergo on the occasion of his 80th birthday, held in Ottawa in July 2012. It comprises research papers and overview articles, which provide a substantial glimpse of the history and state-of-the-art of the field of asymptotic methods in probability and statistics, written by leading experts. The volume consists of twenty articles on topics on limit theorems for self-normalized processes, planar processes, the central limit theorem and laws of large numbers, change-point problems, short and long range dependent time series, applied probability and stochastic processes, and the theory and methods of statistics. It also includes Csoergo's list of publications during more than 50 years, since 1962.

This book provides a comprehensive up-to-date presentation of some of the classical areas of reliability, based on a more advanced probabilistic framework using the modern theory of stochastic processes. This framework allows analysts to formulate general failure models, establish formulae for computing various performance measures, as well as determine how to identify optimal replacement policies in complex situations.

In this second edition of the book, two major topics have been added to the original version: copula models which are used to study the effect of structural dependencies on the system reliability; and maintenance optimization which highlights delay time models under safety constraints.

Terje Aven is Professor of Reliability and Risk Analysis at University of Stavanger, Norway. Uwe Jensen is working as a Professor at the Institute of Applied Mathematics and Statistics of the University of Hohenheim in Stuttgart, Germany.

Review of first edition:

"This is an excellent book on mathematical, statistical and stochastic models in reliability. The authors have done an excellent job of unifying some of the stochastic models in reliability. The book is a good reference book but may not be suitable as a textbook for students in professional fields such as engineering. This book may be used for graduate level seminar courses for students who have had at least the first course in stochastic processes and some knowledge of reliability mathematics. It should be a good reference book for researchers in reliability mathematics."

--Mathematical Reviews (2000)

"

Stochastic resonance has been observed in many forms of systems, and has been hotly debated by scientists for over 30 years. Applications incorporating aspects of stochastic resonance may yet prove revolutionary in fields such as distributed sensor networks, nano-electronics, and biomedical prosthetics. Ideal for researchers in fields ranging from computational neuroscience through to electronic engineering, this book addresses in detail various theoretical aspects of stochastic quantization, in the context of the suprathreshold stochastic resonance effect. Initial chapters review stochastic resonance and outline some of the controversies and debates that have surrounded it. The book then discusses suprathreshold stochastic resonance, and its extension to more general models of stochastic signal quantization. Finally, it considers various constraints and tradeoffs in the performance of stochastic quantizers, before culminating with a chapter in the application of suprathreshold stochastic resonance to the design of cochlear implants.

A unique, integrated treatment of computer modeling and simulation "The future of science belongs to those willing to make the shift to simulation-based modeling," predicts Rice Professor James Thompson, a leading modeler and computational statistician widely known for his original ideas and engaging style. He discusses methods, available to anyone with a fast desktop computer, for integrating simulation into the modeling process in order to create meaningful models of real phenomena. Drawing from a wealth of experience, he gives examples from trading markets, oncology, epidemiology, statistical process control, physics, public policy, combat, real-world optimization, Bayesian analyses, and population dynamics. Dr. Thompson believes that, so far from liberating us from the necessity of modeling, the fast computer enables us to engage in realistic models of processes in , for example, economics, which have not been possible earlier because simple stochastic models in the forward temporal direction generally become quite unmanageably complex when one is looking for such things as likelihoods. Thompson shows how simulation may be used to bypass the necessity of obtaining likelihood functions or moment-generating functions as a precursor to parameter estimation. Simulation: A Modeler’s Approach is a provocative and practical guide for professionals in applied statistics as well as engineers, scientists, computer scientists, financial analysts, and anyone with an interest in the synergy between data, models, and the digital computer.

This simple, compact toolkit for designing and analyzing stochastic approximation algorithms requires only basic literacy in probability and differential equations. Yet these algorithms have powerful applications in control and communications engineering, artificial intelligence and economic modelling. The dynamical systems viewpoint treats an algorithm as a noisy discretization of a limiting differential equation and argues that, under reasonable hypotheses, it tracks the asymptotic behaviour of the differential equation with probability one. The differential equation, which can usually be obtained by inspection, is easier to analyze. Novel topics include finite-time behaviour, multiple timescales and asynchronous implementation. There is a useful taxonomy of applications, with concrete examples from engineering and economics. Notably it covers variants of stochastic gradient-based optimization schemes, fixed-point solvers, which are commonplace in learning algorithms for approximate dynamic programming, and some models of collective behaviour. Three appendices give background on differential equations and probability.