A unique interdisciplinary foundation for real-world problem solving

Stochastic search and optimization techniques are used in a vast number of areas, including aerospace, medicine, transportation, and finance, to name but a few. Whether the goal is refining the design of a missile or aircraft, determining the effectiveness of a new drug, developing the most efficient timing strategies for traffic signals, or making investment decisions in order to increase profits, stochastic algorithms can help researchers and practitioners devise optimal solutions to countless real-world problems.

Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control is a graduate-level introduction to the principles, algorithms, and practical aspects of stochastic optimization, including applications drawn from engineering, statistics, and computer science. The treatment is both rigorous and broadly accessible, distinguishing this text from much of the current literature and providing students, researchers, and practitioners with a strong foundation for the often-daunting task of solving real-world problems.

The text covers a broad range of today’s most widely used stochastic algorithms, including:

• Random search
• Recursive linear estimation
• Stochastic approximation
• Simulated annealing
• Genetic and evolutionary methods
• Machine (reinforcement) learning
• Model selection
• Simulation-based optimization
• Markov chain Monte Carlo
• Optimal experimental design

The book includes over 130 examples, Web links to software and data sets, more than 250 exercises for the reader, and an extensive list of references. These features help make the text an invaluable resource for those interested in the theory or practice of stochastic search and optimization.

Reliability theory is of fundamental importance for engineers and managers involved in the manufacture of high-quality products and the design of reliable systems. In order to make sense of the theory, however, and to apply it to real systems, an understanding of the basic stochastic processes is indispensable. As well as providing readers with useful reliability studies and applications, Stochastic Processes also gives a basic treatment of such stochastic processes as: the Poisson process, the renewal process, the Markov chain, the Markov process, and the Markov renewal process. Many examples are cited from reliability models to show the reader how to apply stochastic processes. Furthermore, Stochastic Processes gives a simple introduction to other stochastic processes such as the cumulative process, the Wiener process, the Brownian motion and reliability applications. Stochastic Processes is suitable for use as a reliability textbook by advanced undergraduate and graduate students. It is also of interest to researchers, engineers and managers who study or practise reliability and maintenance.

Performance optimization is vital in the design and operation of modern engineering systems, including communications, manufacturing, robotics, and logistics. Most engineering systems are too complicated to model, or the system parameters cannot be easily identified, so learning techniques have to be applied. This book provides a unified framework based on a sensitivity point of view. It also introduces new approaches and proposes new research topics within this sensitivity-based framework. This new perspective on a popular topic is presented by a well respected expert in the field.

This volume offers a collection of carefully selected, peer-reviewed papers presented at the BIOMAT 2018 International Symposium, which was held at the University Hassan II, Morocco, from October 29th to November 2nd, 2018. The topics covered include applications of mathematical modeling in hepatitis B, HIV and Chikungunya infections; tumor cell dynamics; inflammatory processes; chemotherapeutic drug effects; and population dynamics. Also discussing the application of techniques like the generalized stochastic Milevsky-Promislov model, numerical simulations and convergence of discrete and continuous models, it is an invaluable resource on interdisciplinary research in mathematical biology for students, researchers, and professionals. Held every year since 2001, the BIOMAT International Symposium gathers together, in a single conference, researchers from Mathematics, Physics, Biology, and affine fields to promote the interdisciplinary exchange of results, ideas and techniques, promoting truly international cooperation for problem discussion. The 2018 edition of BIOMAT International Symposium received contributions by authors from seventeen countries: Algeria, Brazil, Cameroon, Canada, Chad, Colombia, France, Germany, Hungary, Italy, Mali, Morocco, Nigeria, Poland, Portugal, Russia, and Senegal. Selected papers presented at the 2017 edition of this Symposium were also published by Springer, in the volume "Trends in Biomathematics: Modeling, Optimization and Computational Problems" (978-3-319-91091-8).

One of the main aims of this book is to exhibit some fruitful links between renewal theory and regular variation of functions. Applications of renewal processes play a key role in actuarial and financial mathematics as well as in engineering, operations research and other fields of applied mathematics. On the other hand, regular variation of functions is a property that features prominently in many fields of mathematics. The structure of the book reflects the historical development of the authors' research work and approach - first some applications are discussed, after which a basic theory is created, and finally further applications are provided. The authors present a generalized and unified approach to the asymptotic behavior of renewal processes, involving cases of dependent inter-arrival times. This method works for other important functionals as well, such as first and last exit times or sojourn times (also under dependencies), and it can be used to solve several other problems. For example, various applications in function analysis concerning Abelian and Tauberian theorems can be studied as well as those in studies of the asymptotic behavior of solutions of stochastic differential equations. The classes of functions that are investigated and used in a probabilistic context extend the well-known Karamata theory of regularly varying functions and thus are also of interest in the theory of functions. The book provides a rigorous treatment of the subject and may serve as an introduction to the field. It is aimed at researchers and students working in probability, the theory of stochastic processes, operations research, mathematical statistics, the theory of functions, analytic number theory and complex analysis, as well as economists with a mathematical background. Readers should have completed introductory courses in analysis and probability theory.

Selected papers submitted by participants of the international Conference "Stochastic Analysis and Applied Probability 2010" ( www.saap2010.org ) make up the basis of this volume.

The SAAP 2010 was held in Tunisia, from 7-9 October, 2010, and was organized by the "Applied Mathematics & Mathematical Physics" research unit of the preparatory institute to the military academies of Sousse (Tunisia), chaired by Mounir Zili.

The papers cover theoretical, numerical and applied aspects of stochastic processes and stochastic differential equations. The study of such topic is motivated in part by the need to model, understand, forecast and control the behavior of many natural phenomena that evolve in time in a random way. Such phenomena appear in the fields of finance, telecommunications, economics, biology, geology, demography, physics, chemistry, signal processing and modern control theory, to mention just a few.

As this book emphasizes the importance of numerical and theoretical studies of the stochastic differential equations and stochastic processes, it will be useful for a wide spectrum of researchers in applied probability, stochastic numerical and theoretical analysis and statistics, as well as for graduate students.

To make it more complete and accessible for graduate students, practitioners and researchers, the editors Mounir Zili and Daria Filatova have included a survey dedicated to the basic concepts of numerical analysis of the stochastic differential equations, written by Henri Schurz.

Concentration inequalities, which express the fact that certain complicated random variables are almost constant, have proven of utmost importance in many areas of probability and statistics. This volume contains refined versions of these inequalities, and their relationship to many applications particularly in stochastic analysis. The broad range and the high quality of the contributions make this book highly attractive for graduates, postgraduates and researchers in the above areas.

Over the last years, stochastic analysis has had an enormous progress with the impetus originating from different branches of mathematics: PDE's and the Malliavin calculus, quantum physics, path space analysis on curved manifolds via probabilistic methods, and more.

This volume contains selected contributions which were presented at the 8th Silivri Workshop on Stochastic Analysis and Related Topics, held in September 2000 in Gazimagusa, North Cyprus.

The topics include stochastic control theory, generalized functions in a nonlinear setting, tangent spaces of manifold-valued paths with quasi-invariant measures, and applications in game theory, theoretical biology and theoretical physics.

Contributors: A.E. Bashirov, A. Bensoussan and J. Frehse, U. Capar and H. Aktuglul, A.B. Cruzeiro and Kai-Nan Xiang, E. Hausenblas, Y. Ishikawa, N. Mahmudov, P. Malliavin and U. Taneri, N. Privault, A.S. Ustunel"

sections dealing with fuzzy functions and fuzzy random functions are certain to be of special interest. The reader is expected to be in command of the knowledge gained in a basic university mathematics course, with the inclusion of stochastic elements. A specification of uncertainty in any particular case is often difficult. For this reason Chaps. 3 and 4 are devoted solely to this problem. The derivation of fuzzy variables for representing informal and lexical uncertainty reflects the subjective assessment of objective conditions in the form of a membership function. Techniques for modeling fuzzy random variables are presented for data that simultaneously exhibit stochastic and nonstochastic properties. The application of fuzzy randomness is demonstrated in three fields of civil engineering and computational mechanics: structural analysis, safety assessment, and design. The methods of fuzzy structural analysis and fuzzy probabilistic structural analysis developed in Chap. 5 are applicable without restriction to arbitrary geometrically and physically nonlinear problems. The most important forms of the latter are the Fuzzy Finite Element Method (FFEM) and the Fuzzy Stochastic Finite Element Method (FSFEM).

A 'stochastic' process is a 'random' or 'conjectural' process, and this book is concerned with applied probability and statistics. Whilst maintaining the mathematical rigour this subject requires, it addresses topics of interest to engineers, such as problems in modelling, control, reliability maintenance, data analysis and engineering involvement with insurance.
This book deals with the tools and techniques used in the stochastic process - estimation, optimisation and recursive logarithms - in a form accessible to engineers and which can also be applied to Matlab.
Amongst the themes covered in the chapters are mathematical expectation arising from increasing information patterns, the estimation of probability distribution, the treatment of distribution of real random phenomena (in engineering, economics, biology and medicine etc), and expectation maximisation. The latter part of the book considers optimization algorithms, which can be used, for example, to help in the better utilization of resources, and stochastic approximation algorithms, which can provide prototype models in many practical applications.
*An engineering approach to applied probabilities and statistics
*Presents examples related to practical engineering applications, such as reliability, randomness and use of resources
*Readers with varying interests and mathematical backgrounds will find this book accessible

This volume presents a collection of papers covering applications from a wide range of systems with infinitely many degrees of freedom studied using techniques from stochastic and infinite dimensional analysis, e.g. Feynman path integrals, the statistical mechanics of polymer chains, complex networks, and quantum field theory. Systems of infinitely many degrees of freedom create their particular mathematical challenges which have been addressed by different mathematical theories, namely in the theories of stochastic processes, Malliavin calculus, and especially white noise analysis. These proceedings are inspired by a conference held on the occasion of Prof. Ludwig Streit's 75th birthday and celebrate his pioneering and ongoing work in these fields.

The book presents a thorough development of the modern theory of stochastic approximation or recursive stochastic algorithms for both constrained and unconstrained problems. There is a complete development of both probability one and weak convergence methods for very general noise processes. The proofs of convergence use the ODE method, the most powerful to date, with which the asymptotic behavior is characterized by the limit behavior of a mean ODE. The assumptions and proof methods are designed to cover the needs of recent applications. The development proceeds from simple to complex problems, allowing the underlying ideas to be more easily understood. Rate of convergence, iterate averaging, high-dimensional problems, stability-ODE methods, two time scale, asynchronous and decentralized algorithms, general correlated and state-dependent noise, perturbed test function methods, and large devitations methods, are covered. Many motivational examples from learning theory, ergodic cost problems for discrete event systems, wireless communications, adaptive control, signal processing, and elsewhere, illustrate the application of the theory. This second edition is a thorough revision, although the main features and the structure remain unchanged. It contains many additional applications and results, and more detailed discussion. Harold J. Kushner is a University Professor and Professor of Applied Mathematics at Brown University. He has written numerous books and articles on virtually all aspects of stochastic systems theory, and has received various awards including the IEEE Control Systems Field Award.

This graduate-level text covers modeling, programming and analysis of simulation experiments and provides a rigorous treatment of the foundations of simulation and why it works. It introduces object-oriented programming for simulation, covers both the probabilistic and statistical basis for simulation in a rigorous but accessible manner (providing all necessary background material); and provides a modern treatment of experiment design and analysis that goes beyond classical statistics. The book emphasizes essential foundations throughout, rather than providing a compendium of algorithms and theorems and prepares the reader to use simulation in research as well as practice.

The book is a rigorous, but concise treatment, emphasizing lasting principles but also providing specific training in modeling, programming and analysis. In addition to teaching readers how to do simulation, it also prepares them to use simulation in their research; no other book does this. An online solutions manual for end of chapter exercises is also be provided. "

Sampling-based computational methods have become a fundamental part of the numerical toolset of practitioners and researchers across an enormous number of different applied domains and academic disciplines. This book provides a broad treatment of such sampling-based methods, as well as accompanying mathematical analysis of the convergence properties of the methods discussed. The reach of the ideas is illustrated by discussing a wide range of applications and the models that have found wide usage. The first half of the book focuses on general methods; the second half discusses model-specific algorithms. Exercises and illustrations are included.

This book presents a treatise on the theory and modeling of second-order stationary processes, including an exposition on selected application areas that are important in the engineering and applied sciences. The foundational issues regarding stationary processes dealt with in the beginning of the book have a long history, starting in the 1940s with the work of Kolmogorov, Wiener, Cramer and his students, in particular Wold, and have since been refined and complemented by many others. Problems concerning the filtering and modeling of stationary random signals and systems have also been addressed and studied, fostered by the advent of modern digital computers, since the fundamental work of R.E. Kalman in the early 1960s. The book offers a unified and logically consistent view of the subject based on simple ideas from Hilbert space geometry and coordinate-free thinking. In this framework, the concepts of stochastic state space and state space modeling, based on the notion of the conditional independence of past and future flows of the relevant signals, are revealed to be fundamentally unifying ideas. The book, based on over 30 years of original research, represents a valuable contribution that will inform the fields of stochastic modeling, estimation, system identification, and time series analysis for decades to come. It also provides the mathematical tools needed to grasp and analyze the structures of algorithms in stochastic systems theory.

Networks of Learning Automata: Techniques for Online Stochastic Optimization is a comprehensive account of learning automata models with emphasis on multiautomata systems. It considers synthesis of complex learning structures from simple building blocks and uses stochastic algorithms for refining probabilities of selecting actions. Mathematical analysis of the behavior of games and feedforward networks is provided. Algorithms considered here can be used for online optimization of systems based on noisy measurements of performance index. Also, algorithms that assure convergence to the global optimum are presented. Parallel operation of automata systems for improving speed of convergence is described. The authors also include extensive discussion of how learning automata solutions can be constructed in a variety of applications.

Dedicated to the Russian mathematician Albert Shiryaev on his 70th birthday, this is a collection of papers written by his former students, co-authors and colleagues. The book represents the modern state of art of a quickly maturing theory and will be an essential source and reading for researchers in this area. Diversity of topics and comprehensive style of the papers make the book attractive for PhD students and young researchers.

This book adresses the needs of both researchers and practitioners. It combines a rigorous overview of the mathematics of financial markets with an insight into the practical application of these models to the risk and portfolio management of interest-rate derivatives. It can also serve as a valuable textbook for graduate and PhD students in mathematics who want to get some knowledge about financial markets. The first part of the book is an exposition of advanced stochastic calculus. It defines the theoretical framework for the pricing and hedging of contingent claims with a special focus on interest-rate markets. The second part covers a selection of short and long-term oriented risk measures as well as their application to the risk management of interest -rate portfolios. Interesting and comprehensive case studies are provided to illustrate the theoretical concepts.

This monograph is intended to be a complete treatment of the metrical the ory of the (regular) continued fraction expansion and related representations of real numbers. We have attempted to give the best possible results known so far, with proofs which are the simplest and most direct. The book has had a long gestation period because we first decided to write it in March 1994. This gave us the possibility of essentially improving the initial versions of many parts of it. Even if the two authors are different in style and approach, every effort has been made to hide the differences. Let 0 denote the set of irrationals in I = [0,1]. Define the (reg ular) continued fraction transformation T by T (w) = fractional part of n 1/w, w E O. Write T for the nth iterate of T, n E N = {O, 1, ... }, n 1 with TO = identity map. The positive integers an(w) = al(T - (W)), n E N+ = {1,2*** }, where al(w) = integer part of 1/w, w E 0, are called the (regular continued fraction) digits of w. Writing . for arbitrary indeterminates Xi, 1 :::; i :::; n, we have w = lim [al(w),*** , an(w)], w E 0, n--->oo thus explaining the name of T. The above equation will be also written as w = lim [al(w), a2(w),***], w E O.

The numerical analysis of stochastic differential equations (SDEs) differs significantly from that of ordinary differential equations. This book provides an easily accessible introduction to SDEs, their applications and the numerical methods to solve such equations.

From the reviews:

"The authors draw upon their own research and experiences in obviously many disciplines... considerable time has obviously been spent writing this in the simplest language possible." --ZAMP

Stochastic switching systems represent an interesting class of systems that can be used to model a variety of systems having abrupt random changes in their dynamics. Such systems may be found in the fields of manufacturing, communications, aerospace, power, and economics. This work presents stochastic switching systems and provides up-to-date methods and techniques for the analysis and design of various control systems with or without uncertainties. An introductory chapter highlights basic concepts and practical models, which are then used to solve more advanced problems throughout the book. Included are many numerical examples as well as LMI analysis methods and design approaches to supplement the developed results. Stochastic Switching Systems may be used as a supplementary textbook for graduate-level engineering courses, or as a reference for control engineers, graduate students, and researchers in systems and control. Prerequisites include elementary courses in matrix theory, probability, optimization techniques, and control systems theory.

This book compiles and critically discusses modern engineering system degradation models and their impact on engineering decisions. In particular, the authors focus on modeling the uncertain nature of degradation considering both conceptual discussions and formal mathematical formulations. It also describes the basics concepts and the various modeling aspects of life-cycle analysis (LCA). It highlights the role of degradation in LCA and defines optimum design and operation parameters. Given the relationship between operational decisions and the performance of the system's condition over time, maintenance models are also discussed. The concepts and models presented have applications in a large variety of engineering fields such as Civil, Environmental, Industrial, Electrical and Mechanical engineering. However, special emphasis is given to problems related to large infrastructure systems. The book is intended to be used both as a reference resource for researchers and practitioners and as an academic text for courses related to risk and reliability, infrastructure performance modeling and life-cycle assessment.

This book, which is based on several courses of lectures given by the author at the Independent University of Moscow, is devoted to Sobolev-type spaces and boundary value problems for linear elliptic partial differential equations. Its main focus is on problems in non-smooth (Lipschitz) domains for strongly elliptic systems. The author, who is a prominent expert in the theory of linear partial differential equations, spectral theory and pseudodifferential operators, has included his own very recent findings in the present book. The book is well suited as a modern graduate textbook, utilizing a thorough and clear format that strikes a good balance between the choice of material and the style of exposition. It can be used both as an introduction to recent advances in elliptic equations and boundary value problems and as a valuable survey and reference work. It also includes a good deal of new and extremely useful material not available in standard textbooks to date. Graduate and post-graduate students, as well as specialists working in the fields of partial differential equations, functional analysis, operator theory and mathematical physics will find this book particularly valuable.

Stochastic differential equations (SDEs) are a powerful tool in science, mathematics, economics and finance. This book will help the reader to master the basic theory and learn some applications of SDEs. In particular, the reader will be provided with the backward SDE technique for use in research when considering financial problems in the market, and with the reflecting SDE technique to enable study of optimal stochastic population control problems. These two techniques are powerful and efficient, and can also be applied to research in many other problems in nature, science and elsewhere.

The theory of stochastic processes, for science and engineering, can be considered as an extension of probability theory allowing modeling of the evolution of systems over time. The modern theory of Markov processes has its origins in the studies of A.A. Markov (1856-1922) on sequences of experiments "connected in a chain" and in the attempts to describe mathematically the physical phenomenon Brownian motion. The theory of stochastic processes entered in a period of intensive development when the idea of Markov property was brought in. This book is a modern overall view of semi-Markov processes and its applications in reliability. It is accessible to readers with a first course in Probability theory (including the basic notions of Markov chain). The text contains many examples which aid in the understanding of the theoretical notions and shows how to apply them to concrete physical situations including algorithmic simulations. Many examples of the concrete applications in reliability are given. Features: * Processes associated to semi-Markov kernel for general and discrete state spaces * Asymptotic theory of processes and of additive functionals * Statistical estimation of semi-Markov kernel and of reliability function * Monte Carlo simulation * Applications in reliability and maintenance The book is a valuable resource for understanding the latest developments in Semi-Markov Processes and reliability. Practitioners, researchers and professionals in applied mathematics, control and engineering who work in areas of reliability, lifetime data analysis, statistics, probability, and engineering will find this book an up-to-date overview of the field.