This book presents a treatise on the theory and modeling of second-order stationary processes, including an exposition on selected application areas that are important in the engineering and applied sciences. The foundational issues regarding stationary processes dealt with in the beginning of the book have a long history, starting in the 1940s with the work of Kolmogorov, Wiener, Cramér and his students, in particular Wold, and have since been refined and complemented by many others. Problems concerning the filtering and modeling of stationary random signals and systems have also been addressed and studied, fostered by the advent of modern digital computers, since the fundamental work of R.E. Kalman in the early 1960s. The book offers a unified and logically consistent view of the subject based on simple ideas from Hilbert space geometry and coordinate-free thinking. In this framework, the concepts of stochastic state space and state space modeling, based on the notion of the conditional independence of past and future flows of the relevant signals, are revealed to be fundamentally unifying ideas. The book, based on over 30 years of original research, represents a valuable contribution that will inform the fields of stochastic modeling, estimation, system identification, and time series analysis for decades to come. It also provides the mathematical tools needed to grasp and analyze the structures of algorithms in stochastic systems theory.

This monograph introduces methods for handling filtering and control problems in nonlinear stochastic systems arising from network-induced phenomena consequent on limited communication capacity. Such phenomena include communication delay, packet dropout, signal quantization or saturation, randomly occurring nonlinearities and randomly occurring uncertainties. The text is self-contained, beginning with an introduction to nonlinear stochastic systems, network-induced phenomena and filtering and control, moving through a collection of the latest research results which focuses on the three aspects of: * the state-of-the-art of nonlinear filtering and control; * recent advances in recursive filtering and sliding mode control; and * their potential for application in networked control systems, and concluding with some ideas for future research work. New concepts such as the randomly occurring uncertainty and the probability-constrained performance index are proposed to make the network models as realistic as possible. The power of combinations of such recent tools as the completing-the-square and sums-of-squares techniques, Hamilton-Jacobi-Isaacs matrix inequalities, difference linear matrix inequalities and parameter-dependent matrix inequalities is exploited in treating the mathematical and computational challenges arising from nonlinearity and stochasticity. Nonlinear Stochastic Systems with Network-Induced Phenomena establishes a unified framework of control and filtering which will be of value to academic researchers in bringing structure to problems associated with an important class of networked system and offering new means of solving them. The significance of the new concepts, models and methods presented for practical control engineering and signal processing will also make it a valuable reference for engineers dealing with nonlinear control and filtering problems.

The dynamics of population systems cannot be understood within the framework of ordinary differential equations, which assume that the number of interacting agents is infinite. With recent advances in ecology, biochemistry and genetics it is becoming increasingly clear that real systems are in fact subject to a great deal of noise. Relevant examples include social insects competing for resources, molecules undergoing chemical reactions in a cell and a pool of genomes subject to evolution. When the population size is small, novel macroscopic phenomena can arise, which can be analyzed using the theory of stochastic processes. This thesis is centered on two unsolved problems in population dynamics: the symmetry breaking observed in foraging populations and the robustness of spatial patterns. We argue that these problems can be resolved with the help of two novel concepts: noise-induced bistable states and stochastic patterns.

This book examines optimization problems that in practice involve random model parameters. It details the computation of robust optimal solutions, i.e., optimal solutions that are insensitive with respect to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems. Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures and differentiation formulas for probabilities and expectations. In the third edition, this book further develops stochastic optimization methods. In particular, it now shows how to apply stochastic optimization methods to the approximate solution of important concrete problems arising in engineering, economics and operations research.

This volume presents an extensive overview of all major modern trends in applications of probability and stochastic analysis. It will be a great source of inspiration for designing new algorithms, modeling procedures and experiments. Accessible to researchers, practitioners, as well as graduate and postgraduate students, this volume presents a variety of new tools, ideas and methodologies in the fields of optimization, physics, finance, probability, hydrodynamics, reliability, decision making, mathematical finance, mathematical physics and economics. Contributions to this Work include those of selected speakers from the international conference entitled "Modern Stochastics: Theory and Applications III," held on September 10 -14, 2012 at Taras Shevchenko National University of Kyiv, Ukraine. The conference covered the following areas of research in probability theory and its applications: stochastic analysis, stochastic processes and fields, random matrices, optimization methods in probability, stochastic models of evolution systems, financial mathematics, risk processes and actuarial mathematics and information security.

Considering Poisson random measures as the driving sources for stochastic (partial) differential equations allows us to incorporate jumps and to model sudden, unexpected phenomena. By using such equations the present book introduces a new method for modeling the states of complex systems perturbed by random sources over time, such as interest rates in financial markets or temperature distributions in a specific region. It studies properties of the solutions of the stochastic equations, observing the long-term behavior and the sensitivity of the solutions to changes in the initial data. The authors consider an integration theory of measurable and adapted processes in appropriate Banach spaces as well as the non-Gaussian case, whereas most of the literature only focuses on predictable settings in Hilbert spaces. The book is intended for graduate students and researchers in stochastic (partial) differential equations, mathematical finance and non-linear filtering and assumes a knowledge of the required integration theory, existence and uniqueness results and stability theory. The results will be of particular interest to natural scientists and the finance community. Readers should ideally be familiar with stochastic processes and probability theory in general, as well as functional analysis and in particular the theory of operator semigroups.

This book, which is based on several courses of lectures given by the author at the Independent University of Moscow, is devoted to Sobolev-type spaces and boundary value problems for linear elliptic partial differential equations. Its main focus is on problems in non-smooth (Lipschitz) domains for strongly elliptic systems. The author, who is a prominent expert in the theory of linear partial differential equations, spectral theory and pseudodifferential operators, has included his own very recent findings in the present book. The book is well suited as a modern graduate textbook, utilizing a thorough and clear format that strikes a good balance between the choice of material and the style of exposition. It can be used both as an introduction to recent advances in elliptic equations and boundary value problems and as a valuable survey and reference work. It also includes a good deal of new and extremely useful material not available in standard textbooks to date. Graduate and post-graduate students, as well as specialists working in the fields of partial differential equations, functional analysis, operator theory and mathematical physics will find this book particularly valuable.

In some cases, certain coherent structures can exist in stochastic dynamic systems almost in every particular realization of random parameters describing these systems. Dynamic localization in one-dimensional dynamic systems, vortexgenesis (vortex production) in hydrodynamic flows, and phenomenon of clustering of various fields in random media (i.e., appearance of small regions with enhanced content of the field against the nearly vanishing background of this field in the remaining portion of space) are examples of such structure formation. The general methodology presented in Volume 1 is used in Volume 2 Coherent Phenomena in Stochastic Dynamic Systems to expound the theory of these phenomena in some specific fields of stochastic science, among which are hydrodynamics, magnetohydrodynamics, acoustics, optics, and radiophysics. The material of this volume includes particle and field clustering in the cases of scalar (density field) and vector (magnetic field) passive tracers in a random velocity field, dynamic localization of plane waves in layered random media, as well as monochromatic wave propagation and caustic structure formation in random media in terms of the scalar parabolic equation.

This book develops the theory of continuous and discrete stochastic processes within the context of cell biology. A wide range of biological topics are covered including normal and anomalous diffusion in complex cellular environments, stochastic ion channels and excitable systems, stochastic calcium signaling, molecular motors, intracellular transport, signal transduction, bacterial chemotaxis, robustness in gene networks, genetic switches and oscillators, cell polarization, polymerization, cellular length control, and branching processes. The book also provides a pedagogical introduction to the theory of stochastic process - Fokker Planck equations, stochastic differential equations, master equations and jump Markov processes, diffusion approximations and the system size expansion, first passage time problems, stochastic hybrid systems, reaction-diffusion equations, exclusion processes, WKB methods, martingales and branching processes, stochastic calculus, and numerical methods. This text is primarily aimed at graduate students and researchers working in mathematical biology and applied mathematicians interested in stochastic modeling. Applied probabilists and theoretical physicists should also find it of interest. It assumes no prior background in statistical physics and introduces concepts in stochastic processes via motivating biological applications. The book is highly illustrated and contains a large number of examples and exercises that further develop the models and ideas in the body of the text. It is based on a course that the author has taught at the University of Utah for many years.

This volume highlights the main results of the research performed within the network "Harmonic and Complex Analysis and its Applications" (HCAA), which was a five-year (2007-2012) European Science Foundation Programme intended to explore and to strengthen the bridge between two scientific communities: analysts with broad backgrounds in complex and harmonic analysis and mathematical physics, and specialists in physics and applied sciences. It coordinated actions for advancing harmonic and complex analysis and for expanding its application to challenging scientific problems. Particular topics considered by this Programme included conformal and quasiconformal mappings, potential theory, Banach spaces of analytic functions and their applications to the problems of fluid mechanics, conformal field theory, Hamiltonian and Lagrangian mechanics, and signal processing. This book is a collection of surveys written as a result of activities of the Programme and will be interesting and useful for professionals and novices in analysis and mathematical physics, as well as for graduate students. Browsing the volume, the reader will undoubtedly notice that, as the scope of the Programme is rather broad, there are many interrelations between the various contributions, which can be regarded as different facets of a common theme.

This book studies some of the groundbreaking advances that have been made regarding analytic capacity and its relationship to rectifiability in the decade 1995-2005. The Cauchy transform plays a fundamental role in this area and is accordingly one of the main subjects covered. Another important topic, which may be of independent interest for many analysts, is the so-called non-homogeneous Calderon-Zygmund theory, the development of which has been largely motivated by the problems arising in connection with analytic capacity. The Painleve problem, which was first posed around 1900, consists in finding a description of the removable singularities for bounded analytic functions in metric and geometric terms. Analytic capacity is a key tool in the study of this problem. In the 1960s Vitushkin conjectured that the removable sets which have finite length coincide with those which are purely unrectifiable. Moreover, because of the applications to the theory of uniform rational approximation, he posed the question as to whether analytic capacity is semiadditive. This work presents full proofs of Vitushkin's conjecture and of the semiadditivity of analytic capacity, both of which remained open problems until very recently. Other related questions are also discussed, such as the relationship between rectifiability and the existence of principal values for the Cauchy transforms and other singular integrals. The book is largely self-contained and should be accessible for graduate students in analysis, as well as a valuable resource for researchers.

Offering a viable solution to the long-standing problem of estimating the abundance of rare, clustered populations, adaptive sampling designs are rapidly gaining prominence in the natural and social sciences as well as in other fields with inherently difficult sampling situations. In marked contrast to conventional sampling designs, in which the entire sample of units to be observed is fixed prior to the survey, adaptive sampling strategies allow for increased sampling intensity depending upon observations made during the survey. For example, in a survey to assess the abundance of a rare animal species, neighboring sites may be added to the sample whenever the species is encountered during the survey. In an epidemiological survey of a contagious or genetically linked disease, sampling intensity may be increased whenever prevalence of the disease is encountered.

Written by two acknowledged experts in this emerging field, this book offers researchers their first comprehensive introduction to adaptive sampling. An ideal reference for statisticians conducting research in survey designs and spatial statistics as well as researchers working in the environmental, ecological, public health, and biomedical sciences.

Adaptive Sampling:

• Provides a comprehensive, fully integrated introduction to adaptive sampling theory and practice
• Describes recent research findings
• Introduces readers to a wide range of adaptive sampling strategies and techniques
• Includes numerous real-world examples from environmental pollution studies, surveys of rare animal and plant species, studies of contagious diseases, marketing surveys, mineral and fossil-fuel assessments, and more

A unified methodology for categorizing various complex objects is presented in this book. Through probability theory, novel asymptotically minimax criteria suitable for practical applications in imaging and data analysis are examined including the special cases such as the Jensen-Shannon divergence and the probabilistic neural network. An optimal approximate nearest neighbor search algorithm, which allows faster classification of databases is featured. Rough set theory, sequential analysis and granular computing are used to improve performance of the hierarchical classifiers. Practical examples in face identification (including deep neural networks), isolated commands recognition in voice control system and classification of visemes captured by the Kinect depth camera are included. This approach creates fast and accurate search procedures by using exact probability densities of applied dissimilarity measures. This book can be used as a guide for independent study and as supplementary material for a technically oriented graduate course in intelligent systems and data mining. Students and researchers interested in the theoretical and practical aspects of intelligent classification systems will find answers to: - Why conventional implementation of the naive Bayesian approach does not work well in image classification? - How to deal with insufficient performance of hierarchical classification systems? - Is it possible to prevent an exhaustive search of the nearest neighbor in a database?

The concept of a system as an entity in its own right has emerged with increasing force in the past few decades in, for example, the areas of electrical and control engineering, economics, ecology, urban structures, automaton theory, operational research and industry. The more definite concept of a large-scale system is implicit in these applications, but is particularly evident in fields such as the study of communication networks, computer networks and neural networks. The Wiley-Interscience Series in Systems and Optimization has been established to serve the needs of researchers in these rapidly developing fields. It is intended for works concerned with developments in quantitative systems theory, applications of such theory in areas of interest, or associated methodology. Of related interest Stochastic Programming Peter Kall, University of ZA1/4rich, Switzerland and Stein W. Wallace, University of Trondheim, Norway Stochastic Programming is the first textbook to provide a thorough and self-contained introduction to the subject. Carefully written to cover all necessary background material from both linear and non-linear programming, as well as probability theory, the book draws together the methods and techniques previously described in disparate sources. After introducing the terms and modelling issues when randomness is introduced in a deterministic mathematical programming model, the authors cover decision trees and dynamic programming, recourse problems, probabilistic constraints, preprocessing and network problems. Exercises are provided at the end of each chapter. Throughout, the emphasis is on the appropriate use of the techniques, rather than on the underlying mathematicalproofs and theories, making the book ideal for researchers and students in mathematical programming and operations research who wish to develop their skills in stochastic programming.

This book explores discrete-time dynamic optimization and provides a detailed introduction to both deterministic and stochastic models. Covering problems with finite and infinite horizon, as well as Markov renewal programs, Bayesian control models and partially observable processes, the book focuses on the precise modelling of applications in a variety of areas, including operations research, computer science, mathematics, statistics, engineering, economics and finance. Dynamic Optimization is a carefully presented textbook which starts with discrete-time deterministic dynamic optimization problems, providing readers with the tools for sequential decision-making, before proceeding to the more complicated stochastic models. The authors present complete and simple proofs and illustrate the main results with numerous examples and exercises (without solutions). With relevant material covered in four appendices, this book is completely self-contained.

Focusing on stochastic porous media equations, this book places an emphasis on existence theorems, asymptotic behavior and ergodic properties of the associated transition semigroup. Stochastic perturbations of the porous media equation have reviously been considered by physicists, but rigorous mathematical existence results have only recently been found. The porous media equation models a number of different physical phenomena, including the flow of an ideal gas and the diffusion of a compressible fluid through porous media, and also thermal propagation in plasma and plasma radiation. Another important application is to a model of the standard self-organized criticality process, called the "sand-pile model" or the "Bak-Tang-Wiesenfeld model". The book will be of interest to PhD students and researchers in mathematics, physics and biology.

The objective of this book is to introduce the elements of stochastic processes in a rather concise manner where we present the two most important parts - Markov chains and stochastic analysis. The readers are led directly to the core of the main topics to be treated in the context. Further details and additional materials are left to a section containing abundant exercises for further reading and studying.In the part on Markov chains, the focus is on the ergodicity. By using the minimal nonnegative solution method, we deal with the recurrence and various types of ergodicity. This is done step by step, from finite state spaces to denumerable state spaces, and from discrete time to continuous time. The methods of proofs adopt modern techniques, such as coupling and duality methods. Some very new results are included, such as the estimate of the spectral gap. The structure and proofs in the first part are rather different from other existing textbooks on Markov chains.In the part on stochastic analysis, we cover the martingale theory and Brownian motions, the stochastic integral and stochastic differential equations with emphasis on one dimension, and the multidimensional stochastic integral and stochastic equation based on semimartingales. We introduce three important topics here: the Feynman-Kac formula, random time transform and Girsanov transform. As an essential application of the probability theory in classical mathematics, we also deal with the famous Brunn-Minkowski inequality in convex geometry.This book also features modern probability theory that is used in different fields, such as MCMC, or even deterministic areas: convex geometry and number theory. It provides a new and direct routine for students going through the classical Markov chains to the modern stochastic analysis.

An extension problem (often called a boundary problem) of Markov processes has been studied, particularly in the case of one-dimensional diffusion processes, by W. Feller, K. Ito, and H. P. McKean, among others. In this book, Ito discussed a case of a general Markov process with state space S and a specified point a S called a boundary. The problem is to obtain all possible recurrent extensions of a given minimal process (i.e., the process on S \ {a} which is absorbed on reaching the boundary a). The study in this lecture is restricted to a simpler case of the boundary a being a discontinuous entrance point, leaving a more general case of a continuous entrance point to future works. He established a one-to-one correspondence between a recurrent extension and a pair of a positive measure k(db) on S \ {a} (called the jumping-in measure and a non-negative number m< (called the stagnancy rate). The necessary and sufficient conditions for a pair k, m was obtained so that the correspondence is precisely described. For this, Ito used, as a fundamental tool, the notion of Poisson point processes formed of all excursions of the process on S \ {a}. This theory of Ito's of Poisson point processes of excursions is indeed a breakthrough. It has been expanded and applied to more general extension problems by many succeeding researchers. Thus we may say that this lecture note by Ito is really a memorial work in the extension problems of Markov processes. Especially in Chapter 1 of this note, a general theory of Poisson point processes is given that reminds us of Ito's beautiful and impressive lectures in his day.

The analysis of PDEs is a prominent discipline in mathematics research, both in terms of its theoretical aspects and its relevance in applications. In recent years, the geometric properties of linear and nonlinear second order PDEs of elliptic and parabolic type have been extensively studied by many outstanding researchers. This book collects contributions from a selected group of leading experts who took part in the INdAM meeting "Geometric methods in PDEs", on the occasion of the 70th birthday of Ermanno Lanconelli. They describe a number of new achievements and/or the state of the art in their discipline of research, providing readers an overview of recent progress and future research trends in PDEs. In particular, the volume collects significant results for sub-elliptic equations, potential theory and diffusion equations, with an emphasis on comparing different methodologies and on their implications for theory and applications.

This introduction to random walks on infinite graphs gives particular emphasis to graphs with polynomial volume growth. It offers an overview of analytic methods, starting with the connection between random walks and electrical resistance, and then proceeding to study the use of isoperimetric and Poincare inequalities. The book presents rough isometries and looks at the properties of a graph that are stable under these transformations. Applications include the 'type problem': determining whether a graph is transient or recurrent. The final chapters show how geometric properties of the graph can be used to establish heat kernel bounds, that is, bounds on the transition probabilities of the random walk, and it is proved that Gaussian bounds hold for graphs that are roughly isometric to Euclidean space. Aimed at graduate students in mathematics, the book is also useful for researchers as a reference for results that are hard to find elsewhere.

In recent years, random variables and stochastic processes have emerged as important factors in predicting outcomes in virtually every field of applied and social science. Ironically, according to Nicolas Bouleau and Dominique Lepingle, the presence of randomness in the model sometimes leads engineers to accept crude mathematical treatments that produce inaccurate results. The purpose of Numerical Methods for Stochastic Processes is to add greater rigor to numerical treatment of stochastic processes so that they produce results that can be relied upon when making decisions and assessing risks. Based on a postgraduate course given by the authors at Paris 6 University, the text emphasizes simulation methods, which can now be implemented with specialized computer programs. Specifically presented are the Monte Carlo and shift methods, which use an "imitation of randomness" and have a wide range of applications, and the so-called quasi-Monte Carlo methods, which are rigorous but less widely applicable. Offering a broad introduction to the field, this book presents the current state of the main methods and ideas and the cases for which they have been proved. Nevertheless, the authors do explore problems raised by these newer methods and suggest areas in which further research is needed. Extensive notes and a full bibliography give interested readers the option of delving deeper into stochastic numerical analysis. For professional statisticians, engineers, and physical and social scientists, Numerical Methods for Stochastic Processes provides both the theoretical background and the necessary practical tools to improve predictions based on randomness in the model. With its exercises andbroad-spectrum coverage, it is also an excellent textbook for introductory graduate-level courses in stochastic process mathematics.

This book introduces several topics related to linear model theory, including: multivariate linear models, discriminant analysis, principal components, factor analysis, time series in both the frequency and time domains, and spatial data analysis. This second edition adds new material on nonparametric regression, response surface maximization, and longitudinal models. The book provides a unified approach to these disparate subjects and serves as a self-contained companion volume to the author's Plane Answers to Complex Questions: The Theory of Linear Models. Ronald Christensen is Professor of Statistics at the University of New Mexico. He is well known for his work on the theory and application of linear models having linear structure.

Algorithm Issues and Challenges Associated with the Development of Robust CFD Codes.- Flight Path Optimization at Constant Altitude.- A survey on the Newton problem of optimal profiles.- Innovative Rotor Blade Design Code.- Fields of Extremals and Sufficient Conditions for the Simplest Problem of the Calculus of Variations in -Variables.- A Framework for Aerodynamic Shape Optimization.- Optimal Motions of Multibody Systems in Resistive Media.- Instationary Heat-Constrained Trajectory Optimization of a Hypersonic Space Vehicle by ODE#x2013;PDE-Constrained Optimal Control.- Variational Approaches to Fracture.- On the Problem of Synchronization of Identical Dynamical Systems: The Huygens#x2019;s Clocks.- Best wing system: an exact solution of the Prandtl#x2019;s problem.- Numerical simulation of the dynamics of boats by a variational inequality approach.- Concepts of Active Noise Aircraft Cockpits Reduction Employed in High Noise Level.- Lekhnitskii#x2019;s Formalism for Stress Concentrations Around Irregularities in Anisotropic Plates: Solutions for Arbitrary Boundary Conditions.- Best Initial Conditions for the Rendezvous Maneuver.- Commercial Aircraft Design for Reduced Noise and Environmental Impact.- Variational Approach to the Problem of the Minimum Induced Drag of Wings.- Plastic Hinges in a Beam.- Problems of Minimal and Maximal Aerodynamic Resistance..- Shock Optimization for Airfoil Design Problems.- Differential Games Treated by a Gradient#x2013;Restoration Approach.- Interval Methods for Optimal Control.- Application of Optimisation Algorithms to Aircraft Aerodynamics.- Different levels of Optimization in Aircraft Design.- Numerical and Analytical Methods for Global Optimization.- The Aeroservoelasticity Qualification Process in Alenia.- Further Steps towards Quantitative Conceptual Aircraft Design.- Some Plebeian Variational Problems.

This textbook presents an exposition of stochastic dynamics and irreversibility. It comprises the principles of probability theory and the stochastic dynamics in continuous spaces, described by Langevin and Fokker-Planck equations, and in discrete spaces, described by Markov chains and master equations. Special concern is given to the study of irreversibility, both in systems that evolve to equilibrium and in nonequilibrium stationary states. Attention is also given to the study of models displaying phase transitions and critical phenomena both in thermodynamic equilibrium and out of equilibrium. These models include the linear Glauber model, the Glauber-Ising model, lattice models with absorbing states such as the contact process and those used in population dynamic and spreading of epidemic, probabilistic cellular automata, reaction-diffusion processes, random sequential adsorption and dynamic percolation. A stochastic approach to chemical reaction is also presented.The textbook is intended for students of physics and chemistry and for those interested in stochastic dynamics. It provides, by means of examples and problems, a comprehensive and detailed explanation of the theory and its applications.

The book develops modern methods and in particular the "generic chaining" to bound stochastic processes. This methods allows in particular to get optimal bounds for Gaussian and Bernoulli processes. Applications are given to stable processes, infinitely divisible processes, matching theorems, the convergence of random Fourier series, of orthogonal series, and to functional analysis. The complete solution of a number of classical problems is given in complete detail, and an ambitious program for future research is laid out.