An extension problem (often called a boundary problem) of Markov processes has been studied, particularly in the case of one-dimensional diffusion processes, by W. Feller, K. Ito, and H. P. McKean, among others. In this book, Ito discussed a case of a general Markov process with state space S and a specified point a S called a boundary. The problem is to obtain all possible recurrent extensions of a given minimal process (i.e., the process on S \ {a} which is absorbed on reaching the boundary a). The study in this lecture is restricted to a simpler case of the boundary a being a discontinuous entrance point, leaving a more general case of a continuous entrance point to future works. He established a one-to-one correspondence between a recurrent extension and a pair of a positive measure k(db) on S \ {a} (called the jumping-in measure and a non-negative number m< (called the stagnancy rate). The necessary and sufficient conditions for a pair k, m was obtained so that the correspondence is precisely described. For this, Ito used, as a fundamental tool, the notion of Poisson point processes formed of all excursions of the process on S \ {a}. This theory of Ito's of Poisson point processes of excursions is indeed a breakthrough. It has been expanded and applied to more general extension problems by many succeeding researchers. Thus we may say that this lecture note by Ito is really a memorial work in the extension problems of Markov processes. Especially in Chapter 1 of this note, a general theory of Poisson point processes is given that reminds us of Ito's beautiful and impressive lectures in his day.

Wiley-Interscience Series in Discrete Mathematics and Optimization Advisory Editors Ronald L. Graham Jan Karel Lenstra Robert E. Tarjan Discrete Mathematics and Optimization involves the study of finite structures. It is one of the fastest growing areas in mathematics today. The level and depth of recent advances in the area and the wide applicability of its evolving techniques point to the rapidity with which the field is moving from its beginnings to maturity and presage the ever-increasing interaction between it and computer science. The Series provides a broad coverage of discrete mathematics and optimization, ranging over such fields as combinatorics, graph theory, enumeration, mathematical programming and the analysis of algorithms, and including such topics as Ramsey theory, transversal theory, block designs, finite geometries, Polya theory, graph and matroid algorithms, network flows, polyhedral combinatorics and computational complexity. The Wiley - Interscience Series in Discrete Mathematics and Optimization will be a substantial part of the record of this extraordinary development. Recent titles in the Series: Search Problems Rudolf Ahlswede, University of Bielefeld, Federal Republic of Germany Ingo Wegener, Johann Wolfgang Goethe University, Frankfurt, Federal Republic of Germany The problems of search, exploration, discovery and identification are of key importance in a wide variety of applications. This book will be of great interest to all those concerned with searching, sorting, information processing, design of experiments and optimal allocation of resources. 1987 Introduction to Optimization E. M. L. Beale FRS, Scicon Ltd, Milton Keynes, and Imperial College, London This book is intended as an introduction to the many topics covered by the term 'optimization', with special emphasis on applications in industry. It is divided into three parts. The first part covers unconstrained optimization, the second describes the methods used to solve linear programming problems, and the third covers nonlinear programming, integer programming and dynamic programming. The book is intended for senior undergraduate and graduate students studying optimization as part of a course in mathematics, computer science or engineering. 1988

Networked control systems are increasingly ubiquitous today, with applications ranging from vehicle communication and adaptive power grids to space exploration and economics. The optimal design of such systems presents major challenges, requiring tools from various disciplines within applied mathematics such as decentralized control, stochastic control, information theory, and quantization. A thorough, self-contained book, Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints aims to connect these diverse disciplines with precision and rigor, while conveying design guidelines to controller architects. Unique in the literature, it lays a comprehensive theoretical foundation for the study of networked control systems, and introduces an array of concrete tools for work in the field. Salient features included: * Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. * Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. * Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. * Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. * Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end. * Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. * Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. * Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. * Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. * Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.

This book brings theories in nonlinear dynamics, stochastic processes, irreversible thermodynamics, physical chemistry and biochemistry together in an introductory but formal and comprehensive manner.Coupled with examples, the theories are developed stepwise, starting with the simplest concepts and building upon them into a more general framework.Furthermore, each new mathematical derivation is immediately applied to one or more biological systems.The last chapters focus on applying mathematical and physical techniques to study systems such as: gene regulatory networks and molecular motors.

The target audience of this book are mainly final year undergraduate and graduate students with a solid mathematical background (physicists, mathematicians and engineers), as well as with basic notions of biochemistry and cellular biology. This book can also be useful to students with a biological background who are interested in mathematical modeling and have a working knowledge of calculus, differential equations and a basic understanding of probability theory."

The monograph addresses a problem of stochastic analysis based on the uncertainty assessment by simulation and application of this method in ecology and steel industry under uncertainty. The first chapter defines the Monte Carlo (MC) method and random variables in stochastic models. Chapter two deals with the contamination transport in porous media. Stochastic approach for Municipal Solid Waste transit time contaminants modeling using MC simulation has been worked out. The third chapter describes the risk analysis of the waste to energy facility proposal for Konin city, including the financial aspects. Environmental impact assessment of the ArcelorMittal Steel Power Plant, in Krakow - in the chapter four - is given. Thus, four scenarios of the energy mix production processes were studied. Chapter five contains examples of using ecological Life Cycle Assessment (LCA) - a relatively new method of environmental impact assessment - which help in preparing pro-ecological strategy, and which can lead to reducing the amount of wastes produced in the ArcelorMittal Steel Plant production processes. Moreover, real input and output data of selected processes under uncertainty, mainly used in the LCA technique, have been examined. The last chapter of this monograph contains final summary. The log-normal probability distribution, widely used in risk analysis and environmental management, in order to develop a stochastic analysis of the LCA, as well as uniform distribution for stochastic approach of pollution transport in porous media has been proposed. The distributions employed in this monograph are assembled from site-specific data, data existing in the most current literature, and professional judgment.

Stochastic calculus provides a powerful description of a specific class of stochastic processes in physics and finance. However, many econophysicists struggle to understand it. This book presents the subject simply and systematically, giving graduate students and practitioners a better understanding and enabling them to apply the methods in practice. The book develops Ito calculus and Fokker-Planck equations as parallel approaches to stochastic processes, using those methods in a unified way. The focus is on nonstationary processes, and statistical ensembles are emphasized in time series analysis. Stochastic calculus is developed using general martingales. Scaling and fat tails are presented via diffusive models. Fractional Brownian motion is thoroughly analyzed and contrasted with Ito processes. The Chapman-Kolmogorov and Fokker-Planck equations are shown in theory and by example to be more general than a Markov process. The book also presents new ideas in financial economics and a critical survey of econometrics.

This book introduces several topics related to linear model theory, including: multivariate linear models, discriminant analysis, principal components, factor analysis, time series in both the frequency and time domains, and spatial data analysis. This second edition adds new material on nonparametric regression, response surface maximization, and longitudinal models. The book provides a unified approach to these disparate subjects and serves as a self-contained companion volume to the author's Plane Answers to Complex Questions: The Theory of Linear Models. Ronald Christensen is Professor of Statistics at the University of New Mexico. He is well known for his work on the theory and application of linear models having linear structure.

Over the last thirty years there has been extensive use of continuous time econometric methods in macroeconomic modelling. This monograph presents a continuous time macroeconometric model of the United Kingdom incorporating stochastic trends. Its development represents a major step forward in continuous time macroeconomic modelling. The book describes the model in detail and, like earlier models, it is designed in such a way as to permit a rigorous mathematical analysis of its steady-state and stability properties, thus providing a valuable check on the capacity of the model to generate plausible long-run behaviour. The model is estimated using newly developed exact Gaussian estimation methods for continuous time econometric models incorporating unobservable stochastic trends. The book also includes discussion of the application of the model to dynamic analysis and forecasting.

Stochastic resonance has been observed in many forms of systems, and has been hotly debated by scientists for over 30 years. Applications incorporating aspects of stochastic resonance may yet prove revolutionary in fields such as distributed sensor networks, nano-electronics, and biomedical prosthetics. Ideal for researchers in fields ranging from computational neuroscience through to electronic engineering, this book addresses in detail various theoretical aspects of stochastic quantization, in the context of the suprathreshold stochastic resonance effect. Initial chapters review stochastic resonance and outline some of the controversies and debates that have surrounded it. The book then discusses suprathreshold stochastic resonance, and its extension to more general models of stochastic signal quantization. Finally, it considers various constraints and tradeoffs in the performance of stochastic quantizers, before culminating with a chapter in the application of suprathreshold stochastic resonance to the design of cochlear implants.

The study of M-matrices, their inverses and discrete potential theory is now a well-established part of linear algebra and the theory of Markov chains. The main focus of this monograph is the so-called inverse M-matrix problem, which asks for a characterization of nonnegative matrices whose inverses are M-matrices. We present an answer in terms of discrete potential theory based on the Choquet-Deny Theorem. A distinguished subclass of inverse M-matrices is ultrametric matrices, which are important in applications such as taxonomy. Ultrametricity is revealed to be a relevant concept in linear algebra and discrete potential theory because of its relation with trees in graph theory and mean expected value matrices in probability theory. Remarkable properties of Hadamard functions and products for the class of inverse M-matrices are developed and probabilistic insights are provided throughout the monograph.

This book is dedicated to the mathematical study of two-dimensional statistical hydrodynamics and turbulence, described by the 2D Navier-Stokes system with a random force. The authors' main goal is to justify the statistical properties of a fluid's velocity field u(t,x) that physicists assume in their work. They rigorously prove that u(t,x) converges, as time grows, to a statistical equilibrium, independent of initial data. They use this to study ergodic properties of u(t,x) - proving, in particular, that observables f(u(t,.)) satisfy the strong law of large numbers and central limit theorem. They also discuss the inviscid limit when viscosity goes to zero, normalising the force so that the energy of solutions stays constant, while their Reynolds numbers grow to infinity. They show that then the statistical equilibria converge to invariant measures of the 2D Euler equation and study these measures. The methods apply to other nonlinear PDEs perturbed by random forces.

Environmental Data Analysis with MatLab is a new edition that expands fundamentally on the original with an expanded tutorial approach, new crib sheets, and problem sets providing a clear learning path for students and researchers working to analyze real data sets in the environmental sciences. Since publication of the bestselling Environmental Data Analysis with MATLAB (R), many advances have been made in environmental data analysis. One only has to consider the global warming debate to realize how critically important it is to be able to derive clear conclusions from often noisy data drawn from a broad range of sources. The work teaches the basics of the underlying theory of data analysis and then reinforces that knowledge with carefully chosen, realistic scenarios. MATLAB (R), a commercial data processing environment, is used in these scenarios. Significant content is devoted to teaching how it can be effectively used in an environmental data analysis setting. This new edition, though written in a self-contained way, is supplemented with data and MATLAB (R) scripts that can be used as a data analysis tutorial. New features include boxed crib sheets to help identify major results and important formulas and give brief advice on how and when they should be used. Numerical derivatives and integrals are derived and illustrated. Includes log-log plots with further examples of their use. Discusses new datasets on precipitation and stream flow. Topical enhancement applies the chi-squared test to the results of the generalized least squares method. New coverage of cluster analysis and approximation techniques that are widely applied in data analysis, including Taylor Series and low-order polynomial approximations; non-linear least-squares with Newton's method; and pre-calculation and updating techniques applicable to real time data acquisition.

This book was first published in 2004. Many observed phenomena, from the changing health of a patient to values on the stock market, are characterised by quantities that vary over time: stochastic processes are designed to study them. This book introduces practical methods of applying stochastic processes to an audience knowledgeable only in basic statistics. It covers almost all aspects of the subject and presents the theory in an easily accessible form that is highlighted by application to many examples. These examples arise from dozens of areas, from sociology through medicine to engineering. Complementing these are exercise sets making the book suited for introductory courses in stochastic processes. Software (available from www.cambridge.org) is provided for the freely available R system for the reader to apply to all the models presented.

Line and hyperplane location problems play an important role not only in operations research and location theory, but also in computational geometry and robust statistics. This book provides a survey on line and hyperplane location combining analytical and geometrical methods. The major portion of the text presents new results on this topic, including the extension of some special cases to all distances derived from norms and a discussion of restricted problems in the plane. Almost all results are proven in the text and most of them are illustrated by examples. Furthermore, relations to classical facility location and to problems in computational geometry are pointed out. Audience: The book is suitable for researchers, lecturers, and graduate students working in the fields of location theory or computational geometry.

Optimal Control and Optimization of Stochastic Supply Chain Systems examines its subject the context of the presence of a variety of uncertainties. Numerous examples with intuitive illustrations and tables are provided, to demonstrate the structural characteristics of the optimal control policies in various stochastic supply chains and to show how to make use of these characteristics to construct easy-to-operate sub-optimal policies. In Part I, a general introduction to stochastic supply chain systems is provided. Analytical models for various stochastic supply chain systems are formulated and analysed in Part II. In Part III the structural knowledge of the optimal control policies obtained in Part II is utilized to construct easy-to-operate sub-optimal control policies for various stochastic supply chain systems accordingly. Finally, Part IV discusses the optimisation of threshold-type control policies and their robustness. A key feature of the book is its tying together of the complex analytical models produced by the requirements of operational practice, and the simple solutions needed for implementation. The analytical models and theoretical analysis propounded in this monograph will be of benefit to academic researchers and graduate students looking at logistics and supply chain management from standpoints in operations research or industrial, manufacturing, or control engineering. The practical tools and solutions and the qualitative insights into the ideas underlying functional supply chain systems will be of similar use to readers from more industrially-based backgrounds.

Uncertainty is an inherent feature of both properties of physical systems and the inputs to these systems that needs to be quantified for cost effective and reliable designs. The states of these systems satisfy equations with random entries, referred to as stochastic equations, so that they are random functions of time and/or space. The solution of stochastic equations poses notable technical difficulties that are frequently circumvented by heuristic assumptions at the expense of accuracy and rigor. The main objective of "Stochastic Systems" is to promoting the development of accurate and efficient methods for solving stochastic equations and to foster interactions between engineers, scientists, and mathematicians. To achieve these objectives "Stochastic Systems "presents:

. A clear and brief review of essential concepts on probability theory, random functions, stochastic calculus, Monte Carlo simulation, and functional analysis

. ""Probabilistic models for random variables and functions needed to formulate stochastic equations describing realistic problems in engineering and applied sciences

. ""Practical methods for quantifying the uncertain parameters in the definition of stochastic equations, solving approximately these equations, and assessing the accuracy of approximate solutions

"Stochastic Systems "provides key information for researchers, graduate students, and engineers who are interested in the formulation and solution of stochastic problems encountered in a broad range of disciplines. Numerous examples are used to clarify and illustrate theoretical concepts and methods for solving stochastic equations. The extensive bibliography and index at the end of the book constitute an ideal resource for both theoreticians and practitioners.

"

This comprehensive volume on ergodic control for diffusions highlights intuition alongside technical arguments. A concise account of Markov process theory is followed by a complete development of the fundamental issues and formalisms in control of diffusions. This then leads to a comprehensive treatment of ergodic control, a problem that straddles stochastic control and the ergodic theory of Markov processes. The interplay between the probabilistic and ergodic-theoretic aspects of the problem, notably the asymptotics of empirical measures on one hand, and the analytic aspects leading to a characterization of optimality via the associated Hamilton Jacobi Bellman equation on the other, is clearly revealed. The more abstract controlled martingale problem is also presented, in addition to many other related issues and models. Assuming only graduate-level probability and analysis, the authors develop the theory in a manner that makes it accessible to users in applied mathematics, engineering, finance and operations research.

Stochastic Analysis aims to provide mathematical tools to describe and model high dimensional random systems. Such tools arise in the study of Stochastic Differential Equations and Stochastic Partial Differential Equations, Infinite Dimensional Stochastic Geometry, Random Media and Interacting Particle Systems, Super-processes, Stochastic Filtering, Mathematical Finance, etc. Stochastic Analysis has emerged as a core area of late 20th century Mathematics and is currently undergoing a rapid scientific development. The special volume "Stochastic Analysis 2010" provides a sample of the current research in the different branches of the subject. It includes the collected works of the participants at the Stochastic Analysis section of the 7th ISAAC Congress organized at Imperial College London in July 2009.

This monograph is a presentation of a unified approach to a certain class of semimartingale inequalities, which can be regarded as probabilistic extensions of classical estimates for conjugate harmonic functions on the unit disc. The approach, which has its roots in the seminal works of Burkholder in the 80s, enables to deduce a given inequality for semimartingales from the existence of a certain special function with some convex-type properties. Remarkably, an appropriate application of the method leads to the sharp version of the estimate under investigation, which is particularly important for applications. These include the theory of quasiregular mappings (with deep implications to the geometric function theory); the boundedness of two-dimensional Hilbert transform and a more general class of Fourier multipliers; the theory of rank-one convex and quasiconvex functions; and more. The book is divided into a few separate parts. In the introductory chapter we present motivation for the results and relate them to some classical problems in harmonic analysis. The next part contains a general description of the method, which is applied in subsequent chapters to the study of sharp estimates for discrete-time martingales; discrete-time sub- and supermartingales; continuous time processes; the square and maximal functions. Each chapter contains additional bibliographical notes included for reference.

Random Fields on the Sphere presents a comprehensive analysis of isotropic spherical random fields. The main emphasis is on tools from harmonic analysis, beginning with the representation theory for the group of rotations SO(3). Many recent developments on the method of moments and cumulants for the analysis of Gaussian subordinated fields are reviewed. This background material is used to analyse spectral representations of isotropic spherical random fields and then to investigate in depth the properties of associated harmonic coefficients. Properties and statistical estimation of angular power spectra and polyspectra are addressed in full. The authors are strongly motivated by cosmological applications, especially the analysis of cosmic microwave background (CMB) radiation data, which has initiated a challenging new field of mathematical and statistical research. Ideal for mathematicians and statisticians interested in applications to cosmology, it will also interest cosmologists and mathematicians working in group representations, stochastic calculus and spherical wavelets.

This classic in stochastic network modelling broke new ground when it was published in 1979, and it remains a superb introduction to reversibility and its applications. The book concerns behaviour in equilibrium of vector stochastic processes or stochastic networks. When a stochastic network is reversible its analysis is greatly simplified, and the first chapter is devoted to a discussion of the concept of reversibility. The rest of the book focuses on the various applications of reversibility and the extent to which the assumption of reversibility can be relaxed without destroying the associated tractability. Now back in print for a new generation, this book makes enjoyable reading for anyone interested in stochastic processes thanks to the author's clear and easy-to-read style. Elementary probability is the only prerequisite and exercises are interspersed throughout.

Methods of global analysis and stochastic analysis are most often applied in mathematical physics as separate entities, thus forming important directions in the field. However, while combination of the two subject areas is rare, it is fundamental for the consideration of a broader class of problems. This book develops methods of Global Analysis and Stochastic Analysis such that their combination allows one to have a more or less common treatment for areas of mathematical physics that traditionally are considered as divergent and requiring different methods of investigation. Global and Stochastic Analysis with Applications to Mathematical Physics covers branches of mathematics that are currently absent in monograph form. Through the demonstration of new topics of investigation and results, both in traditional and more recent problems, this book offers a fresh perspective on ordinary and stochastic differential equations and inclusions (in particular, given in terms of Nelson's mean derivatives) on linear spaces and manifolds. Topics covered include classical mechanics on non-linear configuration spaces, problems of statistical and quantum physics, and hydrodynamics. A self-contained book that provides a large amount of preliminary material and recent results which will serve to be a useful introduction to the subject and a valuable resource for further research. It will appeal to researchers, graduate and PhD students working in global analysis, stochastic analysis and mathematical physics.

Many phenomena in engineering and mathematical physics can be modeled by means of boundary value problems for a certain elliptic differential operator in a given domain. When the differential operator under discussion is of second order a variety of tools are available for dealing with such problems, including boundary integral methods, variational methods, harmonic measure techniques, and methods based on classical harmonic analysis. When the differential operator is of higher-order (as is the case, e.g., with anisotropic plate bending when one deals with a fourth order operator) only a few options could be successfully implemented. In the 1970s Alberto Calderon, one of the founders of the modern theory of Singular Integral Operators, advocated the use of layer potentials for the treatment of higher-order elliptic boundary value problems. The present monograph represents the first systematic treatment based on this approach.

This research monograph lays, for the first time, the mathematical foundation aimed at solving boundary value problems for higher-order elliptic operators in non-smooth domains using the layer potential method and addresses a comprehensive range of topics, dealing with elliptic boundary value problems in non-smooth domains including layer potentials, jump relations, non-tangential maximal function estimates, multi-traces and extensions, boundary value problems with data in Whitney-Lebesque spaces, Whitney-Besov spaces, Whitney-Sobolev- based Lebesgue spaces, Whitney-Triebel-Lizorkin spaces, Whitney-Sobolev-based Hardy spaces, Whitney-BMO and Whitney-VMO spaces."

Stochastic Optimal Control (SOC)-a mathematical theory concerned with minimizing a cost (or maximizing a payout) pertaining to a controlled dynamic processunder uncertainty-has proven incredibly helpful to understanding and predicting debt crises and evaluating proposed financial regulation and risk management."Stochastic Optimal Control and the U.S. Financial Debt Crisis"analyzes SOC in relation to the 2008 U.S. financial crisis, and offers a detailed framework depicting why such a methodology is best suited for reducing financial risk and addressing key regulatory issues. Topics discussed include the inadequacies of the current approaches underlying financial regulations, the use of SOC to explain debt crises and superiority over existing approaches to regulation, and the domestic and international applications of SOC to financial crises. Principles in this book will appeal to economists, mathematicians, and researchers interested in the U.S. financial debt crisis and optimal risk management."

In 2014, winner of "Outstanding Book Award" by The Japan Society for Fuzzy Theory and Intelligent Informatics. Covering in detail both theoretical and practical perspectives, this book is a self-contained and systematic depiction of current fuzzy stochastic optimization that deploys the fuzzy random variable as a core mathematical tool to model the integrated fuzzy random uncertainty. It proceeds in an orderly fashion from the requisite theoretical aspects of the fuzzy random variable to fuzzy stochastic optimization models and their real-life case studies. The volume reflects the fact that randomness and fuzziness (or vagueness) are two major sources of uncertainty in the real world, with significant implications in a number of settings. In industrial engineering, management and economics, the chances are high that decision makers will be confronted with information that is simultaneously probabilistically uncertain and fuzzily imprecise, and optimization in the form of a decision must be made in an environment that is doubly uncertain, characterized by a co-occurrence of randomness and fuzziness. This book begins by outlining the history and development of the fuzzy random variable before detailing numerous optimization models and applications that include the design of system controls for a dam.