This book examines optimization problems that in practice involve random model parameters. It outlines the computation of robust optimal solutions, i.e., optimal solutions that are insensitive to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into corresponding deterministic problems. Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures, and differentiation formulas for probabilities and expectations. The fourth edition of this classic text has been carefully and thoroughly revised. It includes new chapters on the solution of stochastic linear programs by discretization of the underlying probability distribution, and on solving deterministic optimization problems by means of controlled random search methods and multiple random search procedures. It also presents a new application of stochastic optimization methods to machine learning problems with different loss functions. For the computation of optimal feedback controls under stochastic uncertainty, besides the open-loop feedback procedures, a new method based on Taylor expansions with respect to the gain parameters is presented.  The book is intended for researchers and graduate students who are interested in stochastics, stochastic optimization, and control. It will also benefit professionals and practitioners whose work involves technical, economic and/or operations research problems under stochastic uncertainty.

This book examines application and methods to incorporating stochastic parameter variations into the optimization process to decrease expense in corrective measures. Basic types of deterministic substitute problems occurring mostly in practice involve i) minimization of the expected primary costs subject to expected recourse cost constraints (reliability constraints) and remaining deterministic constraints, e.g. box constraints, as well as ii) minimization of the expected total costs (costs of construction, design, recourse costs, etc.) subject to the remaining deterministic constraints. After an introduction into the theory of dynamic control systems with random parameters, the major control laws are described, as open-loop control, closed-loop, feedback control and open-loop feedback control, used for iterative construction of feedback controls. For approximate solution of optimization and control problems with random parameters and involving expected cost/loss-type objective, constraint functions, Taylor expansion procedures, and Homotopy methods are considered, Examples and applications to stochastic optimization of regulators are given. Moreover, for reliability-based analysis and optimal design problems, corresponding optimization-based limit state functions are constructed. Because of the complexity of concrete optimization/control problems and their lack of the mathematical regularity as required of Mathematical Programming (MP) techniques, other optimization techniques, like random search methods (RSM) became increasingly important. Basic results on the convergence and convergence rates of random search methods are presented. Moreover, for the improvement of the - sometimes very low - convergence rate of RSM, search methods based on optimal stochastic decision processes are presented. In order to improve the convergence behavior of RSM, the random search procedure is embedded into a stochastic decision process for an optimal control of the probability distributions of the search variates (mutation random variables).

This book examines application and methods to incorporating stochastic parameter variations into the optimization process to decrease expense in corrective measures. Basic types of deterministic substitute problems occurring mostly in practice involve i) minimization of the expected primary costs subject to expected recourse cost constraints (reliability constraints) and remaining deterministic constraints, e.g. box constraints, as well as ii) minimization of the expected total costs (costs of construction, design, recourse costs, etc.) subject to the remaining deterministic constraints. After an introduction into the theory of dynamic control systems with random parameters, the major control laws are described, as open-loop control, closed-loop, feedback control and open-loop feedback control, used for iterative construction of feedback controls. For approximate solution of optimization and control problems with random parameters and involving expected cost/loss-type objective, constraint functions, Taylor expansion procedures, and Homotopy methods are considered, Examples and applications to stochastic optimization of regulators are given. Moreover, for reliability-based analysis and optimal design problems, corresponding optimization-based limit state functions are constructed. Because of the complexity of concrete optimization/control problems and their lack of the mathematical regularity as required of Mathematical Programming (MP) techniques, other optimization techniques, like random search methods (RSM) became increasingly important. Basic results on the convergence and convergence rates of random search methods are presented. Moreover, for the improvement of the - sometimes very low - convergence rate of RSM, search methods based on optimal stochastic decision processes are presented. In order to improve the convergence behavior of RSM, the random search procedure is embedded into a stochastic decision process for an optimal control of the probability distributions of the search variates (mutation random variables).

This book examines optimization problems that in practice involve random model parameters. It details the computation of robust optimal solutions, i.e., optimal solutions that are insensitive with respect to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems. Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures and differentiation formulas for probabilities and expectations. In the third edition, this book further develops stochastic optimization methods. In particular, it now shows how to apply stochastic optimization methods to the approximate solution of important concrete problems arising in engineering, economics and operations research.

Optimization problems arising in practice involve random model parameters. For the computation of robust optimal solutions, i.e., optimal solutions being insenistive with respect to random parameter variations, appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data, and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems. Due to the occurring probabilities and expectations, approximative solution techniques must be applied. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures, differentiation formulas for probabilities and expectations.

Support for addressing the on-going global changes needs solutions for new scientific problems which in turn require new concepts and tools. A key issue concerns a vast variety of irreducible uncertainties, including extreme events of high multidimensional consequences, e.g., the climate change. The dilemma is concerned with enormous costs versus massive uncertainties of extreme impacts. Traditional scientific approaches rely on real observations and experiments. Yet no sufficient observations exist for new problems, and "pure" experiments, and learning by doing may be expensive, dangerous, or impossible. In addition, the available historical observations are often contaminated by past actions, and policies. Thus, tools are presented for the explicit treatment of uncertainties using "synthetic" information composed of available "hard" data from historical observations, the results of possible experiments, and scientific facts, as well as "soft" data from experts' opinions, and scenarios.

Ongoing global changes bring fundamentally new scientific problems requiring
new concepts and tools. A key issue concerns a vast variety of practically
irreducible uncertainties, which challenge our traditional models and require
new concepts and analytical tools. The uncertainty critically dominates, e.g.,
the climate change debates. In short, the dilemma is concerned with enormous
costs vs. massive uncertainties of potential extreme impacts.
Traditional scientific approaches usually rely on real observations and
experiments. Yet no sufficient observations exist for new problems, and "pure"
experiments and learning by doing may be very expensive, dangerous, or
simply impossible. In addition, available historical observations are contaminated
by actions, policies. The complexity of new problems does not allow to achieve
enough certainty by increasing the resolution of models or by bringing in more links.
Hence, new tools for modeling and management of uncertainty are needed, as given
in this book which was prepared for an interdisciplinary audience, and addresses open
problems, limitations of known approaches, novel methods and techniques, or lessons
from the applications of various approaches. Thus, the book contributes to a better
understanding between practitioners dealing with the management of uncertainty, and
scientists working on either corresponding modeling approaches that can be applied for
improving understanding or management of uncertainty.

Uncertainties and changes are pervasive characteristics of modern systems involving interactions between humans, economics, nature and technology. These systems are often too complex to allow for precise evaluations and, as a result, the lack of proper management (control) may create significant risks. In order to develop robust strategies we need approaches which explic itly deal with uncertainties, risks and changing conditions. One rather general approach is to characterize (explicitly or implicitly) uncertainties by objec tive or subjective probabilities (measures of confidence or belief). This leads us to stochastic optimization problems which can rarely be solved by using the standard deterministic optimization and optimal control methods. In the stochastic optimization the accent is on problems with a large number of deci sion and random variables, and consequently the focus ofattention is directed to efficient solution procedures rather than to (analytical) closed-form solu tions. Objective and constraint functions of dynamic stochastic optimization problems have the form of multidimensional integrals of rather involved in that may have a nonsmooth and even discontinuous character - the tegrands typical situation for "hit-or-miss" type of decision making problems involving irreversibility ofdecisions or/and abrupt changes ofthe system. In general, the exact evaluation of such functions (as is assumed in the standard optimization and control theory) is practically impossible. Also, the problem does not often possess the separability properties that allow to derive the standard in control theory recursive (Bellman) equations."

Optimization problems arising in practice usually contain several random parameters. Hence, in order to obtain optimal solutions being robust with respect to random parameter variations, the mostly available statistical information about the random parameters should be considered already at the planning phase. The original problem with random parameters must be replaced by an appropriate deterministic substitute problem, and efficient numerical solution or approximation techniques have to be developed for those problems. This proceedings volume contains a selection of papers on modelling techniques, approximation methods, numerical solution procedures for stochastic optimization problems and applications to the reliability-based optimization of concrete technical or economic systems.

In order to obtain more reliable optimal solutions of concrete technical/economic problems, e.g. optimal design problems, the often known stochastic variations of many technical/economic parameters have to be taken into account already in the planning phase. Hence, ordinary mathematical programs have to be replaced by appropriate stochastic programs. New theoretical insight into several branches of reliability-oriented optimization of stochastic systems, new computational approaches and technical/economic applications of stochastic programming methods can be found in this volume.

This volume includes a selection of papers presented at the GAMM/ IFIP-Workshop on IIStochastic Optimization: Numerical Methods and ll Technical Applications , held at the Federal Armed Forces Univer- sity Munich, May 29-31, 1990. The objective of this meeting was to bring together scientists from Stochastic Programming and from those Engineering areas, where Mathematical Programming models are common tools, as e.g. Optimal structural Design, Power Dispatch, Acid Rain Abatement etc .. Hence, the aim was to discuss the effects of taking into account the in- herent randomness of some data of these problems, i.e. considering Stochastic Programming instead of Mathematical Programming models in order to get solutions being more reliable, but not more expen- sive. An international programme committe2 was formed which included H.A. Eschenauer (Germany) P. Kall (Switzerland) K. Marti (Germany, Chairman) J. Mayer (Hungary) G.I. Schueller (Austria) Although the number of participants had to be small for technical reasons, the area covered by the lectures during the workshop was rather broad. It contains theoretical insight into stochastic pro- gramming problems, new computational approaches, analyses of known solution methods, and applications in such very different technical fields as ecology, energy demands, and optimal reliability of me- chanical structures. In particular, the applied presentation also pointed to several open methodological problems.

In engineering and economics a certain vector of inputs or decisions must often be chosen, subject to some constraints, such that the expected costs arising from the deviation between the output of a stochastic linear system and a desired stochastic target vector are minimal. In many cases the loss function u is convex and the occuring random variables have, at least approximately, a joint discrete distribution. Concrete problems of this type are stochastic linear programs with recourse, portfolio optimization problems, error minimization and optimal design problems. In solving stochastic optimization problems of this type by standard optimization software, the main difficulty is that the objective function F and its derivatives are defined by multiple integrals. Hence, one wants to omit, as much as possible, the time-consuming computation of derivatives of F. Using the special structure of the problem, the mathematical foundations and several concrete methods for the computation of feasible descent directions, in a certain part of the feasible domain, are presented first, without any derivatives of the objective function F. It can also be used to support other methods for solving discretely distributed stochastic programs, especially large scale linear programming and stochastic approximation methods.

Das Buch gibt eine Einfuhrung in das neue Gebiet der Analyse und Optimierung von Tragwerken unter stochastischer Unsicherheit. Es werden die Grundlagen ausfuhrlich dargestellt und zum Teil von unterschiedlichen Standpunkten aus beleuchtet.

In Teil I wird die lineare Theorie der Stabtragwerke als Grundlage fur die FEM entwickelt. Vorausgesetzt werden dabei nur wenige Kenntnisse aus der Technischen Mechanik und der Ingenieurmathematik, insbesondere eine gewisse Vertrautheit mit der Matrizenrechnung.

In Teil II wird dargestellt, wie sich die Wahrscheinlichkeitsverteilungen der Verschiebungen und Spannungen in den Knoten aus denen der stochastischen Stabparameter und ausseren Lasten - zumindest approximativ - berechnen lassen.

In Teil III schliesslich wird die Optimierung von Tragwerken mit stochastischen Parametern behandelt. Dazu wird ein geeignetes deterministisches Ersatzproblem des Ausgangsproblems mit stochastischen Modellparametern formuliert.

Eine kurze Beschreibung einiger Optimierungsverfahren findet man im letzten Abschnitt. Besondere Muhe wurde auf die zahlreichen und eingehend behandelten Beispiele verwandt.

Das Buch ist geschrieben fur Studierende, praktisch tatige Ingenieure und Mathematiker. "

Managing safety of diverse systems requires decision-making under uncertainties and risks. Such systems are typically characterized by spatio-temporal heterogeneities, inter-dependencies, externalities, endogenous risks, discontinuities, irreversibility, practically irreducible uncertainties, and rare events with catastrophic consequences. Traditional scientific approaches rely on data from real observations and experiments; yet no sufficient observations exist for new problems, and experiments are usually impossible. Therefore, science-based support for addressing such new class of problems needs to replace the traditional "deterministic predictions" analysis by new methods and tools for designing decisions that are robust against the involved uncertainties and risks. The new methods treat uncertainties explicitly by using "synthetic" information derived by integration of "hard" elements, including available data, results of possible experiments, and formal representations of scientific facts, with "soft" elements based on diverse representations of scenarios and opinions of public, stakeholders, and experts. The volume presents such effective new methods, and illustrates their applications in different problem areas, including engineering, economy, finance, agriculture, environment, and policy making.

Die sichere Beherrschung der f r viele ingenieurwissenschaftlich-technische und wirtschaftswissenschaftlich-statistische Anwendungen unverzichtbaren mathematischen Grundlagen aus der Differential- und Integralrechnung (Analysis) einer Variablen erfordert neben dem Besuch von Kursen ber "Differential- und Integralrechnung einer Variablen" insbesondere auch die selbst ndige Bearbeitung einer ausreichenden Anzahl von Beispielen und bungsaufgaben zu den im "Grundkurs Mathematik" oder anderen einf hrenden Werken ber Analysis einer Variablen behandelten mathematischen Werkzeugen. Ausreichendes bungsmaterial mit vollst ndigen L sungen zum Nachrechnen oder zur Kontrolle eigener L sungen ist im " bungsbuch" enthalten. Die Gliederung der bungsaufgaben richtet sich dabei nach dem bew hrten Aufbau der Kurse ber Differential- und Integralrechnung einer Variablen (Analysis I).

Moderne Techniken bauen mehr denn je auf der Mathematik auf. So durchdringen Informationsverarbeitung, Modellierung, Systemanalyse, Stochastik, Simulations- und Optimierungsmethoden alle Bereiche der Naturwissenschaften, Ingenieur- und Wirtschaftswissenschaften. Selbst Sprachwissenschaftler, Psychologen oder Soziologen benAtigen heute ein ausreichendes mathematisches RA1/4stzeug, um in ihrem Beruf bestehen zu kAnnen. Andererseits haben StudienanfAnger sehr hAufig ungenA1/4gende mathematische Kenntnisse in der Differential- und Integralrechnung fA1/4r Funktionen einer Variablen. Zur Schaffung solider mathematischer Grundlagen vermittelt dieses Buch durch eine behutsame EinfA1/4hrung und Veranschaulichung der Begriffe und Methoden eine lebendige Vorstellung des Stoffes und eine saubere Beherrschung der grundlegenden analytischen Techniken, um die verschiedenartigsten Aufgaben zu lAsen.

Dieses Buch ist eine EinfA1/4hrung in die mathematische Theorie der Optimierung. Nach einer kurzen Beschreibung der Problemstellung und einer Aoebersicht A1/4ber die grundlegenden Typen von Optimierungsaufgaben werden im zweiten Kapitel lineare Optimierungsprobleme behandelt, fA1/4r die ein vollstAndiges LAsungsverfahren, der Simplexalgorithmus, zur VerfA1/4gung steht. FA1/4r die LAsung nichtlinearer Optimierungsaufgaben mit differenzierbaren bzw. konvexen Funktionen werden im dritten Kapitel notwendige und hinreichende OptimimalitAtsbedingungen bereitgestellt. Bei der Darstellung des Stoffes wurde darauf geachtet, neue Begriffe und Methoden anhand vieler Beispiele auf anschauliche Art einzufA1/4hren. Vorausgesetzt werden einige wenige mathematische Grundkenntnisse, wie sie in jeder einfA1/4hrenden Vorlesung in die HAhere Mathematik vermittelt werden. Jeder Abschnitt schlieAt mit einer Reihe von Aoebungsaufgaben. Die ausfA1/4hrlichen LAsungen zu allen Aufgaben werden am Ende des Lehrbuchs gegeben.