Nonlinear Optimization is an intriguing area of study where mathematical theory, algorithms and applications converge to calculate the optimal values of continuous functions. Within this subject, Global Optimization aims at finding global optima for difficult problems in which many local optima might exist.

This book provides a compelling introduction to global and non-linear optimization providing interdisciplinary readers with a strong background to continue their studies into these and other related fields. The book offers insight in relevant concepts such as "region of attraction" and "Branch-and-Bound" by elaborating small numerical examples and exercises for the reader to follow.

Minimal Surfaces is the first volume of a three volume treatise on minimal surfaces (Grundlehren Nr. 339-341). Each volume can be read and studied independently of the others. The central theme is boundary value problems for minimal surfaces. The treatise is a substantially revised and extended version of the monograph Minimal Surfaces I, II (Grundlehren Nr. 295 & 296). The first volume begins with an exposition of basic ideas of the theory of surfaces in three-dimensional Euclidean space, followed by an introduction of minimal surfaces as stationary points of area, or equivalently, as surfaces of zero mean curvature. The final definition of a minimal surface is that of a non-constant harmonic mapping X: \Omega\to\R DEGREES3 which is conformally parametrized on \Omega\subset\R DEGREES2 and may have branch points. Thereafter the classical theory of minimal surfaces is surveyed, comprising many examples, a treatment of Bjorlings initial value problem, reflection principles, a formula of the second variation of area, the theorems of Bernstein, Heinz, Osserman, and Fujimoto. The second part of this volume begins with a survey of Plateaus problem and of some of its modifications. One of the main features is a new, completely elementary proof of the fact that area A and Dirichlet integral D have the same infimum in the class C(G) of admissible surfaces spanning a prescribed contour G. This leads to a new, simplified solution of the simultaneous problem of minimizing A and D in C(G), as well as to new proofs of the mapping theorems of Riemann and Korn-Lichtenstein, and to a new solution of the simultaneous Douglas problem for A and D where G consists of several closed components. Then basic facts of stable minimal surfaces are derived; this is done in the context of stable H-surfaces (i.e. of stable surfaces of prescribed mean curvature H), especially of cmc-surfaces (H = const), and leads to curvature estimates for stable, immersed cmc-surfaces and to Nitsches uniqueness theorem and Tomis finiteness result. In addition, a theory of unstable solutions of Plateaus problems is developed which is based on Courants mountain pass lemma. Furthermore, Dirichlets problem for nonparametric H-surfaces is solved, using the solution of Plateaus problem for H-surfaces and the pertinent estimates."

There is an increasing demand for dynamic systems to become safer and more reliable. This requirement extends beyond the normally accepted safety-critical systems such as nuclear reactors and aircraft, where safety is of paramount importance, to systems such as autonomous vehicles and process control systems where the system availability is vital. It is clear that fault diagnosis is becoming an important subject in modern control theory and practice. Robust Model-Based Fault Diagnosis for Dynamic Systems presents the subject of model-based fault diagnosis in a unified framework. It contains many important topics and methods; however, total coverage and completeness is not the primary concern. The book focuses on fundamental issues such as basic definitions, residual generation methods and the importance of robustness in model-based fault diagnosis approaches. In this book, fault diagnosis concepts and methods are illustrated by either simple academic examples or practical applications. The first two chapters are of tutorial value and provide a starting point for newcomers to this field.The rest of the book presents the state of the art in model-based fault diagnosis by discussing many important robust approaches and their applications. This will certainly appeal to experts in this field. Robust Model-Based Fault Diagnosis for Dynamic Systems targets both newcomers who want to get into this subject, and experts who are concerned with fundamental issues and are also looking for inspiration for future research. The book is useful for both researchers in academia and professional engineers in industry because both theory and applications are discussed. Although this is a research monograph, it will be an important text for postgraduate research students world-wide. The largest market, however, will be academics, libraries and practicing engineers and scientists throughout the world.

The numerous applications of optimal control theory have given an incentive to the development of approximate techniques aimed at the construction of control laws and the optimization of dynamical systems. These constructive approaches rely on small parameter methods (averaging, regular and singular perturbations), which are well-known and have been proven to be efficient in nonlinear mechanics and optimal control theory (maximum principle, variational calculus and dynamic programming). An essential feature of the procedures for solving optimal control problems consists in the necessity for dealing with two-point boundary-value problems for nonlinear and, as a rule, nonsmooth multi-dimensional sets of differential equations. This circumstance complicates direct applications of the above-mentioned perturbation methods which have been developed mostly for investigating initial-value (Cauchy) problems. There is now a need for a systematic presentation of constructive analytical per turbation methods relevant to optimal control problems for nonlinear systems. The purpose of this book is to meet this need in the English language scientific literature and to present consistently small parameter techniques relating to the constructive investigation of some classes of optimal control problems which often arise in prac tice. This book is based on a revised and modified version of the monograph: L. D. Akulenko "Asymptotic methods in optimal control." Moscow: Nauka, 366 p. (in Russian)."

This volume contains the lectures presented at the NATO Advanced Study Institute (ASI) on " Frontiers of Chemical Dynamics ", held in the Club AIda, Kerner, Turkey, from 5th September to 16th September 1994. The Kerner area, famous for its pristine beaches and craggy mountains provided an excellent atmosphere for an intellectually and socially active meeting. The first class facilities of Club AIda allowed the participants to concentrate on the scientific activities without any outside interferences and disturbances. The main objective of the meeting was to bring experts of chemical dynamics to discuss problems from both experimental and theoretical points of view. The organizing committee has helped a great deal to collect an impressive list of lecturers, although there were quite a number of other scientists whom we would have liked to invite. Unfortunately, the number of lecturers is limited and we had to leave out some of them. The selection of the lecturers from a very long list was a difficult process and those who are approached in our very first attempt were all known for giving very good lectures. The purpose of the ASI's are mainly educational even though they may be at a very high level and it is essential to keep in mind the pedagogical aspects of the meeting without sacrificing the scientific quality. This point was underlined several times in our communications with lecturers.

Evolutionary Algorithms (EAs) have grown into a mature field of research in optimization, and have proven to be effective and robust problem solvers for a broad range of static real-world optimization problems. Yet, since they are based on the principles of natural evolution, and since natural evolution is a dynamic process in a changing environment, EAs are also well suited to dynamic optimization problems. Evolutionary Optimization in Dynamic Environments is the first comprehensive work on the application of EAs to dynamic optimization problems. It provides an extensive survey on research in the area and shows how EAs can be successfully used to * continuously and efficiently adapt a solution to a changing environment, * find a good trade-off between solution quality and adaptation cost, * find robust solutions whose quality is insensitive to changes in the environment, * find flexible solutions which are not only good but that can be easily adapted when necessary. All four aspects are treated in this book, providing a holistic view on the challenges and opportunities when applying EAs to dynamic optimization problems.The comprehensive and up-to-date coverage of the subject, together with details of latest original research, makes Evolutionary Optimization in Dynamic Environments an invaluable resource for researchers and professionals who are dealing with dynamic and stochastic optimization problems, and who are interested in applying local search heuristics, such as evolutionary algorithms.

Linear Programming (LP) is perhaps the most frequently used optimization technique. One of the reasons for its wide use is that very powerful solution algorithms exist for linear optimization. Computer programs based on either the simplex or interior point methods are capable of solving very large-scale problems with high reliability and within reasonable time. Model builders are aware of this and often try to formulate real-life problems within this framework to ensure they can be solved efficiently. It is also true that many real-life optimization problems can be formulated as truly linear models and also many others can well be approximated by linearization. The two main methods for solving LP problems are the variants of the simplex method and the interior point methods (IPMs). It turns out that both variants have their role in solving different problems. It has been recognized that, since the introduction of the IPMs, the efficiency of simplex based solvers has increased by two orders of magnitude. This increased efficiency can be attributed to the following: (1) theoretical developments in the underlying algorithms, (2) inclusion of results of computer science, (3) using the principles of software engineering, and (4) taking into account the state-of-the-art in computer technology.
Theoretically correct algorithms can be implemented in many different ways, but the performance is dependent on how the implementation is done. The success is based on the proper synthesis of the above mentioned (1-4) components. Computational Techniques of the Simplex Method is a systematic treatment focused on the computational issues of the simplex method. It provides a comprehensive coverage of the most important and successful algorithmic and implementation techniques of the simplex method. It is a unique source of essential, never discussed details of algorithmic elements and their implementation. On the basis of the book the reader will be able to create a highly advanced implementation of the simplex method which, in turn, can be used directly or as a building block in other solution algorithms.

Modeling, Control And Optimization Of Complex Systems is a collection of contributions from leading international researchers in the fields of dynamic systems, control theory, and modeling. These papers were presented at the Symposium on Modeling and Optimization of Complex Systems in honor of Larry Yu-Chi Ho in June 2001. They include exciting research topics such as:

-modeling of complex systems,
-power control in ad hoc wireless networks,
-adaptive control using multiple models,
-constrained control,
-linear quadratic control,
-discrete events,
-Markov decision processes and reinforcement learning,
-optimal control for discrete event and hybrid systems,
-optimal representation and visualization of multivariate data and functions in low-dimensional spaces.

This book is a compilation of a selected subset of research articles presented at the Eighth INFORMS Computing Society Conference, held in Chandler, Arizona, from January 8 to 10, 2003. The articles in this book represent the diversity and depth of the interface between ORiMS (operations research and the management sciences) and CS/AI (computer science and artificial intelligence ). This volume starts with two papers that represent the reflective and integrative thinking that is critical to any scientific discipline. These two articles present philosophical perspectives on computation, covering a variety of traditional and newer methods for modeling, solving, and explaining mathematical models. The next set includes articles that study machine learning and computational heuristics, and is followed by articles that address issues in performance testing of solution algorithms and heuristics. These two sets of papers demonstrate the richness of thought that takes place at the ORiMS and CSI AI interface. The final set of articles demonstrates the usefulness of these and other methods at the interface towards solving problems in the real world, covering e-commerce, workflow, electronic negotiation, music, parallel computation, and telecommunications. The articles in this collection represent the results of cross-fertilization between ORiMS and CSI AI, making possible advances that could have not been achieved in isolation. The continuing aim ofthe INFORMS Computing Society and this research conference is to invigorate and further develop this interface.

Rule-based fuzzy modeling has been recognised as a powerful technique for the modeling of partly-known nonlinear systems. Fuzzy models can effectively integrate information from different sources, such as physical laws, empirical models, measurements and heuristics. Application areas of fuzzy models include prediction, decision support, system analysis, control design, etc. Fuzzy Modeling for Control addresses fuzzy modeling from the systems and control engineering points of view. It focuses on the selection of appropriate model structures, on the acquisition of dynamic fuzzy models from process measurements (fuzzy identification), and on the design of nonlinear controllers based on fuzzy models. To automatically generate fuzzy models from measurements, a comprehensive methodology is developed which employs fuzzy clustering techniques to partition the available data into subsets characterized by locally linear behaviour. The relationships between the presented identification method and linear regression are exploited, allowing for the combination of fuzzy logic techniques with standard system identification tools. Attention is paid to the trade-off between the accuracy and transparency of the obtained fuzzy models. Control design based on a fuzzy model of a nonlinear dynamic process is addressed, using the concepts of model-based predictive control and internal model control with an inverted fuzzy model. To this end, methods to exactly invert specific types of fuzzy models are presented. In the context of predictive control, branch-and-bound optimization is applied. The main features of the presented techniques are illustrated by means of simple examples. In addition, three real-world applications are described. Finally, software tools for building fuzzy models from measurements are available from the author.

With contributions by specialists in optimization and practitioners in the fields of aerospace engineering, chemical engineering, and fluid and solid mechanics, the major themes include an assessment of the state of the art in optimization algorithms as well as challenging applications in design and control, in the areas of process engineering and systems with partial differential equation models.

Since the building of all the Universe is perfect and is cre- ated by the wisdom Creator, nothing arises in the Universe in which one cannot see the sense of some maXImum or mInImUm Euler God moves the Universe along geometrical lines Plato Mathematical models of most closed physical systems are based on vari- ational principles, i.e., it is postulated that equations describing the evolu- tion of a system are the Euler~Lagrange equations of a certain functional. In this connection, variational methods are one of the basic tools for studying many problems of natural sciences. The first problems related to the search for extrema appeared as far back as in ancient mathematics. They go back to Archimedes, Appolonius, and Euclid. In many respects, the problems of seeking maxima and minima have stimulated the creation of differential calculus; the variational prin- ciples of optics and mechanics, which were discovered in the seventeenth and eighteenth centuries, gave impetus to an intensive development of the calculus of variations. In one way or another, variational problems were of interest to such giants of natural sciences as Fermat, Newton, Descartes, Euler, Huygens, 1. Bernoulli, J. Bernoulli, Legendre, Jacobi, Kepler, La- grange, and Weierstrass.

This study is one of the first attempts to bridge the theoretical models of variational dynamics of perfect fluids and some practical approaches worked out in chemical and mechanical engineering in the field newly called thermo-hydrodynamics. In recent years, applied mathematicians and theoretical physicists have made significant progress in formulating analytical tools to describe fluid dynamics through variational methods. These tools are much loved by theoretists, and rightly so, because they are quite powerful and beautiful theoretical tools. Chemists, physicists and engineers, however, are limited in their ability to use these tools, because presently they are applicable only to "perfect fluids" (i. e. those fluids without viscosity, heat transfer, diffusion and chemical reactions). To be useful, a model must take into account important transport and rate phenomena, which are inherent to real fluid behavior and which cannot be ignored. This monograph serves to provide the beginnings of a means by which to extend the mathematical analyses to include the basic effects of thermo-hydrodynamics. In large part a research report, this study uses variational calculus as a basic theoretical tool, without undo compromise to the integrity of the mathematical analyses, while emphasizing the conservation laws of real fluids in the context of underlying thermodynamics --reversible or irreversible. The approach of this monograph is a new generalizing approach, based on Nother's theorem and variational calculus, which leads to the energy-momentum tensor and the related conservation or balance equations in fluids.

When solving the control and design problems in aerospace and naval engi neering, energetics, economics, biology, etc., we need to know the state of investigated dynamic processes. The presence of inherent uncertainties in the description of these processes and of noises in measurement devices leads to the necessity to construct the estimators for corresponding dynamic systems. The estimators recover the required information about system state from mea surement data. An attempt to solve the estimation problems in an optimal way results in the formulation of different variational problems. The type and complexity of these variational problems depend on the process model, the model of uncertainties, and the estimation performance criterion. A solution of variational problem determines an optimal estimator. Howerever, there exist at least two reasons why we use nonoptimal esti mators. The first reason is that the numerical algorithms for solving the corresponding variational problems can be very difficult for numerical imple mentation. For example, the dimension of these algorithms can be very high."

In Linear Programming: A Modern Integrated Analysis, both boundary (simplex) and interior point methods are derived from the complementary slackness theorem and, unlike most books, the duality theorem is derived from Farkas's Lemma, which is proved as a convex separation theorem. The tedium of the simplex method is thus avoided. A new and inductive proof of Kantorovich's Theorem is offered, related to the convergence of Newton's method. Of the boundary methods, the book presents the (revised) primal and the dual simplex methods. An extensive discussion is given of the primal, dual and primal-dual affine scaling methods. In addition, the proof of the convergence under degeneracy, a bounded variable variant, and a super-linearly convergent variant of the primal affine scaling method are covered in one chapter. Polynomial barrier or path-following homotopy methods, and the projective transformation method are also covered in the interior point chapter. Besides the popular sparse Cholesky factorization and the conjugate gradient method, new methods are presented in a separate chapter on implementation. These methods use LQ factorization and iterative techniques.

An operator theoretic approach to robust control analysis for linear time-varying systems, with the emphasis on the conceptual similarity with the H control theory for time-invariant systems. It clarifies the major difficulties confronted in the time varying case and all the necessary operator theory is developed from first principles, making the book as self-contained as possible. After presenting the necessary results from the theories of Toeplitz operators and nest algebras, linear systems are defined as input-output operators and the relationship between stabilisation and the existence of co-prime factorisations is described. Uniform optimal control problems are formulated as model-matching problems and are reduced to four block problems, while robustness is considered both from the point of view of fractional representations and the "time varying gap" metric, as is the relationship between these types of uncertainties. The book closes with the solution of the orthogonal embedding problem for time-varying contractive systems. As such, this book is useful to both mathematicians and to control engineers.

This book discusses convex analysis, the basic underlying structure of argumentation in economic theory. Convex analysis is also common to the optimization of problems encountered in many applications. The text is aimed at senior undergraduate students, graduate students, and specialists of mathematical programming who are undertaking research into applied mathematics and economics. The text consists of a systematic development in eight chapters, and contains exercises. The book is appropriate as a class text or for self-study.

Modeling and Simulation: Theory and Practice provides a comprehensive review of both methodologies and applications of simulation and modeling. The methodology section includes such topics as the philosophy of simulation, inverse problems in simulation, simulation model compilers, treatment of ill-defined systems, and a survey of simulation languages. The application section covers a wide range of topics, including applications to environmental management, biology and medicine, neural networks, collaborative visualization and intelligent interfaces. The book consists of 13 invited chapters written by former colleagues and students of Professor Karplus. Also included are several short 'reminiscences' describing Professor Karplus' impact on the professional careers of former colleagues and students who worked closely with him over the years.

Iterative methods for finding fixed points of non-expansive operators in Hilbert spaces have been described in many publications. In this monograph we try to present the methods in a consolidated way. We introduce several classes of operators, examine their properties, define iterative methods generated by operators from these classes and present general convergence theorems. On this basis we discuss the conditions under which particular methods converge. A large part of the results presented in this monograph can be found in various forms in the literature (although several results presented here are new). We have tried, however, to show that the convergence of a large class of iteration methods follows from general properties of some classes of operators and from some general convergence theorems.

Man wird dem einzelnen nicht gerecht, wenn man es gesondert ins Auge jaftt, ohne seinen Zusammenhang mit dem Ganzen zu beachten und dem Beziehungssystem Rechnung zu tragen, in dem es steht. Thomas Mann Science in general, as well as in each of its individual fields, is a part of human culture. In that sense, this book aims to contribute to uncovering a small part of the connections and relationships which bind image processing, categorized in informatics and technology, with the knowledge accumulated over the years on discrete structures. How does one consider problems, models, mathematical methods and prac- tical applications? How does the search for ideas and the endeavour for know- ledge in the original work of scientists find expression? Is there something to be learnt from science to date for future developments? Such questions have shaped the content and style of this book. Substantial impetus to the discrete theory of image processing was afforded by the work of Rosenfeld and colleagues. Other fruitful sources of ideas con- sidered here are number theoretical problems (GauB, Minkowski) and integral geometric investigations (Blaschke, Santalo). Since the beginning of the 1980s I have strived to build upon these ideas a unified mathematical representation of discrete image processing working together with R.K1ette and P.Hufnagl.

Semiring theory stands with a foot in each of two mathematical domains. The first being abstract algebra and the other the fields of applied mathematics such as optimization theory, the theory of discrete-event dynamical systems, automata theory, and formal language theory, as well as from the allied areas of theoretical computer science and theoretical physics. Most important applications of semiring theory in these areas turn out to revolve around the problem of finding the equalizer of a pair of affine maps between two semimodules. In this volume, we chart the state of the art on solving this problem, and present many specific cases of applications.

This book is essentially the third part of a trilogy, along with Semirings and their Applications, and Power Algebras over Semirings, both written by the same author and published by Kluwer Academic Publishers in 1999. While each book can be read independently of the others, to get the full force of the theory and applications one should have access to all three.

This work will be of interest to academic and industrial researchers and graduate students. The intent of the book is to bring the applications to the attention of the abstract mathematicians and to make the abstract mathematics available to those who are using these tools in an ad-hoc manner without realizing the full force of the theory.

Convex Analysis may be considered as a refinement of standard calculus, with equalities and approximations replaced by inequalities. As such, it can easily be integrated into a graduate study curriculum. Minimization algorithms, more specifically those adapted to non-differentiable functions, provide an immediate application of convex analysis to various fields related to optimization and operations research. These two topics making up the title of the book, reflect the two origins of the authors, who belong respectively to the academic world and to that of applications. Part I can be used as an introductory textbook (as a basis for courses, or for self-study); Part II continues this at a higher technical level and is addressed more to specialists, collecting results that so far have not appeared in books.

Advances in science and technology necessitate the use of increasingly-complicated dynamic control processes. Undoubtedly, sophisticated mathematical models are also concurrently elaborated for these processes. In particular, linear dynamic control systems iJ = Ay + Bu, y E M C ]Rn, U E ]RT, (1) where A and B are constants, are often abandoned in favor of nonlinear dynamic control systems (2) which, in addition, contain a large number of equations. The solution of problems for multidimensional nonlinear control systems en counters serious difficulties, which are both mathematical and technical in nature. Therefore it is imperative to develop methods of reduction of nonlinear systems to a simpler form, for example, decomposition into systems of lesser dimension. Approaches to reduction are diverse, in particular, techniques based on approxi mation methods. In this monograph, we elaborate the most natural and obvious (in our opinion) approach, which is essentially inherent in any theory of math ematical entities, for instance, in the theory of linear spaces, theory of groups, etc. Reduction in our interpretation is based on assigning to the initial object an isomorphic object, a quotient object, and a subobject. In the theory of linear spaces, for instance, reduction consists in reducing to an isomorphic linear space, quotient space, and subspace. Strictly speaking, the exposition of any mathemat ical theory essentially begins with the introduction of these reduced objects and determination of their basic properties in relation to the initial object."

Of recent coinage, the term "nondifferentiable optimization" (NDO) covers a spectrum of problems related to finding extremal values of nondifferentiable functions. Problems of minimizing nonsmooth functions arise in engineering applications as well as in mathematics proper. The Chebyshev approximation problem is an ample illustration of this. Without loss of generality, we shall consider only minimization problems. Among nonsmooth minimization problems, minimax problems and convex problems have been studied extensively ([31], [36], [57], [110], [120]). Interest in NDO has been constantly growing in recent years (monographs: [30], [81], [127] and articles and papers: [14], [20], [87]-[89], [98], [130], [135], [140]-[142], [152], [153], [160], all dealing with various aspects of non smooth optimization). For solving an arbitrary minimization problem, it is neces sary to: 1. Study properties of the objective function, in particular, its differentiability and directional differentiability. 2. Establish necessary (and, if possible, sufficient) condi tions for a global or local minimum. 3. Find the direction of descent (steepest or, simply, feasible--in appropriate sense). 4. Construct methods of successive approximation. In this book, the minimization problems for nonsmooth func tions of a finite number of variables are considered. Of fun damental importance are necessary conditions for an extremum (for example, [24], [45], [57], [73], [74], [103], [159], [163], [167], [168].

This new edition, like the first, presents a thorough introduction to differential and integral calculus, including the integration of differential forms on manifolds. However, an additional chapter on elementary topology makes the book more complete as an advanced calculus text, and sections have been added introducing physical applications in thermodynamics, fluid dynamics, and classical rigid body mechanics.