The field of neural information processing has two main objects: investigation into the functioning of biological neural networks and use of artificial neural networks to sol ve real world problems. Even before the reincarnation of the field of artificial neural networks in mid nineteen eighties, researchers have attempted to explore the engineering of human brain function. After the reincarnation, we have seen an emergence of a large number of neural network models and their successful applications to solve real world problems. This volume presents a collection of recent research and developments in the field of neural information processing. The book is organized in three Parts, i.e., (1) architectures, (2) learning algorithms, and (3) applications. Artificial neural networks consist of simple processing elements called neurons, which are connected by weights. The number of neurons and how they are connected to each other defines the architecture of a particular neural network. Part 1 of the book has nine chapters, demonstrating some of recent neural network architectures derived either to mimic aspects of human brain function or applied in some real world problems. Muresan provides a simple neural network model, based on spiking neurons that make use of shunting inhibition, which is capable of resisting small scale changes of stimulus. Hoshino and Zheng simulate a neural network of the auditory cortex to investigate neural basis for encoding and perception of vowel sounds.

This book considers problems of optimization arising in the design of electromagnetic radiators and receivers, presenting a systematic general theory applicable to a wide class of structures. The theory is illustrated with examples, and indications of how the results can be applied to more complicated structures. The final chapter introduces techniques from multicriteria optimization in antenna design. References to mathematics and engineering literature guide readers through the necessary mathematical background.

Convexity of sets in linear spaces, and concavity and convexity of functions, lie at the root of beautiful theoretical results that are at the same time extremely useful in the analysis and solution of optimization problems, including problems of either single objective or multiple objectives. Not all of these results rely necessarily on convexity and concavity; some of the results can guarantee that each local optimum is also a global optimum, giving these methods broader application to a wider class of problems. Hence, the focus of the first part of the book is concerned with several types of generalized convex sets and generalized concave functions. In addition to their applicability to nonconvex optimization, these convex sets and generalized concave functions are used in the book's second part, where decision-making and optimization problems under uncertainty are investigated. Uncertainty in the problem data often cannot be avoided when dealing with practical problems. Errors occur in real-world data for a host of reasons. However, over the last thirty years, the fuzzy set approach has proved to be useful in these situations. It is this approach to optimization under uncertainty that is extensively used and studied in the second part of this book. Typically, the membership functions of fuzzy sets involved in such problems are neither concave nor convex. They are, however, often quasiconcave or concave in some generalized sense. This opens possibilities for application of results on generalized concavity to fuzzy optimization. Despite this obvious relation, applying the interface of these two areas has been limited to date. It is hoped that the combination of ideas and results from the field of generalized concavity on the one hand and fuzzy optimization on the other hand outlined and discussed in Generalized Concavity in Fuzzy Optimization and Decision Analysis will be of interest to both communities. Our aim is to broaden the classes of problems that the combination of these two areas can satisfactorily address and solve.

The International Conference on Finsler and Lagrange Geometry and its Applications: A Meeting of Minds, took place August 13-20, 1998 at the University of Alberta in Edmonton, Canada. The main objective of this meeting was to help acquaint North American geometers with the extensive modern literature on Finsler geometry and Lagrange geometry of the Japanese and European schools, each with its own venerable history, on the one hand, and to communicate recent advances in stochastic theory and Hodge theory for Finsler manifolds by the younger North American school, on the other. The intent was to bring together practitioners of these schools of thought in a Canadian venue where there would be ample opportunity to exchange information and have cordial personal interactions. The present set of refereed papers begins .with the Pedagogical Sec tion I, where introductory and brief survey articles are presented, one from the Japanese School and two from the European School (Romania and Hungary). These have been prepared for non-experts with the intent of explaining basic points of view. The Section III is the main body of work. It is arranged in alphabetical order, by author. Section II gives a brief account of each of these contribu tions with a short reference list at the end. More extensive references are given in the individual articles."

The last decade has seen a remarkable development of the "Marginal and Moment Problems" as a research area in Probability and Statistics. Its attractiveness stemmed from its lasting ability to provide a researcher with difficult theoretical problems that have direct consequences for appli cations outside of mathematics. The relevant research aims centered mainly along the following lines that very frequently met each other to provide sur prizing and useful results : -To construct a probability distribution (to prove its existence, at least) with a given support and with some additional inner stochastic property defined typically either by moments or by marginal distributions. -To study the geometrical and topological structure of the set of prob ability distributions generated by such a property mostly with the aim to propose a procedure that would result in a stochastic model with some optimal properties within the set of probability distributions. These research aims characterize also, though only very generally, the scientific program of the 1996 conference "Distributions with given marginals and moment problems" held at the beginning of September in Prague, Czech Republic, to perpetuate the tradition and achievements of the closely related 1990 Roma symposium "On Frechet Classes" 1 and 1993 Seattle" AMS Summer Conference on Marginal Problem".

Geometric dynamics is a tool for developing a mathematical representation of real world phenomena, based on the notion of a field line described in two ways: -as the solution of any Cauchy problem associated to a first-order autonomous differential system; -as the solution of a certain Cauchy problem associated to a second-order conservative prolongation of the initial system. The basic novelty of our book is the discovery that a field line is a geodesic of a suitable geometrical structure on a given space (Lorentz-Udri~te world-force law). In other words, we create a wider class of Riemann-Jacobi, Riemann-Jacobi-Lagrange, or Finsler-Jacobi manifolds, ensuring that all trajectories of a given vector field are geodesics. This is our contribution to an old open problem studied by H. Poincare, S. Sasaki and others. From the kinematic viewpoint of corpuscular intuition, a field line shows the trajectory followed by a particle at a point of the definition domain of a vector field, if the particle is sensitive to the related type of field. Therefore, field lines appear in a natural way in problems of theoretical mechanics, fluid mechanics, physics, thermodynamics, biology, chemistry, etc.

In November 2001 the Mathematical Research Center at Oberwolfach, Germany, hosted the third Conference on Mathematical Models and Numerical Simulation in Electronic Industry. It brought together researchers in mathematics, electrical engineering and scientists working in industry.

The contributions to this volume try to bridge the gap between basic and applied mathematics, research in electrical engineering and the needs of industry.

The starting point of this volume was a conference entitled "Progress in Mathematical Programming," held at the Asilomar Conference Center in Pacific Grove, California, March 1-4, 1987. The main topic of the conference was developments in the theory and practice of linear programming since Karmarkar's algorithm. There were thirty presentations and approximately fifty people attended. Presentations included new algorithms, new analyses of algorithms, reports on computational experience, and some other topics related to the practice of mathematical programming. Interestingly, most of the progress reported at the conference was on the theoretical side. Several new polynomial algorithms for linear program- ming were presented (Barnes-Chopra-Jensen, Goldfarb-Mehrotra, Gonzaga, Kojima-Mizuno-Yoshise, Renegar, Todd, Vaidya, and Ye). Other algorithms presented were by Betke-Gritzmann, Blum, Gill-Murray-Saunders-Wright, Nazareth, Vial, and Zikan-Cottle. Efforts in the theoretical analysis of algo- rithms were also reported (Anstreicher, Bayer-Lagarias, Imai, Lagarias, Megiddo-Shub, Lagarias, Smale, and Vanderbei). Computational experiences were reported by Lustig, Tomlin, Todd, Tone, Ye, and Zikan-Cottle. Of special interest, although not in the main direction discussed at the conference, was the report by Rinaldi on the practical solution of some large traveling salesman problems. At the time of the conference, it was still not clear whether the new algorithms developed since Karmarkar's algorithm would replace the simplex method in practice. Alan Hoffman presented results on conditions under which linear programming problems can be solved by greedy algorithms.

This book provides a systematic and comprehensive account of asymptotic sets and functions from which a broad and useful theory emerges in the areas of optimization and variational inequalities. A variety of motivations leads mathematicians to study questions about attainment of the infimum in a minimization problem and its stability, duality and minmax theorems, convexification of sets and functions, and maximal monotone maps. For each there is the central problem of handling unbounded situations. Such problems arise in theory but also within the development of numerical methods. The book focuses on the notions of asymptotic cones and associated asymptotic functions that provide a natural and unifying framework for the resolution of these types of problems. These notions have been used largely and traditionally in convex analysis, yet these concepts play a prominent and independent role in both convex and nonconvex analysis. This book covers convex and nonconvex problems, offering detailed analysis and techniques that go beyond traditional approaches. The book will serve as a useful reference and self-contained text for researchers and graduate students in the fields of modern optimization theory and nonlinear analysis.

As our title reveals, we focus on optimal control methods and applications relevant to linear dynamic economic systems in discrete-time variables. We deal only with discrete cases simply because economic data are available in discrete forms, hence realistic economic policies should be established in discrete-time structures. Though many books have been written on optimal control in engineering, we see few on discrete-type optimal control. More over, since economic models take slightly different forms than do engineer ing ones, we need a comprehensive, self-contained treatment of linear optimal control applicable to discrete-time economic systems. The present work is intended to fill this need from the standpoint of contemporary macroeconomic stabilization. The work is organized as follows. In Chapter 1 we demonstrate instru ment instability in an economic stabilization problem and thereby establish the motivation for our departure into the optimal control world. Chapter 2 provides fundamental concepts and propositions for controlling linear deterministic discrete-time systems, together with some economic applica tions and numerical methods. Our optimal control rules are in the form of feedback from known state variables of the preceding period. When state variables are not observable or are accessible only with observation errors, we must obtain appropriate proxies for these variables, which are called "observers" in deterministic cases or "filters" in stochastic circumstances. In Chapters 3 and 4, respectively, Luenberger observers and Kalman filters are discussed, developed, and applied in various directions. Noticing that a separation principle lies between observer (or filter) and controller (cf."

The subject of the present book is sub differential calculus. The main source of this branch of functional analysis is the theory of extremal problems. For a start, we explicate the origin and statement of the principal problems of sub differential calculus. To this end, consider an abstract minimization problem formulated as follows: x E X, f(x) --+ inf. Here X is a vector space and f : X --+ iR is a numeric function taking possibly infinite values. In these circumstances, we are usually interested in the quantity inf f( x), the value of the problem, and in a solution or an optimum plan of the problem (i. e. , such an x that f(x) = inf f(X", if the latter exists. It is a rare occurrence to solve an arbitrary problem explicitly, i. e. to exhibit the value of the problem and one of its solutions. In this respect it becomes necessary to simplify the initial problem by reducing it to somewhat more manageable modifications formulated with the details of the structure of the objective function taken in due account. The conventional hypothesis presumed in attempts at theoretically approaching the reduction sought is as follows. Introducing an auxiliary function 1, one considers the next problem: x EX, f(x) -l(x) --+ inf. Furthermore, the new problem is assumed to be as complicated as the initial prob lem provided that 1 is a linear functional over X, i. e.

In delivering lectures and writing books, we were most often forced to pay absolutely no attention to a great body of interesting results and useful algorithms appearing in numerous sources and occasionally encountered. It was absolutely that most of these re sults would finally be forgotten because it is impossible to run through the entire variety of sources where these materials could be published. Therefore, we decided to do what we can to correct this situation. We discussed this problem with Ershov and came to an idea to write an encyclopedia of algorithms on graphs focusing our main attention on the algorithms already used in programming and their generalizations or modifications. We thought that it is reasonable to group all graphs into certain classes and place the algo rithms developed for each class into a separate book. The existence of trees, i. e., a class of graphs especially important for programming, also supported this decision. This monograph is the first but, as we hope, not the last book written as part of our project. It was preceded by two books "Algorithms on Trees" (1984) and "Algorithms of Processing of Trees" (1990) small editions of which were published at the Computer Center of the Siberian Division of the Russian Academy of Sciences. The books were distributed immediately and this made out our decision to prepare a combined mono graph on the basis of these books even stronger."

This book describes the rapidly developing field of interior point methods (IPMs). An extensive analysis is given of path-following methods for linear programming, quadratic programming and convex programming. These methods, which form a subclass of interior point methods, follow the central path, which is an analytic curve defined by the problem. Relatively simple and elegant proofs for polynomiality are given. The theory is illustrated using several explicit examples. Moreover, an overview of other classes of IPMs is given. It is shown that all these methods rely on the same notion as the path-following methods: all these methods use the central path implicitly or explicitly as a reference path to go to the optimum. For specialists in IPMs as well as those seeking an introduction to IPMs. The book is accessible to any mathematician with basic mathematical programming knowledge.

Many problems in statistics and econometrics offer themselves naturally to
the use of optimization heuristics. Standard methods applied to highly
complex problems often produce approximate results, of unknown quality,
based on heavy assumptions. Optimization heuristic methods provide
powerful results to many complex problems. combined with relatively
simple implementation.

• Offers a self-contained introduction to optimization heuristics in econometrics and statistics
• Features many examples of optimization heuristic methods applied to real problems
• Includes detailed coverage of the threshold accepting heuristic
• Provides suggestions for further reading

This volume provides a comprehensive introduction to the theory of (deterministic) optimization. It covers both continuous and discrete optimization. This allows readers to study problems under different points-of-view, which supports a better understanding of the entire field. Many exercises are included to increase the reader's understanding.

Frontiers of Evolutionary Computation brings together eleven contributions by international leading researchers discussing what significant issues still remain unresolved in the field of Evolutionary Computation (EC). They explore such topics as the role of building blocks, the balancing of exploration with exploitation, the modeling of EC algorithms, the connection with optimization theory and the role of EC as a meta-heuristic method, to name a few. The articles feature a mixture of informal discussion interspersed with formal statements, thus providing the reader an opportunity to observe a wide range of EC problems from the investigative perspective of world-renowned researchers. These prominent researchers include:
-Heinz Muhlenbein,
-Kenneth De Jong,
-Carlos Cotta and Pablo Moscato,
-Lee Altenberg,
-Gary A. Kochenberger, Fred Glover, Bahram Alidaee and Cesar Rego,
-William G. Macready,
-Christopher R. Stephens and Riccardo Poli,
-Lothar M. Schmitt,
-John R. Koza, Matthew J. Street and Martin A. Keane,
-Vivek Balaraman,
-Wolfgang Banzhaf and Julian Miller.

Frontiers of Evolutionary Computation is ideal for researchers and students who want to follow the process of EC problem-solving and for those who want to consider what frontiers still await their exploration. "

The purpose of this four volume series is to make available for college teachers and students samples of important and realistic applications of mathematics which can be covered in undergraduate programs. The goal is to provide illustrations of how modem mathematics is actually employed to solve relevant contemporary problems. Although these independent chapters were prepared primarily for teachers in the general mathematical sciences, they should prove valuable to students, teachers, and research scientists in many of the fields of application as well. Prerequisites for each chapter and suggestions for the teacher are provided. Several of these chapters have been tested in a variety of classroom settings, and all have undergone extensive peer review and revision. Illustrations and exercises be covered in one class, are included in most chapters. Some units can whereas others provide sufficient material for a few weeks of class time. Volume 1 contains 23 chapters and deals with differential equations and, in the last four chapters, problems leading to partial differential equations. Applications are taken from medicine, biology, traffic systems and several other fields. The 14 chapters in Volume 2 are devoted mostly to problems arising in political science, but they also address questions appearing in sociology and ecology. Topics covered include voting systems, weighted voting, proportional representation, coalitional values, and committees. The 14 chapters in Volume 3 emphasize discrete mathematical methods such as those which arise in graph theory, combinatorics, and networks.

This book contains a selection of papers presented at the conference on High Performance Software for Nonlinear Optimization (HPSN097) which was held in Ischia, Italy, in June 1997. The rapid progress of computer technologies, including new parallel architec tures, has stimulated a large amount of research devoted to building software environments and defining algorithms able to fully exploit this new computa tional power. In some sense, numerical analysis has to conform itself to the new tools. The impact of parallel computing in nonlinear optimization, which had a slow start at the beginning, seems now to increase at a fast rate, and it is reasonable to expect an even greater acceleration in the future. As with the first HPSNO conference, the goal of the HPSN097 conference was to supply a broad overview of the more recent developments and trends in nonlinear optimization, emphasizing the algorithmic and high performance software aspects. Bringing together new computational methodologies with theoretical ad vances and new computer technologies is an exciting challenge that involves all scientists willing to develop high performance numerical software. This book contains several important contributions from different and com plementary standpoints. Obviously, the articles in the book do not cover all the areas of the conference topic or all the most recent developments, because of the large number of new theoretical and computational ideas of the last few years."

After the IUTAM Symposium on Optimization in Structural Design held in Warsaw in 1973, it was clear to me that the time had come for organizing into a consistent body of thought the enormous quantity of results obtained in this domain, studied from so many different points of view, with so many different methods, and at so many levels of practical applicability. My colleague and friend Gianantonnio Sacchi from Milan and I met with Professor Prager in Savognin in July 1974, where I submitted to them my first ideas for a treatise on structural optimization: It should cover the whole domain from basic theory to practical applications, and deal with various materials, various types of structures, various functions required of the structures, and various types of cost . . Obviously, this was to be a team effort, to total three or four volumes, to be written in a balanced manner as textbooks and handbooks. Nothing similar existed at that time, and, indeed, nothing has been published to date. Professor Prager was immedi ately in favor of such a project. He agreed to write a first part on optimality criteria with me and to help me in the general organization of the series. Since Professor Sacchi was willing to write the text on variational methods, it remained to find authors for parts on the mathematical programming approach to structural optimization (and, more generally, on numerical methods) and on practical optimal design procedures in metal and concrete."

During the last three decades, breakthroughs in computer technology have made a tremendous impact on optimization. In particular, parallel computing has made it possible to solve larger and computationally more difficult prob lems. This volume contains mainly lecture notes from a Nordic Summer School held at the Linkoping Institute of Technology, Sweden in August 1995. In order to make the book more complete, a few authors were invited to contribute chapters that were not part of the course on this first occasion. The purpose of this Nordic course in advanced studies was three-fold. One goal was to introduce the students to the new achievements in a new and very active field, bring them close to world leading researchers, and strengthen their competence in an area with internationally explosive rate of growth. A second goal was to strengthen the bonds between students from different Nordic countries, and to encourage collaboration and joint research ventures over the borders. In this respect, the course built further on the achievements of the "Nordic Network in Mathematical Programming," which has been running during the last three years with the support ofthe Nordic Council for Advanced Studies (NorFA). The final goal was to produce literature on the particular subject, which would be available to both the participating students and to the students of the "next generation" ."

2. The Algorithm ...59 3. Convergence Analysis ..., ...60 4. Complexity Analysis ...63 5. Conclusions ...67 References ...67 A Simple Proof for a Result of Ollerenshaw on Steiner Trees ...68 Xiufeng Du, Ding-Zhu Du, Biao Gao, and Lixue Qii 1. Introduction ...68 2. In the Euclidean Plane ...69 3. In the Rectilinear Plane ...70 4. Discussion ...-...71 References ...71 Optimization Algorithms for the Satisfiability (SAT) Problem ...72 Jun Gu 1. Introduction ...72 2. A Classification of SAT Algorithms ...7:3 3. Preliminaries ...IV 4. Complete Algorithms and Incomplete Algorithms ...81 5. Optimization: An Iterative Refinement Process ...86 6. Local Search Algorithms for SAT ...89 7. Global Optimization Algorithms for SAT Problem ...106 8. Applications ...137 9. Future Work ...140 10. Conclusions ...141 References ...143 Ergodic Convergence in Proximal Point Algorithms with Bregman Functions ...155 Osman Guier 1. Introduction ...: ...155 2. Convergence for Function Minimization ...158 3. Convergence for Arbitrary Maximal Monotone Operators ...161 References ...163 Adding and Deleting Constraints in the Logarithmic Barrier Method for LP ...166 D. den Hertog, C. Roos, and T. Terlaky 1. Introduction ...16(5 2. The Logarithmic Darrier Method ...lG8 CONTENTS IX 3. The Effects of Shifting, Adding and Deleting Constraints ...171 4. The Build-Up and Down Algorithm ...177 ...5. Complexity Analysis ...180 References ...184 A Projection Method for Solving Infinite Systems of Linear Inequalities ...186 Hui Hu 1. Introduction ...186 2. The Projection Method ...186 3. Convergence Rate ...189 4. Infinite Systems of Convex Inequalities ...191 5. Application ...193 References ...

In 1984, N. Karmarkar published a seminal paper on algorithmic linear programming. During the subsequent decade, it stimulated a huge outpouring of new algorithmic results by researchers world-wide in many areas of mathematical programming and numerical computation. This book gives an overview of the resulting, dramatic reorganization that has occurred in one of these areas: algorithmic differentiable optimization and equation-solving, or, more simply, algorithmic differentiable programming. The book is aimed at readers familiar with advanced calculus, numerical analysis, in particular numerical linear algebra, the theory and algorithms of linear and nonlinear programming, and the fundamentals of computer science, in particular, computer programming and the basic models of computation and complexity theory. J.L. Nazareth is a Professor in the Department of Pure and Applied Mathematics at Washington State University. He is the author of two books previously published by Springer-Verlag, DLP and Extensions: An Optimization Model and Decision Support System (2001) and The Newton-Cauchy Framework: A Unified Approach to Unconstrained Nonlinear Minimization (1994).

Over the past decade the financial and business environments have undergone significant changes. During the same period several advances have been made within the field of financial engineering, involving both the methodological tools as well as the application areas.

This comprehensive edited volume discusses the most recent advances within the field of financial engineering, focusing not only on the description of the existing areas in financial engineering research, but also on the new methodologies that have been developed for modeling and addressing financial engineering problems.

This book is divided into four major parts, each covering different aspects of financial engineering and modeling such as portfolio management and trading, risk management, applications of operation research methods, and credit rating models.

Handbook of Financial Engineering is intended for financial engineers, researchers, applied mathematicians, and graduate students interested in real-world applications to financial engineering.

A function is convex if its epigraph is convex. This geometrical structure has very strong implications in terms of continuity and differentiability. Separation theorems lead to optimality conditions and duality for convex problems. A function is quasiconvex if its lower level sets are convex. Here again, the geo metrical structure of the level sets implies some continuity and differentiability properties for quasiconvex functions. Optimality conditions and duality can be derived for optimization problems involving such functions as well. Over a period of about fifty years, quasiconvex and other generalized convex functions have been considered in a variety of fields including economies, man agement science, engineering, probability and applied sciences in accordance with the need of particular applications. During the last twenty-five years, an increase of research activities in this field has been witnessed. More recently generalized monotonicity of maps has been studied. It relates to generalized convexity off unctions as monotonicity relates to convexity. Generalized monotonicity plays a role in variational inequality problems, complementarity problems and more generally, in equilibrium prob lems."

A logic view of 0-1 integer programming problems, providing new insights into the structure of problems that can lead the researcher to more effective solution techniques depending on the problem class. Operations research techniques are integrated into a logic programming environment. The first monographic treatment that begins to unify these two methodological approaches. Logic-based methods for modelling and solving combinatorial problems have recently started to play a significant role in both theory and practice. The application of logic to combinatorial problems has a dual aspect. On one hand, constraint logic programming allows one to declaratively model combinatorial problems over an appropriate constraint domain, the problems then being solved by a corresponding constraint solver. Besides being a high-level declarative interface to the constraint solver, the logic programming language allows one also to implement those subproblems that cannot be naturally expressed with constraints. On the other hand, logic-based methods can be used as a constraint solving technique within a constraint solver for combinatorial problems modelled as 0-1 integer programs.