Since the publication of the first edition of our book, geometric algorithms and combinatorial optimization have kept growing at the same fast pace as before. Nevertheless, we do not feel that the ongoing research has made this book outdated. Rather, it seems that many of the new results build on the models, algorithms, and theorems presented here. For instance, the celebrated Dyer-Frieze-Kannan algorithm for approximating the volume of a convex body is based on the oracle model of convex bodies and uses the ellipsoid method as a preprocessing technique. The polynomial time equivalence of optimization, separation, and membership has become a commonly employed tool in the study of the complexity of combinatorial optimization problems and in the newly developing field of computational convexity. Implementations of the basis reduction algorithm can be found in various computer algebra software systems. On the other hand, several of the open problems discussed in the first edition are still unsolved. For example, there are still no combinatorial polynomial time algorithms known for minimizing a submodular function or finding a maximum clique in a perfect graph. Moreover, despite the success of the interior point methods for the solution of explicitly given linear programs there is still no method known that solves implicitly given linear programs, such as those described in this book, and that is both practically and theoretically efficient. In particular, it is not known how to adapt interior point methods to such linear programs.

This book is about time-domain modelling, stability, stabilization, control design and filtering for JTDS. It gives readers a thorough understanding of the basic mathematical analysis and fundamentals, offers a straightforward treatment of the different topics and provides broad coverage of the recent methodologies.

The problem of obtaining dynamical models directly from an observed time-series occurs in many fields of application. There are a number of possible approaches to this problem. In this volume a number of such points of view are exposed: the statistical time series approach, a theory of guaranted performance, and finally a deterministic approximation approach. This volume is an out-growth of a number of get-togethers sponsered by the Systems and Decision Sciences group of the International Institute of Applied Systems Analysis (IIASA) in Laxenburg, Austria. The hospitality and support of this organization is gratefully acknowledged. Jan Willems Groningen, the Netherlands May 1989 TABLE OF CONTENTS Linear System Identification- A Survey page 1 M. Deistler A Tutorial on Hankel-Norm Approximation 26 K. Glover A Deterministic Approach to Approximate Modelling 49 C. Heij and J. C. Willems Identification - a Theory of Guaranteed Estimates 135 A. B. Kurzhanski Statistical Aspects of Model Selection 215 R. Shibata Index 241 Addresses of Authors 246 LINEAR SYSTEM IDENTIFICATION* A SURVEY M. DEISTLER Abstract In this paper we give an introductory survey on the theory of identification of (in general MIMO) linear systems from (discrete) time series data. The main parts are: Structure theory for linear systems, asymptotic properties of maximum likelihood type estimators, estimation of the dynamic specification by methods based on information criteria and finally, extensions and alternative approaches such as identification of unstable systems and errors-in-variables. Keywords Linear systems, parametrization, maximum likelihood estimation, information criteria, errors-in-variables.

The purpose of this four volume series is to make available for college teachers and students samples of important and realistic applications of mathematics which can be covered in undergraduate programs. The goal is to provide illustrations of how modem mathematics is actually employed to solve relevant contemporary problems. Although these independent chapters were prepared primarily for teachers in the general mathematical sciences, they should prove valuable to students, teachers, and research scientists in many of the fields of application as well. Prerequisites for each chapter and suggestions for the teacher are provided. Several of these chapters have been tested in a variety of classroom settings, and all have undergone extensive peer review and revision. Illustrations and exercises be covered in one class, are included in most chapters. Some units can whereas others provide sufficient material for a few weeks of class time. Volume 1 contains 23 chapters and deals with differential equations and, in the last four chapters, problems leading to partial differential equations. Applications are taken from medicine, biology, traffic systems and several other fields. The 14 chapters in Volume 2 are devoted mostly to problems arising in political science, but they also address questions appearing in sociology and ecology. Topics covered include voting systems, weighted voting, proportional representation, coalitional values, and committees. The 14 chapters in Volume 3 emphasize discrete mathematical methods such as those which arise in graph theory, combinatorics, and networks.

In recent years much attention has been given to the development of auto matic systems of planning, design and control in various branches of the national economy. Quality of decisions is an issue which has come to the forefront, increasing the significance of optimization algorithms in math ematical software packages for al, ltomatic systems of various levels and pur poses. Methods for minimizing functions with discontinuous gradients are gaining in importance and the xperts in the computational methods of mathematical programming tend to agree that progress in the development of algorithms for minimizing nonsmooth functions is the key to the con struction of efficient techniques for solving large scale problems. This monograph summarizes to a certain extent fifteen years of the author's work on developing generalized gradient methods for nonsmooth minimization. This work started in the department of economic cybernetics of the Institute of Cybernetics of the Ukrainian Academy of Sciences under the supervision of V.S. Mikhalevich, a member of the Ukrainian Academy of Sciences, in connection with the need for solutions to important, practical problems of optimal planning and design. In Chap. I we describe basic classes of nonsmooth functions that are dif ferentiable almost everywhere, and analyze various ways of defining generalized gradient sets. In Chap. 2 we study in detail various versions of the su bgradient method, show their relation to the methods of Fejer-type approximations and briefly present the fundamentals of e-subgradient methods."

Hysteresis phenomena are common in numerous physical, mechanical, ecological and biological systems. They reflect memory effects and process irreversibility. The use of hysteresis operators (hysterons) offers an approach to macroscopic modelling of the dynamics of phase transitions and rheological systems. The applications cover processes in electromagnetism, elastoplasticity and population dynamics in particular. Hysterons are also typical elements of control systems where they represent thermostats and other discontinuous controllers with memory. The book offers the first systematic mathematical treatment of hysteresis nonlinearities. Construction procedures are set up for hysterons in various function spaces, in continuous and discontinuous cases. A general theory of variable hysterons is developed, including identification and stability questions. Both deterministic and non-deterministic hysterons are considered, with applications to the study of feedback systems. Many of the results presented - mostly obtained by the authors and their scientific group - have not been published before. The book is essentially self contained and is addressed both to researchers and advanced students.

This is the first volume of a three-volume introduction to modern geometry, with emphasis on applications to other areas of mathematics and theoretical physics. Topics covered include tensors and their differential calculus, the calculus of variations in one and several dimensions, and geometric field theory. This material is explained in as simple and concrete a language as possible, in a terminology acceptable to physicists. The text for the second edition has been substantially revised.

This handbook provides an in-depth examination of important theoretical methods and procedures in applied analysis. It details many of the most important theoretical trends in nonlinear analysis and applications to different fields. These features make the volume a valuable tool for every researcher working on nonlinear analysis.

The articles in this volume cover recent work in the area of flow control from the point of view of both engineers and mathematicians. These writings are especially timely, as they coincide with the emergence of the role of mathematics and systematic engineering analysis in flow control and optimization. Recently this role has significantly expanded to the point where now sophisticated mathematical and computational tools are being increasingly applied to the control and optimization of fluid flows. These articles document some important work that has gone on to influence the practical, everyday design of flows; moreover, they represent the state of the art in the formulation, analysis, and computation of flow control problems. This volume will be of interest to both applied mathematicians and to engineers.

The articles in this volume focus on control theory of systems governed by nonlinear linear partial differential equations, identification and optimal design of such systems, and modelling of advanced materials. Optimal design of systems governed by PDEs is a relatively new area of study, now particularly relevant because of interest in optimization of fluid flow in domains of variable configuration, advanced and composite materials studies and "smart" materials which include possibilities for built in sensing and control actuation. The book will be of interest to both applied mathematicians and to engineers.

During the past decade the interaction between control theory and linear algebra has been ever increasing, giving rise to new results in both areas. As a natural outflow of this research, this book presents information on this interdisciplinary area. The cross-fertilization between control and linear algebra can be found in subfields such as Numerical Linear Algebra, Canonical Forms, Ring-theoretic Methods, Matrix Theory, and Robust Control. This book's editors were challenged to present the latest results in these areas and to find points of common interest. This volume reflects very nicely the interaction: the range of topics seems very wide indeed, but the basic problems and techniques are always closely connected. And the common denominator in all of this is, of course, linear algebra.
This book is suitable for both mathematicians and students.

The basis for this book is a number of lectures given frequently by the author to third year students of the Department of Economics at Leningrad State University who specialize in economical cybernetics. The main purpose of this book is to provide the student with a relatively simple and easy-to-understand manual containing the basic mathematical machinery utilized in the theory of games. Practical examples (including those from the field of economics) serve mainly as an interpretation of the mathematical foundations of this theory rather than as indications of their actual or potential applicability. The present volume is significantly different from other books on the theory of games. The difference is both in the choice of mathematical problems as well as in the nature of the exposition. The realm of the problems is somewhat limited but the author has tried to achieve the greatest possible systematization in his exposition. Whenever possible the author has attempted to provide a game-theoretical argument with the necessary mathematical rigor and reasonable generality. Formal mathematical prerequisites for this book are quite modest. Only the elementary tools of linear algebra and mathematical analysis are used.

This monograph is an introduction to optimal control theory for systems governed by vector ordinary differential equations. It is not intended as a state-of-the-art handbook for researchers. We have tried to keep two types of reader in mind: (1) mathematicians, graduate students, and advanced undergraduates in mathematics who want a concise introduction to a field which contains nontrivial interesting applications of mathematics (for example, weak convergence, convexity, and the theory of ordinary differential equations); (2) economists, applied scientists, and engineers who want to understand some of the mathematical foundations. of optimal control theory. In general, we have emphasized motivation and explanation, avoiding the "definition-axiom-theorem-proof" approach. We make use of a large number of examples, especially one simple canonical example which we carry through the entire book. In proving theorems, we often just prove the simplest case, then state the more general results which can be proved. Many of the more difficult topics are discussed in the "Notes" sections at the end of chapters and several major proofs are in the Appendices. We feel that a solid understanding of basic facts is best attained by at first avoiding excessive generality. We have not tried to give an exhaustive list of references, preferring to refer the reader to existing books or papers with extensive bibliographies. References are given by author's name and the year of publication, e.g., Waltman [1974].

This IMA Volume in Mathematics and its Applications DISCRETE EVENT SYSTEMS, MANUFACTURING SYSTEMS AND COMMUNICATION NETWORKS is based on the proceedings of a workshop that was an integral part of the 1992-93 IMA program on "Control Theory. " The study of discrete event dynamical systems (DEDS) has become rapidly popular among researchers in systems and control, in communication networks, in manufacturing, and in distributed computing. This development has created problems for re searchers and potential "consumers" of the research. The first problem is the veritable Babel of languages, formalisms, and approaches, which makes it very difficult to determine the commonalities and distinctions among the competing schools of approaches. The second, related, problem arises from the different traditions, paradigms, values, and experience that scholars bring to their study of DEDS, depending on whether they come from control, com munication, computer science, or mathematical logic. As a result, intellectual exchange among scholars becomes compromised by unexplicated assumptions. The purpose of the Workshop was to promote exchange among scholars representing some of the major "schools" of thought in DEDS with the hope that (1) greater clarity will be achieved thereby, and (2) cross-fertilization will lead to more fruitful questions. We thank P. R. Kumar and P. P. Varaiya for organizing the workshop and editing the proceedings. We also take this opportunity to thank the National Science Foundation and the Army Research Office, whose financial support made the workshop possible. A vner Friedman Willard Miller, Jr."

As any human activity needs goals, mathematical research needs problems -David Hilbert Mechanics is the paradise of mathematical sciences -Leonardo da Vinci Mechanics and mathematics have been complementary partners since Newton's time and the history of science shows much evidence of the ben eficial influence of these disciplines on each other. Driven by increasingly elaborate modern technological applications the symbiotic relationship between mathematics and mechanics is continually growing. However, the increasingly large number of specialist journals has generated a du ality gap between the two partners, and this gap is growing wider. Advances in Mechanics and Mathematics (AMMA) is intended to bridge the gap by providing multi-disciplinary publications which fall into the two following complementary categories: 1. An annual book dedicated to the latest developments in mechanics and mathematics; 2. Monographs, advanced textbooks, handbooks, edited vol umes and selected conference proceedings. The AMMA annual book publishes invited and contributed compre hensive reviews, research and survey articles within the broad area of modern mechanics and applied mathematics. Mechanics is understood here in the most general sense of the word, and is taken to embrace relevant physical and biological phenomena involving electromagnetic, thermal and quantum effects and biomechanics, as well as general dy namical systems. Especially encouraged are articles on mathematical and computational models and methods based on mechanics and their interactions with other fields. All contributions will be reviewed so as to guarantee the highest possible scientific standards."

Approach your problems from the right end It isn't that they can't see the solution. It is and begin with the answers. Then one day, that they can't see the problem. perhaps you will find the final question. G. K. Chesterton. The Scandal of Father 'The Hermit Clad in Crane Feathers' in R. Brown 'The point of a Pin'. van Gulik's The Chinese Maze Murders. Growing specialization and diversification have brought a host of monographs and textbooks on increasingly specialized topics. However, the "tree" of knowledge of mathematics and related fields does not grow only by putting forth new branches. It also happens, quite often in fact, that branches which were thought to be completely disparate are suddenly seen to be related. Further, the kind and level of sophistication of mathematics applied in various sciences has changed drastically in recent years: measure theory is used (non trivially) in regional and theoretical economics; algebraic geometry interacts with physics; the Minkowsky lemma, coding theory and the structure of water meet one another in packing and covering theory; quantum fields, crystal defects and mathematical programming profit from homotopy theory; Lie algebras are relevant to filtering; and prediction and electrical engineering can use Stein spaces. And in addition to this there are such new emerging subdisciplines as "experimental mathematics," "CFD," "completely integrable systems," "chaos, synergetics and large-scale order," which are almost impossible to fit into the existing classification schemes. They draw upon widely different sections of mathematics."

Robust control originates with the need to cope with systems with modeling uncertainty. There have been several mathematical techniques developed for robust control system analysis. The articles in this volume cover all of the major research directions in the field.

This IMA Volume in Mathematics and its Applications STOCHASTIC DIFFERENTIAL SYSTEMS, STOCHASTIC CONTROL THEORY AND APPLICATIONS is the proceedings of a workshop which was an integral part of the 1986-87 IMA program on STOCHASTIC DIFFERENTIAL EQUATIONS AND THEIR APPLICATIONS. We are grateful to the Scientific Committee: Daniel Stroock (Chairman) WendeIl Flerning Theodore Harris Pierre-Louis Lions Steven Orey George Papanicolaou for planning and implementing an exciting and stimulating year-long program. We es pecially thank WendeIl Fleming and Pierre-Louis Lions for organizing an interesting and productive workshop in an area in which mathematics is beginning to make significant contributions to real-world problems. George R. Seil Hans Weinberger PREFACE This volume is the Proceedings of a Workshop on Stochastic Differential Systems, Stochastic Control Theory, and Applications held at IMA June 9-19,1986. The Workshop Program Commit tee consisted of W.H. Fleming and P.-L. Lions (co-chairmen), J. Baras, B. Hajek, J.M. Harrison, and H. Sussmann. The Workshop emphasized topics in the following four areas. (1) Mathematical theory of stochastic differential systems, stochastic control and nonlinear filtering for Markov diffusion processes. Connections with partial differential equations. (2) Applications of stochastic differential system theory, in engineering and management sci ence. Adaptive control of Markov processes. Advanced computational methods in stochas tic control and nonlinear filtering. (3) Stochastic scheduling, queueing networks, and related topics. Flow control, multiarm bandit problems, applications to problems of computer networks and scheduling of complex manufacturing operations."

Methods in Nonlinear Integral Equations presents several extremely fruitful methods for the analysis of systems and nonlinear integral equations. They include: fixed point methods (the Schauder and Leray-Schauder principles), variational methods (direct variational methods and mountain pass theorems), and iterative methods (the discrete continuation principle, upper and lower solutions techniques, Newton's method and the generalized quasilinearization method). Many important applications for several classes of integral equations and, in particular, for initial and boundary value problems, are presented to complement the theory. Special attention is paid to the existence and localization of solutions in bounded domains such as balls and order intervals. The presentation is essentially self-contained and leads the reader from classical concepts to current ideas and methods of nonlinear analysis.

In this treatise we present the semigroup approach to quasilinear evolution equa of parabolic type that has been developed over the last ten years, approxi tions mately. It emphasizes the dynamic viewpoint and is sufficiently general and flexible to encompass a great variety of concrete systems of partial differential equations occurring in science, some of those being of rather 'nonstandard' type. In partic ular, to date it is the only general method that applies to noncoercive systems. Although we are interested in nonlinear problems, our method is based on the theory of linear holomorphic semigroups. This distinguishes it from the theory of nonlinear contraction semigroups whose basis is a nonlinear version of the Hille Yosida theorem: the Crandall-Liggett theorem. The latter theory is well-known and well-documented in the literature. Even though it is a powerful technique having found many applications, it is limited in its scope by the fact that, in concrete applications, it is closely tied to the maximum principle. Thus the theory of nonlinear contraction semigroups does not apply to systems, in general, since they do not allow for a maximum principle. For these reasons we do not include that theory."

"The central fact is that we are planning agents." (M. Bratman, Intentions, Plans, and Practical Reasoning, 1987, p. 2) Recent arguments to the contrary notwithstanding, it seems to be the case that people-the best exemplars of general intelligence that we have to date do a lot of planning. It is therefore not surprising that modeling the planning process has always been a central part of the Artificial Intelligence enterprise. Reasonable behavior in complex environments requires the ability to consider what actions one should take, in order to achieve (some of) what one wants and that, in a nutshell, is what AI planning systems attempt to do. Indeed, the basic description of a plan generation algorithm has remained constant for nearly three decades: given a desciption of an initial state I, a goal state G, and a set of action types, find a sequence S of instantiated actions such that when S is executed instate I, G is guaranteed as a result. Working out the details of this class of algorithms, and making the elabora tions necessary for them to be effective in real environments, have proven to be bigger tasks than one might have imagined.

Biotechnology has been labelled as one of the key technologies of the last two decades of the 20th Century, offering boundless solutions to problems ranging from food and agricultural production to pharmaceutical and medical applications, as well as environmental and bioremediation problems. Biological processes, however, are complex and the prevailing mechanisms are either unknown or poorly understood. This means that adequate techniques for data acquisition and analysis, leading to appropriate modeling and simulation packages that can be superimposed on the engineering principles, need to be routine tools for future biotechnologists. The present volume presents a masterly summary of the most recent work in the field, covering: instrumentation systems; enzyme technology; environmental biotechnology; food applications; and metabolic engineering.

Proceedings of the IUTAM Symposium on Structural Optimization, Melbourne, Australia, February 9-13, 1988

In the fifties and sixties, several real problems, old and new, especially in Physics, Mechanics, Fluidodynamics, Structural Engi- neering, have shown the need of new mathematical models for study- ing the equilibrium of a system. This has led to the formulation of Variational Inequalities (by G. Stampacchia), and to the develop- ment of Complementarity Systems (by W.S. Dorn, G.B. Dantzig, R.W. Cottle, O.L. Mangasarian et al.) with important applications in the elasto-plastic field (initiated by G. Maier). The great advan- tage of these models is that the equilibrium is not necessarily the extremum of functional, like energy, so that no such functional must be supposed to exist. In the same decades, in some fields like Control Theory, Net- works, Industrial Systems, Logistics, Management Science, there has been a strong request of mathmatical models for optimizing situa- tions where there are concurrent objectives, so that Vector Optimiza- tion (initiated by W. Pareto) has received new impetus. With regard to equilibrium problems, Vector Optimization has the above - mentioned drawback of being obliged to assume the exis- tence of a (vector) functional. Therefore, at the end of the seventies the study of Vector Variational Inequalities began with the scope of exploiting the advantages of both variational and vector models. This volume puts together most of the recent mathematical results in Vector Variational Inequalities with the purpose of contributing to further research.

This book is devoted to an investigation of control problems which can be described by ordinary differential equations and be expressed in terms of game theoretical notions. In these terms, a strategy is a control based on the feedback principle which will assure a definite equality for the controlled process which is subject to uncertain factors such as a move or a controlling action of the opponent. "Game" "Theoretical Control Problems" contains definitions and formalizations of differential games, existence for equilibrium and extensive discussions of optimal strategies. Formal definitions and statements are accompanied by suitable motivations and discussions of computational algorithms. The book is addessed to mathematicians, engineers, economists and other users of control theoretical and game theoretical notions.