Dynamic Programming and Modern Control Theory

This book is a self-contained text devoted to the numerical determination of optimal inputs for system identification. It presents the current state of optimal inputs with extensive background material on optimization and system identification. The field of optimal inputs has been an area of considerable research recently with important advances by R. Mehra, G. c. Goodwin, M. Aoki, and N. E. Nahi, to name just a few eminent in vestigators. The authors' interest in optimal inputs first developed when F. E. Yates, an eminent physiologist, expressed the need for optimal or preferred inputs to estimate physiological parameters. The text assumes no previous knowledge of optimal control theory, numerical methods for solving two-point boundary-value problems, or system identification. As such it should be of interest to students as well as researchers in control engineering, computer science, biomedical en gineering, operations research, and economics. In addition the sections on beam theory should be of special interest to mechanical and civil en gineers and the sections on eigenvalues should be of interest to numerical analysts. The authors have tried to present a balanced viewpoint; however, primary emphasis is on those methods in which they have had first-hand experience. Their work has been influenced by many authors. Special acknowledgment should go to those listed above as well as R. Bellman, A. Miele, G. A. Bekey, and A. P. Sage. The book can be used for a two-semester course in control theory, system identification, and optimal inputs."

For many years it has been an article of faith of numerical analysts that the evaluation of derivatives of complicated functions should be avoided. Derivatives were evaluated using finite differences or, more recently, using symbolic manipulation packages. The first has the disadvantage of limited accuracy. The second has disadvantages of being expensive and requiring considerable computer memory. The recent developments described in this text allow the evaluation of derivatives using simple automatic derivative evaluation subroutines pro grammed in FORTRAN or BASIC. These subroutines can even be programmed on a personal computer. The concept for the evaluation of the derivatives was originally developed by Wengert over 20 years ago. Significant im provements have been made in Wengert's method and are utilized in this text. The purpose of this text is to familiarize computer users with a simple and practical method for obtaining the partial derivatives of complicated mathematical expressions. The text illustrates the use of automatic deriva tive evaluation subroutines to solve a wide range of nonlinear least-squares, optimal control, system identification, two-point boundary value problems, and integral equations. The numerical values of the derivatives are evalu ated exactly, except for roundoff, using simple FORTRAN or BASIC sub routines. These derivatives are derived automatically behind the scenes, from the equivalent of analytical expressions, without any effort from the user. The use of costly software packages is not required."