Recursive Identification and Parameter Estimation describes a recursive approach to solving system identification and parameter estimation problems arising from diverse areas. Supplying rigorous theoretical analysis, it presents the material and proposed algorithms in a manner that makes it easy to understand-providing readers with the modeling and identification skills required for successful theoretical research and effective application. The book begins by introducing the basic concepts of probability theory, including martingales, martingale difference sequences, Markov chains, mixing processes, and stationary processes. Next, it discusses the root-seeking problem for functions, starting with the classic RM algorithm, but with attention mainly paid to the stochastic approximation algorithms with expanding truncations (SAAWET) which serves as the basic tool for recursively solving the problems addressed in the book. The book not only identifies the results of system identification and parameter estimation, but also demonstrates how to apply the proposed approaches for addressing problems in a range of areas, including: Identification of ARMAX systems without imposing restrictive conditions Identification of typical nonlinear systems Optimal adaptive tracking Consensus of multi-agents systems Principal component analysis Distributed randomized PageRank computation This book recursively identifies autoregressive and moving average with exogenous input (ARMAX) and discusses the identification of non-linear systems. It concludes by addressing the problems arising from different areas that are solved by SAAWET. Demonstrating how to apply the proposed approaches to solve problems across a range of areas, the book is suitable for students, researchers, and engineers working in systems and control, signal processing, communication, and mathematical statistics.

Recursive Identification and Parameter Estimation describes a recursive approach to solving system identification and parameter estimation problems arising from diverse areas. Supplying rigorous theoretical analysis, it presents the material and proposed algorithms in a manner that makes it easy to understand-providing readers with the modeling and identification skills required for successful theoretical research and effective application. The book begins by introducing the basic concepts of probability theory, including martingales, martingale difference sequences, Markov chains, mixing processes, and stationary processes. Next, it discusses the root-seeking problem for functions, starting with the classic RM algorithm, but with attention mainly paid to the stochastic approximation algorithms with expanding truncations (SAAWET) which serves as the basic tool for recursively solving the problems addressed in the book. The book not only identifies the results of system identification and parameter estimation, but also demonstrates how to apply the proposed approaches for addressing problems in a range of areas, including: Identification of ARMAX systems without imposing restrictive conditions Identification of typical nonlinear systems Optimal adaptive tracking Consensus of multi-agents systems Principal component analysis Distributed randomized PageRank computation This book recursively identifies autoregressive and moving average with exogenous input (ARMAX) and discusses the identification of non-linear systems. It concludes by addressing the problems arising from different areas that are solved by SAAWET. Demonstrating how to apply the proposed approaches to solve problems across a range of areas, the book is suitable for students, researchers, and engineers working in systems and control, signal processing, communication, and mathematical statistics.

Identifying the input-output relationship of a system or discovering the evolutionary law of a signal on the basis of observation data, and applying the constructed mathematical model to predicting, controlling or extracting other useful information constitute a problem that has been drawing a lot of attention from engineering and gaining more and more importance in econo metrics, biology, environmental science and other related areas. Over the last 30-odd years, research on this problem has rapidly developed in various areas under different terms, such as time series analysis, signal processing and system identification. Since the randomness almost always exists in real systems and in observation data, and since the random process is sometimes used to model the uncertainty in systems, it is reasonable to consider the object as a stochastic system. In some applications identification can be carried out off line, but in other cases this is impossible, for example, when the structure or the parameter of the system depends on the sample, or when the system is time-varying. In these cases we have to identify the system on line and to adjust the control in accordance with the model which is supposed to be approaching the true system during the process of identification. This is why there has been an increasing interest in identification and adaptive control for stochastic systems from both theorists and practitioners."

Estimating unknown parameters based on observation data conta- ing information about the parameters is ubiquitous in diverse areas of both theory and application. For example, in system identification the unknown system coefficients are estimated on the basis of input-output data of the control system; in adaptive control systems the adaptive control gain should be defined based on observation data in such a way that the gain asymptotically tends to the optimal one; in blind ch- nel identification the channel coefficients are estimated using the output data obtained at the receiver; in signal processing the optimal weighting matrix is estimated on the basis of observations; in pattern classifi- tion the parameters specifying the partition hyperplane are searched by learning, and more examples may be added to this list. All these parameter estimation problems can be transformed to a root-seeking problem for an unknown function. To see this, let - note the observation at time i. e. , the information available about the unknown parameters at time It can be assumed that the parameter under estimation denoted by is a root of some unknown function This is not a restriction, because, for example, may serve as such a function.

Estimating unknown parameters based on observation data conta- ing information about the parameters is ubiquitous in diverse areas of both theory and application. For example, in system identification the unknown system coefficients are estimated on the basis of input-output data of the control system; in adaptive control systems the adaptive control gain should be defined based on observation data in such a way that the gain asymptotically tends to the optimal one; in blind ch- nel identification the channel coefficients are estimated using the output data obtained at the receiver; in signal processing the optimal weighting matrix is estimated on the basis of observations; in pattern classifi- tion the parameters specifying the partition hyperplane are searched by learning, and more examples may be added to this list. All these parameter estimation problems can be transformed to a root-seeking problem for an unknown function. To see this, let - note the observation at time i. e. , the information available about the unknown parameters at time It can be assumed that the parameter under estimation denoted by is a root of some unknown function This is not a restriction, because, for example, may serve as such a function.

Identifying the input-output relationship of a system or discovering the evolutionary law of a signal on the basis of observation data, and applying the constructed mathematical model to predicting, controlling or extracting other useful information constitute a problem that has been drawing a lot of attention from engineering and gaining more and more importance in econo metrics, biology, environmental science and other related areas. Over the last 30-odd years, research on this problem has rapidly developed in various areas under different terms, such as time series analysis, signal processing and system identification. Since the randomness almost always exists in real systems and in observation data, and since the random process is sometimes used to model the uncertainty in systems, it is reasonable to consider the object as a stochastic system. In some applications identification can be carried out off line, but in other cases this is impossible, for example, when the structure or the parameter of the system depends on the sample, or when the system is time-varying. In these cases we have to identify the system on line and to adjust the control in accordance with the model which is supposed to be approaching the true system during the process of identification. This is why there has been an increasing interest in identification and adaptive control for stochastic systems from both theorists and practitioners."