Extremum Seeking through Delays and PDEs, the first book on the topic, expands the scope of applicability of the extremum seeking method, from static and finite-dimensional systems to infinite-dimensional systems. Readers will find: Numerous algorithms for model-free real-time optimization are developed and their convergence guaranteed. Extensions from single-player optimization to noncooperative games, under delays and pdes, are provided. The delays and pdes are compensated in the control designs using the pde backstepping approach, and stability is ensured using infinite-dimensional versions of averaging theory. Accessible and powerful tools for analysis. This book is intended for control engineers in all disciplines (electrical, mechanical, aerospace, chemical), mathematicians, physicists, biologists, and economists. It is appropriate for graduate students, researchers, and industrial users.

This monograph introduces breakthrough control algorithms for partial differential equation models with moving boundaries, the study of which is known as the Stefan problem. The algorithms can be used to improve the performance of various processes with phase changes, such as additive manufacturing. Using the authors' innovative design solutions, readers will also be equipped to apply estimation algorithms for real-world phase change dynamics, from polar ice to lithium-ion batteries. A historical treatment of the Stefan problem opens the book, situating readers in the larger context of the area. Following this, the chapters are organized into two parts. The first presents the design method and analysis of the boundary control and estimation algorithms. Part two then explores a number of applications, such as 3D printing via screw extrusion and laser sintering, and also discusses the experimental verifications conducted. A number of open problems and provided as well, offering readers multiple paths to explore in future research. Materials Phase Change PDE Control & Estimation is ideal for researchers and graduate students working on control and dynamical systems, and particularly those studying partial differential equations and moving boundaries. It will also appeal to industrial engineers and graduate students in engineering who are interested in this area.

This monograph introduces breakthrough control algorithms for partial differential equation models with moving boundaries, the study of which is known as the Stefan problem. The algorithms can be used to improve the performance of various processes with phase changes, such as additive manufacturing. Using the authors' innovative design solutions, readers will also be equipped to apply estimation algorithms for real-world phase change dynamics, from polar ice to lithium-ion batteries. A historical treatment of the Stefan problem opens the book, situating readers in the larger context of the area. Following this, the chapters are organized into two parts. The first presents the design method and analysis of the boundary control and estimation algorithms. Part two then explores a number of applications, such as 3D printing via screw extrusion and laser sintering, and also discusses the experimental verifications conducted. A number of open problems and provided as well, offering readers multiple paths to explore in future research. Materials Phase Change PDE Control & Estimation is ideal for researchers and graduate students working on control and dynamical systems, and particularly those studying partial differential equations and moving boundaries. It will also appeal to industrial engineers and graduate students in engineering who are interested in this area.

This monograph bridges the gap between the nonlinear predictor as a concept and as a practical tool, presenting a complete theory of the application of predictor feedback to time-invariant, uncertain systems with constant input delays and/or measurement delays. It supplies several methods for generating the necessary real-time solutions to the systems' nonlinear differential equations, which the authors refer to as approximate predictors. Predictor feedback for linear time-invariant (LTI) systems is presented in Part I to provide a solid foundation on the necessary concepts, as LTI systems pose fewer technical difficulties than nonlinear systems. Part II extends all of the concepts to nonlinear time-invariant systems. Finally, Part III explores extensions of predictor feedback to systems described by integral delay equations and to discrete-time systems. The book's core is the design of control and observer algorithms with which global stabilization, guaranteed in the previous literature with idealized (but non-implementable) predictors, is preserved with approximate predictors developed in the book. An applications-driven engineer will find a large number of explicit formulae, which are given throughout the book to assist in the application of the theory to a variety of control problems. A mathematician will find sophisticated new proof techniques, which are developed for the purpose of providing global stability guarantees for the nonlinear infinite-dimensional delay system under feedback laws employing practically implementable approximate predictors. Researchers working on global stabilization problems for time-delay systems will find this monograph to be a helpful summary of the state of the art, while graduate students in the broad field of systems and control will advance their skills in nonlinear control design and the analysis of nonlinear delay systems.

This monograph bridges the gap between the nonlinear predictor as a concept and as a practical tool, presenting a complete theory of the application of predictor feedback to time-invariant, uncertain systems with constant input delays and/or measurement delays. It supplies several methods for generating the necessary real-time solutions to the systems' nonlinear differential equations, which the authors refer to as approximate predictors. Predictor feedback for linear time-invariant (LTI) systems is presented in Part I to provide a solid foundation on the necessary concepts, as LTI systems pose fewer technical difficulties than nonlinear systems. Part II extends all of the concepts to nonlinear time-invariant systems. Finally, Part III explores extensions of predictor feedback to systems described by integral delay equations and to discrete-time systems. The book's core is the design of control and observer algorithms with which global stabilization, guaranteed in the previous literature with idealized (but non-implementable) predictors, is preserved with approximate predictors developed in the book. An applications-driven engineer will find a large number of explicit formulae, which are given throughout the book to assist in the application of the theory to a variety of control problems. A mathematician will find sophisticated new proof techniques, which are developed for the purpose of providing global stability guarantees for the nonlinear infinite-dimensional delay system under feedback laws employing practically implementable approximate predictors. Researchers working on global stabilization problems for time-delay systems will find this monograph to be a helpful summary of the state of the art, while graduate students in the broad field of systems and control will advance their skills in nonlinear control design and the analysis of nonlinear delay systems.

With this brief, the authors present algorithms for model-free stabilization of unstable dynamic systems. An extremum-seeking algorithm assigns the role of a cost function to the dynamic system's control Lyapunov function (clf) aiming at its minimization. The minimization of the clf drives the clf to zero and achieves asymptotic stabilization. This approach does not rely on, or require knowledge of, the system model. Instead, it employs periodic perturbation signals, along with the clf. The same effect is achieved as by using clf-based feedback laws that profit from modeling knowledge, but in a time-average sense. Rather than use integrals of the systems vector field, we employ Lie-bracket-based (i.e., derivative-based) averaging. The brief contains numerous examples and applications, including examples with unknown control directions and experiments with charged particle accelerators. It is intended for theoretical control engineers and mathematicians, and practitioners working in various industrial areas and in robotics.

Stochastic Averaging and Extremum Seeking treats methods inspired by attempts to understand the seemingly non-mathematical question of bacterial chemotaxis and their application in other environments. The text presents significant generalizations on existing stochastic averaging theory developed from scratch and necessitated by the need to avoid violation of previous theoretical assumptions by algorithms which are otherwise effective in treating these systems. Coverage is given to four main topics. Stochastic averaging theorems are developed for the analysis of continuous-time nonlinear systems with random forcing, removing prior restrictions on nonlinearity growth and on the finiteness of the time interval. The new stochastic averaging theorems are usable not only as approximation tools but also for providing stability guarantees. Stochastic extremum-seeking algorithms are introduced for optimization of systems without available models. Both gradient- and Newton-based algorithms are presented, offering the user the choice between the simplicity of implementation (gradient) and the ability to achieve a known, arbitrary convergence rate (Newton). The design of algorithms for non-cooperative/adversarial games is described. The analysis of their convergence to Nash equilibria is provided. The algorithms are illustrated on models of economic competition and on problems of the deployment of teams of robotic vehicles. Bacterial locomotion, such as chemotaxis in E. coli, is explored with the aim of identifying two simple feedback laws for climbing nutrient gradients. Stochastic extremum seeking is shown to be a biologically-plausible interpretation for chemotaxis. For the same chemotaxis-inspired stochastic feedback laws, the book also provides a detailed analysis of convergence for models of nonholonomic robotic vehicles operating in GPS-denied environments. The book contains block diagrams and several simulation examples, including examples arising from bacterial locomotion, multi-agent robotic systems, and economic market models. Stochastic Averaging and Extremum Seeking will be informative for control engineers from backgrounds in electrical, mechanical, chemical and aerospace engineering and to applied mathematicians. Economics researchers, biologists, biophysicists and roboticists will find the applications examples instructive.

Stochastic Averaging and Extremum Seeking treats methods inspired by attempts to understand the seemingly non-mathematical question of bacterial chemotaxis and their application in other environments. The text presents significant generalizations on existing stochastic averaging theory developed from scratch and necessitated by the need to avoid violation of previous theoretical assumptions by algorithms which are otherwise effective in treating these systems. Coverage is given to four main topics. Stochastic averaging theorems are developed for the analysis of continuous-time nonlinear systems with random forcing, removing prior restrictions on nonlinearity growth and on the finiteness of the time interval. The new stochastic averaging theorems are usable not only as approximation tools but also for providing stability guarantees. Stochastic extremum-seeking algorithms are introduced for optimization of systems without available models. Both gradient- and Newton-based algorithms are presented, offering the user the choice between the simplicity of implementation (gradient) and the ability to achieve a known, arbitrary convergence rate (Newton). The design of algorithms for non-cooperative/adversarial games is described. The analysis of their convergence to Nash equilibria is provided. The algorithms are illustrated on models of economic competition and on problems of the deployment of teams of robotic vehicles. Bacterial locomotion, such as chemotaxis in E. coli, is explored with the aim of identifying two simple feedback laws for climbing nutrient gradients. Stochastic extremum seeking is shown to be a biologically-plausible interpretation for chemotaxis. For the same chemotaxis-inspired stochastic feedback laws, the book also provides a detailed analysis of convergence for models of nonholonomic robotic vehicles operating in GPS-denied environments. The book contains block diagrams and several simulation examples, including examples arising from bacterial locomotion, multi-agent robotic systems, and economic market models. Stochastic Averaging and Extremum Seeking will be informative for control engineers from backgrounds in electrical, mechanical, chemical and aerospace engineering and to applied mathematicians. Economics researchers, biologists, biophysicists and roboticists will find the applications examples instructive.

This accessible book pioneers feedback concepts for control mixing. It reviews research results appearing over the last decade, and contains control designs for stabilization of channel, pipe and bluff body flows, as well as control designs for the opposite problem of mixing enhancement.

Shedding light on new opportunities in predictor feedback, this book significantly broadens the set of techniques available to a mathematician or engineer working on delay systems. It is a collection of tools and techniques that make predictor feedback ideas applicable to nonlinear systems, systems modeled by PDEs, systems with highly uncertain or completely unknown input/output delays, and systems whose actuator or sensor dynamics are modeled by more general hyperbolic or parabolic PDEs, rather than by pure delay.

Replete with examples, Delay Compensation for Nonlinear, Adaptive, and PDE Systems is an excellent reference guide for graduate students, researchers, and professionals in mathematics, systems control, as well as chemical, mechanical, electrical, computer, aerospace, and civil/structural engineering. Parts of the book may be used in graduate courses on general distributed parameter systems, linear delay systems, PDEs, nonlinear control, state estimator and observers, adaptive control, robust control, or linear time-varying systems.

This monograph presents new constructive design methods for boundary stabilization and boundary estimation for several classes of benchmark problems in flow control, with potential applications to turbulence control, weather forecasting, and plasma control. One of the main features of the book is a unique "backstepping" approach to parabolic partial differential equations, which yields not only the stabilization of the flow, but also the explicit solvability of the closed-loop system.

The work is an excellent reference for a broad, interdisciplinary engineering and mathematics audience: control theorists, fluid mechanicists, mechanical engineers, aerospace engineers, chemical engineers, electrical engineers, applied mathematicians, as well as research and graduate students in these fields.

The emergence of flow control as an attractive new field is owed to breakthroughs in MEMS (micro-electromechanical systems) and related technologies. The instrumentation of fluid flows on extremely short length and short time scales requires the practical tool of control algorithms with provable performance guarantees. Dedicated to this problem, Flow Control by Feedback, brings together controller design and fluid mechanics expertise in an exposition of the latest research results. Featuring: Exhaustive treatment of flow control core areas including stabilization and mixing control techniques; self-contained introductory sections on Navier-Stokes equations, linear and nonlinear control and sensors and MEMS to facilitate accessibility to this cross-disciplinary subject; a comprehensive survey of feedback algorithms for flow control that are currently available. In response to the intense interest in flow control, this volume will be an essential addition to the library of researchers and graduate students in control theory, fluid mechanics, mathematics and physics. Content structure is ideal for instruction on flow control modules or as supplementary reading on fluid dynamics and infinite dimensional systems courses.

The efforts in nonlinear control over the last few years have led to the level of generality in which conceptual solutions exist for all systems affine in control and the disturbance, and constructive designs exist for a specific class of nonlinear systems - although broad in terms of physical relevance. This monograph presents the fundamentals of global stabilization and optimal control of nonlinear systems with uncertain models. It offers a unified view of deterministic disturbance attenuation, stochastic control, and adaptive control for nonlinear systems. The book addresses a large audience of researchers, students, engineers and mathematicians in the areas of robust and adaptive nonlinear control, nonlinear H... stochastic nonlinear control (including risk-sensitive), and other related areas of control an d dynamical systems theory.

New adaptive and event-triggered control designs with concrete applications in undersea construction, offshore drilling, and cable elevators Control applications in undersea construction, cable elevators, and offshore drilling present major methodological challenges because they involve PDE systems (cables and drillstrings) of time-varying length, coupled with ODE systems (the attached loads or tools) that usually have unknown parameters and unmeasured states. In PDE Control of String-Actuated Motion, Ji Wang and Miroslav Krstic develop control algorithms for these complex PDE-ODE systems evolving on time-varying domains. Motivated by physical systems, the book's algorithms are designed to operate, with rigorous mathematical guarantees, in the presence of real-world challenges, such as unknown parameters, unmeasured distributed states, environmental disturbances, delays, and event-triggered implementations. The book leverages the power of the PDE backstepping approach and expands its scope in many directions. Filled with theoretical innovations and comprehensive in its coverage, PDE Control of String-Actuated Motion provides new design tools and mathematical techniques with far-reaching potential in adaptive control, delay systems, and event-triggered control.

This monograph explores the design of controllers that suppress oscillations and instabilities in congested traffic flow using PDE backstepping methods. The first part of the text is concerned with basic backstepping control of freeway traffic using the Aw-Rascle-Zhang (ARZ) second-order PDE model. It begins by illustrating a basic control problem - suppressing traffic with stop-and-go oscillations downstream of ramp metering - before turning to the more challenging case for traffic upstream of ramp metering. The authors demonstrate how to design state observers for the purpose of stabilization using output-feedback control. Experimental traffic data are then used to calibrate the ARZ model and validate the boundary observer design. Because large uncertainties may arise in traffic models, adaptive control and reinforcement learning methods are also explored in detail. Part II then extends the conventional ARZ model utilized until this point in order to address more complex traffic conditions: multi-lane traffic, multi-class traffic, networks of freeway segments, and driver use of routing apps. The final chapters demonstrate the use of the Lighthill-Whitham-Richards (LWR) first-order PDE model to regulate congestion in traffic flows and to optimize flow through a bottleneck. In order to make the text self-contained, an introduction to the PDE backstepping method for systems of coupled first-order hyperbolic PDEs is included. Traffic Congestion Control by PDE Backstepping is ideal for control theorists working on control of systems modeled by PDEs and for traffic engineers and applied scientists working on unsteady traffic flows. It will also be a valuable resource for researchers interested in boundary control of coupled systems of first-order hyperbolic PDEs.

This book introduces a comprehensive methodology for adaptive control design of parabolic partial differential equations with unknown functional parameters, including reaction-convection-diffusion systems ubiquitous in chemical, thermal, biomedical, aerospace, and energy systems. Andrey Smyshlyaev and Miroslav Krstic develop explicit feedback laws that do not require real-time solution of Riccati or other algebraic operator-valued equations. The book emphasizes stabilization by boundary control and using boundary sensing for unstable PDE systems with an infinite relative degree. The book also presents a rich collection of methods for system identification of PDEs, methods that employ Lyapunov, passivity, observer-based, swapping-based, gradient, and least-squares tools and parameterizations, among others.

Including a wealth of stimulating ideas and providing the mathematical and control-systems background needed to follow the designs and proofs, the book will be of great use to students and researchers in mathematics, engineering, and physics. It also makes a valuable supplemental text for graduate courses on distributed parameter systems and adaptive control.

Actuator and sensor delays are among the most common dynamic phenomena in engineering practice, and when disregarded, they render controlled systems unstable. Over the past sixty years, predictor feedback has been a key tool for compensating such delays, but conventional predictor feedback algorithms assume that the delays and other parameters of a given system are known. When incorrect parameter values are used in the predictor, the resulting controller may be as destabilizing as without the delay compensation. Delay-Adaptive Linear Control develops adaptive predictor feedback algorithms equipped with online estimators of unknown delays and other parameters. Such estimators are designed as nonlinear differential equations, which dynamically adjust the parameters of the predictor. The design and analysis of the adaptive predictors involves a Lyapunov stability study of systems whose dimension is infinite, because of the delays, and nonlinear, because of the parameter estimators. This comprehensive book solves adaptive delay compensation problems for systems with single and multiple inputs/outputs, unknown and distinct delays in different input channels, unknown delay kernels, unknown plant parameters, unmeasurable finite-dimensional plant states, and unmeasurable infinite-dimensional actuator states. Presenting breakthroughs in adaptive control and control of delay systems, Delay-Adaptive Linear Control offers powerful new tools for the control engineer and the mathematician.

New adaptive and event-triggered control designs with concrete applications in undersea construction, offshore drilling, and cable elevators Control applications in undersea construction, cable elevators, and offshore drilling present major methodological challenges because they involve PDE systems (cables and drillstrings) of time-varying length, coupled with ODE systems (the attached loads or tools) that usually have unknown parameters and unmeasured states. In PDE Control of String-Actuated Motion, Ji Wang and Miroslav Krstic develop control algorithms for these complex PDE-ODE systems evolving on time-varying domains. Motivated by physical systems, the book’s algorithms are designed to operate, with rigorous mathematical guarantees, in the presence of real-world challenges, such as unknown parameters, unmeasured distributed states, environmental disturbances, delays, and event-triggered implementations. The book leverages the power of the PDE backstepping approach and expands its scope in many directions. Filled with theoretical innovations and comprehensive in its coverage, PDE Control of String-Actuated Motion provides new design tools and mathematical techniques with far-reaching potential in adaptive control, delay systems, and event-triggered control.