Providing readers with a detailed examination of resilient controls in risk-averse decision, this monograph is aimed toward researchers and graduate students in applied mathematics and electrical engineering with a systems-theoretic concentration. This work contains a timely and responsive evaluation of reforms on the use of asymmetry or skewness pertaining to the restrictive family of quadratic costs that have been appeared in various scholarly forums. Additionally, the book includes a discussion of the current and ongoing efforts in the usage of risk, dynamic game decision optimization and disturbance mitigation techniques with output feedback measurements tailored toward the worst-case scenarios. This work encompasses some of the current changes across uncertainty quantification, stochastic control communities, and the creative efforts that are being made to increase the understanding of resilient controls. Specific considerations are made in this book for the application of decision theory to resilient controls of the linear-quadratic class of stochastic dynamical systems. Each of these topics are examined explicitly in several chapters. This monograph also puts forward initiatives to reform both control decisions with risk consequences and correct-by-design paradigms for performance reliability associated with the class of stochastic linear dynamical systems with integral quadratic costs and subject to network delays, control and communication constraints.

The sequential quadratic hamiltonian (SQH) method is a novel numerical optimization procedure for solving optimal control problems governed by differential models. It is based on the characterisation of optimal controls in the framework of the Pontryagin maximum principle (PMP). The SQH method is a powerful computational methodology that is capable of development in many directions. The Sequential Quadratic Hamiltonian Method: Solving Optimal Control Problems discusses its analysis and use in solving nonsmooth ODE control problems, relaxed ODE control problems, stochastic control problems, mixed-integer control problems, PDE control problems, inverse PDE problems, differential Nash game problems, and problems related to residual neural networks. This book may serve as a textbook for undergraduate and graduate students, and as an introduction for researchers in sciences and engineering who intend to further develop the SQH method or wish to use it as a numerical tool for solving challenging optimal control problems and for investigating the Pontryagin maximum principle on new optimisation problems. Feature Provides insight into mathematical and computational issues concerning optimal control problems, while discussing many differential models of interest in different disciplines. Suitable for undergraduate and graduate students and as an introduction for researchers in sciences and engineering. Accompanied by codes which allow the reader to apply the SQH method to solve many different optimal control and optimisation problems

Machine learning heavily relies on optimization algorithms to solve its learning models. Constrained problems constitute a major type of optimization problem, and the alternating direction method of multipliers (ADMM) is a commonly used algorithm to solve constrained problems, especially linearly constrained ones. Written by experts in machine learning and optimization, this is the first book providing a state-of-the-art review on ADMM under various scenarios, including deterministic and convex optimization, nonconvex optimization, stochastic optimization, and distributed optimization. Offering a rich blend of ideas, theories and proofs, the book is up-to-date and self-contained. It is an excellent reference book for users who are seeking a relatively universal algorithm for constrained problems. Graduate students or researchers can read it to grasp the frontiers of ADMM in machine learning in a short period of time.

This book is devoted to the study of classes of optimal control problems arising in economic growth theory, related to the Robinson-Solow-Srinivasan (RSS) model. The model was introduced in the 1960s by economists Joan Robinson, Robert Solow, and Thirukodikaval Nilakanta Srinivasan and was further studied by Robinson, Nobuo Okishio, and Joseph Stiglitz. Since then, the study of the RSS model has become an important element of economic dynamics. In this book, two large general classes of optimal control problems, both of them containing the RSS model as a particular case, are presented for study. For these two classes, a turnpike theory is developed and the existence of solutions to the corresponding infinite horizon optimal control problems is established. The book contains 9 chapters. Chapter 1 discusses turnpike properties for some optimal control problems that are known in the literature, including problems corresponding to the RSS model. The first class of optimal control problems is studied in Chaps. 2-6. In Chap. 2, infinite horizon optimal control problems with nonautonomous optimality criteria are considered. The utility functions, which determine the optimality criterion, are nonconcave. This class of models contains the RSS model as a particular case. The stability of the turnpike phenomenon of the one-dimensional nonautonomous concave RSS model is analyzed in Chap. 3. The following chapter takes up the study of a class of autonomous nonconcave optimal control problems, a subclass of problems considered in Chap. 2. The equivalence of the turnpike property and the asymptotic turnpike property, as well as the stability of the turnpike phenomenon, is established. Turnpike conditions and the stability of the turnpike phenomenon for nonautonomous problems are examined in Chap. 5, with Chap. 6 devoted to the study of the turnpike properties for the one-dimensional nonautonomous nonconcave RSS model. The utility functions, which determine the optimality criterion, are nonconcave. The class of RSS models is identified with a complete metric space of utility functions. Using the Baire category approach, the turnpike phenomenon is shown to hold for most of the models. Chapter 7 begins the study of the second large class of autonomous optimal control problems, and turnpike conditions are established. The stability of the turnpike phenomenon for this class of problems is investigated further in Chaps. 8 and 9.

This book covers not only foundational materials but also the most recent progresses made during the past few years on the area of machine learning algorithms. In spite of the intensive research and development in this area, there does not exist a systematic treatment to introduce the fundamental concepts and recent progresses on machine learning algorithms, especially on those based on stochastic optimization methods, randomized algorithms, nonconvex optimization, distributed and online learning, and projection free methods. This book will benefit the broad audience in the area of machine learning, artificial intelligence and mathematical programming community by presenting these recent developments in a tutorial style, starting from the basic building blocks to the most carefully designed and complicated algorithms for machine learning.

Mathematical methods and theories with interdisciplinary applications are presented in this book. The eighteen contributions presented in this Work have been written by eminent scientists; a few papers are based on talks which took place at the International Conference at the Hellenic Artillery School in May 2015. Each paper evaluates possible solutions to long-standing problems such as the solvability of the direct electromagnetic scattering problem, geometric approaches to cyber security, ellipsoid targeting with overlap, non-equilibrium solutions of dynamic networks, measuring ballistic dispersion, elliptic regularity theory for the numerical solution of variational problems, approximation theory for polynomials on the real line and the unit circle, complementarity and variational inequalities in electronics, new two-slope parameterized achievement scalarizing functions for nonlinear multiobjective optimization, and strong and weak convexity of closed sets in a Hilbert space. Graduate students, scientists, engineers and researchers in pure and applied mathematical sciences, operations research, engineering, and cyber security will find the interdisciplinary scientific perspectives useful to their overall understanding and further research.

This new 4th edition offers an introduction to optimal control theory and its diverse applications in management science and economics. It introduces students to the concept of the maximum principle in continuous (as well as discrete) time by combining dynamic programming and Kuhn-Tucker theory. While some mathematical background is needed, the emphasis of the book is not on mathematical rigor, but on modeling realistic situations encountered in business and economics. It applies optimal control theory to the functional areas of management including finance, production and marketing, as well as the economics of growth and of natural resources. In addition, it features material on stochastic Nash and Stackelberg differential games and an adverse selection model in the principal-agent framework. Exercises are included in each chapter, while the answers to selected exercises help deepen readers' understanding of the material covered. Also included are appendices of supplementary material on the solution of differential equations, the calculus of variations and its ties to the maximum principle, and special topics including the Kalman filter, certainty equivalence, singular control, a global saddle point theorem, Sethi-Skiba points, and distributed parameter systems. Optimal control methods are used to determine optimal ways to control a dynamic system. The theoretical work in this field serves as the foundation for the book, in which the author applies it to business management problems developed from his own research and classroom instruction. The new edition has been refined and updated, making it a valuable resource for graduate courses on applied optimal control theory, but also for financial and industrial engineers, economists, and operational researchers interested in applying dynamic optimization in their fields.

This book includes selected peer-reviewed papers presented at the International Conference on Modeling, Simulation and Optimization (CoMSO 2021), organized by National Institute of Technology, Silchar, Assam, India, during December 16-18, 2021. The book covers topics of modeling, simulation and optimization, including computational modeling and simulation, system modeling and simulation, device/VLSI modeling and simulation, control theory and applications, modeling and simulation of energy systems and optimization. The book disseminates various models of diverse systems and includes solutions of emerging challenges of diverse scientific fields.

DEA is computational at its core and this book will be one of several books that we will look to publish on the computational aspects of DEA. This book by Zhu and Cook will deal with the micro aspects of handling and modeling data issues in modeling DEA problems. DEA's use has grown with its capability of dealing with complex service industry and the public service domain types of problems that require modeling both qualitative and quantitative data. This will be a handbook treatment dealing with specific data problems including the following: (1) imprecise data, (2) inaccurate data, (3) missing data, (4) qualitative data, (5) outliers, (6) undesirable outputs, (7) quality data, (8) statistical analysis, (9) software and other data aspects of modeling complex DEA problems. In addition, the book will demonstrate how to visualize DEA results when the data is more than 3-dimensional, and how to identify efficiency units quickly and accurately.

This edited book discusses creative and recent developments of fuzzy systems and its real-life applications of multiple criteria decision making. Keeping on the existing fuzzy sets and recent developed fuzzy sets, viz., intuitionistic fuzzy, Pythagorean fuzzy, Fermatean fuzzy, Hesitant fuzzy and multiple criteria decision approaches, this book is committed to probing the soft computing techniques and fuzzy multiple criteria decision making in favour of fuzzy intelligent system and business analytics. It also addresses novel development of fuzzy set theory as well as real-life applications of fuzzy systems. It presents challenging and useful real-world applications based on problems of decision making in various fields. The modelling and solution procedures of such real-world problems will be provided concisely although all topics start with a more developed resolution. The contributory chapters will be based on the vast research experiences of the authors in real-world decision-making problems. This book provides readers with a valuable conspectus of several decision-making problems as a reference for researchers and industrial practitioners in this field. This book will broadly cover recent development of fuzzy systems and its applications of multiple criteria decision making in the areas of management and production, manufacturing management, selections problems, group decision making, transportation and logistics, inventory control systems and interval technique/fuzzy technique (uncertainty) of the above mentioned areas.

Optimization is a field important in its own right but is also integral to numerous applied sciences, including operations research, management science, economics, finance and all branches of mathematics-oriented engineering. Constrained optimization models are one of the most widely used mathematical models in operations research and management science.

This book gives a modern and well-balanced presentation of the subject, focusing on theory but also including algorithims and examples from various real-world applications. The text is easy to read and accessible to anyone with a knowledge of multi-dimensional calculus, linear algebra and basic numerical methods. Detailed examples and counter-examples are provided--as are exercises, solutions and helpful hints, and Matlab/Maple supplements.

The intended readership is advanced undergraduates, graduates, and professionals in any of the applied fields.

This book provides a postgraduate audience the keys they need to understand and further develop a set of tools for the efficient computation of lower bounds and valid inequalities in integer programs and combinatorial optimization problems. After discussing the classical approaches described in the literature, the book addresses how to extend these tools to other non-standard formulations that may be applied to a broad set of applications. Examples are provided to illustrate the underlying concepts and to pave the way for future contributions.

This book provides a comprehensive, modern introduction to convex optimization, a field that is becoming increasingly important in applied mathematics, economics and finance, engineering, and computer science, notably in data science and machine learning. Written by a leading expert in the field, this book includes recent advances in the algorithmic theory of convex optimization, naturally complementing the existing literature. It contains a unified and rigorous presentation of the acceleration techniques for minimization schemes of first- and second-order. It provides readers with a full treatment of the smoothing technique, which has tremendously extended the abilities of gradient-type methods. Several powerful approaches in structural optimization, including optimization in relative scale and polynomial-time interior-point methods, are also discussed in detail. Researchers in theoretical optimization as well as professionals working on optimization problems will find this book very useful. It presents many successful examples of how to develop very fast specialized minimization algorithms. Based on the author's lectures, it can naturally serve as the basis for introductory and advanced courses in convex optimization for students in engineering, economics, computer science and mathematics.

Constraint Programming is a problem-solving paradigm that establishes a clear distinction between two pivotal aspects of a problem: (1) a precise definition of the constraints that define the problem to be solved and (2) the algorithms and heuristics enabling the selection of decisions to solve the problem. It is because of these capabilities that Constraint Programming is increasingly being employed as a problem-solving tool to solve scheduling problems. Hence the development of Constraint-Based Scheduling as a field of study. The aim of this book is to provide an overview of the most widely used Constraint-Based Scheduling techniques. Following the principles of Constraint Programming, the book consists of three distinct parts: The first chapter introduces the basic principles of Constraint Programming and provides a model of the constraints that are the most often encountered in scheduling problems. Chapters 2, 3, 4, and 5 are focused on the propagation of resource constraints, which usually are responsible for the "hardness" of the scheduling problem. Chapters 6, 7, and 8 are dedicated to the resolution of several scheduling problems. These examples illustrate the use and the practical efficiency of the constraint propagation methods of the previous chapters. They also show that besides constraint propagation, the exploration of the search space must be carefully designed, taking into account specific properties of the considered problem (e.g., dominance relations, symmetries, possible use of decomposition rules). Chapter 9 mentions various extensions of the model and presents promising research directions.

This volume presents extensive research devoted to a broad spectrum of mathematics with emphasis on interdisciplinary aspects of Optimization and Probability. Chapters also emphasize applications to Data Science, a timely field with a high impact in our modern society. The discussion presents modern, state-of-the-art, research results and advances in areas including non-convex optimization, decentralized distributed convex optimization, topics on surrogate-based reduced dimension global optimization in process systems engineering, the projection of a point onto a convex set, optimal sampling for learning sparse approximations in high dimensions, the split feasibility problem, higher order embeddings, codifferentials and quasidifferentials of the expectation of nonsmooth random integrands, adjoint circuit chains associated with a random walk, analysis of the trade-off between sample size and precision in truncated ordinary least squares, spatial deep learning, efficient location-based tracking for IoT devices using compressive sensing and machine learning techniques, and nonsmooth mathematical programs with vanishing constraints in Banach spaces. The book is a valuable source for graduate students as well as researchers working on Optimization, Probability and their various interconnections with a variety of other areas. Chapter 12 is available open access under a Creative Commons Attribution 4.0 International License via link.springer.com.

This textbook provides a hands-on treatment of the subject of optimization. A comprehensive set of problems and exercises makes it suitable for use in one or two semesters of an advanced undergraduate course or a first-year graduate course. Each half of the book contains a full semester's worth of complementary yet stand-alone material. The practical orientation of the topics chosen and a wealth of useful examples also make the book suitable as a reference work for practitioners in the field. In this second edition the authors have added sections on recent innovations, techniques, and methodologies.

This volume contains the edited texts of the lectures presented at the Workshop on Nonlinear Optimization held in Erice, Sicily, at the "G. Stampacchia" School of Mathematics of the "E. Majorana" Centre for Scientific Culture, June 23 -July 2, 1998. In the tradition of these meetings, the main purpose was to review and discuss recent advances and promising research trends concerning theory, algorithms and innovative applications in the field of Nonlinear Optimization, and of related topics such as Convex Optimization, Nonsmooth Optimization, Variational Inequalities and Complementarity Problems. The meeting was attended by 83 people from 21 countries. Besides the lectures, several formal and informal discussions took place. The result was a wide and deep knowledge of the present research tendencies in the field. We wish to express our appreciation for the active contribution of all the par ticipants in the meeting. Our gratitude is due to the Ettore Majorana Centre in Erice, which offered its facilities and rewarding environment: its staff was certainly instrumental for the success of the meeting. Our gratitude is also due to Francisco Facchinei and Massimo Roma for the effort and time devoted as members of the Organising Committee. We are indebted to the Italian National Research Council, and in particular to the Group on Functional Analysis and its Applications and to the Committees on Engineering Sciences and on Information Sciences and Technolo gies for their financial support. Finally, we address our thanks to Kluwer Academic Publishers for having offered to publish this volume."

This book investigates Reliability-based Multidisciplinary Design Optimization (RBMDO) theory and its application in the design of deep manned submersibles (DMSs). Multidisciplinary Design Optimization (MDO) is an effective design method for large engineering systems like aircraft, warships, and satellites, which require designers and engineers from various disciplines to cooperate with each other. MDO can be used to handle the conflicts that arise between these disciplines, and focuses on the optimal design of the system as a whole. However, it can also push designs to the brink of failure. In order to keep the system balanced, Reliability-based Design (RBD) must be incorporated into MDO. Consequently, new algorithms and methods have to be developed for RBMDO theory. This book provides an essential overview of MDO, RBD, and RBMDO and subsequently introduces key algorithms and methods by means of case analyses. In closing, it introduces readers to the design of DMSs and applies RBMDO methods to the design of the manned hull and the general concept design. The book is intended for all students and researchers who are interested in system design theory, and for engineers working on large, complex engineering systems.

Fundamentals and important results of vector optimization in a general setting are presented in this book. The theory developed includes scalarization, existence theorems, a generalized Lagrange multiplier rule and duality results. Applications to vector approximation, cooperative game theory and multiobjective optimization are described. The theory is extended to set optimization with particular emphasis on contingent epiderivatives, subgradients and optimality conditions. Background material of convex analysis being necessary is concisely summarized at the beginning.

This second edition contains new parts on the adaptive Eichfelder-Polak method, a concrete application to magnetic resonance systems in medical engineering and additional remarks on the contribution of F.Y. Edgeworth and V. Pareto. The bibliography is updated and includes more recent important publications.

This carefully curated volume presents an in-depth, state-of-the-art discussion on many applications of Synthetic Aperture Radar (SAR). Integrating interdisciplinary sciences, the book features novel ideas, quantitative methods, and research results, promising to advance computational practices and technologies within the academic and industrial communities. SAR applications employ diverse and often complex computational methods rooted in machine learning, estimation, statistical learning, inversion models, and empirical models. Current and emerging applications of SAR data for earth observation, object detection and recognition, change detection, navigation, and interference mitigation are highlighted. Cutting edge methods, with particular emphasis on machine learning, are included. Contemporary deep learning models in object detection and recognition in SAR imagery with corresponding feature extraction and training schemes are considered. State-of-the-art neural network architectures in SAR-aided navigation are compared and discussed further. Advanced empirical and machine learning models in retrieving land and ocean information - wind, wave, soil conditions, among others, are also included.

This volume comprises a selection of works presented at the Numerical and Evolutionary Optimization (NEO) workshop held in September 2015 in Tijuana, Mexico. The development of powerful search and optimization techniques is of great importance in today's world that requires researchers and practitioners to tackle a growing number of challenging real-world problems. In particular, there are two well-established and widely known fields that are commonly applied in this area: (i) traditional numerical optimization techniques and (ii) comparatively recent bio-inspired heuristics. Both paradigms have their unique strengths and weaknesses, allowing them to solve some challenging problems while still failing in others. The goal of the NEO workshop series is to bring together people from these and related fields to discuss, compare and merge their complimentary perspectives in order to develop fast and reliable hybrid methods that maximize the strengths and minimize the weaknesses of the underlying paradigms. Through this effort, we believe that the NEO can promote the development of new techniques that are applicable to a broader class of problems. Moreover, NEO fosters the understanding and adequate treatment of real-world problems particularly in emerging fields that affect us all such as health care, smart cities, big data, among many others. The extended papers the NEO 2015 that comprise this book make a contribution to this goal.

This book is a detailed introduction to selective maintenance and updates readers on recent advances in this field, emphasizing mathematical formulation and optimization techniques. The book is useful for reliability engineers and managers engaged in the practice of reliability engineering and maintenance management. It also provides references that will lead to further studies at the end of each chapter. This book is a reference for researchers in reliability and maintenance and can be used as an advanced text for students.

This text provides a framework in which the main objectives of the field of uncertainty quantification (UQ) are defined and an overview of the range of mathematical methods by which they can be achieved. Complete with exercises throughout, the book will equip readers with both theoretical understanding and practical experience of the key mathematical and algorithmic tools underlying the treatment of uncertainty in modern applied mathematics. Students and readers alike are encouraged to apply the mathematical methods discussed in this book to their own favorite problems to understand their strengths and weaknesses, also making the text suitable for a self-study. Uncertainty quantification is a topic of increasing practical importance at the intersection of applied mathematics, statistics, computation and numerous application areas in science and engineering. This text is designed as an introduction to UQ for senior undergraduate and graduate students with a mathematical or statistical background and also for researchers from the mathematical sciences or from applications areas who are interested in the field. T. J. Sullivan was Warwick Zeeman Lecturer at the Mathematics Institute of the University of Warwick, United Kingdom, from 2012 to 2015. Since 2015, he is Junior Professor of Applied Mathematics at the Free University of Berlin, Germany, with specialism in Uncertainty and Risk Quantification.

This book presents a panorama about the recent progress of industrial mathematics from the point of view of both industrials and researchers. The chapters correspond to a selection of the contributions presented in the "Industry Day" and in the Minisymposium "EU - MATHS - IN: Success Stories of Applications of Mathematics to Industry" organized in the framework of the International Conference ICIAM 2019 held in Valencia (Spain) on July 15-19, 2019. In the Industry Day, included for the first time in this series of Conferences, representatives of companies from different countries and several sectors presented their view about the benefits regarding the usage of mathematical tools and/or collaboration with mathematicians. The contributions of this special session were addressed to industry people. Minisymposium contributions detailed some collaborations between mathematicians and industrials that led to real benefits in several European companies. All the speakers were affiliated in some of the European National Networks that constitute the European Service Network of Mathematics for Industry and Innovation (EU-MATHS-IN).