This book addresses the frontier advances in the theory and application of nature-inspired optimization techniques, including solving the quadratic assignment problem, prediction in nature-inspired dynamic optimization, the lion algorithm and its applications, optimizing the operation scheduling of microgrids, PID controllers for two-legged robots, optimizing crane operating times, planning electrical energy distribution systems, automatic design and evaluation of classification pipelines, and optimizing wind-energy power generation plants. The book also presents a variety of nature-inspired methods and illustrates methods of adapting these to said applications. Nature-inspired computation, developed by mimicking natural phenomena, makes a significant contribution toward the solution of non-convex optimization problems that normal mathematical optimizers fail to solve. As such, a wide range of nature-inspired computing approaches has been used in multidisciplinary engineering applications. Written by researchers and developers from a variety of fields, this book presents the latest findings, novel techniques and pioneering applications.

This book on optimization includes forewords by Michael I. Jordan, Zongben Xu and Zhi-Quan Luo. Machine learning relies heavily on optimization to solve problems with its learning models, and first-order optimization algorithms are the mainstream approaches. The acceleration of first-order optimization algorithms is crucial for the efficiency of machine learning. Written by leading experts in the field, this book provides a comprehensive introduction to, and state-of-the-art review of accelerated first-order optimization algorithms for machine learning. It discusses a variety of methods, including deterministic and stochastic algorithms, where the algorithms can be synchronous or asynchronous, for unconstrained and constrained problems, which can be convex or non-convex. Offering a rich blend of ideas, theories and proofs, the book is up-to-date and self-contained. It is an excellent reference resource for users who are seeking faster optimization algorithms, as well as for graduate students and researchers wanting to grasp the frontiers of optimization in machine learning in a short time.

Solving nonsmooth optimization (NSO) problems is critical in many practical applications and real-world modeling systems. The aim of this book is to survey various numerical methods for solving NSO problems and to provide an overview of the latest developments in the field. Experts from around the world share their perspectives on specific aspects of numerical NSO. The book is divided into four parts, the first of which considers general methods including subgradient, bundle and gradient sampling methods. In turn, the second focuses on methods that exploit the problem's special structure, e.g. algorithms for nonsmooth DC programming, VU decomposition techniques, and algorithms for minimax and piecewise differentiable problems. The third part considers methods for special problems like multiobjective and mixed integer NSO, and problems involving inexact data, while the last part highlights the latest advancements in derivative-free NSO. Given its scope, the book is ideal for students attending courses on numerical nonsmooth optimization, for lecturers who teach optimization courses, and for practitioners who apply nonsmooth optimization methods in engineering, artificial intelligence, machine learning, and business. Furthermore, it can serve as a reference text for experts dealing with nonsmooth optimization.

This book collects some basic results on the null controllability for degenerate and singular parabolic problems. It aims to provide postgraduate students and senior researchers with a useful text, where they can find the desired statements and the related bibliography. For these reasons, the authors will not give all the detailed proofs of the given theorems, but just some of them, in order to show the underlying strategy in this area.

This proceedings presents the result of the 8th International Conference in Network Analysis, held at the Higher School of Economics, Moscow, in May 2018. The conference brought together scientists, engineers, and researchers from academia, industry, and government. Contributions in this book focus on the development of network algorithms for data mining and its applications. Researchers and students in mathematics, economics, statistics, computer science, and engineering find this collection a valuable resource filled with the latest research in network analysis. Computational aspects and applications of large-scale networks in market models, neural networks, social networks, power transmission grids, maximum clique problem, telecommunication networks, and complexity graphs are included with new tools for efficient network analysis of large-scale networks. Machine learning techniques in network settings including community detection, clustering, and biclustering algorithms are presented with applications to social network analysis.

This volume covers contemporary aspects of geometric measure theory with a focus on applications to partial differential equations, free boundary problems and water waves. It is based on lectures given at the 2019 CIME summer school "Geometric Measure Theory and Applications - From Geometric Analysis to Free Boundary Problems" which took place in Cetraro, Italy, under the scientific direction of Matteo Focardi and Emanuele Spadaro. Providing a description of the structure of measures satisfying certain differential constraints, and covering regularity theory for Bernoulli type free boundary problems and water waves as well as regularity theory for the obstacle problems and the developments leading to applications to the Stefan problem, this volume will be of interest to students and researchers in mathematical analysis and its applications.

This book explores applications of computational intelligence in key and emerging fields of engineering, especially with regard to condition monitoring and fault diagnosis, inverse problems, decision support systems and optimization. These applications can be beneficial in a broad range of contexts, including: water distribution networks, manufacturing systems, production and storage of electrical energy, heat transfer, acoustic levitation, uncertainty and robustness of infinite-dimensional objects, fatigue failure prediction, autonomous navigation, nanotechnology, and the analysis of technological development indexes. All applications, mathematical and computational tools, and original results are presented using rigorous mathematical procedures. Further, the book gathers contributions by respected experts from 22 different research centers and eight countries: Brazil, Cuba, France, Hungary, India, Japan, Romania and Spain. The book is intended for use in graduate courses on applied computation, applied mathematics, and engineering, where tools like computational intelligence and numerical methods are applied to the solution of real-world problems in emerging areas of engineering.

This book presents a wide range of optimization methods and their applications to various electrical power system problems such as economical load dispatch, demand supply management in microgrids, levelized energy pricing, load frequency control and congestion management, and reactive power management in radial distribution systems. Problems related to electrical power systems are often highly complex due to the massive dimensions, nonlinearity, non-convexity and discontinuity associated with objective functions. These systems also have a large number of equality and inequality constraints, which give rise to optimization problems that are difficult to solve using classical numerical methods. In this regard, nature inspired optimization algorithms offer an effective alternative, due to their ease of use, population-based parallel search mechanism, non-dependence on the nature of the problem, and ability to accommodate non-differentiable, non-convex problems. The analytical model of nature inspired techniques mimics the natural behaviors and intelligence of life forms. These techniques are mainly based on evolution, swarm intelligence, ecology, human intelligence and physical science.

This textbook provides an introduction to probabilistic reliability analysis of power systems. It discusses a range of probabilistic methods used in reliability modelling of power system components, small systems and large systems. It also presents the benefits of probabilistic methods for modelling renewable energy sources. The textbook describes real-life studies, discussing practical examples and providing interesting problems, teaching students the methods in a thorough and hands-on way. The textbook has chapters dedicated to reliability models for components (reliability functions, component life cycle, two-state Markov model, stress-strength model), small systems (reliability networks, Markov models, fault/event tree analysis) and large systems (generation adequacy, state enumeration, Monte-Carlo simulation). Moreover, it contains chapters about probabilistic optimal power flow, the reliability of underground cables and cyber-physical power systems. After reading this book, engineering students will be able to apply various methods to model the reliability of power system components, smaller and larger systems. The textbook will be accessible to power engineering students, as well as students from mathematics, computer science, physics, mechanical engineering, policy & management, and will allow them to apply reliability analysis methods to their own areas of expertise.

This book highlights recent advances in the field of districting, territory design, and zone design. Districting problems deal essentially with tactical decisions, and involve mainly dividing a set of geographic units into clusters or territories subject to some planning requirements. This book presents models, theory, algorithms (exact or heuristic), and applications that would bring research on districting systems up-to-date and define the state-of-the-art. Although papers have addressed real-world problems that require districting or territory division decisions, this is the first comprehensive book that directly addresses these problems. The chapters capture the diverse nature of districting applications, as the book is divided into three different areas of research. Part I covers recent up-to-date surveys on important areas of districting such as police districting, health care districting, and districting algorithms based on computational geometry. Part II focuses on recent advances on theory, modeling, and algorithms including mathematical programming and heuristic approaches, and finally, Part III contains successful applications in real-world districting cases.

The goal of this book is to gather in a single work the most relevant concepts related in optimization methods, showing how such theories and methods can be addressed using the open source, multi-platform R tool. Modern optimization methods, also known as metaheuristics, are particularly useful for solving complex problems for which no specialized optimization algorithm has been developed. These methods often yield high quality solutions with a more reasonable use of computational resources (e.g. memory and processing effort). Examples of popular modern methods discussed in this book are: simulated annealing; tabu search; genetic algorithms; differential evolution; and particle swarm optimization. This book is suitable for undergraduate and graduate students in computer science, information technology, and related areas, as well as data analysts interested in exploring modern optimization methods using R. This new edition integrates the latest R packages through text and code examples. It also discusses new topics, such as: the impact of artificial intelligence and business analytics in modern optimization tasks; the creation of interactive Web applications; usage of parallel computing; and more modern optimization algorithms (e.g., iterated racing, ant colony optimization, grammatical evolution).

This book constitutes the refereed proceedings of the 11th International Conference on Optimization and Applications, OPTIMA 2020, held in September - October 2020. Due to the COVID-19 pandemic the conference was held online. The 18 revised full papers presented were carefully reviewed and selected from 60 submissions. The papers are organized in topical sections on global optimization; combinatorial and discrete optimization; optimal control; optimization in economy, finance and social sciences; applications.

The book is devoted to the study of approximate solutions of optimization problems in the presence of computational errors. It contains a number of results on the convergence behavior of algorithms in a Hilbert space, which are known as important tools for solving optimization problems. The research presented in the book is the continuation and the further development of the author's (c) 2016 book Numerical Optimization with Computational Errors, Springer 2016. Both books study the algorithms taking into account computational errors which are always present in practice. The main goal is, for a known computational error, to find out what an approximate solution can be obtained and how many iterates one needs for this. The main difference between this new book and the 2016 book is that in this present book the discussion takes into consideration the fact that for every algorithm, its iteration consists of several steps and that computational errors for different steps are generally, different. This fact, which was not taken into account in the previous book, is indeed important in practice. For example, the subgradient projection algorithm consists of two steps. The first step is a calculation of a subgradient of the objective function while in the second one we calculate a projection on the feasible set. In each of these two steps there is a computational error and these two computational errors are different in general. It may happen that the feasible set is simple and the objective function is complicated. As a result, the computational error, made when one calculates the projection, is essentially smaller than the computational error of the calculation of the subgradient. Clearly, an opposite case is possible too. Another feature of this book is a study of a number of important algorithms which appeared recently in the literature and which are not discussed in the previous book. This monograph contains 12 chapters. Chapter 1 is an introduction. In Chapter 2 we study the subgradient projection algorithm for minimization of convex and nonsmooth functions. We generalize the results of [NOCE] and establish results which has no prototype in [NOCE]. In Chapter 3 we analyze the mirror descent algorithm for minimization of convex and nonsmooth functions, under the presence of computational errors. For this algorithm each iteration consists of two steps. The first step is a calculation of a subgradient of the objective function while in the second one we solve an auxiliary minimization problem on the set of feasible points. In each of these two steps there is a computational error. We generalize the results of [NOCE] and establish results which has no prototype in [NOCE]. In Chapter 4 we analyze the projected gradient algorithm with a smooth objective function under the presence of computational errors. In Chapter 5 we consider an algorithm, which is an extension of the projection gradient algorithm used for solving linear inverse problems arising in signal/image processing. In Chapter 6 we study continuous subgradient method and continuous subgradient projection algorithm for minimization of convex nonsmooth functions and for computing the saddle points of convex-concave functions, under the presence of computational errors. All the results of this chapter has no prototype in [NOCE]. In Chapters 7-12 we analyze several algorithms under the presence of computational errors which were not considered in [NOCE]. Again, each step of an iteration has a computational errors and we take into account that these errors are, in general, different. An optimization problems with a composite objective function is studied in Chapter 7. A zero-sum game with two-players is considered in Chapter 8. A predicted decrease approximation-based method is used in Chapter 9 for constrained convex optimization. Chapter 10 is devoted to minimization of quasiconvex functions. Minimization of sharp weakly convex functions is discussed in Chapter 11. Chapter 12 is devoted to a generalized projected subgradient method for minimization of a convex function over a set which is not necessarily convex. The book is of interest for researchers and engineers working in optimization. It also can be useful in preparation courses for graduate students. The main feature of the book which appeals specifically to this audience is the study of the influence of computational errors for several important optimization algorithms. The book is of interest for experts in applications of optimization to engineering and economics.

This book studies complex systems with elements represented by random variables. Its main goal is to study and compare uncertainty of algorithms of network structure identification with applications to market network analysis. For this, a mathematical model of random variable network is introduced, uncertainty of identification procedure is defined through a risk function, random variables networks with different measures of similarity (dependence) are discussed, and general statistical properties of identification algorithms are studied. The volume also introduces a new class of identification algorithms based on a new measure of similarity and prove its robustness in a large class of distributions, and presents applications to social networks, power transmission grids, telecommunication networks, stock market networks, and brain networks through a theoretical analysis that identifies network structures. Both researchers and graduate students in computer science, mathematics, and optimization will find the applications and techniques presented useful.

This book discusses one of the major applications of artificial intelligence: the use of machine learning to extract useful information from multimodal data. It discusses the optimization methods that help minimize the error in developing patterns and classifications, which further helps improve prediction and decision-making. The book also presents formulations of real-world machine learning problems, and discusses AI solution methodologies as standalone or hybrid approaches. Lastly, it proposes novel metaheuristic methods to solve complex machine learning problems. Featuring valuable insights, the book helps readers explore new avenues leading toward multidisciplinary research discussions.

This volume comprises selected, revised papers from the Joint CIM-WIAS Workshop, TAAO 2017, held in Lisbon, Portugal, in December 2017. The workshop brought together experts from research groups at the Weierstrass Institute in Berlin and mathematics centres in Portugal to present and discuss current scientific topics and to promote existing and future collaborations. The papers include the following topics: PDEs with applications to material sciences, thermodynamics and laser dynamics, scientific computing, nonlinear optimization and stochastic analysis.

This handbook gathers state-of-the-art research on optimization problems in power distribution systems, covering classical problems as well as the challenges introduced by distributed power generation and smart grid resources. It also presents recent models, solution techniques and computational tools to solve planning problems for power distribution systems and explains how to apply them in distributed and variable energy generation resources. As such, the book therefore is a valuable tool to leverage the expansion and operation planning of electricity distribution networks.

The results presented here (including the assessment of a new tool - inhibitory trees) offer valuable tools for researchers in the areas of data mining, knowledge discovery, and machine learning, especially those whose work involves decision tables with many-valued decisions. The authors consider various examples of problems and corresponding decision tables with many-valued decisions, discuss the difference between decision and inhibitory trees and rules, and develop tools for their analysis and design. Applications include the study of totally optimal (optimal in relation to a number of criteria simultaneously) decision and inhibitory trees and rules; the comparison of greedy heuristics for tree and rule construction as single-criterion and bi-criteria optimization algorithms; and the development of a restricted multi-pruning approach used in classification and knowledge representation.

The book discusses advantages of the firefly algorithm over other well-known metaheuristic algorithms in various engineering studies. The book provides a brief outline of various application-oriented problem solving methods, like economic emission load dispatch problem, designing a fully digital controlled reconfigurable switched beam nonconcentric ring array antenna, image segmentation, span minimization in permutation flow shop scheduling, multi-objective load dispatch problems, image compression, etc., using FA and its variants. It also covers the use of the firefly algorithm to select features, as research has shown that the firefly algorithm generates precise and optimal results in terms of time and optimality. In addition, the book also explores the potential of the firefly algorithm to provide a solution to traveling salesman problem, graph coloring problem, etc

This book provides a comprehensive introduction to nonlinear programming, featuring a broad range of applications and solution methods in the field of continuous optimization. It begins with a summary of classical results on unconstrained optimization, followed by a wealth of applications from a diverse mix of fields, e.g. location analysis, traffic planning, and water quality management, to name but a few. In turn, the book presents a formal description of optimality conditions, followed by an in-depth discussion of the main solution techniques. Each method is formally described, and then fully solved using a numerical example.

The theory presented in this work merges many concepts from mathematical optimization and real algebraic geometry. When unknown or uncertain data in an optimization problem is replaced with parameters, one obtains a multi-parametric optimization problem whose optimal solution comes in the form of a function of the parameters.The theory and methodology presented in this work allows one to solve both Linear Programs and convex Quadratic Programs containing parameters in any location within the problem data as well as multi-objective optimization problems with any number of convex quadratic or linear objectives and linear constraints. Applications of these classes of problems are extremely widespread, ranging from business and economics to chemical and environmental engineering. Prior to this work, no solution procedure existed for these general classes of problems except for the recently proposed algorithms

This textbook offers graduate students a concise introduction to the classic notions of convex optimization. Written in a highly accessible style and including numerous examples and illustrations, it presents everything readers need to know about convexity and convex optimization. The book introduces a systematic three-step method for doing everything, which can be summarized as "conify, work, deconify". It starts with the concept of convex sets, their primal description, constructions, topological properties and dual description, and then moves on to convex functions and the fundamental principles of convex optimization and their use in the complete analysis of convex optimization problems by means of a systematic four-step method. Lastly, it includes chapters on alternative formulations of optimality conditions and on illustrations of their use. "The author deals with the delicate subjects in a precise yet light-minded spirit... For experts in the field, this book not only offers a unifying view, but also opens a door to new discoveries in convexity and optimization...perfectly suited for classroom teaching." Shuzhong Zhang, Professor of Industrial and Systems Engineering, University of Minnesota

This book introduces students to optimization theory and its use in economics and allied disciplines. The first of its three parts examines the existence of solutions to optimization problems in Rn, and how these solutions may be identified. The second part explores how solutions to optimization problems change with changes in the underlying parameters, and the last part provides an extensive description of the fundamental principles of finite- and infinite-horizon dynamic programming. A preliminary chapter and three appendices are designed to keep the book mathematically self-contained.

This book presents the latest insights and developments in the field of socio-cultural inspired algorithms. Akin to evolutionary and swarm-based optimization algorithms, socio-cultural algorithms belong to the category of metaheuristics (problem-independent computational methods) and are inspired by natural and social tendencies observed in humans by which they learn from one another through social interactions. This book is an interesting read for engineers, scientists, and students studying/working in the optimization, evolutionary computation, artificial intelligence (AI) and computational intelligence fields.

This book contains mostly the author's up-to-date research results in the area. Option pricing has attracted much attention in the past decade from applied mathematicians, statisticians, practitioners and educators. Many partial differential equation-based theoretical models have been developed for valuing various options. These models do not have any practical use unless their solutions can be found. However, most of these models are far too complex to solve analytically and numerical approximations have to be sought in practice. The contents of the book consist of three parts: (i) basic theory of stochastic control and formulation of various option pricing models, (ii) design of finite volume, finite difference and penalty-based algorithms for solving the models and (iii) stability and convergence analysis of the algorithms. It also contains extensive numerical experiments demonstrating how these algorithms perform for practical problems. The theoretical and numerical results demonstrate these algorithms provide efficient, accurate and easy-to-implement numerical tools for financial engineers to price options. This book is appealing to researchers in financial engineering, optimal control and operations research. Financial engineers and practitioners will also find the book helpful in practice.