In the last few years, Algorithms for Convex Optimization have revolutionized algorithm design, both for discrete and continuous optimization problems. For problems like maximum flow, maximum matching, and submodular function minimization, the fastest algorithms involve essential methods such as gradient descent, mirror descent, interior point methods, and ellipsoid methods. The goal of this self-contained book is to enable researchers and professionals in computer science, data science, and machine learning to gain an in-depth understanding of these algorithms. The text emphasizes how to derive key algorithms for convex optimization from first principles and how to establish precise running time bounds. This modern text explains the success of these algorithms in problems of discrete optimization, as well as how these methods have significantly pushed the state of the art of convex optimization itself.

Optimization: Structure and Applications presents selected contributions from renowned researchers in the fields of operations research and industrial engineering. The book is divided into two parts; the first focuses on mathematical structure, and the second, on real-world applications. The work includes recent developments in several optimization-related topics such as decision theory, linear programming, turnpike theory, duality theory, convex analysis, and queuing theory. The applications presented include, but are not limited to, data imaging, network capacity allocation, water system management, and materials design.

The 21 self-contained chapters in this volume are devoted to the examination of modern trends and open problems in the field of optimization. This book will be a valuable tool not only to specialists interested in the technical detail and various applications presented, but also to researchers interested in building upon the book s theoretical results."

Optimization methods play a central role in financial modeling. This textbook is devoted to explaining how state-of-the-art optimization theory, algorithms, and software can be used to efficiently solve problems in computational finance. It discusses some classical mean-variance portfolio optimization models as well as more modern developments such as models for optimal trade execution and dynamic portfolio allocation with transaction costs and taxes. Chapters discussing the theory and efficient solution methods for the main classes of optimization problems alternate with chapters discussing their use in the modeling and solution of central problems in mathematical finance. This book will be interesting and useful for students, academics, and practitioners with a background in mathematics, operations research, or financial engineering. The second edition includes new examples and exercises as well as a more detailed discussion of mean-variance optimization, multi-period models, and additional material to highlight the relevance to finance.

The exercise of solving engineering problems that require optimisation procedures can be seriously affected by uncertain variables, resulting in potential underperforming solutions. Although this is a well-known problem, important knowledge gaps are still to be addressed. For example, concepts of robustness largely differ from study to study, robust solutions are generally provided with limited information about their uncertainty, and robust optimisation is difficult to apply as it is a computationally demanding task. The proposed research aims to address the mentioned challenges and focuses on robust optimisation of multiple objectives and multiple sources of probabilistically described uncertainty. This is done by the development of the Robust Optimisation and Probabilistic Analysis of Robustness algorithm (ROPAR), which integrates widely accepted robustness metrics into a single flexible framework. In this thesis, ROPAR is not only tested in benchmark functions, but also in engineering problems related to the water sector, in particular the design of urban drainage and water distribution systems. ROPAR allows for employing practically any existing multi-objective optimisation algorithm as its internal optimisation engine, which enables its applicability to other problems as well. Additionally, ROPAR can be straightforwardly parallelized, allowing for fast availability of results.

Analysis and Design of Discrete Part Production Lines provides a complete overview of production systems, investigating several production line problems, and describing the best approaches to the analysis of production line performance. Written by experts in the field of production and manufacturing research, this book also presents numerous techniques that can be used to describe and model various types of production lines.

Special Features:

* Includes access to a supplementary web-based software package, providing algorithms and examples, developed by distinguished experts of the field.

* Describes new results for evaluative techniques and design algorithms as well as several open problems in production line optimization.

* Presents in detail the theory and techniques that underlie production system management, design, and analysis, allowing the book to serve as an excellent introduction to newcomers in the field.

* Has potential for use in a graduate level course in industrial or manufacturing engineering, or in a business course with a manufacturing focus.

* Contains appendices providing an overview of several mathematical techniques employed to design and evaluate production line models.

As optimization techniques have developed, a gap has arisen between the people devising the methods and the people who actually need to use them. Research into methods is necessarily long-term and located usually in academic establishments; whereas the application of an optimization technique, normally in an industrial environment, has to be justified financially in the short term. The gap is probably inevitable; but there is no need for textbooks to reflect it. Teaching of optimization techniques separately from their connection with applications is pointless. This book gives a detailed exposition of the techniques.

In this first volume, T. A. J. Nicholson demonstrates the full range of techniques available to the practitioner for the solution of varying problems. For each technique, the background reasoning behind its development is explained in simple terms; where helpful it is supported by a geometrical argument; and the iterative algorithm for finding the optimum is defined clearly. These steps enable the reader not only to see plainly what is happening in the method but also to reach a level of understanding necessary to write computer programs for optimization techniques.

Problems are tackled in the same way--by searching a feasible region for an optimum. This approach helps the reader to develop the most essential of all skills--selecting appropriate techniques for different circumstances. The numerous worked examples in the text, supported by worked solutions, and the exercises at the end of the chapters are important aids to learning and to teachers. This book serves as an introduction to optimization techniques for students as well as a reference work for the practitioner in business and industry.

"T. A. J. Nicholson" is Senior Lecturer at the London Business School with research and consulting interests in industrial control systems.

Combinatorial optimization is a multidisciplinary scientific area, lying in the interface of three major scientific domains: mathematics, theoretical computer science and management. The three volumes of the Combinatorial Optimization series aim to cover a wide range of topics in this area. These topics also deal with fundamental notions and approaches as with several classical applications of combinatorial optimization. Concepts of Combinatorial Optimization, is divided into three parts: - On the complexity of combinatorial optimization problems, presenting basics about worst-case and randomized complexity; - Classical solution methods, presenting the two most-known methods for solving hard combinatorial optimization problems, that are Branch-and-Bound and Dynamic Programming; - Elements from mathematical programming, presenting fundamentals from mathematical programming based methods that are in the heart of Operations Research since the origins of this field.

Computational optimization methods have matured over the last few years due to extensive research by applied mathematicians and engineers. These methods have been applied to many practical applications. Several general-purpose optimization programs and programs for specific engineering applications have become available to solve particular optimization problems.Written by leading researchers in the field of optimization, this highly readable book covers state-of-the-art computational algorithms as well as applications of optimization to structural and mechanical systems. Formulations of the problems and numerical solutions are presented, and topics requiring further research are also suggested.

The book presents, in a systematic manner, the optimal controls under different mathematical models in fermentation processes. Variant mathematical models - i.e., those for multistage systems; switched autonomous systems; time-dependent and state-dependent switched systems; multistage time-delay systems and switched time-delay systems - for fed-batch fermentation processes are proposed and the theories and algorithms of their optimal control problems are studied and discussed. By putting forward novel methods and innovative tools, the book provides a state-of-the-art and comprehensive systematic treatment of optimal control problems arising in fermentation processes. It not only develops nonlinear dynamical system, optimal control theory and optimization algorithms, but can also help to increase productivity and provide valuable reference material on commercial fermentation processes.

This book will cover heuristic optimization techniques and applications in engineering problems. The book will be divided into three sections that will provide coverage of the techniques, which can be employed by engineers, researchers, and manufacturing industries, to improve their productivity with the sole motive of socio-economic development. This will be the first book in the category of heuristic techniques with relevance to engineering problems and achieving optimal solutions. Features Explains the concept of optimization and the relevance of using heuristic techniques for optimal solutions in engineering problems Illustrates the various heuristics techniques Describes evolutionary heuristic techniques like genetic algorithm and particle swarm optimization Contains natural based techniques like ant colony optimization, bee algorithm, firefly optimization, and cuckoo search Offers sample problems and their optimization, using various heuristic techniques

Recognized as a "Recommended" title by Choice for their April 2021 issue. Choice is a publishing unit at the Association of College & Research Libraries (ACR&L), a division of the American Library Association. Choice has been the acknowledged leader in the provision of objective, high-quality evaluations of nonfiction academic writing. Metaheuristic optimization is a higher-level procedure or heuristic designed to find, generate, or select a heuristic (partial search algorithm) that may provide a sufficiently good solution to an optimization problem, especially with incomplete or imperfect information or limited computation capacity. This is usually applied when two or more objectives are to be optimized simultaneously. This book is presented with two major objectives. Firstly, it features chapters by eminent researchers in the field providing the readers about the current status of the subject. Secondly, algorithm-based optimization or advanced optimization techniques, which are applied to mostly non-engineering problems, are applied to engineering problems. This book will also serve as an aid to both research and industry. Usage of these methodologies would enable the improvement in engineering and manufacturing technology and support an organization in this era of low product life cycle. Features: Covers the application of recent and new algorithms Focuses on the development aspects such as including surrogate modeling, parallelization, game theory, and hybridization Presents the advances of engineering applications for both single-objective and multi-objective optimization problems Offers recent developments from a variety of engineering fields Discusses Optimization using Evolutionary Algorithms and Metaheuristics applications in engineering

This textbook provides students, researchers, and engineers in the area of electrical engineering with advanced mathematical optimization methods. Presented in a readable format, this book highlights fundamental concepts of advanced optimization used in electrical engineering. Chapters provide a collection that ranges from simple yet important concepts such as unconstrained optimization to highly advanced topics such as linear matrix inequalities and artificial intelligence-based optimization methodologies. The reader is motivated to engage with the content via numerous application examples of optimization in the area of electrical engineering. The book begins with an extended review of linear algebra that is a prerequisite to mathematical optimization. It then precedes with unconstrained optimization, convex programming, duality, linear matrix inequality, and intelligent optimization methods. This book can be used as the main text in courses such as Engineering Optimization, Convex Engineering Optimization, Advanced Engineering Mathematics and Robust Optimization and will be useful for practicing design engineers in electrical engineering fields. Author provided cases studies and worked examples are included for student and instructor use.

This proceedings volume convenes selected, peer-reviewed papers presented at the 3rd International Conference on Mathematics and its Applications in Science and Engineering - ICMASE 2022, which was held on July 4-7, 2022 by the Technical University of Civil Engineering of Bucharest, Romania. Works in this volume cover new developments in applications of mathematics in science and engineering, with emphasis on mathematical and computational modeling of real-world problems. Topics range from the use of differential equations to model mechanical structures to the employ of number theory in the development of information security and cryptography. Educational issues specific to the acquisition of mathematical competencies by engineering and science students at all university levels are also touched on. Researchers and university students are the natural audiences for this book, which can be equally appealing to practitioners seeking up-to-date techniques in mathematical applications to different contexts and disciplines.

This volume features recent development and techniques in evolution equations by renown experts in the field. Each contribution emphasizes the relevance and depth of this important area of mathematics and its expanding reach into the physical, biological, social, and computational sciences as well as into engineering and technology. The reader will find an accessible summary of a wide range of active research topics, along with exciting new results. Topics include: Impulsive implicit Caputo fractional q-difference equations in finite and infinite dimensional Banach spaces; optimal control of averaged state of a population dynamic model; structural stability of nonlinear elliptic p(u)-Laplacian problem with Robin-type boundary condition; exponential dichotomy and partial neutral functional differential equations, stable and center-stable manifolds of admissible class; global attractor in Alpha-norm for some partial functional differential equations of neutral and retarded type; and more. Researchers in mathematical sciences, biosciences, computational sciences and related fields, will benefit from the rich and useful resources provided. Upper undergraduate and graduate students may be inspired to contribute to this active and stimulating field.

This book describes the development of innovative non-centralized optimization-based control schemes to solve economic dispatch problems of large-scale energy systems. Particularly, it focuses on communication and cooperation processes of local controllers, which are integral parts of such schemes. The economic dispatch problem, which is formulated as a convex optimization problem with edge-based coupling constraints, is solved by using methodologies in distributed optimization over time-varying networks, together with distributed model predictive control, and system partitioning techniques. At first, the book describes two distributed optimization methods, which are iterative and require the local controllers to exchange information with each other at each iteration. In turn, it shows that the sequence produced by these methods converges to an optimal solution when some conditions, which include how the controllers must communicate and cooperate, are satisfied. Further, it proposes an information exchange protocol to cope with possible communication link failures. Finally, the proposed distributed optimization methods are extended to the cases with random communication networks and asynchronous updates. Overall, this book presents a set of improved predictive control and distributed optimization methods, together with a rigorous mathematical analysis of each proposed algorithms. It describes a comprehensive approach to cope with communication and cooperation issues of non-centralized control schemes and show how the improved schemes can be successfully applied to solve the economic dispatch problems of large-scale energy systems.

This book covers the issues related to optimization of engineering and management problems using soft computing techniques with an industrial outlook. It covers a broad area related to real life complex decision making problems using a heuristics approach. It also explores a wide perspective and future directions in industrial engineering research on a global platform/scenario. The book highlights the concept of optimization, presents various soft computing techniques, offers sample problems, and discusses related software programs complete with illustrations. Features Explains the concept of optimization and relevance to soft computing techniques towards optimal solution in engineering and management Presents various soft computing techniques Offers problems and their optimization using various soft computing techniques Discusses related software programs, with illustrations Provides a step-by-step tutorial on how to handle relevant software for obtaining the optimal solution to various engineering problems

This volume contains papers presented at the 11th scientific meeting of the IFIP working group on reliability and optimization of structural systems. The purpose of Working Group 7.5 is to promote modern structural system reliability and optimization theory and its applications; stimulate research, development, and application; assist and advance research and development; further the dissemination and exchange of information; and encourage education. The main themes include structural reliability methods and applications, engineering risk analysis and decision-making, new optimization techniques and various applications in civil engineering.

This book is devoted to the development of optimal control theory for finite dimensional systems governed by deterministic and stochastic differential equations driven by vector measures. The book deals with a broad class of controls, including regular controls (vector-valued measurable functions), relaxed controls (measure-valued functions) and controls determined by vector measures, where both fully and partially observed control problems are considered. In the past few decades, there have been remarkable advances in the field of systems and control theory thanks to the unprecedented interaction between mathematics and the physical and engineering sciences. Recently, optimal control theory for dynamic systems driven by vector measures has attracted increasing interest. This book presents this theory for dynamic systems governed by both ordinary and stochastic differential equations, including extensive results on the existence of optimal controls and necessary conditions for optimality. Computational algorithms are developed based on the optimality conditions, with numerical results presented to demonstrate the applicability of the theoretical results developed in the book. This book will be of interest to researchers in optimal control or applied functional analysis interested in applications of vector measures to control theory, stochastic systems driven by vector measures, and related topics. In particular, this self-contained account can be a starting point for further advances in the theory and applications of dynamic systems driven and controlled by vector measures.

This book deals with nonsmooth structures arising within the optimization setting. It considers four optimization problems, namely, mathematical programs with complementarity constraints, general semi-infinite programming problems, mathematical programs with vanishing constraints and bilevel optimization. The author uses the topological approach and topological invariants of corresponding feasible sets are investigated. Moreover, the critical point theory in the sense of Morse is presented and parametric and stability issues are considered. The material progresses systematically and establishes a comprehensive theory for a rather broad class of optimization problems tailored to their particular type of nonsmoothness. Topological Aspects of Nonsmooth Optimization will benefit researchers and graduate students in applied mathematics, especially those working in optimization theory, nonsmooth analysis, algebraic topology and singularity theory.

This comprehensive volume covers a wide range of duality topics ranging from simple ideas in network flows to complex issues issues in non-convex optimization and multicriteria problems. In addition, it examines duality in the context of variational inequalities and vector variational inequalities as generalizations to optimization. Duality in Optimization and Variational Inequalities is intended for researchers and practitioners of optimization with the aim of enhancing their understanding of duality and offers a wider appreciation of optimality conditions in various scenarios and under different assumptions. It will enable the reader to use duality to devise more effective computational methods, and to aid more meaningful interpretation of optimization and variational inequality problems.

Seeking sparse solutions of underdetermined linear systems is required in many areas of engineering and science such as signal and image processing. The efficient sparse representation becomes central in various big or high-dimensional data processing, yielding fruitful theoretical and realistic results in these fields. The mathematical optimization plays a fundamentally important role in the development of these results and acts as the mainstream numerical algorithms for the sparsity-seeking problems arising from big-data processing, compressed sensing, statistical learning, computer vision, and so on. This has attracted the interest of many researchers at the interface of engineering, mathematics and computer science. Sparse Optimization Theory and Methods presents the state of the art in theory and algorithms for signal recovery under the sparsity assumption. The up-to-date uniqueness conditions for the sparsest solution of underdertemined linear systems are described. The results for sparse signal recovery under the matrix property called range space property (RSP) are introduced, which is a deep and mild condition for the sparse signal to be recovered by convex optimization methods. This framework is generalized to 1-bit compressed sensing, leading to a novel sign recovery theory in this area. Two efficient sparsity-seeking algorithms, reweighted l1-minimization in primal space and the algorithm based on complementary slackness property, are presented. The theoretical efficiency of these algorithms is rigorously analysed in this book. Under the RSP assumption, the author also provides a novel and unified stability analysis for several popular optimization methods for sparse signal recovery, including l1-mininization, Dantzig selector and LASSO. This book incorporates recent development and the author's latest research in the field that have not appeared in other books.

This is the second of three volumes providing a comprehensive presentation of the fundamentals of scientific computing. This volume discusses more advanced topics than volume one, and is largely not a prerequisite for volume three. This book and its companions show how to determine the quality of computational results, and how to measure the relative efficiency of competing methods. Readers learn how to determine the maximum attainable accuracy of algorithms, and how to select the best method for computing problems. This book also discusses programming in several languages, including C++, Fortran and MATLAB. There are 49 examples, 110 exercises, 66 algorithms, 24 interactive JavaScript programs, 77 references to software programs and 1 case study. Topics are introduced with goals, literature references and links to public software. There are descriptions of the current algorithms in LAPACK, GSLIB and MATLAB. This book could be used for a second course in numerical methods, for either upper level undergraduates or first year graduate students. Parts of the text could be used for specialized courses, such as nonlinear optimization or iterative linear algebra.

Presenting a fresh look at process control, this new text demonstrates state-space approach shown in parallel with the traditional approach to explain the strategies used in industry today. Modern time-domain and traditional transform-domain methods are integrated throughout and explain the advantages and limitations of each approach; the fundamental theoretical concepts and methods of process control are applied to practical problems. To ensure understanding of the mathematical calculations involved, MATLAB (R) is included for numeric calculations and MAPLE for symbolic calculations, with the math behind every method carefully explained so that students develop a clear understanding of how and why the software tools work. Written for a one-semester course with optional advanced-level material, features include solved examples, cases that include a number of chemical reactor examples, chapter summaries, key terms, and concepts, as well as over 240 end-of-chapter problems, focused computational exercises and solutions for instructors.

This monograph deals with a general class of solution approaches in deterministic global optimization, namely the geometric branch-and-bound methods which are popular algorithms, for instance, in Lipschitzian optimization, d.c. programming, and interval analysis.It alsointroduces a new concept for the rate of convergence and analyzes several bounding operations reported in the literature, from the theoretical as well as from the empirical point of view. Furthermore, extensions of the prototype algorithm for multicriteria global optimization problems as well as mixed combinatorial optimization problems are considered. Numerical examples based on facility location problems support the theory. Applications of geometric branch-and-bound methods, namely the circle detection problem in image processing, the integrated scheduling and location makespan problem, and the median line location problem in the three-dimensional space are also presented. The book is intended for both researchers and students in the areas of mathematics, operations research, engineering, and computer science.

This superb new book is one of the first publications in recent years to provide a broad overview of this interdisciplinary field. Most of the book is written in a self contained manner, assuming only a general knowledge of statistical mechanics and basic probabilty theory . It provides the reader with a sound introduction to the field and to the analytical techniques necessary to follow its most recent developments