The chapters which appear in this volume are selected studies presented at the First International Conference on Engineering and Applied Sciences Optimization (OPT-i), Kos, Greece, 4-6 June 2014 and works written by friends, former colleagues and students of the late Professor M. G. Karlaftis; all in the area of optimization that he loved and published so much in himself. The subject areas represented here range from structural optimization, logistics, transportation, traffic and telecommunication networks to operational research, metaheuristics, multidisciplinary and multiphysics design optimization, etc. This volume is dedicated to the life and the memory of Professor Matthew G. Karlaftis, who passed away a few hours before he was to give the opening speech at OPT-i. All contributions reflect the warmth and genuine friendship which he enjoyed from his associates and show how much his scientific contribution has been appreciated. He will be greatly missed and it is hoped that this volume will be received as a suitable memorial to his life and achievements.

This introduction to the field of hyper-heuristics presents the required foundations and tools and illustrates some of their applications. The authors organized the 13 chapters into three parts. The first, hyper-heuristic fundamentals and theory, provides an overview of selection constructive, selection perturbative, generation constructive and generation perturbative hyper-heuristics, and then a formal definition of hyper-heuristics. The chapters in the second part of the book examine applications of hyper-heuristics in vehicle routing, nurse rostering, packing and examination timetabling. The third part of the book presents advanced topics and then a summary of the field and future research directions. Finally the appendices offer details of the HyFlex framework and the EvoHyp toolkit, and then the definition, problem model and constraints for the most tested combinatorial optimization problems. The book will be of value to graduate students, researchers, and practitioners.

Solving nonsmooth optimization (NSO) problems is critical in many practical applications and real-world modeling systems. The aim of this book is to survey various numerical methods for solving NSO problems and to provide an overview of the latest developments in the field. Experts from around the world share their perspectives on specific aspects of numerical NSO. The book is divided into four parts, the first of which considers general methods including subgradient, bundle and gradient sampling methods. In turn, the second focuses on methods that exploit the problem's special structure, e.g. algorithms for nonsmooth DC programming, VU decomposition techniques, and algorithms for minimax and piecewise differentiable problems. The third part considers methods for special problems like multiobjective and mixed integer NSO, and problems involving inexact data, while the last part highlights the latest advancements in derivative-free NSO. Given its scope, the book is ideal for students attending courses on numerical nonsmooth optimization, for lecturers who teach optimization courses, and for practitioners who apply nonsmooth optimization methods in engineering, artificial intelligence, machine learning, and business. Furthermore, it can serve as a reference text for experts dealing with nonsmooth optimization.

This book offers a valuable reference guide for researchers in distributed optimization and for senior undergraduate and graduate students alike. Focusing on the natures and functions of agents, communication networks and algorithms in the context of distributed optimization for networked control systems, this book introduces readers to the background of distributed optimization; recent developments in distributed algorithms for various types of underlying communication networks; the implementation of computation-efficient and communication-efficient strategies in the execution of distributed algorithms; and the frameworks of convergence analysis and performance evaluation. On this basis, the book then thoroughly studies 1) distributed constrained optimization and the random sleep scheme, from an agent perspective; 2) asynchronous broadcast-based algorithms, event-triggered communication, quantized communication, unbalanced directed networks, and time-varying networks, from a communication network perspective; and 3) accelerated algorithms and stochastic gradient algorithms, from an algorithm perspective. Finally, the applications of distributed optimization in large-scale statistical learning, wireless sensor networks, and for optimal energy management in smart grids are discussed.

Many important problems in global optimization, algebra, probability and statistics, applied mathematics, control theory, financial mathematics, inverse problems, etc. can be modeled as a particular instance of the Generalized Moment Problem (GMP). This book introduces, in a unified manual, a new general methodology to solve the GMP when its data are polynomials and basic semi-algebraic sets. This methodology combines semidefinite programming with recent results from real algebraic geometry to provide a hierarchy of semidefinite relaxations converging to the desired optimal value. Applied on appropriate cones, standard duality in convex optimization nicely expresses the duality between moments and positive polynomials. In the second part of this invaluable volume, the methodology is particularized and described in detail for various applications, including global optimization, probability, optimal context, mathematical finance, multivariate integration, etc., and examples are provided for each particular application.

Many important applications in global optimization, algebra, probability and statistics, applied mathematics, control theory, financial mathematics, inverse problems, etc. can be modeled as a particular instance of the Generalized Moment Problem (GMP).This book introduces a new general methodology to solve the GMP when its data are polynomials and basic semi-algebraic sets. This methodology combines semidefinite programming with recent results from real algebraic geometry to provide a hierarchy of semidefinite relaxations converging to the desired optimal value. Applied on appropriate cones, standard duality in convex optimization nicely expresses the duality between moments and positive polynomials.In the second part, the methodology is particularized and described in detail for various applications, including global optimization, probability, optimal control, mathematical finance, multivariate integration, etc., and examples are provided for each particular application.

This book is a collection of original papers presented at the International Conference on Computational Mathematics in Nanoelectronics and Astrophysics (CMNA 2018) held at the Indian Institute of Technology Indore, India, from 1 to 3 November 2018. It aims at presenting recent developments of computational mathematics in nanoelectronics, astrophysics and related areas of space sciences and engineering. These proceedings discuss the most advanced innovations, trends and real-world challenges encountered and their solutions with the application of computational mathematics in nanoelectronics, astrophysics and space sciences. From focusing on nano-enhanced smart technological developments to the research contributions of premier institutes in India and abroad on ISRO's future space explorations-this book includes topics from highly interdisciplinary areas of research. The book is of interest to researchers, students and practising engineers working in diverse areas of science and engineering, ranging from applied and computational mathematics to nanoelectronics, nanofabrications and astrophysics.

This book on optimization includes forewords by Michael I. Jordan, Zongben Xu and Zhi-Quan Luo. Machine learning relies heavily on optimization to solve problems with its learning models, and first-order optimization algorithms are the mainstream approaches. The acceleration of first-order optimization algorithms is crucial for the efficiency of machine learning. Written by leading experts in the field, this book provides a comprehensive introduction to, and state-of-the-art review of accelerated first-order optimization algorithms for machine learning. It discusses a variety of methods, including deterministic and stochastic algorithms, where the algorithms can be synchronous or asynchronous, for unconstrained and constrained problems, which can be convex or non-convex. Offering a rich blend of ideas, theories and proofs, the book is up-to-date and self-contained. It is an excellent reference resource for users who are seeking faster optimization algorithms, as well as for graduate students and researchers wanting to grasp the frontiers of optimization in machine learning in a short time.

In Mathematical Analysis and Optimization for Economists, the author aims to introduce students of economics to the power and versatility of traditional as well as contemporary methodologies in mathematics and optimization theory; and, illustrates how these techniques can be applied in solving microeconomic problems. This book combines the areas of intermediate to advanced mathematics, optimization, and microeconomic decision making, and is suitable for advanced undergraduates and first-year graduate students. This text is highly readable, with all concepts fully defined, and contains numerous detailed example problems in both mathematics and microeconomic applications. Each section contains some standard, as well as more thoughtful and challenging, exercises. Solutions can be downloaded from the CRC Press website. All solutions are detailed and complete. Features Contains a whole spectrum of modern applicable mathematical techniques, many of which are not found in other books of this type. Comprehensive and contains numerous and detailed example problems in both mathematics and economic analysis. Suitable for economists and economics students with only a minimal mathematical background. Classroom-tested over the years when the author was actively teaching at the University of Hartford. Serves as a beginner text in optimization for applied mathematics students. Accompanied by several electronic chapters on linear algebra and matrix theory, nonsmooth optimization, economic efficiency, and distance functions available for free on www.routledge.com/9780367759018.

Optimization: Structure and Applications presents selected contributions from renowned researchers in the fields of operations research and industrial engineering. The book is divided into two parts; the first focuses on mathematical structure, and the second, on real-world applications. The work includes recent developments in several optimization-related topics such as decision theory, linear programming, turnpike theory, duality theory, convex analysis, and queuing theory. The applications presented include, but are not limited to, data imaging, network capacity allocation, water system management, and materials design.

The 21 self-contained chapters in this volume are devoted to the examination of modern trends and open problems in the field of optimization. This book will be a valuable tool not only to specialists interested in the technical detail and various applications presented, but also to researchers interested in building upon the book s theoretical results."

A complete, highly accessible introduction to one of today’s most exciting areas of applied mathematics One of the youngest, most vital areas of applied mathematics, combinatorial optimization integrates techniques from combinatorics, linear programming, and the theory of algorithms. Because of its success in solving difficult problems in areas from telecommunications to VLSI, from product distribution to airline crew scheduling, the field has seen a ground swell of activity over the past decade. Combinatorial Optimization is an ideal introduction to this mathematical discipline for advanced undergraduates and graduate students of discrete mathematics, computer science, and operations research. Written by a team of recognized experts, the text offers a thorough, highly accessible treatment of both classical concepts and recent results. The topics include:

• Network flow problems
• Optimal matching
• Integrality of polyhedra
• Matroids
• NP-completeness

While mathematically sophisticated methods can be used to better understand and improve processes, the nonlinear nature of food processing models can make their dynamic optimization a daunting task. With contributions from a virtual who s who in the food processing industry, Optimization in Food Engineering evaluates the potential uses and limitations of optimization techniques for food processing, including classical methods, artificial intelligence-genetic algorithms, multi-objective optimization procedures, and computational fluid dynamics.

The book begins by delineating the fundamentals and methods for analytical and numerical procedures. It then covers optimization techniques and how they specifically apply to food processing. The final section digs deep into fundamental food processes and provides detailed explanation and examples from the most experienced and published authors in the field. This includes a range of processes from optimization strategies for improving the performance of batch reactors to the optimization of conventional thermal processing, microwave heating, freeze drying, spray drying, and refrigeration systems, to structural optimization techniques for developing beverage containers, optimization approaches for impingement processing, and optimal operational planning methodologies. Each chapter presents the required parameters for the given process with the optimization procedure to apply.

An increasing part of the food processor s job is to optimize systems to squeeze more dollars out of overhead to offset rising utility and transportation costs. Logically combining optimization techniques from many sources into a single volume focused on food production processes, this book provides real solutions to increases in energy, healthcare, and product liability costs that impact the bottom line in food production.

This book explores applications of computational intelligence in key and emerging fields of engineering, especially with regard to condition monitoring and fault diagnosis, inverse problems, decision support systems and optimization. These applications can be beneficial in a broad range of contexts, including: water distribution networks, manufacturing systems, production and storage of electrical energy, heat transfer, acoustic levitation, uncertainty and robustness of infinite-dimensional objects, fatigue failure prediction, autonomous navigation, nanotechnology, and the analysis of technological development indexes. All applications, mathematical and computational tools, and original results are presented using rigorous mathematical procedures. Further, the book gathers contributions by respected experts from 22 different research centers and eight countries: Brazil, Cuba, France, Hungary, India, Japan, Romania and Spain. The book is intended for use in graduate courses on applied computation, applied mathematics, and engineering, where tools like computational intelligence and numerical methods are applied to the solution of real-world problems in emerging areas of engineering.

Analysis and Design of Discrete Part Production Lines provides a complete overview of production systems, investigating several production line problems, and describing the best approaches to the analysis of production line performance. Written by experts in the field of production and manufacturing research, this book also presents numerous techniques that can be used to describe and model various types of production lines.

Special Features:

* Includes access to a supplementary web-based software package, providing algorithms and examples, developed by distinguished experts of the field.

* Describes new results for evaluative techniques and design algorithms as well as several open problems in production line optimization.

* Presents in detail the theory and techniques that underlie production system management, design, and analysis, allowing the book to serve as an excellent introduction to newcomers in the field.

* Has potential for use in a graduate level course in industrial or manufacturing engineering, or in a business course with a manufacturing focus.

* Contains appendices providing an overview of several mathematical techniques employed to design and evaluate production line models.

Seeking sparse solutions of underdetermined linear systems is required in many areas of engineering and science such as signal and image processing. The efficient sparse representation becomes central in various big or high-dimensional data processing, yielding fruitful theoretical and realistic results in these fields. The mathematical optimization plays a fundamentally important role in the development of these results and acts as the mainstream numerical algorithms for the sparsity-seeking problems arising from big-data processing, compressed sensing, statistical learning, computer vision, and so on. This has attracted the interest of many researchers at the interface of engineering, mathematics and computer science. Sparse Optimization Theory and Methods presents the state of the art in theory and algorithms for signal recovery under the sparsity assumption. The up-to-date uniqueness conditions for the sparsest solution of underdertemined linear systems are described. The results for sparse signal recovery under the matrix property called range space property (RSP) are introduced, which is a deep and mild condition for the sparse signal to be recovered by convex optimization methods. This framework is generalized to 1-bit compressed sensing, leading to a novel sign recovery theory in this area. Two efficient sparsity-seeking algorithms, reweighted l1-minimization in primal space and the algorithm based on complementary slackness property, are presented. The theoretical efficiency of these algorithms is rigorously analysed in this book. Under the RSP assumption, the author also provides a novel and unified stability analysis for several popular optimization methods for sparse signal recovery, including l1-mininization, Dantzig selector and LASSO. This book incorporates recent development and the author's latest research in the field that have not appeared in other books.

As optimization techniques have developed, a gap has arisen between the people devising the methods and the people who actually need to use them. Research into methods is necessarily long-term and located usually in academic establishments; whereas the application of an optimization technique, normally in an industrial environment, has to be justified financially in the short term. The gap is probably inevitable; but there is no need for textbooks to reflect it. Teaching of optimization techniques separately from their connection with applications is pointless. This book gives a detailed exposition of the techniques.

In this first volume, T. A. J. Nicholson demonstrates the full range of techniques available to the practitioner for the solution of varying problems. For each technique, the background reasoning behind its development is explained in simple terms; where helpful it is supported by a geometrical argument; and the iterative algorithm for finding the optimum is defined clearly. These steps enable the reader not only to see plainly what is happening in the method but also to reach a level of understanding necessary to write computer programs for optimization techniques.

Problems are tackled in the same way--by searching a feasible region for an optimum. This approach helps the reader to develop the most essential of all skills--selecting appropriate techniques for different circumstances. The numerous worked examples in the text, supported by worked solutions, and the exercises at the end of the chapters are important aids to learning and to teachers. This book serves as an introduction to optimization techniques for students as well as a reference work for the practitioner in business and industry.

"T. A. J. Nicholson" is Senior Lecturer at the London Business School with research and consulting interests in industrial control systems.

Computational optimization methods have matured over the last few years due to extensive research by applied mathematicians and engineers. These methods have been applied to many practical applications. Several general-purpose optimization programs and programs for specific engineering applications have become available to solve particular optimization problems.Written by leading researchers in the field of optimization, this highly readable book covers state-of-the-art computational algorithms as well as applications of optimization to structural and mechanical systems. Formulations of the problems and numerical solutions are presented, and topics requiring further research are also suggested.

This book is devoted to the study of a class of optimal control problems arising in mathematical economics, related to the Robinson-Solow-Srinivasan (RSS) model. It will be useful for researches interested in the turnpike theory, infinite horizon optimal control and their applications, and mathematical economists. The RSS is a well-known model of economic dynamics that was introduced in the 1960s and as many other models of economic dynamics, the RSS model is determined by an objective function (a utility function) and a set-valued mapping (a technology map). The set-valued map generates a dynamical system whose trajectories are under consideration and the objective function determines an optimality criterion. The goal is to find optimal trajectories of the dynamical system, using the optimality criterion. Chapter 1 discusses turnpike properties for some classes of discrete time optimal control problems. Chapter 2 present the description of the RSS model and discuss its basic properties. Infinite horizon optimal control problems, related to the RSS model are studied in Chapter 3. Turnpike properties for the RSS model are analyzed in Chapter 4. Chapter 5 studies infinite horizon optimal control problems related to the RSS model with a nonconcave utility function. Chapter 6 focuses on infinite horizon optimal control problems with nonautonomous optimality criterions. Chapter 7 contains turnpike results for a class of discrete-time optimal control problems. Chapter 8 discusses the RSS model and compares different optimality criterions. Chapter 9 is devoted to the study of the turnpike properties for the RSS model. In Chapter 10 the one-dimensional autonomous RSS model is considered and the continuous time RSS model is studied in Chapter 11.

An Application-Oriented Introduction to Essential Optimization Concepts and Best Practices Optimization is an inherent human tendency that gained new life after the advent of calculus; now, as the world grows increasingly reliant on complex systems, optimization has become both more important and more challenging than ever before. Engineering Optimization provides a practically-focused introduction to modern engineering optimization best practices, covering fundamental analytical and numerical techniques throughout each stage of the optimization process. Although essential algorithms are explained in detail, the focus lies more in the human function: how to create an appropriate objective function, choose decision variables, identify and incorporate constraints, define convergence, and other critical issues that define the success or failure of an optimization project. Examples, exercises, and homework throughout reinforce the author's "do, not study" approach to learning, underscoring the application-oriented discussion that provides a deep, generic understanding of the optimization process that can be applied to any field. Providing excellent reference for students or professionals, Engineering Optimization Describes and develops a variety of algorithms, including gradient based (such as Newton's, and Levenberg-Marquardt), direct search (such as Hooke-Jeeves, Leapfrogging, and Particle Swarm), along with surrogate functions for surface characterization Provides guidance on optimizer choice by application, and explains how to determine appropriate optimizer parameter values Details current best practices for critical stages of specifying an optimization procedure, including decision variables, defining constraints, and relationship modeling Provides access to software and Visual Basic macros for Excel on the companion website, along with solutions to examples presented in the book Clear explanations, explicit equation derivations, and practical examples make this book ideal for use as part of a class or self-study, assuming a basic understanding of statistics, calculus, computer programming, and engineering models. Anyone seeking best practices for "making the best choices" will find value in this introductory resource.

This book examines the mismatch between discrete programs, which lie at the center of modern applied mathematics, and the continuous space phenomena they simulate. The author considers whether we can imagine continuous spaces of programs, and asks what the structure of such spaces would be and how they would be constituted. He proposes a functional analysis of program spaces focused through the lens of iterative optimization. The author begins with the observation that optimization methods such as Genetic Algorithms, Evolution Strategies, and Particle Swarm Optimization can be analyzed as Estimation of Distributions Algorithms (EDAs) in that they can be formulated as conditional probability distributions. The probabilities themselves are mathematical objects that can be compared and operated on, and thus many methods in Evolutionary Computation can be placed in a shared vector space and analyzed using techniques of functional analysis. The core ideas of this book expand from that concept, eventually incorporating all iterative stochastic search methods, including gradient-based methods. Inspired by work on Randomized Search Heuristics, the author covers all iterative optimization methods and not just evolutionary methods. The No Free Lunch Theorem is viewed as a useful introduction to the broader field of analysis that comes from developing a shared mathematical space for optimization algorithms. The author brings in intuitions from several branches of mathematics such as topology, probability theory, and stochastic processes and provides substantial background material to make the work as self-contained as possible. The book will be valuable for researchers in the areas of global optimization, machine learning, evolutionary theory, and control theory.

This volume contains papers presented at the 11th scientific meeting of the IFIP working group on reliability and optimization of structural systems. The purpose of Working Group 7.5 is to promote modern structural system reliability and optimization theory and its applications; stimulate research, development, and application; assist and advance research and development; further the dissemination and exchange of information; and encourage education. The main themes include structural reliability methods and applications, engineering risk analysis and decision-making, new optimization techniques and various applications in civil engineering.

This book deals with nonsmooth structures arising within the optimization setting. It considers four optimization problems, namely, mathematical programs with complementarity constraints, general semi-infinite programming problems, mathematical programs with vanishing constraints and bilevel optimization. The author uses the topological approach and topological invariants of corresponding feasible sets are investigated. Moreover, the critical point theory in the sense of Morse is presented and parametric and stability issues are considered. The material progresses systematically and establishes a comprehensive theory for a rather broad class of optimization problems tailored to their particular type of nonsmoothness. Topological Aspects of Nonsmooth Optimization will benefit researchers and graduate students in applied mathematics, especially those working in optimization theory, nonsmooth analysis, algebraic topology and singularity theory.

This textbook provides students, researchers, and engineers in the area of electrical engineering with advanced mathematical optimization methods. Presented in a readable format, this book highlights fundamental concepts of advanced optimization used in electrical engineering. Chapters provide a collection that ranges from simple yet important concepts such as unconstrained optimization to highly advanced topics such as linear matrix inequalities and artificial intelligence-based optimization methodologies. The reader is motivated to engage with the content via numerous application examples of optimization in the area of electrical engineering. The book begins with an extended review of linear algebra that is a prerequisite to mathematical optimization. It then precedes with unconstrained optimization, convex programming, duality, linear matrix inequality, and intelligent optimization methods. This book can be used as the main text in courses such as Engineering Optimization, Convex Engineering Optimization, Advanced Engineering Mathematics and Robust Optimization and will be useful for practicing design engineers in electrical engineering fields. Author provided cases studies and worked examples are included for student and instructor use.

The exercise of solving engineering problems that require optimisation procedures can be seriously affected by uncertain variables, resulting in potential underperforming solutions. Although this is a well-known problem, important knowledge gaps are still to be addressed. For example, concepts of robustness largely differ from study to study, robust solutions are generally provided with limited information about their uncertainty, and robust optimisation is difficult to apply as it is a computationally demanding task. The proposed research aims to address the mentioned challenges and focuses on robust optimisation of multiple objectives and multiple sources of probabilistically described uncertainty. This is done by the development of the Robust Optimisation and Probabilistic Analysis of Robustness algorithm (ROPAR), which integrates widely accepted robustness metrics into a single flexible framework. In this thesis, ROPAR is not only tested in benchmark functions, but also in engineering problems related to the water sector, in particular the design of urban drainage and water distribution systems. ROPAR allows for employing practically any existing multi-objective optimisation algorithm as its internal optimisation engine, which enables its applicability to other problems as well. Additionally, ROPAR can be straightforwardly parallelized, allowing for fast availability of results.

This is the third of three volumes providing a comprehensive presentation of the fundamentals of scientific computing. This volume discusses topics that depend more on calculus than linear algebra, in order to prepare the reader for solving differential equations. This book and its companions show how to determine the quality of computational results, and how to measure the relative efficiency of competing methods. Readers learn how to determine the maximum attainable accuracy of algorithms, and how to select the best method for computing problems. This book also discusses programming in several languages, including C++, Fortran and MATLAB. There are 90 examples, 200 exercises, 36 algorithms, 40 interactive JavaScript programs, 91 references to software programs and 1 case study. Topics are introduced with goals, literature references and links to public software. There are descriptions of the current algorithms in GSLIB and MATLAB. This book could be used for a second course in numerical methods, for either upper level undergraduates or first year graduate students. Parts of the text could be used for specialized courses, such as nonlinear optimization or iterative linear algebra.