This text provides deep and comprehensive coverage of the mathematical background for data science, including machine learning, optimal recovery, compressed sensing, optimization, and neural networks. In the past few decades, heuristic methods adopted by big tech companies have complemented existing scientific disciplines to form the new field of Data Science. This text embarks the readers on an engaging itinerary through the theory supporting the field. Altogether, twenty-seven lecture-length chapters with exercises provide all the details necessary for a solid understanding of key topics in data science. While the book covers standard material on machine learning and optimization, it also includes distinctive presentations of topics such as reproducing kernel Hilbert spaces, spectral clustering, optimal recovery, compressed sensing, group testing, and applications of semidefinite programming. Students and data scientists with less mathematical background will appreciate the appendices that provide more background on some of the more abstract concepts.

The Christoffel-Darboux kernel, a central object in approximation theory, is shown to have many potential uses in modern data analysis, including applications in machine learning. This is the first book to offer a rapid introduction to the subject, illustrating the surprising effectiveness of a simple tool. Bridging the gap between classical mathematics and current evolving research, the authors present the topic in detail and follow a heuristic, example-based approach, assuming only a basic background in functional analysis, probability and some elementary notions of algebraic geometry. They cover new results in both pure and applied mathematics and introduce techniques that have a wide range of potential impacts on modern quantitative and qualitative science. Comprehensive notes provide historical background, discuss advanced concepts and give detailed bibliographical references. Researchers and graduate students in mathematics, statistics, engineering or economics will find new perspectives on traditional themes, along with challenging open problems.

A comprehensive introduction to convexity and optimization in Rn

This book presents the mathematics of finite dimensional constrained optimization problems. It provides a basis for the further mathematical study of convexity, of more general optimization problems, and of numerical algorithms for the solution of finite dimensional optimization problems. For readers who do not have the requisite background in real analysis, the author provides a chapter covering this material. The text features abundant exercises and problems designed to lead the reader to a fundamental understanding of the material.

Convexity and Optimization in Rn provides detailed discussion of:

• Requisite topics in real analysis
• Convex sets
• Convex functions
• Optimization problems
• Convex programming and duality
• The simplex method

A detailed bibliography is included for further study and an index offers quick reference. Suitable as a text for both graduate and undergraduate students in mathematics and engineering, this accessible text is written from extensively class-tested notes.

In the last few years, Algorithms for Convex Optimization have revolutionized algorithm design, both for discrete and continuous optimization problems. For problems like maximum flow, maximum matching, and submodular function minimization, the fastest algorithms involve essential methods such as gradient descent, mirror descent, interior point methods, and ellipsoid methods. The goal of this self-contained book is to enable researchers and professionals in computer science, data science, and machine learning to gain an in-depth understanding of these algorithms. The text emphasizes how to derive key algorithms for convex optimization from first principles and how to establish precise running time bounds. This modern text explains the success of these algorithms in problems of discrete optimization, as well as how these methods have significantly pushed the state of the art of convex optimization itself.

This is the first book devoted entirely to Particle Swarm Optimization (PSO), which is a non-specific algorithm, similar to evolutionary algorithms, such as taboo search and ant colonies.

Since its original development in 1995, PSO has mainly been applied to continuous-discrete heterogeneous strongly non-linear numerical optimization and it is thus used almost everywhere in the world. Its convergence rate also makes it a preferred tool in dynamic optimization.

Reactive Search and Intelligent Optimization is an excellent introduction to the main principles of reactive search, as well as an attempt to develop some fresh intuition for the approaches. The book looks at different optimization possibilities with an emphasis on opportunities for learning and self-tuning strategies. While focusing more on methods than on problems, problems are introduced wherever they help make the discussion more concrete, or when a specific problem has been widely studied by reactive search and intelligent optimization heuristics. Individual chapters cover reacting on the neighborhood; reacting on the annealing schedule; reactive prohibitions; model-based search; reacting on the objective function; relationships between reactive search and reinforcement learning; and much more. Each chapter is structured to show basic issues and algorithms; the parameters critical for the success of the different methods discussed; and opportunities for the automated tuning of these parameters.

Understand common scheduling as well as other advanced operational problems with this valuable reference from a recognized leader in the field. Beginning with basic principles and an overview of linear and mixed-integer programming, this unified treatment introduces the fundamental ideas underpinning most modeling approaches, and will allow you to easily develop your own models. With more than 150 figures, the basic concepts and ideas behind the development of different approaches are clearly illustrated. Addresses a wide range of problems arising in diverse industrial sectors, from oil and gas to fine chemicals, and from commodity chemicals to food manufacturing. A perfect resource for engineering and computer science students, researchers working in the area, and industrial practitioners.

Written by an international group of active researchers in the field, this volume presents innovative formulations and applied procedures for sensitivity analysis and structural design optimization. Eight chapters discuss subjects ranging from recent developments in the determination and application of topological gradients, to the use of evolutionary algorithms and meta-models to solve practical engineering problems. With such a comprehensive set of contributions, the book is a valuable source of information for graduate students and researchers entering or working in the matter.

Address vector and matrix methods necessary in numerical methods and optimization of linear systems in engineering with this unified text. Treats the mathematical models that describe and predict the evolution of our processes and systems, and the numerical methods required to obtain approximate solutions. Explores the dynamical systems theory used to describe and characterize system behaviour, alongside the techniques used to optimize their performance. Integrates and unifies matrix and eigenfunction methods with their applications in numerical and optimization methods. Consolidating, generalizing, and unifying these topics into a single coherent subject, this practical resource is suitable for advanced undergraduate students and graduate students in engineering, physical sciences, and applied mathematics.

There are no silver bullets in algorithm design, and no single algorithmic idea is powerful and flexible enough to solve every computational problem. Nor are there silver bullets in algorithm analysis, as the most enlightening method for analyzing an algorithm often depends on the problem and the application. However, typical algorithms courses rely almost entirely on a single analysis framework, that of worst-case analysis, wherein an algorithm is assessed by its worst performance on any input of a given size. The purpose of this book is to popularize several alternatives to worst-case analysis and their most notable algorithmic applications, from clustering to linear programming to neural network training. Forty leading researchers have contributed introductions to different facets of this field, emphasizing the most important models and results, many of which can be taught in lectures to beginning graduate students in theoretical computer science and machine learning.

This book provides an essential introduction to Stochastic Programming, especially intended for graduate students. The book begins by exploring a linear programming problem with random parameters, representing a decision problem under uncertainty. Several models for this problem are presented, including the main ones used in Stochastic Programming: recourse models and chance constraint models. The book not only discusses the theoretical properties of these models and algorithms for solving them, but also explains the intrinsic differences between the models. In the book's closing section, several case studies are presented, helping students apply the theory covered to practical problems. The book is based on lecture notes developed for an Econometrics and Operations Research course for master students at the University of Groningen, the Netherlands - the longest-standing Stochastic Programming course worldwide.

Providing an alternative to engineering-focused resources in the area, Programming Mathematics Using MATLAB (R) introduces the basics of programming and of using MATLAB (R) by highlighting many mathematical examples. Emphasizing mathematical concepts through the visualization of programming throughout the book, this useful resource utilizes examples that may be familiar to math students (such as numerical integration) and others that may be new (such as fractals). Additionally, the text uniquely offers a variety of MATLAB (R) projects, all of which have been class-tested thoroughly, and which enable students to put MATLAB (R) programming into practice while expanding their comprehension of concepts such as Taylor polynomials and the Gram-Schmidt process. Programming Mathematics Using MATLAB (R) is appropriate for readers familiar with sophomore-level mathematics (vectors, matrices, multivariable calculus), and is useful for math courses focused on MATLAB (R) specifically and those focused on mathematical concepts which seek to utilize MATLAB (R) in the classroom.

Master the design and operation of perfusion cell cultures with this authoritative reference. Discover the current state-of-the-art in the design and operation of continuous bioreactors, with emphasis on mammalian cell cultures for producing therapeutic proteins. Topics include the current market for recombinant therapeutic proteins, current industry challenges and the potential contribution of continuous manufacturing. Provides coverage of every step of process development and reactor operation, including small scale screening to lab-scale and scale-up to manufacturing scale. Illustrated through real-life case studies, this is a perfect resource for groups active in the cell culture field, as well as graduate students in areas such as chemical engineering, biotechnology, chemistry and biology, and to those in the pharmaceutical industry, particularly biopharma, biotechnology and food or agro industry.

Analysis, assessment, and data management are core tools required for operation research analysts. The April 2011 conference held at the Helenic Military Academy addressed these issues with efforts to collect valuable recommendations for improving analysts' capabilities to assess and communicate the necessary qualitative data to military leaders. This unique volume is an outgrowth of the April conference and comprises of contributions from the fields of science, mathematics, and the military, bringing Greek research findings to the world. Topics cover a wide variety of mathematical methods used with application to defense and security. Each contribution considers directions and pursuits of scientists that pertain to the military as well as the theoretical background required for methods, algorithms, and techniques used in military applications. The direction of theoretical results in these applications is conveyed and open problems and future areas of focus are highlighted. A foreword will be composed by a member of N.A.T.O. or a ranking member of the armed forces. Topics covered include: applied OR and military applications, signal processing, scattering, scientific computing and applications, combat simulation and statistical modeling, satellite remote sensing, and applied informatics - cryptography and coding. The contents of this volume will be of interest to a diverse audience including military operations research analysts, the military community at large, and practitioners working with mathematical methods and applications to informatics and military science.

Water supply- and drainage systems and mixed water channel systems are networks whose high dynamic is determined and/or affected by consumer habits on drinking water on the one hand and by climate conditions, in particular rainfall, on the other hand. According to their size, water networks consist of hundreds or thousands of system elements. Moreover, different types of decisions (continuous and discrete) have to be taken in the water management. The networks have to be optimized in terms of topology and operation by targeting a variety of criteria. Criteria may for example be economic, social or ecological ones and may compete with each other. The development of complex model systems and their use for deriving optimal decisions in water management is taking place at a rapid pace. Simulation and optimization methods originating in Operations Research have been used for several decades; usually with very limited direct cooperation with applied mathematics. The research presented here aims at bridging this gap, thereby opening up space for synergies and innovation. It is directly applicable for relevant practical problems and has been carried out in cooperation with utility and dumping companies, infrastructure providers and planning offices. A close and direct connection to the practice of water management has been established by involving application-oriented know-how from the field of civil engineering. On the mathematical side all necessary disciplines were involved, including mixed-integer optimization, multi-objective and facility location optimization, numerics for cross-linked dynamic transportation systems and optimization as well as control of hybrid systems. Most of the presented research has been supported by the joint project "Discret-continuous optimization of dynamic water systems" of the federal ministry of education and research (BMBF).

This book is intended to be used as a textbook for graduate students studying theoretical computer science. It can also be used as a reference book for researchers in the area of design and analysis of approximation algorithms. Design and Analysis of Approximation Algorithms is a graduate course in theoretical computer science taught widely in the universities, both in the United States and abroad. There are, however, very few textbooks available for this course. Among those available in the market, most books follow a problem-oriented format; that is, they collected many important combinatorial optimization problems and their approximation algorithms, and organized them based on the types, or applications, of problems, such as geometric-type problems, algebraic-type problems, etc. Such arrangement of materials is perhaps convenient for a researcher to look for the problems and algorithms related to his/her work, but is difficult for a student to capture the ideas underlying the various algorithms. In the new book proposed here, we follow a more structured, technique-oriented presentation. We organize approximation algorithms into different chapters, based on the design techniques for the algorithms, so that the reader can study approximation algorithms of the same nature together. It helps the reader to better understand the design and analysis techniques for approximation algorithms, and also helps the teacher to present the ideas and techniques of approximation algorithms in a more unified way.

Monte Carlo methods are among the most used and useful computational tools available today, providing efficient and practical algorithims to solve a wide range of scientific and engineering problems. Applications covered in this book include optimization, finance, statistical mechanics, birth and death processes, and gambling systems.

Explorations in Monte Carlo Methods provides a hands-on approach to learning this subject. Each new idea is carefully motivated by a realistic problem, thus leading from questions to theory via examples and numerical simulations. Programming exercises are integrated throughout the text as the primary vehicle for learning the material. Each chapter ends with a large collection of problems illustrating and directing the material. This book is suitable as a textbook for students of engineering and the sciences, as well as mathematics.

The book presents, in a systematic manner, the optimal controls under different mathematical models in fermentation processes. Variant mathematical models - i.e., those for multistage systems; switched autonomous systems; time-dependent and state-dependent switched systems; multistage time-delay systems and switched time-delay systems - for fed-batch fermentation processes are proposed and the theories and algorithms of their optimal control problems are studied and discussed. By putting forward novel methods and innovative tools, the book provides a state-of-the-art and comprehensive systematic treatment of optimal control problems arising in fermentation processes. It not only develops nonlinear dynamical system, optimal control theory and optimization algorithms, but can also help to increase productivity and provide valuable reference material on commercial fermentation processes.

This well-thought-out book covers the fundamentals of nonlinear analysis, with a particular focus on variational methods and their applications. Starting from preliminaries in functional analysis, it expands in several directions such as Banach spaces, fixed point theory, nonsmooth analysis, minimax theory, variational calculus and inequalities, critical point theory, monotone, maximal monotone and pseudomonotone operators, and evolution problems.

Optimization methods play a central role in financial modeling. This textbook is devoted to explaining how state-of-the-art optimization theory, algorithms, and software can be used to efficiently solve problems in computational finance. It discusses some classical mean-variance portfolio optimization models as well as more modern developments such as models for optimal trade execution and dynamic portfolio allocation with transaction costs and taxes. Chapters discussing the theory and efficient solution methods for the main classes of optimization problems alternate with chapters discussing their use in the modeling and solution of central problems in mathematical finance. This book will be interesting and useful for students, academics, and practitioners with a background in mathematics, operations research, or financial engineering. The second edition includes new examples and exercises as well as a more detailed discussion of mean-variance optimization, multi-period models, and additional material to highlight the relevance to finance.

This book constitutes the thoroughly refereed proceedings of the Clausthal-Goettingen International Workshop on Simulation Science, held in Goettingen, Germany, in April 2017. The 16 full papers presented were carefully reviewed and selected from 40 submissions. The papers are organized in topical sections on simulation and optimization in networks, simulation of materials, distributed simulations.

This book explores the updated version of the GLOBAL algorithm which contains improvements for a local search algorithm and new Java implementations. Efficiency comparisons to earlier versions and on the increased speed achieved by the parallelization, are detailed. Examples are provided for students as well as researchers and practitioners in optimization, operations research, and mathematics to compose their own scripts with ease. A GLOBAL manual is presented in the appendix to assist new users with modules and test functions. GLOBAL is a successful stochastic multistart global optimization algorithm that has passed several computational tests, and is efficient and reliable for small to medium dimensional global optimization problems. The algorithm uses clustering to ensure efficiency and is modular in regard to the two local search methods it starts with, but it can also easily apply other local techniques. The strength of this algorithm lies in its reliability and adaptive algorithm parameters. The GLOBAL algorithm is free to download also in the earlier Fortran, C, and MATLAB implementations.

Model Predictive Control (MPC), the dominant advanced control approach in industry over the past twenty-five years, is presented comprehensively in this unique book. With a simple, unified approach, and with attention to real-time implementation, it covers predictive control theory including the stability, feasibility, and robustness of MPC controllers. The theory of explicit MPC, where the nonlinear optimal feedback controller can be calculated efficiently, is presented in the context of linear systems with linear constraints, switched linear systems, and, more generally, linear hybrid systems. Drawing upon years of practical experience and using numerous examples and illustrative applications, the authors discuss the techniques required to design predictive control laws, including algorithms for polyhedral manipulations, mathematical and multiparametric programming and how to validate the theoretical properties and to implement predictive control policies. The most important algorithms feature in an accompanying free online MATLAB toolbox, which allows easy access to sample solutions. Predictive Control for Linear and Hybrid Systems is an ideal reference for graduate, postgraduate and advanced control practitioners interested in theory and/or implementation aspects of predictive control.

Classical decision theory evaluates entire worlds, specified so as to include everything a decision-maker cares about. Thus applying decision theory requires performing computations far beyond an ordinary decision-maker's ability. In this book Paul Weirich explains how individuals can simplify and streamline their choices. He shows how different 'parts' of options (intrinsic, temporal, spatiotemporal, causal) are separable, so that we can know what difference one part makes to the value of an option, regardless of what happens in the other parts. He suggests that the primary value of options is found in basic intrinsic attitudes towards outcomes: desires, aversions, or indifferences. And using these two facts he argues that we need only compare small parts of the options we face in order to make a rational decision. This important book will interest readers in decision theory, economics, and the behavioral sciences.

The main goal of this book is to show how to modify and optimize the properties of the damping matrix in order to find the most beneficial way of adding damping to a given mechanical system. To this end, a two-degree-of-freedom model of disc brake is analyzed to gain insight into the fundamental physical behavior of damping. In addition, more realistic, high-dimensional finite element brake models are studied and optimized for stability.