Monte Carlo methods are among the most used and useful computational tools available today, providing efficient and practical algorithims to solve a wide range of scientific and engineering problems. Applications covered in this book include optimization, finance, statistical mechanics, birth and death processes, and gambling systems. Explorations in Monte Carlo Methods provides a hands-on approach to learning this subject. Each new idea is carefully motivated by a realistic problem, thus leading from questions to theory via examples and numerical simulations. Programming exercises are integrated throughout the text as the primary vehicle for learning the material. Each chapter ends with a large collection of problems illustrating and directing the material. This book is suitable as a textbook for students of engineering and the sciences, as well as mathematics.

A long long time ago, echoing philosophical and aesthetic principles that existed since antiquity, William of Ockham enounced the principle of parsimony, better known today as Ockham's razor: "Entities should not be multiplied without neces sity. " This principle enabled scientists to select the "best" physical laws and theories to explain the workings of the Universe and continued to guide scienti?c research, leadingtobeautifulresultsliketheminimaldescriptionlength approachtostatistical inference and the related Kolmogorov complexity approach to pattern recognition. However, notions of complexity and description length are subjective concepts anddependonthelanguage"spoken"whenpresentingideasandresults. The?eldof sparse representations, that recently underwent a Big Bang like expansion, explic itly deals with the Yin Yang interplay between the parsimony of descriptions and the "language" or "dictionary" used in them, and it became an extremely exciting area of investigation. It already yielded a rich crop of mathematically pleasing, deep and beautiful results that quickly translated into a wealth of practical engineering applications. You are holding in your hands the ?rst guide book to Sparseland, and I am sure you'll ?nd in it both familiar and new landscapes to see and admire, as well as ex cellent pointers that will help you ?nd further valuable treasures. Enjoy the journey to Sparseland! Haifa, Israel, December 2009 Alfred M. Bruckstein vii Preface This book was originally written to serve as the material for an advanced one semester (fourteen 2 hour lectures) graduate course for engineering students at the Technion, Israel.

Computational complexity is a serious bottleneck for the design process in virtually any engineering area. While migration from prototyping and experimental-based design validation to verification using computer simulation models is inevitable and has a number of advantages, high computational costs of accurate, high-fidelity simulations can be a major issue that slows down the development of computer-aided design methodologies, particularly those exploiting automated design improvement procedures, e.g., numerical optimization. The continuous increase of available computational resources does not always translate into shortening of the design cycle because of the growing demand for higher accuracy and necessity to simulate larger and more complex systems. Accurate simulation of a single design of a given system may be as long as several hours, days or even weeks, which often makes design automation using conventional methods impractical or even prohibitive. Additional problems include numerical noise often present in the simulation data, possible presence of multiple locally optimum designs, as well as multiple conflicting objectives. In this edited book, various techniques that can alleviate solving computationally expensive engineering design problems are presented. One of the most promising approaches is the use of fast replacement models, so-called surrogates, that reliably represent the expensive, simulation-based model of the system/device of interest but they are much cheaper and analytically tractable. Here, a group of international experts summarize recent developments in the area and demonstrate applications in various disciplines of engineering and science. The main purpose of the work is to provide the basic concepts and formulations of the surrogate-based modeling and optimization paradigm, as well as discuss relevant modeling techniques, optimization algorithms and design procedures. Therefore, this book should be useful to researchers and engineers from any discipline where computationally heavy simulations are used on daily basis in the design process.

In operations research and computer science it is common practice to evaluate the performance of optimization algorithms on the basis of computational results, and the experimental approach should follow accepted principles that guarantee the reliability and reproducibility of results. However, computational experiments differ from those in other sciences, and the last decade has seen considerable methodological research devoted to understanding the particular features of such experiments and assessing the related statistical methods. This book consists of methodological contributions on different scenarios of experimental analysis. The first part overviews the main issues in the experimental analysis of algorithms, and discusses the experimental cycle of algorithm development; the second part treats the characterization by means of statistical distributions of algorithm performance in terms of solution quality, runtime and other measures; and the third part collects advanced methods from experimental design for configuring and tuning algorithms on a specific class of instances with the goal of using the least amount of experimentation. The contributor list includes leading scientists in algorithm design, statistical design, optimization and heuristics, and most chapters provide theoretical background and are enriched with case studies. This book is written for researchers and practitioners in operations research and computer science who wish to improve the experimental assessment of optimization algorithms and, consequently, their design.

This book is about optimization techniques and is subdivided into two parts. In the first part a wide overview on optimization theory is presented. Optimization is presented as being composed of five topics, namely: design of experiment, response surface modeling, deterministic optimization, stochastic optimization, and robust engineering design. Each chapter, after presenting the main techniques for each part, draws application oriented conclusions including didactic examples. In the second part some applications are presented to guide the reader through the process of setting up a few optimization exercises, analyzing critically the choices which are made step by step, and showing how the different topics that constitute the optimization theory can be used jointly in an optimization process. The applications which are presented are mainly in the field of thermodynamics and fluid dynamics due to the author's background.

Using network models to investigate the interconnectivity in modern economic systems allows researchers to better understand and explain some economic phenomena. This volume presents contributions by known experts and active researchers in economic and financial network modeling. Readers are provided with an understanding of the latest advances in network analysis as applied to economics, finance, corporate governance, and investments. Moreover, recent advances in market network analysis that focus on influential techniques for market graph analysis are also examined. Young researchers will find this volume particularly useful in facilitating their introduction to this new and fascinating field. Professionals in economics, financial management, various technologies, and network analysis, will find the network models presented in this book beneficial in analyzing the interconnectivity in modern economic systems.

In many decision problems, e.g. from the area of production and logistics manage ment, the evaluation of alternatives and the determination of an optimal or at least suboptimal solution is an important but dif?cult task. For most such problems no ef?cient algorithm is known and classical approaches of Operations Research like Mixed Integer Linear Programming or Dynamic Pro gramming are often of limited use due to excessive computation time. Therefore, dedicated heuristic solution approaches have been developed which aim at providing good solutions in reasonable time for a given problem. However, such methods have two major drawbacks: First, they are tailored to a speci?c prob lem and their adaption to other problems is dif?cult and in many cases even impos sible. Second, they are typically designed to "build" one single solution in the most effective way, whereas most decision problems have a vast number of feasible solu tions. Hence usually the chances are high that there exist better ones. To overcome these limitations, problem independent search strategies, in particular metaheuris tics, have been proposed. This book provides an elementary step by step introduction to metaheuristics focusing on the search concepts they are based on. The ?rst part demonstrates un derlying concepts of search strategies using a simple example optimization problem.

Providing readers with a detailed examination of resilient controls in risk-averse decision, this monograph is aimed toward researchers and graduate students in applied mathematics and electrical engineering with a systems-theoretic concentration. This work contains a timely and responsive evaluation of reforms on the use of asymmetry or skewness pertaining to the restrictive family of quadratic costs that have been appeared in various scholarly forums. Additionally, the book includes a discussion of the current and ongoing efforts in the usage of risk, dynamic game decision optimization and disturbance mitigation techniques with output feedback measurements tailored toward the worst-case scenarios. This work encompasses some of the current changes across uncertainty quantification, stochastic control communities, and the creative efforts that are being made to increase the understanding of resilient controls. Specific considerations are made in this book for the application of decision theory to resilient controls of the linear-quadratic class of stochastic dynamical systems. Each of these topics are examined explicitly in several chapters. This monograph also puts forward initiatives to reform both control decisions with risk consequences and correct-by-design paradigms for performance reliability associated with the class of stochastic linear dynamical systems with integral quadratic costs and subject to network delays, control and communication constraints.

This book on PDE Constrained Optimization contains contributions on the mathematical analysis and numerical solution of constrained optimal control and optimization problems where a partial differential equation (PDE) or a system of PDEs appears as an essential part of the constraints. The appropriate treatment of such problems requires a fundamental understanding of the subtle interplay between optimization in function spaces and numerical discretization techniques and relies on advanced methodologies from the theory of PDEs and numerical analysis as well as scientific computing. The contributions reflect the work of the European Science Foundation Networking Programme 'Optimization with PDEs' (OPTPDE).

The volume is dedicated to Stephen Smale on the occasion of his 80th birthday.Besides his startling 1960 result of the proof of the Poincare conjecture for all dimensionsgreater than or equal to five, Smale's ground breaking contributions invarious fields in Mathematics have marked the second part of the 20th century andbeyond. Stephen Smale has done pioneering work in differential topology, globalanalysis, dynamical systems, nonlinear functional analysis, numerical analysis, theoryof computation and machine learning as well as applications in the physical andbiological sciences and economics. In sum, Stephen Smale has manifestly brokenthe barriers among the different fields of mathematics and dispelled some remainingprejudices. He is indeed a universal mathematician. Smale has been honoredwith several prizes and honorary degrees including, among others, the Fields Medal(1966), The Veblen Prize (1966), the National Medal of Science (1996) and theWolfPrize (2006/2007).

Shimon Even's Graph Algorithms, published in 1979, was a seminal introductory book on algorithms read by everyone engaged in the field. This thoroughly revised second edition, with a foreword by Richard M. Karp and notes by Andrew V. Goldberg, continues the exceptional presentation from the first edition and explains algorithms in a formal but simple language with a direct and intuitive presentation. The book begins by covering basic material, including graphs and shortest paths, trees, depth-first-search and breadth-first search. The main part of the book is devoted to network flows and applications of network flows, and it ends with chapters on planar graphs and testing graph planarity.

This volume covers some of the topics that are related to the rapidly growing field of biomedical informatics. In June 11-12, 2010 a workshop entitled 'Optimization and Data Analysis in Biomedical Informatics' was organized at The Fields Institute. Following this event invited contributions were gathered based on the talks presented at the workshop, and additional invited chapters were chosen from world's leading experts. In this publication, the authors share their expertise in the form of state-of-the-art research and review chapters, bringing together researchers from different disciplines and emphasizing the value of mathematical methods in the areas of clinical sciences. This work is targeted to applied mathematicians, computer scientists, industrial engineers, and clinical scientists who are interested in exploring emerging and fascinating interdisciplinary topics of research. It is designed to further stimulate and enhance fruitful collaborations between scientists from different disciplines.

Analysis, assessment, and data management are core tools required for operation research analysts. The April 2011 conference held at the Helenic Military Academy addressed these issues with efforts to collect valuable recommendations for improving analysts' capabilities to assess and communicate the necessary qualitative data to military leaders. This unique volume is an outgrowth of the April conference and comprises of contributions from the fields of science, mathematics, and the military, bringing Greek research findings to the world. Topics cover a wide variety of mathematical methods used with application to defense and security. Each contribution considers directions and pursuits of scientists that pertain to the military as well as the theoretical background required for methods, algorithms, and techniques used in military applications. The direction of theoretical results in these applications is conveyed and open problems and future areas of focus are highlighted. A foreword will be composed by a member of N.A.T.O. or a ranking member of the armed forces. Topics covered include: applied OR and military applications, signal processing, scattering, scientific computing and applications, combat simulation and statistical modeling, satellite remote sensing, and applied informatics - cryptography and coding. The contents of this volume will be of interest to a diverse audience including military operations research analysts, the military community at large, and practitioners working with mathematical methods and applications to informatics and military science.

This volume contains a selection of contributions that were presented at the Modeling and Optimization: Theory and Applications Conference (MOPTA) held at Lehigh University in Bethlehem, Pennsylvania, USA on August 18-20, 2010. The conference brought together a diverse group of researchers and practitioners, working on both theoretical and practical aspects of continuous or discrete optimization. Topics presented included algorithms for solving convex, network, mixed-integer, nonlinear, and global optimization problems, and addressed the application of optimization techniques in finance, logistics, health, and other important fields. The contributions contained in this volume represent a sample of these topics and applications and illustrate the broad diversity of ideas discussed at the meeting.

This book investigates several duality approaches for vector optimization problems, while also comparing them. Special attention is paid to duality for linear vector optimization problems, for which a vector dual that avoids the shortcomings of the classical ones is proposed. Moreover, the book addresses different efficiency concepts for vector optimization problems. Among the problems that appear when the framework is generalized by considering set-valued functions, an increasing interest is generated by those involving monotone operators, especially now that new methods for approaching them by means of convex analysis have been developed. Following this path, the book provides several results on different properties of sums of monotone operators.

Shimon Even's Graph Algorithms, published in 1979, was a seminal introductory book on algorithms read by everyone engaged in the field. This thoroughly revised second edition, with a foreword by Richard M. Karp and notes by Andrew V. Goldberg, continues the exceptional presentation from the first edition and explains algorithms in a formal but simple language with a direct and intuitive presentation. The book begins by covering basic material, including graphs and shortest paths, trees, depth-first-search and breadth-first search. The main part of the book is devoted to network flows and applications of network flows, and it ends with chapters on planar graphs and testing graph planarity.

An effective reliability programme is an essential component of every product's design, testing and efficient production. From the failure analysis of a microelectronic device to software fault tolerance and from the accelerated life testing of mechanical components to hardware verification, a common underlying philosophy of reliability applies. Defining both fundamental and applied work across the entire systems reliability arena, this state-of-the-art reference presents methodologies for quality, maintainability and dependability. Featuring: Contributions from 60 leading reliability experts in academia and industry giving comprehensive and authoritative coverage. A distinguished international Editorial Board ensuring clarity and precision throughout. Extensive references to the theoretical foundations, recent research and future directions described in each chapter. Comprehensive subject index providing maximum utility to the reader. Applications and examples across all branches of engineering including IT, power, automotive and aerospace sectors. The handbook's cross-disciplinary scope will ensure that it serves as an indispensable tool for researchers in industrial, electrical, electronics, computer, civil, mechanical and systems engineering. It will also aid professional engineers to find creative reliability solutions and management to evaluate systems reliability and to improve processes. For student research projects it will be the ideal starting point whether addressing basic questions in communications and electronics or learning advanced applications in micro-electro-mechanical systems (MEMS), manufacturing and high-assurance engineering systems.

This book is the first easy-to-read text on nonsmooth optimization (NSO, not necessarily di erentiable optimization). Solving these kinds of problems plays a critical role in many industrial applications and real-world modeling systems, for example in the context of image denoising, optimal control, neural network training, data mining, economics and computational chemistry and physics. The book covers both the theory and the numerical methods used in NSO and provide an overview of di erent problems arising in the eld. It is organized into three parts:

1. convex and nonconvex analysis and the theory of NSO;

2. test problems and practical applications;

3. a guide to NSO software.The book is ideal for anyone teaching or attending NSO courses. As an accessible introduction to the eld, it is also well suited as an independent learning guide for practitioners already familiar with the basics of optimization."

This book describes how evolutionary algorithms (EA), including genetic algorithms (GA) and particle swarm optimization (PSO) can be utilized for solving multi-objective optimization problems in the area of embedded and VLSI system design. Many complex engineering optimization problems can be modelled as multi-objective formulations. This book provides an introduction to multi-objective optimization using meta-heuristic algorithms, GA and PSO and how they can be applied to problems like hardware/software partitioning in embedded systems, circuit partitioning in VLSI, design of operational amplifiers in analog VLSI, design space exploration in high-level synthesis, delay fault testing in VLSI testing and scheduling in heterogeneous distributed systems. It is shown how, in each case, the various aspects of the EA, namely its representation and operators like crossover, mutation, etc, can be separately formulated to solve these problems. This book is intended for design engineers and researchers in the field of VLSI and embedded system design. The book introduces the multi-objective GA and PSO in a simple and easily understandable way that will appeal to introductory readers.

This book contains a selection of refereed papers presented at the "International Conference on Operations Research (OR 2013)" which took place at Erasmus University Rotterdam September 3-6, 2013. The conference was jointly organized by the German and the Dutch OR Society. More than 800 scientists and students from over 50 countries attended OR 2013 and presented more than 600 papers in parallel topical streams, as well as special award sessions. The theme of the conference and its proceedings is "Impact on People, Business and Society".

This volume explores the emerging and current, cutting-edge theories and methods of modeling, optimization, dynamics and bio economy. It provides an overview of the main issues, results and open questions in these fields as well as covers applications to biology, economy, energy, industry, physics, psychology and finance.

The majority of the contributed papers for this volume come from the participants of the International Conference on Modeling, Optimization and Dynamics (ICMOD 2010), a satellite conference of EURO XXIV Lisbon 2010, which took place at Faculty of Sciences of University of Porto, Portugal and from the Berkeley Bio economy Conference 2012, at the University of California, Berkeley, USA.

Many of our daily-life problems can be written in the form of an optimization problem. Therefore, solution methods are needed to solve such problems. Due to the complexity of the problems, it is not always easy to find the exact solution. However, approximate solutions can be found. The theory of the best approximation is applicable in a variety of problems arising in nonlinear functional analysis and optimization. This book highlights interesting aspects of nonlinear analysis and optimization together with many applications in the areas of physical and social sciences including engineering. It is immensely helpful for young graduates and researchers who are pursuing research in this field, as it provides abundant research resources for researchers and post-doctoral fellows. This will be a valuable addition to the library of anyone who works in the field of applied mathematics, economics and engineering.

The main purpose of the book is to show how a viscosity approach can be used to tackle control problems in insurance. The problems covered are the maximization of survival probability as well as the maximization of dividends in the classical collective risk model. The authors consider the possibility of controlling the risk process by reinsurance as well as by investments. They show that optimal value functions are characterized as either the unique or the smallest viscosity solution of the associated Hamilton-Jacobi-Bellman equation; they also study the structure of the optimal strategies and show how to find them. The viscosity approach was widely used in control problems related to mathematical finance but until quite recently it was not used to solve control problems related to actuarial mathematical science. This book is designed to familiarize the reader on how to use this approach. The intended audience is graduate students as well as researchers in this area.

The implicit function theorem is one of the most important theorems in analysis and its many variants are basic tools in partial differential equations and numerical analysis.

This second edition of "Implicit Functions and Solution Mappings "presents an updated and more complete picture of the field by including solutions of problems that have been solved since the first edition was published, and places old and new results in a broader perspective. The purpose of this self-contained work is to provide a reference on the topic and to provide a unified collection of a number of results which are currently scattered throughout the literature. Updates to this edition include new sections in almost all chapters, new exercises and examples, updated commentaries to chapters and an enlarged index and references section.

The volume is dedicated to Boris Mirkin on the occasion of his 70th birthday. In addition to his startling PhD results in abstract automata theory, Mirkin's ground breaking contributions in various fields of decision making and data analysis have marked the fourth quarter of the 20th century and beyond. Boris has done pioneering work in group choice, clustering, data mining and knowledge discovery aimed at finding and describing non-trivial or hidden structures-first of all, clusters, orderings and hierarchies-in multivariate and/or network data. Boris Mirkin has published several books, among them The Group Choice Problem (in Russian, 1974), Analysis of Categorical Attributes (in Russian, 1976), Graphs and Genes (in Russian, co-authored with S.N. Rodin, 1977), Group Choice (Wiley-Interscience, 1979), Analysis of Categorical and Structural Features (in Russian, 1976), Graphs and Genes (Springer, co-authored with S.N.Rodin, 1984), Groupings in Social-Economics Research (in Russian, 1985), Mathematical Classification and Clustering (Kluwer, 1996), Clustering: A Data Recovery Approach (Chapman and Hall/CRC, 2005; 2d much revised edition, 2012) and Core Concepts in Data Analysis: Summarization, Correlation, Visualization (Springer, 2011). This volume contains a collection of papers reflecting recent developments rooted in Boris' fundamental contribution to the state-of-the-art in group choice, ordering, clustering, data mining and knowledge discovery. Researchers, students and software engineers will benefit from new knowledge discovery techniques and application directions