This book is the first comprehensive book about reservoir computing (RC). RC is a powerful and broadly applicable computational framework based on recurrent neural networks. Its advantages lie in small training data set requirements, fast training, inherent memory and high flexibility for various hardware implementations. It originated from computational neuroscience and machine learning but has, in recent years, spread dramatically, and has been introduced into a wide variety of fields, including complex systems science, physics, material science, biological science, quantum machine learning, optical communication systems, and robotics. Reviewing the current state of the art and providing a concise guide to the field, this book introduces readers to its basic concepts, theory, techniques, physical implementations and applications. The book is sub-structured into two major parts: theory and physical implementations. Both parts consist of a compilation of chapters, authored by leading experts in their respective fields. The first part is devoted to theoretical developments of RC, extending the framework from the conventional recurrent neural network context to a more general dynamical systems context. With this broadened perspective, RC is not restricted to the area of machine learning but is being connected to a much wider class of systems. The second part of the book focuses on the utilization of physical dynamical systems as reservoirs, a framework referred to as physical reservoir computing. A variety of physical systems and substrates have already been suggested and used for the implementation of reservoir computing. Among these physical systems which cover a wide range of spatial and temporal scales, are mechanical and optical systems, nanomaterials, spintronics, and quantum many body systems. This book offers a valuable resource for researchers (Ph.D. students and experts alike) and practitioners working in the field of machine learning, artificial intelligence, robotics, neuromorphic computing, complex systems, and physics.

This contributed volume investigates several mathematical techniques for the modeling and simulation of viral pandemics, with a special focus on COVID-19. Modeling a pandemic requires an interdisciplinary approach with other fields such as epidemiology, virology, immunology, and biology in general. Spatial dynamics and interactions are also important features to be considered, and a multiscale framework is needed at the level of individuals and the level of virus particles and the immune system. Chapters in this volume address these items, as well as offer perspectives for the future.

'Et moi, ..., si j'avait su comment en revenir, One service mathematics has rendered the je n'y serais point all."' human race. It has put common sense back Jules Verne where it belongs, on the topmost shelf next to the dusty canister labelled 'discarded non. The series is divergent; therefore we may be sense'. able to do something with it. Eric T. Bell O. Hea viside Mathematics is a tool for thought. A highly necessary tool in a world where both feedback and non linearities abound. Similarly, all kinds of parts of mathematics serve as tools for other parts and for other sciences. Applying a simple rewriting rule to the quote on the right above one finds such statements as: 'One service topology has rendered mathematical physics .. .'; 'One service logic has rendered com puter science .. .'; 'One service category theory has rendered mathematics .. .'. All arguably true. And all statements obtainable this way form part of the raison d'etre of this series."

This book comprises chapters authored by experts who are professors and researchers in internationally recognized universities and research institutions. The book presents the results of research and descriptions of real-world systems, services, and technologies. Reading this book, researchers, professional practitioners, and graduate students will gain a clear vision on the state of the art of the research and real-world practice on system dependability and analytics. The book is published in honor of Professor Ravishankar K. Iyer, the George and Ann Fisher Distinguished Professor in the Department of Electrical and Computer Engineering at the University of Illinois at Urbana-Champaign (UIUC), Urbana, Illinois. Professor Iyer is ACM Fellow, IEEE Fellow, AAAS Fellow, and served as Interim Vice Chancellor of UIUC for research during 2008-2011. The book contains chapters written by many of his former students.

This book contains suggestions for and reflections on the teaching, learning and assessing of mathematical modelling and applications in a rapidly changing world, including teaching and learning environments. It addresses all levels of education from universities and technical colleges to secondary and primary schools. Sponsored by the International Community of Teachers of Mathematical Modelling and Applications (ICTMA), it reflects recent ideas and methods contributed by specialists from 30 countries in Africa, the Americas, Asia, Australia and Europe. Inspired by contributions to the Fourteenth Conference on the Teaching of Mathematical Modelling and Applications (ICTMA14) in Hamburg, 2009, the book describes the latest trends in the teaching and learning of mathematical modelling at school and university including teacher education. The broad and versatile range of topics will stress the international state-of-the-art on the following issues:

Theoretical reflections on the teaching and learning of modelling

Modelling competencies

Cognitive perspectives on modelling

Modelling examples for all educational levels

Practice of modelling in school and at university level

Practices in Engineering and Applications"

This work contains an up-to-date coverage of the last 20 years' advances in Bayesian inference in econometrics, with an emphasis on dynamic models. It shows how to treat Bayesian inference in non linear models, by integrating the useful developments of numerical integration techniques based on simulations (such as Markov Chain Monte Carlo methods), and the long available analytical results of Bayesian inference for linear regression models. It thus covers a broad range of rather recent models for economic time series, such as non linear models, autoregressive conditional heteroskedastic regressions, and cointegrated vector autoregressive models. It contains also an extensive chapter on unit root inference from the Bayesian viewpoint. Several examples illustrate the methods. This book is intended for econometrics and statistics postgraduates, professors and researchers in economics departments, business schools, statistics departments, or any research centre in the same fields, especially econometricians.

Mathematical ecology is the application of mathematics to describe and understand ecosystems. There are two main approaches. One is to describe natural communities and induce statistical patterns or relationships which should generally occur. However, this book is devoted entirely to introducing the student to the second approach: to study deterministic mathematical models and, on the basis of mathematical results on the models, to look for the same patterns or relationships in nature. This book is a compromise between three competing desiderata. It seeks to: maximize the generality of the models; constrain the models to "behave" realistically, that is, to exhibit stability and other features; and minimize the difficulty of presentations of the models. The ultimate goal of the book is to introduce the reader to the general mathematical tools used in building realistic ecosystem models. Just such a model is presented in Chapter Nine. The book should also serve as a stepping-stone both to advanced mathematical works like Stability of Biological Communities by Yu. M. Svirezhev and D. O. Logofet (Mir, Moscow, 1983) and to advanced modeling texts like Freshwater Ecosystems by M. Straskraba and A. H. Gnauch (Elsevier, Amsterdam, 1985).

A long long time ago, echoing philosophical and aesthetic principles that existed since antiquity, William of Ockham enounced the principle of parsimony, better known today as Ockham's razor: "Entities should not be multiplied without neces sity. " This principle enabled scientists to select the "best" physical laws and theories to explain the workings of the Universe and continued to guide scienti?c research, leadingtobeautifulresultsliketheminimaldescriptionlength approachtostatistical inference and the related Kolmogorov complexity approach to pattern recognition. However, notions of complexity and description length are subjective concepts anddependonthelanguage"spoken"whenpresentingideasandresults. The?eldof sparse representations, that recently underwent a Big Bang like expansion, explic itly deals with the Yin Yang interplay between the parsimony of descriptions and the "language" or "dictionary" used in them, and it became an extremely exciting area of investigation. It already yielded a rich crop of mathematically pleasing, deep and beautiful results that quickly translated into a wealth of practical engineering applications. You are holding in your hands the ?rst guide book to Sparseland, and I am sure you'll ?nd in it both familiar and new landscapes to see and admire, as well as ex cellent pointers that will help you ?nd further valuable treasures. Enjoy the journey to Sparseland! Haifa, Israel, December 2009 Alfred M. Bruckstein vii Preface This book was originally written to serve as the material for an advanced one semester (fourteen 2 hour lectures) graduate course for engineering students at the Technion, Israel.

The computational models of physical systems comprise parameters, independent and dependent variables. Since the physical processes themselves are seldom known precisely and since most of the model parameters stem from experimental procedures which are also subject to imprecisions, the results predicted by these models are also imprecise, being affected by the uncertainties underlying the respective model. The functional derivatives (also called "sensitivities") of results (also called "responses") produced by mathematical/computational models are needed for many purposes, including: (i) understanding the model by ranking the importance of the various model parameters; (ii) performing "reduced-order modeling" by eliminating unimportant parameters and/or processes; (iii) quantifying the uncertainties induced in a model response due to model parameter uncertainties; (iv) performing "model validation," by comparing computations to experiments to address the question "does the model represent reality?" (v) prioritizing improvements in the model; (vi) performing data assimilation and model calibration as part of forward "predictive modeling" to obtain best-estimate predicted results with reduced predicted uncertainties; (vii) performing inverse "predictive modeling"; (viii) designing and optimizing the system. This 3-Volume monograph describes a comprehensive adjoint sensitivity analysis methodology, developed by the author, which enables the efficient and exact computation of arbitrarily high-order sensitivities of model responses in large-scale systems comprising many model parameters. The qualifier "comprehensive" is employed to highlight that the model parameters considered within the framework of this methodology also include the system's uncertain boundaries and internal interfaces in phase-space. The model's responses can be either scalar-valued functionals of the model's parameters and state variables (e.g., as customarily encountered in optimization problems) or general function-valued responses. Since linear operators admit bona-fide adjoint operators, responses of models that are linear in the state functions (i.e., dependent variables) can depend simultaneously on both the forward and the adjoint state functions. Hence, the sensitivity analysis of such responses warrants the treatment of linear systems in their own right, rather than treating them as particular cases of nonlinear systems. This is in contradistinction to responses for nonlinear systems, which can depend only on the forward state functions, since nonlinear operators do not admit bona-fide adjoint operators (only a linearized form of a nonlinear operator may admit an adjoint operator). Thus, Volume 1 of this book presents the mathematical framework of the nth-Order Comprehensive Adjoint Sensitivity Analysis Methodology for Response-Coupled Forward/Adjoint Linear Systems (abbreviated as "nth-CASAM-L"), which is conceived for the most efficient computation of exactly obtained mathematical expressions of arbitrarily-high-order (nth-order) sensitivities of a generic system response with respect to all of the parameters underlying the respective forward/adjoint systems. Volume 2 of this book presents the application of the nth-CASAM-L to perform a fourth-order sensitivity and uncertainty analysis of an OECD/NEA reactor physics benchmark which is representative of a large-scale model comprises many (21,976) uncertain parameters, thereby amply illustrating the unique potential of the nth-CASAM-L to enable the exact and efficient computation of chosen high-order response sensitivities to model parameters. Volume 3 of this book presents the "nth-Order Comprehensive Adjoint Sensitivity Analysis Methodology for Nonlinear Systems" (abbreviation: nth-CASAM-N) for the practical, efficient, and exact computation of arbitrarily-high order sensitivities of responses to model parameters for systems that are also nonlinear in their underlying state functions. Such computations are not feasible with any other methodology. The application of the nth-CASAM-L and the nth-CASAM-N overcomes the so-called "curse of dimensionality" in sensitivity and uncertainty analysis, thus revolutionizing all of the fields of activities which require accurate computation of response sensitivities. Since this monograph includes many illustrative, fully worked-out, paradigm problems, it can serve as a textbook or as supplementary reading for graduate courses in academic departments in the natural sciences and engineering.

This volume explores the connections between mathematical modeling, computational methods, and high performance computing, and how recent developments in these areas can help to solve complex problems in the natural sciences and engineering. The content of the book is based on talks and papers presented at the conference Modern Mathematical Methods and High Performance Computing in Science & Technology (M3HPCST), held at Inderprastha Engineering College in Ghaziabad, India in January 2020. A wide range of both theoretical and applied topics are covered in detail, including the conceptualization of infinity, efficient domain decomposition, high capacity wireless communication, infectious disease modeling, and more. These chapters are organized around the following areas: Partial and ordinary differential equations Optimization and optimal control High performance and scientific computing Stochastic models and statistics Recent Trends in Mathematical Modeling and High Performance Computing will be of interest to researchers in both mathematics and engineering, as well as to practitioners who face complex models and extensive computations.

This book provides a systematic description about the development of Isogeometric Topology Optimization (ITO) method using the density, and then addresses the effectiveness and efficiency of the ITO method on several design problems, including multi-material structures, stress-minimization structures, piezoelectric structures and also with the uniform manufacturability, ultra-lightweight architected materials with extreme bulk/shear moduli, auxetic metamaterials and auxetic meta-composites with the NPRs behavior in microstructures. A detailed MATLAB implementation of the ITO method with an in-house code "IgaTop" is also presented.

Artificial intelligence (AI) and digital engineering have become prevalent in business, industry, government, and academia. However, the workforce still has a lot to learn on how to leverage them. This handbook presents the preparatory and operational foundations for the efficacy, applicability, risk, and how to take advantage of these tools and techniques. "Handbook of Mathematical and Digital Engineering Foundations for Artificial Intelligence: A Systems Methodology" provides a guide for using digital engineering platforms for advancing AI applications. The book discusses an interface of education and research in the pursuit of AI developments and highlights the facilitation of advanced education through AI and digital engineering systems. It presents an integration of soft and hard skills in developing and using AI and offers a rigorous systems approach to understanding and using AI. This handbook will be the go-to resource for practitioners and students on applying systems methodology to the body of knowledge of understanding, embracing, and using digital engineering tools and techniques.

This book gathers contributions from the fourth edition of the Conference on "Philosophy and Theory of Artificial Intelligence" (PT-AI), held on 27-28th of September 2021 at Chalmers University of Technology, in Gothenburg, Sweden. It covers topics at the interface between philosophy, cognitive science, ethics and computing. It discusses advanced theories fostering the understanding of human cognition, human autonomy, dignity and morality, and the development of corresponding artificial cognitive structures, analyzing important aspects of the relationship between humans and AI systems, including the ethics of AI. This book offers a thought-provoking snapshot of what is currently going on, and what are the main challenges, in the multidisciplinary field of the philosophy of artificial intelligence.

This book discusses significant research and study topics related to mathematical modelling and analysis of infectious diseases. It includes several models and modelling approaches with different aims, such as identifying and analysing causes of occurrence and re-occurrence, causes of spreading, treatments and control strategies. A valuable resource for researchers, students, educators, scientists, professionals and practitioners interested in gaining insights into various aspects of infectious diseases using mathematical modelling and mathematical analysis, the book will also appeal to general readers wanting to understand the dynamics of various diseases and related issues. Key Features Mathematical models that describe population prevalence or incidence of infectious diseases Mathematical tools and techniques to analyse data on the incidence of infectious diseases Early detection and risk estimate models of infectious diseases Mathematical models that describe the transmission of infectious diseases and analyse data Dynamical analysis and control strategies for infectious diseases Studies comparing the utility of particular models in describing infected diseases-related issues such as social, health and economic

This book intends to introduce some recent results on passivity of complex dynamical networks with single weight and multiple weights. The book collects novel research ideas and some definitions in complex dynamical networks, such as passivity, output strict passivity, input strict passivity, finite-time passivity, and multiple weights. Furthermore, the research results previously published in many flagship journals are methodically edited and presented in a unified form. The book is likely to be of interest to university researchers and graduate students in Engineering and Mathematics who wish to study the passivity of complex dynamical networks.

This book introduces advanced mathematical methods and techniques for analysis and simulation of models in mathematical epidemiology. Chronological age and class-age play an important role in the description of infectious diseases and this text provides the tools for the analysis of this type of partial differential equation models. This book presents general theoretical tools as well as large number of specific examples to guide the reader to develop their own tools that they may then apply to study structured models in mathematical epidemiology. The book will be a valuable addition to the arsenal of all researchers interested in developing theory or studying specific models with age structure.

This monograph is a detailed study, and systematic defence, of the Growing Block Theory of time (GBT), first conceived by C.D. Broad. The book offers a coherent, logically perspicuous and ideologically lean formulation of GBT, defends it against the most notorious objections to be found in the extant philosophical literature, and shows how it can be derived from a more general theory, consistent with relativistic spacetime, on the pre-relativistic assumption of an absolute and total temporal order. The authors devise axiomatizations of GBT and its competitors which, against the backdrop of a shared quantified tense logic, significantly improves the prospects of their comparative assessment. Importantly, neither of these axiomatizations involves commitment to properties of presentness, pastness or futurity. The authors proceed to address, and defuse, a number of objections that have been marshaled against GBT, including the so-called epistemic objection according to which the theory invites skepticism about our temporal location. The challenge posed by relativistic physics is met head-on, by replacing claims about temporal variation by claims about variation across spacetime. The book aims to achieve the greatest possible rigor. The background logic is set out in detail, as are the principles governing the notions of precedence and temporal location. The authors likewise devise a novel spacetime logic suited for the articulation, and comparative assessment, of relativistic theories of time. The book comes with three technical appendices which include soundness and completeness proofs for the systems corresponding to GBT and its competitors, in both their pre-relativistic and relativistic forms. The book is primarily directed at researchers and graduate students working on the philosophy of time or temporal logic, but is of interest to metaphysicians and philosophical logicians more generally.

This book provides application of multi criteria decision making techniques for managerial discretion. With this book, a concerted platform has been provided for several peers and other management organizations to understand and implement these tools and deal with the practical problems in a better way so as to provide more robust managerial decision making.

Various problems in climate research, which require the use of advanced statistical techniques, are considered in this book. The examples emphasize the notion that the knowledge of statistical techniques alone is not sufficient. Good physical understanding of the specific problems in climate research is needed to guide the researcher in choosing the right approach to obtain meaningful answers. The second edition of this book, originally based on contributions given during a school sponsored by the European Union on the Italian island of Elba, continues to be based on these general principles. The general outline has been kept the same, covering aspects such as the examination of the observational record, stochastic climate models, analytical techniques, e.g. EOF, teleconnections and so on, but the chapters have been revised and updated, in some cases extensively, to cover the advances in the field in the years since the first edition.

This book provides an overview of the current advances in artificial intelligence and neural nets. Artificial intelligence (AI) methods have shown great capabilities in modelling, prediction and recognition tasks supporting human-machine interaction. At the same time, the issue of emotion has gained increasing attention due to its relevance in achieving human-like interaction with machines. The real challenge is taking advantage of the emotional characterization of humans' interactions to make computers interfacing with them emotionally and socially credible. The book assesses how and to what extent current sophisticated computational intelligence tools might support the multidisciplinary research on the characterization of appropriate system reactions to human emotions and expressions in interactive scenarios. Discussing the latest recent research trends, innovative approaches and future challenges in AI from interdisciplinary perspectives, it is a valuable resource for researchers and practitioners in academia and industry.

From the Foreword by Marshall Fisher, The Wharton School, University of Pennsylvania: As generation of academics and practitioners follows generation, it is worthwhile to compile long views of the research and practice in the past to shed light on research and practice going forward. This collection of peer-reviewed articles is intended to provide such a long view. This book contains a collection of chapters written by leading scholars/practitioners who have continued their efforts in developing and/or implementing innovative OR/MS tools for solving real world problems. In this book, the contributors share their perspectives about the past, present and future of OR/MS theoretical development, solution tools, modeling approaches, and applications. Specifically, this book collects chapters that offer insights about the following topics: * Survey articles taking a long view over the past two or more decades to arrive at the present state of the art while outlining ideas for future research. Surveys focus on use of a particular OR/MS approach, e.g., mathematical programming (LP, MILP, etc.) and solution methods for particular family of application, e.g., distribution system design, distribution planning system, health care. * Autobiographical or biographical accounts of how particular inventions (e.g., Structured Modeling) were made. These could include personal experiences in early development of OR/MS and an overview of what has happened since. * Development of OR/MS mathematical tools (e.g., stochastic programming, optimization theory). * Development of OR/MS in a particular industry sector such as global supply chain management. * Modeling systems for OR/MS and their development over time as well as speculation on future development (e.g., LINDO, LINGO, and What'sBest!) * New applications of OR/MS models (e.g., happiness) The target audience of this book is young researchers, graduate/advanced undergraduate students from OR/MS and related fields like computer science, engineering, and management as well as practitioners who want to understand how OR/MS modeling came about over the past few decades and what research topics or modeling approaches they could pursue in research or application.

This book highlights a comprehensive introduction to the fundamental statistical mechanics underneath the inner workings of neural networks. The book discusses in details important concepts and techniques including the cavity method, the mean-field theory, replica techniques, the Nishimori condition, variational methods, the dynamical mean-field theory, unsupervised learning, associative memory models, perceptron models, the chaos theory of recurrent neural networks, and eigen-spectrums of neural networks, walking new learners through the theories and must-have skillsets to understand and use neural networks. The book focuses on quantitative frameworks of neural network models where the underlying mechanisms can be precisely isolated by physics of mathematical beauty and theoretical predictions. It is a good reference for students, researchers, and practitioners in the area of neural networks.

The second edition of this book brings together a cutting edge international team of contributors to critically review the current knowledge regarding the effectiveness of training interventions designed to improve cognitive functions in different target populations. Since the publication of the first volume, the field of cognitive research has rapidly evolved. There is substantial evidence that cognitive and physical training can improve cognitive performance, but these benefits seem to vary as a function of the type and the intensity of interventions and the way training-induced gains are measured and analyzed. This book will address the new topics in psychological research and aims to resolve some of the currently debated issues. This book offers a comprehensive overview of empirical findings and methodological approaches of cognitive training research in different cognitive domains (memory, executive functions, etc.), types of training (working memory training, video game training, physical training, etc.), age groups (from children to young and older adults), target populations (children with developmental disorders, aging workers, MCI patients etc.), settings (laboratory-based studies, applied studies in clinical and educational settings), and methodological approaches (behavioral studies, neuroscientific studies). Chapters feature theoretical models that describe the mechanisms underlying training-induced cognitive and neural changes. Cognitive Training: An Overview of Features and Applications, Second Edition will be of interest to researchers, practitioners, students, and professors in the fields of psychology and neuroscience.

This book is the second of a set dedicated to the mathematical tools used in partial differential equations derived from physics. It presents the properties of continuous functions, which are useful for solving partial differential equations, and, more particularly, for constructing distributions valued in a Neumann space. The author examines partial derivatives, the construction of primitives, integration and the weighting of value functions in a Neumann space. Many of them are new generalizations of classical properties for values in a Banach space. Simple methods, semi-norms, sequential properties and others are discussed, making these tools accessible to the greatest number of students - doctoral students, postgraduate students - engineers and researchers, without restricting or generalizing the results.

Proceedings of the IIASA Workshop, November 30-December 4, 1987, Laxenburg, Austria