This book is about conformal prediction, an approach to prediction that originated in machine learning in the late 1990s. The main feature of conformal prediction is the principled treatment of the reliability of predictions. The prediction algorithms described - conformal predictors - are provably valid in the sense that they evaluate the reliability of their own predictions in a way that is neither over-pessimistic nor over-optimistic (the latter being especially dangerous). The approach is still flexible enough to incorporate most of the existing powerful methods of machine learning. The book covers both key conformal predictors and the mathematical analysis of their properties. Algorithmic Learning in a Random World contains, in addition to proofs of validity, results about the efficiency of conformal predictors. The only assumption required for validity is that of "randomness" (the prediction algorithm is presented with independent and identically distributed examples); in later chapters, even the assumption of randomness is significantly relaxed. Interesting results about efficiency are established both under randomness and under stronger assumptions. Since publication of the First Edition in 2005 conformal prediction has found numerous applications in medicine and industry, and is becoming a popular machine-learning technique. This Second Edition contains three new chapters. One is about conformal predictive distributions, which are more informative than the set predictions produced by standard conformal predictors. Another is about the efficiency of ways of testing the assumption of randomness based on conformal prediction. The third new chapter harnesses conformal testing procedures for protecting machine-learning algorithms against changes in the distribution of the data. In addition, the existing chapters have been revised, updated, and expanded.

This book intends to report the new results of the efforts on the study of Layered Intelligence of the Machine Brain (LIMB). The book collects novel research ideas in LIMB and summarizes the current machine intelligence level as "five layer intelligence"- environments sensing, active learning, cognitive computing, intelligent decision making and automatized execution. The book is likely to be of interest to university researchers, R&D engineers and graduate students in computer science and electronics who wish to learn the core principles, methods, algorithms, and applications of LIMB.

This book summarizes the state-of-the-art in unsupervised learning. The contributors discuss how with the proliferation of massive amounts of unlabeled data, unsupervised learning algorithms, which can automatically discover interesting and useful patterns in such data, have gained popularity among researchers and practitioners. The authors outline how these algorithms have found numerous applications including pattern recognition, market basket analysis, web mining, social network analysis, information retrieval, recommender systems, market research, intrusion detection, and fraud detection. They present how the difficulty of developing theoretically sound approaches that are amenable to objective evaluation have resulted in the proposal of numerous unsupervised learning algorithms over the past half-century. The intended audience includes researchers and practitioners who are increasingly using unsupervised learning algorithms to analyze their data. Topics of interest include anomaly detection, clustering, feature extraction, and applications of unsupervised learning. Each chapter is contributed by a leading expert in the field.

The book reports on a novel approach for holistically identifying the relevant state drivers of complex, multi-stage manufacturing systems. This approach is able to utilize complex, diverse and high-dimensional data sets, which often occur in manufacturing applications, and to integrate the important process intra- and interrelations. The approach has been evaluated using three scenarios from different manufacturing domains (aviation, chemical and semiconductor). The results, which are reported in detail in this book, confirmed that it is possible to incorporate implicit process intra- and interrelations on both a process and programme level by applying SVM-based feature ranking. In practice, this method can be used to identify the most important process parameters and state characteristics, the so-called state drivers, of a manufacturing system. Given the increasing availability of data and information, this selection support can be directly utilized in, e.g., quality monitoring and advanced process control. Importantly, the method is neither limited to specific products, manufacturing processes or systems, nor by specific quality concepts.

For some time, all branches of the military have used a wide range of sensors to provide data for many purposes, including surveillance, reconnoitring, target detection and battle damage assessment. Many nations have also attempted to utilise these sensors for civilian applications, such as crop monitoring, agricultural disease tracking, environmental diagnostics, cartography, ocean temperature profiling, urban planning, and the characterisation of the Ozone Hole above Antarctica. The recent convergence of several important technologies has made possible new, advanced, high performance, sensor based applications relying on the near-simultaneous fusion of data from an ensemble of different types of sensors. The book examines the underlying principles of sensor operation and data fusion, the techniques and technologies that enable the process, including the operation of 'fusion engines'. Fundamental theory and the enabling technologies of data fusion are presented in a systematic and accessible manner. Applications are discussed in the areas of medicine, meteorology, BDA and targeting, transportation, cartography, the environment, agriculture, and manufacturing and process control.

Visual Question Answering (VQA) usually combines visual inputs like image and video with a natural language question concerning the input and generates a natural language answer as the output. This is by nature a multi-disciplinary research problem, involving computer vision (CV), natural language processing (NLP), knowledge representation and reasoning (KR), etc. Further, VQA is an ambitious undertaking, as it must overcome the challenges of general image understanding and the question-answering task, as well as the difficulties entailed by using large-scale databases with mixed-quality inputs. However, with the advent of deep learning (DL) and driven by the existence of advanced techniques in both CV and NLP and the availability of relevant large-scale datasets, we have recently seen enormous strides in VQA, with more systems and promising results emerging. This book provides a comprehensive overview of VQA, covering fundamental theories, models, datasets, and promising future directions. Given its scope, it can be used as a textbook on computer vision and natural language processing, especially for researchers and students in the area of visual question answering. It also highlights the key models used in VQA.

This open access book covers the use of data science, including advanced machine learning, big data analytics, Semantic Web technologies, natural language processing, social media analysis, time series analysis, among others, for applications in economics and finance. In addition, it shows some successful applications of advanced data science solutions used to extract new knowledge from data in order to improve economic forecasting models. The book starts with an introduction on the use of data science technologies in economics and finance and is followed by thirteen chapters showing success stories of the application of specific data science methodologies, touching on particular topics related to novel big data sources and technologies for economic analysis (e.g. social media and news); big data models leveraging on supervised/unsupervised (deep) machine learning; natural language processing to build economic and financial indicators; and forecasting and nowcasting of economic variables through time series analysis. This book is relevant to all stakeholders involved in digital and data-intensive research in economics and finance, helping them to understand the main opportunities and challenges, become familiar with the latest methodological findings, and learn how to use and evaluate the performances of novel tools and frameworks. It primarily targets data scientists and business analysts exploiting data science technologies, and it will also be a useful resource to research students in disciplines and courses related to these topics. Overall, readers will learn modern and effective data science solutions to create tangible innovations for economic and financial applications.

This book explains the complete loop to effectively use self-tracking data for machine learning. While it focuses on self-tracking data, the techniques explained are also applicable to sensory data in general, making it useful for a wider audience. Discussing concepts drawn from from state-of-the-art scientific literature, it illustrates the approaches using a case study of a rich self-tracking data set. Self-tracking has become part of the modern lifestyle, and the amount of data generated by these devices is so overwhelming that it is difficult to obtain useful insights from it. Luckily, in the domain of artificial intelligence there are techniques that can help out: machine-learning approaches allow this type of data to be analyzed. While there are ample books that explain machine-learning techniques, self-tracking data comes with its own difficulties that require dedicated techniques such as learning over time and across users.

Currently, machine learning is playing a pivotal role in the progress of genomics. The applications of machine learning are helping all to understand the emerging trends and the future scope of genomics. This book provides comprehensive coverage of machine learning applications such as DNN, CNN, and RNN, for predicting the sequence of DNA and RNA binding proteins, expression of the gene, and splicing control. In addition, the book addresses the effect of multiomics data analysis of cancers using tensor decomposition, machine learning techniques for protein engineering, CNN applications on genomics, challenges of long noncoding RNAs in human disease diagnosis, and how machine learning can be used as a tool to shape the future of medicine. More importantly, it gives a comparative analysis and validates the outcomes of machine learning methods on genomic data to the functional laboratory tests or by formal clinical assessment. The topics of this book will cater interest to academicians, practitioners working in the field of functional genomics, and machine learning. Also, this book shall guide comprehensively the graduate, postgraduates, and Ph.D. scholars working in these fields.

This volume presents the current status of software development in the field of computational and theoretical chemistry and gives an overview of the emerging trends. The challenges of maintaining the legacy codes and their adaptation to the rapidly growing hardware capabilities and the new programming environments are surveyed in a series of topical reviews written by the core developers and maintainers of the popular quantum chemistry and molecular dynamics programs. Special emphasis is given to new computational methodologies and practical aspects of their implementation and application in the computational chemistry codes. Modularity of the computational chemistry software is an emerging concept that enables to bypass the development and maintenance bottleneck of the legacy software and to customize the software using the best available computational procedures implemented in the form of self-contained modules. Perspectives on modular design of the computer programs for modeling molecular electronic structure, non-adiabatic dynamics, kinetics, as well as for data visualization are presented by the researchers actively working in the field of software development and application. This volume is of interest to quantum and computational chemists as well as experimental chemists actively using and developing computational software for their research. Chapters "MLatom 2: An Integrative Platform for Atomistic Machine Learning" and "Evolution of the Automatic Rhodopsin Modeling (ARM) Protocol" are available open access under a CC BY 4.0 License via link.springer.com.

This book presents the modern technological advancements and revolutions in the biomedical sector. Progress in the contemporary sensing, Internet of Things (IoT) and machine learning algorithms and architectures have introduced new approaches in the mobile healthcare. A continuous observation of patients with critical health situation is required. It allows monitoring of their health status during daily life activities such as during sports, walking and sleeping. It is realizable by intelligently hybridizing the modern IoT framework, wireless biomedical implants and cloud computing. Such solutions are currently under development and in testing phases by healthcare and governmental institutions, research laboratories and biomedical companies. The biomedical signals such as electrocardiogram (ECG), electroencephalogram (EEG), Electromyography (EMG), phonocardiogram (PCG), Chronic Obstructive Pulmonary (COP), Electrooculography (EoG), photoplethysmography (PPG), and image modalities such as positron emission tomography (PET), magnetic resonance imaging (MRI) and computerized tomography (CT) are non-invasively acquired, measured, and processed via the biomedical sensors and gadgets. These signals and images represent the activities and conditions of human cardiovascular, neural, vision and cerebral systems. Multi-channel sensing of these signals and images with an appropriate granularity is required for an effective monitoring and diagnosis. It renders a big volume of data and its analysis is not feasible manually. Therefore, automated healthcare systems are in the process of evolution. These systems are mainly based on biomedical signal and image acquisition and sensing, preconditioning, features extraction and classification stages. The contemporary biomedical signal sensing, preconditioning, features extraction and intelligent machine and deep learning-based classification algorithms are described. Each chapter starts with the importance, problem statement and motivation. A self-sufficient description is provided. Therefore, each chapter can be read independently. To the best of the editors’ knowledge, this book is a comprehensive compilation on advances in non-invasive biomedical signal sensing and processing with machine and deep learning. We believe that theories, algorithms, realizations, applications, approaches, and challenges, which are presented in this book will have their impact and contribution in the design and development of modern and effective healthcare systems.

The book gives a comprehensive discussion of Database Semantics (DBS) as an agent-based data-driven theory of how natural language communication essentially works. In language communication, agents switch between speak mode, driven by cognition-internal content (input) resulting in cognition-external raw data (e.g. sound waves or pixels, which have no meaning or grammatical properties but can be measured by natural science), and hear mode, driven by the raw data produced by the speaker resulting in cognition-internal content. The motivation is to compare two approaches for an ontology of communication: agent-based data-driven vs. sign-based substitution-driven. Agent-based means: design of a cognitive agent with (i) an interface component for converting raw data into cognitive content (recognition) and converting cognitive content into raw data (action), (ii) an on-board, content-addressable memory (database) for the storage and content retrieval, (iii) separate treatments of the speak and the hear mode. Data-driven means: (a) mapping a cognitive content as input to the speak-mode into a language-dependent surface as output, (b) mapping a surface as input to the hear-mode into a cognitive content as output. Oppositely, sign-based means: no distinction between speak and hear mode, whereas substitution-driven means: using a single start symbol as input for generating infinitely many outputs, based on substitutions by rewrite rules. Collecting recent research of the author, this beautiful, novel and original exposition begins with an introduction to DBS, makes a linguistic detour on subject/predicate gapping and slot-filler repetition, and moves on to discuss computational pragmatics, inference and cognition, grammatical disambiguation and other related topics. The book is mostly addressed to experts working in the field of computational linguistics, as well as to enthusiasts interested in the history and early development of this subject, starting with the pre-computational foundations of theoretical computer science and symbolic logic in the 30s.

Introduction to Machine Learning with Applications in Information Security, Second Edition provides a classroom-tested introduction to a wide variety of machine learning and deep learning algorithms and techniques, reinforced via realistic applications. The book is accessible and doesn't prove theorems, or dwell on mathematical theory. The goal is to present topics at an intuitive level, with just enough detail to clarify the underlying concepts. The book covers core classic machine learning topics in depth, including Hidden Markov Models (HMM), Support Vector Machines (SVM), and clustering. Additional machine learning topics include k-Nearest Neighbor (k-NN), boosting, Random Forests, and Linear Discriminant Analysis (LDA). The fundamental deep learning topics of backpropagation, Convolutional Neural Networks (CNN), Multilayer Perceptrons (MLP), and Recurrent Neural Networks (RNN) are covered in depth. A broad range of advanced deep learning architectures are also presented, including Long Short-Term Memory (LSTM), Generative Adversarial Networks (GAN), Extreme Learning Machines (ELM), Residual Networks (ResNet), Deep Belief Networks (DBN), Bidirectional Encoder Representations from Transformers (BERT), and Word2Vec. Finally, several cutting-edge deep learning topics are discussed, including dropout regularization, attention, explainability, and adversarial attacks. Most of the examples in the book are drawn from the field of information security, with many of the machine learning and deep learning applications focused on malware. The applications presented serve to demystify the topics by illustrating the use of various learning techniques in straightforward scenarios. Some of the exercises in this book require programming, and elementary computing concepts are assumed in a few of the application sections. However, anyone with a modest amount of computing experience should have no trouble with this aspect of the book. Instructor resources, including PowerPoint slides, lecture videos, and other relevant material are provided on an accompanying website: http://www.cs.sjsu.edu/~stamp/ML/.

First Published in 1987. Routledge is an imprint of Taylor & Francis, an informa company.

As genetic algorithms (GAs) become increasingly popular, they are applied to difficult problems that may require considerable computations. In such cases, parallel implementations of GAs become necessary to reach high-quality solutions in reasonable times. But, even though their mechanics are simple, parallel GAs are complex non-linear algorithms that are controlled by many parameters, which are not well understood. Efficient and Accurate Parallel Genetic Algorithms is about the design of parallel GAs. It presents theoretical developments that improve our understanding of the effect of the algorithm's parameters on its search for quality and efficiency. These developments are used to formulate guidelines on how to choose the parameter values that minimize the execution time while consistently reaching solutions of high quality. Efficient and Accurate Parallel Genetic Algorithms can be read in several ways, depending on the readers' interests and their previous knowledge about these algorithms. Newcomers to the field will find the background material in each chapter useful to become acquainted with previous work, and to understand the problems that must be faced to design efficient and reliable algorithms. Potential users of parallel GAs that may have doubts about their practicality or reliability may be more confident after reading this book and understanding the algorithms better. Those who are ready to try a parallel GA on their applications may choose to skim through the background material, and use the results directly without following the derivations in detail. These readers will find that using the results can help them to choose the type of parallel GA that best suits their needs, without having to invest the time to implement and test various options. Once that is settled, even the most experienced users dread the long and frustrating experience of configuring their algorithms by trial and error. The guidelines contained herein will shorten dramatically the time spent tweaking the algorithm, although some experimentation may still be needed for fine-tuning. Efficient and Accurate Parallel Genetic Algorithms is suitable as a secondary text for a graduate level course, and as a reference for researchers and practitioners in industry.

This book describes a novel machine-learning based approach to answer some traditional archaeological problems, relating to archaeological site detection and site locational preferences. Institutional data collected from six Swiss regions (Zurich, Aargau, Grisons, Vaud, Geneva and Fribourg) have been analyzed with an original conceptual framework based on the Random Forest algorithm. It is shown how the algorithm can assist in the modelling process in connection with heterogeneous, incomplete archaeological datasets and related cultural heritage information. Moreover, an in-depth review of past and more recent works of quantitative methods for archaeological predictive modelling is provided. The book guides the readers to set up their own protocol for: i) dealing with uncertain data, ii) predicting archaeological site location, iii) establishing environmental features importance, iv) and suggest a model validation procedure. It addresses both academics and professionals in archaeology and cultural heritage management, and offers a source of inspiration for future research directions in the field of digital humanities and computational archaeology.

This book aims to solve some key problems in the decision and optimization procedure for power market organizers and participants in data-driven approaches. It begins with an overview of the power market data and analyzes on their characteristics and importance for market clearing. Then, the first part of the book discusses the essential problem of bus load forecasting from the perspective of market organizers. The related works include load uncertainty modeling, bus load bad data correction, and monthly load forecasting. The following part of the book answers how much information can be obtained from public data in locational marginal price (LMP)-based markets. It introduces topics such as congestion identification, componential price forecasting, quantifying the impact of forecasting error, and financial transmission right investment. The final part of the book answers how to model the complex market bidding behaviors. Specific works include pattern extraction, aggregated supply curve forecasting, market simulation, and reward function identification in bidding. These methods are especially useful for market organizers to understand the bidding behaviors of market participants and make essential policies. It will benefit and inspire researchers, graduate students, and engineers in the related fields.

This book describes various methods and recent advances in predictive computing and information security. It highlights various predictive application scenarios to discuss these breakthroughs in real-world settings. Further, it addresses state-of-art techniques and the design, development and innovative use of technologies for enhancing predictive computing and information security. Coverage also includes the frameworks for eTransportation and eHealth, security techniques, and algorithms for predictive computing and information security based on Internet-of-Things and Cloud computing. As such, the book offers a valuable resource for graduate students and researchers interested in exploring predictive modeling techniques and architectures to solve information security, privacy and protection issues in future communication.

Representation learning in heterogeneous graphs (HG) is intended to provide a meaningful vector representation for each node so as to facilitate downstream applications such as link prediction, personalized recommendation, node classification, etc. This task, however, is challenging not only because of the need to incorporate heterogeneous structural (graph) information consisting of multiple types of node and edge, but also the need to consider heterogeneous attributes or types of content (e.g. text or image) associated with each node. Although considerable advances have been made in homogeneous (and heterogeneous) graph embedding, attributed graph embedding and graph neural networks, few are capable of simultaneously and effectively taking into account heterogeneous structural (graph) information as well as the heterogeneous content information of each node. In this book, we provide a comprehensive survey of current developments in HG representation learning. More importantly, we present the state-of-the-art in this field, including theoretical models and real applications that have been showcased at the top conferences and journals, such as TKDE, KDD, WWW, IJCAI and AAAI. The book has two major objectives: (1) to provide researchers with an understanding of the fundamental issues and a good point of departure for working in this rapidly expanding field, and (2) to present the latest research on applying heterogeneous graphs to model real systems and learning structural features of interaction systems. To the best of our knowledge, it is the first book to summarize the latest developments and present cutting-edge research on heterogeneous graph representation learning. To gain the most from it, readers should have a basic grasp of computer science, data mining and machine learning.

Written in accessible language without mathematical formulas, this short book provides an overview of the wide and varied applications of artificial intelligence (AI) across the spectrum of physical sciences. Focusing in particular on AI's ability to extract patterns from data, known as machine learning (ML), the book includes a chapter on important machine learning algorithms and their respective applications in physics. It then explores the use of ML across a number of important sub-fields in more detail, ranging from particle, molecular and condensed matter physics, to astrophysics, cosmology and the theory of everything. The book covers such applications as the search for new particles and the detection of gravitational waves from the merging of black holes, and concludes by discussing what the future may hold.

The recent advancement of industrial computerization has significantly helped in resolving the challenges associated with the conventional industrial systems. The industry 4.0 quality standards demand smart and intelligent solutions to revolutionize the industrial applications. Despite, a wide range of available industrial solutions, still the precision, accuracy and speed are a matter of interest to scientists to device novel solutions. In addition, the IoT technologies, though, have gained an inspiration in industrial applications, yet, the time and resource complexity of industrial sensors require intelligent management and monitoring of sensors' data. The integration of machine intelligence and IoT technologies can greatly help in devising cutting edge solutions to very recent issues of industrial applications. Machine intelligence is the most appropriate set of techniques for constructing prediction models due to its capability in handling large-scale and complex datasets. Machine intelligent solution can effectively help the industrial stakeholders in automatic detection of faults, early prediction of errors and risks, tracking industrial shipments through intelligent sensors, health industry risk mitigation employing IoT and machine intelligence, disaster management, and many more. The objectives include: Assessment of limitations of industrial systems, challenges and solutions; Empowerment of industrial systems with machine intelligence to mitigate the risks; Smart safety measures towards industrial systems; and Presentation of recent intelligent systems for a wide range of industrials applications.

With approximately 2500 problems, this book provides a collection of practical problems on the basic and advanced data structures, design, and analysis of algorithms. To make this book suitable for self-instruction, about one-third of the algorithms are supported by solutions, and some others are supported by hints and comments. This book is intended for students wishing to deepen their knowledge of algorithm design in an undergraduate or beginning graduate class on algorithms, for those teaching courses in this area, for use by practicing programmers who wish to hone and expand their skills, and as a self-study text for graduate students who are preparing for the qualifying examination on algorithms for a Ph.D. program in Computer Science or Computer Engineering. About all, it is a good source for exam problems for those who teach algorithms and data structure. The format of each chapter is just a little bit of instruction followed by lots of problems. This book is intended to augment the problem sets found in any standard algorithms textbook. This book * begins with four chapters on background material that most algorithms instructors would like their students to have mastered before setting foot in an algorithms class. The introductory chapters include mathematical induction, complexity notations, recurrence relations, and basic algorithm analysis methods. * provides many problems on basic and advanced data structures including basic data structures (arrays, stack, queue, and linked list), hash, tree, search, and sorting algorithms. * provides many problems on algorithm design techniques: divide and conquer, dynamic programming, greedy algorithms, graph algorithms, and backtracking algorithms. * is rounded out with a chapter on NP-completeness.

This book is intended to assist in the development of smart and efficient green energy solutions. It introduces energy systems, power generation, and power demands which able to minimise generation costs, power loss or environmental effects. It proposes cutting-edge solutions and approaches based on recent technologies such as intelligent renewable energy systems (wind and solar). These solutions, applied to different sectors, can provide a solid basis for meeting the needs of both developed and developing countries. The book provides a collection of contributions including new techniques, methods, algorithms, practical solutions and models based on applying artificial intelligence and the Internet of things into green energy management systems. It provides a comprehensive reference for researchers, scholars and industry in the field of green energy and computational intelligence.

This book provides its readers with an introduction to interesting prediction and science dynamics problems in the field of Science of Science. Prediction focuses on the forecasting of future performance (or impact) of an entity, either a research article or a scientist, and also the prediction of future links in collaboration networks or identifying missing links in citation networks. The single chapters are written in a way that help the reader gain a detailed technical understanding of the corresponding subjects, the strength and weaknesses of the state-of-the-art approaches for each described problem, and the currently open challenges. While chapter 1 provides a useful contribution in the theoretical foundations of the fields of scientometrics and science of science, chapters 2-4 turn the focal point to the study of factors that affect research impact and its dynamics. Chapters 5-7 then focus on article-level measures that quantify the current and future impact of scientific articles. Next, chapters 8-10 investigate subjects relevant to predicting the future impact of individual researchers. Finally, chapters 11-13 focus on science evolution and dynamics, leveraging heterogeneous and interconnected data, where the analysis of research topic trends and their evolution has always played a key role in impact prediction approaches and quantitative analyses in the field of bibliometrics. Each chapter can be read independently, since it includes a detailed description of the problem being investigated along with a thorough discussion and study of the respective state-of-the-art. Due to the cross-disciplinary character of the Science of Science field, the book may be useful to interested readers from a variety of disciplines like information science, information retrieval, network science, informetrics, scientometrics, and machine learning, to name a few. The profiles of the readers may also be diverse ranging from researchers and professors in the respective fields to students and developers being curious about the covered subjects.

Entering the field of artificial intelligence and data science can seem daunting to beginners with little to no prior background, especially those with no programming experience. The concepts used in self-driving cars and virtual assistants like Amazon's Alexa may seem very complex and difficult to grasp. The aim of Artificial Intelligence in Python is to make AI accessible and easy to understand for people with little to no programming experience though practical exercises. Newcomers will gain the necessary knowledge on how to create such systems, which are capable of executing tasks that require some form of human-like intelligence. This book introduces readers to various topics and examples of programming in Python, as well as key concepts in artificial intelligence. Python programming skills will be imparted as we go along. Concepts and code snippets will be covered in a step-by-step manner, to guide and instill confidence in beginners. Complex subjects in deep learning and machine learning will be broken down into easy-to-digest content and examples. Artificial intelligence implementations will also be shared, allowing beginners to generate their own artificial intelligence algorithms for reinforcement learning, style transfer, chatbots, speech, and natural language processing.