This is the first book on synthetic data for deep learning, and its breadth of coverage may render this book as the default reference on synthetic data for years to come. The book can also serve as an introduction to several other important subfields of machine learning that are seldom touched upon in other books. Machine learning as a discipline would not be possible without the inner workings of optimization at hand. The book includes the necessary sinews of optimization though the crux of the discussion centers on the increasingly popular tool for training deep learning models, namely synthetic data. It is expected that the field of synthetic data will undergo exponential growth in the near future. This book serves as a comprehensive survey of the field. In the simplest case, synthetic data refers to computer-generated graphics used to train computer vision models. There are many more facets of synthetic data to consider. In the section on basic computer vision, the book discusses fundamental computer vision problems, both low-level (e.g., optical flow estimation) and high-level (e.g., object detection and semantic segmentation), synthetic environments and datasets for outdoor and urban scenes (autonomous driving), indoor scenes (indoor navigation), aerial navigation, and simulation environments for robotics. Additionally, it touches upon applications of synthetic data outside computer vision (in neural programming, bioinformatics, NLP, and more). It also surveys the work on improving synthetic data development and alternative ways to produce it such as GANs. The book introduces and reviews several different approaches to synthetic data in various domains of machine learning, most notably the following fields: domain adaptation for making synthetic data more realistic and/or adapting the models to be trained on synthetic data and differential privacy for generating synthetic data with privacy guarantees. This discussion is accompanied by an introduction into generative adversarial networks (GAN) and an introduction to differential privacy.

RDF-based knowledge graphs require additional formalisms to be fully context-aware, which is presented in this book. This book also provides a collection of provenance techniques and state-of-the-art metadata-enhanced, provenance-aware, knowledge graph-based representations across multiple application domains, in order to demonstrate how to combine graph-based data models and provenance representations. This is important to make statements authoritative, verifiable, and reproducible, such as in biomedical, pharmaceutical, and cybersecurity applications, where the data source and generator can be just as important as the data itself. Capturing provenance is critical to ensure sound experimental results and rigorously designed research studies for patient and drug safety, pathology reports, and medical evidence generation. Similarly, provenance is needed for cyberthreat intelligence dashboards and attack maps that aggregate and/or fuse heterogeneous data from disparate data sources to differentiate between unimportant online events and dangerous cyberattacks, which is demonstrated in this book. Without provenance, data reliability and trustworthiness might be limited, causing data reuse, trust, reproducibility and accountability issues. This book primarily targets researchers who utilize knowledge graphs in their methods and approaches (this includes researchers from a variety of domains, such as cybersecurity, eHealth, data science, Semantic Web, etc.). This book collects core facts for the state of the art in provenance approaches and techniques, complemented by a critical review of existing approaches. New research directions are also provided that combine data science and knowledge graphs, for an increasingly important research topic.

The recent advancement of industrial computerization has significantly helped in resolving the challenges associated with the conventional industrial systems. The industry 4.0 quality standards demand smart and intelligent solutions to revolutionize the industrial applications. Despite, a wide range of available industrial solutions, still the precision, accuracy and speed are a matter of interest to scientists to device novel solutions. In addition, the IoT technologies, though, have gained an inspiration in industrial applications, yet, the time and resource complexity of industrial sensors require intelligent management and monitoring of sensors' data. The integration of machine intelligence and IoT technologies can greatly help in devising cutting edge solutions to very recent issues of industrial applications. Machine intelligence is the most appropriate set of techniques for constructing prediction models due to its capability in handling large-scale and complex datasets. Machine intelligent solution can effectively help the industrial stakeholders in automatic detection of faults, early prediction of errors and risks, tracking industrial shipments through intelligent sensors, health industry risk mitigation employing IoT and machine intelligence, disaster management, and many more. The objectives include: Assessment of limitations of industrial systems, challenges and solutions; Empowerment of industrial systems with machine intelligence to mitigate the risks; Smart safety measures towards industrial systems; and Presentation of recent intelligent systems for a wide range of industrials applications.

This book analyzes the multimodal verbal and nonverbal behavior of humans in both an artificial game, based on the well-known Mafia and Resistance games, as well as selected other settings. This book develops statistical results linking different types of facial expressions (e.g. smile, pursed lips, raised eyebrows), vocal features (e.g., pitch, loudness) and linguistic features (e.g., dominant language, turn length) with both unary behaviors (e.g. is person X lying?) to binary behaviors (Is person X dominant compared to person Y? Does X trust Y? Does X like Y?). In addition, this book describes machine learning and computer vision-based algorithms that can be used to predict deception, as well as the visual focus of attention of people during discussions that can be linked to many binary behaviors. It is written by a multidisciplinary team of both social scientists and computer scientists. Meetings are at the very heart of human activity. Whether you are involved in a business meeting or in a diplomatic negotiation, such an event has multiple actors, some cooperative and some adversarial. Some actors may be deceptive, others may have complex relationships with others in the group. This book consists of a set of 11 chapters that describe the factors that link human behavior in group settings and attitudes to facial and voice characteristics. Researchers working in social sciences (communication, psychology, cognitive science) with an interest in studying the link between human interpersonal behavior and facial/speech/linguistic characteristics will be interested in this book. Computer scientists, who are interested in developing machine learning and deep learning based models of human behavior in group settings will also be interested in purchasing this book.

In 1964, a mechanism explaining the origin of particle masses was proposed by Robert Brout, Francois Englert, and Peter W. Higgs. 48 years later, in 2012, the so-called Higgs boson was discovered in proton-proton collisions recorded by experiments at the LHC. Since then, its ability to interact with quarks remained experimentally unconfirmed. This book presents a search for Higgs bosons produced in association with top quarks tt H in data recorded with the CMS detector in 2016. It focuses on Higgs boson decays into bottom quarks H bb and top quark pair decays involving at least one lepton. In this analysis, a multiclass classification approach using deep learning techniques was applied for the first time. In light of the dominant background contribution from tt production, the developed method proved to achieve superior sensitivity with respect to existing techniques. In combination with searches in different decay channels, the presented work contributed to the first observations of tt H production and H bb decays.

This book bridges theoretical computer science and machine learning by exploring what the two sides can teach each other. It emphasizes the need for flexible, tractable models that better capture not what makes machine learning hard, but what makes it easy. Theoretical computer scientists will be introduced to important models in machine learning and to the main questions within the field. Machine learning researchers will be introduced to cutting-edge research in an accessible format, and gain familiarity with a modern, algorithmic toolkit, including the method of moments, tensor decompositions and convex programming relaxations. The treatment beyond worst-case analysis is to build a rigorous understanding about the approaches used in practice and to facilitate the discovery of exciting, new ways to solve important long-standing problems.

This book introduces a variety of advanced machine learning approaches covering the areas of neural networks, fuzzy logic, and hybrid intelligent systems for the determination and diagnosis of cancer. Moreover, the tactical solutions of machine learning have proved its vast range of significance and, provided novel solutions in the medical field for the diagnosis of disease. This book also explores the distinct deep learning approaches that are capable of yielding more accurate outcomes for the diagnosis of cancer. In addition to providing an overview of the emerging machine and deep learning approaches, it also enlightens an insight on how to evaluate the efficiency and appropriateness of such techniques and analysis of cancer data used in the cancer diagnosis. Therefore, this book focuses on the recent advancements in the machine learning and deep learning approaches used in the diagnosis of different types of cancer along with their research challenges and future directions for the targeted audience including scientists, experts, Ph.D. students, postdocs, and anyone interested in the subjects discussed.

This book contains select chapters on support vector algorithms from different perspectives, including mathematical background, properties of various kernel functions, and several applications. The main focus of this book is on orthogonal kernel functions, and the properties of the classical kernel functions-Chebyshev, Legendre, Gegenbauer, and Jacobi-are reviewed in some chapters. Moreover, the fractional form of these kernel functions is introduced in the same chapters, and for ease of use for these kernel functions, a tutorial on a Python package named ORSVM is presented. The book also exhibits a variety of applications for support vector algorithms, and in addition to the classification, these algorithms along with the introduced kernel functions are utilized for solving ordinary, partial, integro, and fractional differential equations. On the other hand, nowadays, the real-time and big data applications of support vector algorithms are growing. Consequently, the Compute Unified Device Architecture (CUDA) parallelizing the procedure of support vector algorithms based on orthogonal kernel functions is presented. The book sheds light on how to use support vector algorithms based on orthogonal kernel functions in different situations and gives a significant perspective to all machine learning and scientific machine learning researchers all around the world to utilize fractional orthogonal kernel functions in their pattern recognition or scientific computing problems.

This book assists readers with understanding the key aspects, problems and solutions related to the design of proper Multiple Access Schemes for MTC (Machine-Type Communications) and IoT applications in 5G-and-beyond wireless networks. An overview of MTC applications and their traffic features are also provided. In addition, it presents a comprehensive review of MTC access schemes including orthogonal multiple access schemes (OMA), non-orthogonal multiple access schemes (NOMA), massive MIMO-based schemes and fast uplink grant approaches. It also proposes efficient and reconfigurable access schemes deploying machine learning and optimization techniques to address the main requirements of MTC networks. This book discusses potential research directions to further enhance the performance of MTC access schemes. Machine-type communications are expected to account for the dominant share of the traffic in future wireless networks. While in traditional wireless networks, designed for human-type communications, the focus is on support of large packet sizes in downlink, machine-type communication systems deal with heavy uplink traffic. This is due to the nature of the tasks performed by machine-type communication devices, which is mainly reporting measured data or a detected event. Furthermore, in these networks, using the virtualization framework, the network infrastructure can be shared between different applications for which providing isolation is of high importance. To support these unique characteristics of machine-type communications, proper access schemes need to be developed, which is the focus of this book. This book benefits advanced-level students studying computer science and electrical engineering as a secondary textbook and researchers working in this field. Engineers and practitioners interested in the challenges and practical solutions of integrating MTC in the cloud radio access network of 5G-and-beyond cellular systems will want to purchase this book as well.

This book provides readers the "big picture" and a comprehensive survey of the domain of big data processing systems. For the past decade, the Hadoop framework has dominated the world of big data processing, yet recently academia and industry have started to recognize its limitations in several application domains and thus, it is now gradually being replaced by a collection of engines that are dedicated to specific verticals (e.g. structured data, graph data, and streaming data). The book explores this new wave of systems, which it refers to as Big Data 2.0 processing systems. After Chapter 1 presents the general background of the big data phenomena, Chapter 2 provides an overview of various general-purpose big data processing systems that allow their users to develop various big data processing jobs for different application domains. In turn, Chapter 3 examines various systems that have been introduced to support the SQL flavor on top of the Hadoop infrastructure and provide competing and scalable performance in the processing of large-scale structured data. Chapter 4 discusses several systems that have been designed to tackle the problem of large-scale graph processing, while the main focus of Chapter 5 is on several systems that have been designed to provide scalable solutions for processing big data streams, and on other sets of systems that have been introduced to support the development of data pipelines between various types of big data processing jobs and systems. Next, Chapter 6 focuses on covering the emerging frameworks and systems in the domain of scalable machine learning and deep learning processing. Lastly, Chapter 7 shares conclusions and an outlook on future research challenges. This new and considerably enlarged second edition not only contains the completely new chapter 6, but also offers a refreshed content for the state-of-the-art in all domains of big data processing over the last years. Overall, the book offers a valuable reference guide for professional, students, and researchers in the domain of big data processing systems. Further, its comprehensive content will hopefully encourage readers to pursue further research on the subject.

This book is focused on the use of deep learning (DL) and artificial intelligence (AI) as tools to advance the fields of malware detection and analysis. The individual chapters of the book deal with a wide variety of state-of-the-art AI and DL techniques, which are applied to a number of challenging malware-related problems. DL and AI based approaches to malware detection and analysis are largely data driven and hence minimal expert domain knowledge of malware is needed. This book fills a gap between the emerging fields of DL/AI and malware analysis. It covers a broad range of modern and practical DL and AI techniques, including frameworks and development tools enabling the audience to innovate with cutting-edge research advancements in a multitude of malware (and closely related) use cases.

This book provides its readers with an introduction to interesting prediction and science dynamics problems in the field of Science of Science. Prediction focuses on the forecasting of future performance (or impact) of an entity, either a research article or a scientist, and also the prediction of future links in collaboration networks or identifying missing links in citation networks. The single chapters are written in a way that help the reader gain a detailed technical understanding of the corresponding subjects, the strength and weaknesses of the state-of-the-art approaches for each described problem, and the currently open challenges. While chapter 1 provides a useful contribution in the theoretical foundations of the fields of scientometrics and science of science, chapters 2-4 turn the focal point to the study of factors that affect research impact and its dynamics. Chapters 5-7 then focus on article-level measures that quantify the current and future impact of scientific articles. Next, chapters 8-10 investigate subjects relevant to predicting the future impact of individual researchers. Finally, chapters 11-13 focus on science evolution and dynamics, leveraging heterogeneous and interconnected data, where the analysis of research topic trends and their evolution has always played a key role in impact prediction approaches and quantitative analyses in the field of bibliometrics. Each chapter can be read independently, since it includes a detailed description of the problem being investigated along with a thorough discussion and study of the respective state-of-the-art. Due to the cross-disciplinary character of the Science of Science field, the book may be useful to interested readers from a variety of disciplines like information science, information retrieval, network science, informetrics, scientometrics, and machine learning, to name a few. The profiles of the readers may also be diverse ranging from researchers and professors in the respective fields to students and developers being curious about the covered subjects.

This book covers the essential concepts and strategies within traditional and cutting-edge feature learning methods thru both theoretical analysis and case studies. Good features give good models and it is usually not classifiers but features that determine the effectiveness of a model. In this book, readers can find not only traditional feature learning methods, such as principal component analysis, linear discriminant analysis, and geometrical-structure-based methods, but also advanced feature learning methods, such as sparse learning, low-rank decomposition, tensor-based feature extraction, and deep-learning-based feature learning. Each feature learning method has its own dedicated chapter that explains how it is theoretically derived and shows how it is implemented for real-world applications. Detailed illustrated figures are included for better understanding. This book can be used by students, researchers, and engineers looking for a reference guide for popular methods of feature learning and machine intelligence.

This book presents the state-of-the-art applications of machine learning in the finance domain with a focus on financial product modeling, which aims to advance the model performance and minimize risk and uncertainty. It provides both practical and managerial implications of financial and managerial decision support systems which capture a broad range of financial data traits. It also serves as a guide for the implementation of risk-adjusted financial product pricing systems, while adding a significant supplement to the financial literacy of the investigated study. The book covers advanced machine learning techniques, such as Support Vector Machine, Neural Networks, Random Forest, K-Nearest Neighbors, Extreme Learning Machine, Deep Learning Approaches, and their application to finance datasets. It also leverages real-world financial instances to practice business product modeling and data analysis. Software code, such as MATLAB, Python and/or R including datasets within a broad range of financial domain are included for more rigorous practice. The book primarily aims at providing graduate students and researchers with a roadmap for financial data analysis. It is also intended for a broad audience, including academics, professional financial analysts, and policy-makers who are involved in forecasting, modeling, trading, risk management, economics, credit risk, and portfolio management.

This book is a compendium of the proceedings of the International Conference on Big-Data and Cloud Computing. The papers discuss the recent advances in the areas of big data analytics, data analytics in cloud, smart cities and grid, etc. This volume primarily focuses on the application of knowledge which promotes ideas for solving problems of the society through cutting-edge big-data technologies. The essays featured in this proceeding provide novel ideas that contribute for the growth of world class research and development. It will be useful to researchers in the area of advanced engineering sciences.

This book discusses one of the major applications of artificial intelligence: the use of machine learning to extract useful information from multimodal data. It discusses the optimization methods that help minimize the error in developing patterns and classifications, which further helps improve prediction and decision-making. The book also presents formulations of real-world machine learning problems, and discusses AI solution methodologies as standalone or hybrid approaches. Lastly, it proposes novel metaheuristic methods to solve complex machine learning problems. Featuring valuable insights, the book helps readers explore new avenues leading toward multidisciplinary research discussions.

Machine Learning Guide for Oil and Gas Using Python: A Step-by-Step Breakdown with Data, Algorithms, Codes, and Applications delivers a critical training and resource tool to help engineers understand machine learning theory and practice, specifically referencing use cases in oil and gas. The reference moves from explaining how Python works to step-by-step examples of utilization in various oil and gas scenarios, such as well testing, shale reservoirs and production optimization. Petroleum engineers are quickly applying machine learning techniques to their data challenges, but there is a lack of references beyond the math or heavy theory of machine learning. Machine Learning Guide for Oil and Gas Using Python details the open-source tool Python by explaining how it works at an introductory level then bridging into how to apply the algorithms into different oil and gas scenarios. While similar resources are often too mathematical, this book balances theory with applications, including use cases that help solve different oil and gas data challenges.

This book presents an exciting new synthesis of directed and undirected, discrete and continuous graphical models. Combining elements of Bayesian networks and Markov random fields, the newly introduced hybrid random fields are an interesting approach to get the best of both these worlds, with an added promise of modularity and scalability. The authors have written an enjoyable book---rigorous in the treatment of the mathematical background, but also enlivened by interesting and original historical and philosophical perspectives. -- Manfred Jaeger, Aalborg Universitet The book not only marks an effective direction of investigation with significant experimental advances, but it is also---and perhaps primarily---a guide for the reader through an original trip in the space of probabilistic modeling. While digesting the book, one is enriched with a very open view of the field, with full of stimulating connections. ...] Everyone specifically interested in Bayesian networks and Markov random fields should not miss it. -- Marco Gori, Universita degli Studi di Siena Graphical models are sometimes regarded---incorrectly---as an impractical approach to machine learning, assuming that they only work well for low-dimensional applications and discrete-valued domains. While guiding the reader through the major achievements of this research area in a technically detailed yet accessible way, the book is concerned with the presentation and thorough (mathematical and experimental) investigation of a novel paradigm for probabilistic graphical modeling, the hybrid random field. This model subsumes and extends both Bayesian networks and Markov random fields. Moreover, it comes with well-defined learning algorithms, both for discrete and continuous-valued domains, which fit the needs of real-world applications involving large-scale, high-dimensional data.

Machine learning is an interdisciplinary field of science and engineering that studies mathematical theories and practical applications of systems that learn. This book introduces theories, methods and applications of density ratio estimation, which is a newly emerging paradigm in the machine learning community. Various machine learning problems such as non-stationarity adaptation, outlier detection, dimensionality reduction, independent component analysis, clustering, classification and conditional density estimation can be systematically solved via the estimation of probability density ratios. The authors offer a comprehensive introduction of various density ratio estimators including methods via density estimation, moment matching, probabilistic classification, density fitting and density ratio fitting, as well as describing how these can be applied to machine learning. The book provides mathematical theories for density ratio estimation including parametric and non-parametric convergence analysis and numerical stability analysis to complete the first and definitive treatment of the entire framework of density ratio estimation in machine learning.

The book discusses machine learning-based decision-making models, and presents intelligent, hybrid and adaptive methods and tools for solving complex learning and decision-making problems under conditions of uncertainty. Featuring contributions from data scientists, practitioners and educators, the book covers a range of topics relating to intelligent systems for decision science, and examines recent innovations, trends, and practical challenges in the field. The book is a valuable resource for academics, students, researchers and professionals wanting to gain insights into decision-making.

This book is a compilation of peer-reviewed papers presented at the International Conference on Machine Intelligence and Data Science Applications, organized by the School of Computer Science, University of Petroleum & Energy Studies, Dehradun, India, during 4-5 September 2020. The book addresses the algorithmic aspect of machine intelligence which includes the framework and optimization of various states of algorithms. Variety of papers related to wide applications in various fields like data-driven industrial IoT, bioinformatics, network and security, autonomous computing and various other aligned areas. The book concludes with interdisciplinary applications like legal, health care, smart society, cyber-physical system and smart agriculture. All papers have been carefully reviewed. The book is of interest to computer science engineers, lecturers/researchers in machine intelligence discipline and engineering graduates.

This book discusses the interplay between statistics, data science, machine learning and artificial intelligence, with a focus on environmental science, the natural sciences, and technology. It covers the state of the art from both a theoretical and a practical viewpoint and describes how to successfully apply machine learning methods, demonstrating the benefits of statistics for modeling and analyzing high-dimensional and big data. The book's expert contributions include theoretical studies of machine learning methods, expositions of general methodologies for sound statistical analyses of data as well as novel approaches to modeling and analyzing data for specific problems and areas. In terms of applications, the contributions deal with data as arising in industrial quality control, autonomous driving, transportation and traffic, chip manufacturing, photovoltaics, football, transmission of infectious diseases, Covid-19 and public health. The book will appeal to statisticians and data scientists, as well as engineers and computer scientists working in related fields or applications.

arise automatically as a result of the recursive structure of the task and the continuous nature of the SRN's state space. Elman also introduces a new graphical technique for study ing network behavior based on principal components analysis. He shows that sentences with multiple levels of embedding produce state space trajectories with an intriguing self similar structure. The development and shape of a recurrent network's state space is the subject of Pollack's paper, the most provocative in this collection. Pollack looks more closely at a connectionist network as a continuous dynamical system. He describes a new type of machine learning phenomenon: induction by phase transition. He then shows that under certain conditions, the state space created by these machines can have a fractal or chaotic structure, with a potentially infinite number of states. This is graphically illustrated using a higher-order recurrent network trained to recognize various regular languages over binary strings. Finally, Pollack suggests that it might be possible to exploit the fractal dynamics of these systems to achieve a generative capacity beyond that of finite-state machines."

This book describes a novel machine-learning based approach to answer some traditional archaeological problems, relating to archaeological site detection and site locational preferences. Institutional data collected from six Swiss regions (Zurich, Aargau, Grisons, Vaud, Geneva and Fribourg) have been analyzed with an original conceptual framework based on the Random Forest algorithm. It is shown how the algorithm can assist in the modelling process in connection with heterogeneous, incomplete archaeological datasets and related cultural heritage information. Moreover, an in-depth review of past and more recent works of quantitative methods for archaeological predictive modelling is provided. The book guides the readers to set up their own protocol for: i) dealing with uncertain data, ii) predicting archaeological site location, iii) establishing environmental features importance, iv) and suggest a model validation procedure. It addresses both academics and professionals in archaeology and cultural heritage management, and offers a source of inspiration for future research directions in the field of digital humanities and computational archaeology.

This book provides an introduction to the field of periodic pattern mining, reviews state-of-the-art techniques, discusses recent advances, and reviews open-source software. Periodic pattern mining is a popular and emerging research area in the field of data mining. It involves discovering all regularly occurring patterns in temporal databases. One of the major applications of periodic pattern mining is the analysis of customer transaction databases to discover sets of items that have been regularly purchased by customers. Discovering such patterns has several implications for understanding the behavior of customers. Since the first work on periodic pattern mining, numerous studies have been published and great advances have been made in this field. The book consists of three main parts: introduction, algorithms, and applications. The first chapter is an introduction to pattern mining and periodic pattern mining. The concepts of periodicity, periodic support, search space exploration techniques, and pruning strategies are discussed. The main types of algorithms are also presented such as periodic-frequent pattern growth, partial periodic pattern-growth, and periodic high-utility itemset mining algorithm. Challenges and research opportunities are reviewed. The chapters that follow present state-of-the-art techniques for discovering periodic patterns in (1) transactional databases, (2) temporal databases, (3) quantitative temporal databases, and (4) big data. Then, the theory on concise representations of periodic patterns is presented, as well as hiding sensitive information using privacy-preserving data mining techniques. The book concludes with several applications of periodic pattern mining, including applications in air pollution data analytics, accident data analytics, and traffic congestion analytics.