Cartesian Genetic Programming (CGP) is a highly effective and increasingly popular form of genetic programming. It represents programs in the form of directed graphs, and a particular characteristic is that it has a highly redundant genotype-phenotype mapping, in that genes can be noncoding. It has spawned a number of new forms, each improving on the efficiency, among them modular, or embedded, CGP, and self-modifying CGP. It has been applied to many problems in both computer science and applied sciences. This book contains chapters written by the leading figures in the development and application of CGP, and it will be essential reading for researchers in genetic programming and for engineers and scientists solving applications using these techniques. It will also be useful for advanced undergraduates and postgraduates seeking to understand and utilize a highly efficient form of genetic programming.

This book presents applications of machine learning techniques in processing multimedia large-scale data. Multimedia such as text, image, audio, video, and graphics stands as one of the most demanding and exciting aspects of the information era. The book discusses new challenges faced by researchers in dealing with these large-scale data and also presents innovative solutions to address several potential research problems, e.g., enabling comprehensive visual classification to fill the semantic gap by exploring large-scale data, offering a promising frontier for detailed multimedia understanding, as well as extract patterns and making effective decisions by analyzing the large collection of data.

This book covers a large set of methods in the field of Artificial Intelligence - Deep Learning applied to real-world problems. The fundamentals of the Deep Learning approach and different types of Deep Neural Networks (DNNs) are first summarized in this book, which offers a comprehensive preamble for further problem-oriented chapters. The most interesting and open problems of machine learning in the framework of Deep Learning are discussed in this book and solutions are proposed. This book illustrates how to implement the zero-shot learning with Deep Neural Network Classifiers, which require a large amount of training data. The lack of annotated training data naturally pushes the researchers to implement low supervision algorithms. Metric learning is a long-term research but in the framework of Deep Learning approaches, it gets freshness and originality. Fine-grained classification with a low inter-class variability is a difficult problem for any classification tasks. This book presents how it is solved, by using different modalities and attention mechanisms in 3D convolutional networks. Researchers focused on Machine Learning, Deep learning, Multimedia and Computer Vision will want to buy this book. Advanced level students studying computer science within these topic areas will also find this book useful.

This book is written for software product teams that use AI to add intelligent models to their products or are planning to use it. As AI adoption grows, it is becoming important that all AI driven products can demonstrate they are not introducing any bias to the AI-based decisions they are making, as well as reducing any pre-existing bias or discrimination. The responsibility to ensure that the AI models are ethical and make responsible decisions does not lie with the data scientists alone. The product owners and the business analysts are as important in ensuring bias-free AI as the data scientists on the team. This book addresses the part that these roles play in building a fair, explainable and accountable model, along with ensuring model and data privacy. Each chapter covers the fundamentals for the topic and then goes deep into the subject matter - providing the details that enable the business analysts and the data scientists to implement these fundamentals. AI research is one of the most active and growing areas of computer science and statistics. This book includes an overview of the many techniques that draw from the research or are created by combining different research outputs. Some of the techniques from relevant and popular libraries are covered, but deliberately not drawn very heavily from as they are already well documented, and new research is likely to replace some of it.

Application of Machine Learning in Smart Agriculture is the first book to present a multidisciplinary look at how technology can not only improve agricultural output, but the economic efficiency of that output as well. Through a global lens, the book approaches the subject from a technical perspective, providing important knowledge and insights for effective and efficient implementation and utilization of machine learning. As artificial intelligence techniques are being used to increase yield through optimal planting, fertilizing, irrigation, and harvesting, these are only part of the complex picture which must also take into account the economic investment and its optimized return. The performance of machine learning models improves over time as the various mathematical and statistical models are proven. Presented in three parts, Application of Machine Learning in Smart Agriculture looks at the fundamentals of smart agriculture; the economics of the technology in the agricultural marketplace; and a diverse representation of the tools and techniques currently available, and in development. This book is an important resource for advanced level students and professionals working with artificial intelligence, internet of things, technology and agricultural economics.

This handbook presents state-of-the-art research in reinforcement learning, focusing on its applications in the control and game theory of dynamic systems and future directions for related research and technology. The contributions gathered in this book deal with challenges faced when using learning and adaptation methods to solve academic and industrial problems, such as optimization in dynamic environments with single and multiple agents, convergence and performance analysis, and online implementation. They explore means by which these difficulties can be solved, and cover a wide range of related topics including: deep learning; artificial intelligence; applications of game theory; mixed modality learning; and multi-agent reinforcement learning. Practicing engineers and scholars in the field of machine learning, game theory, and autonomous control will find the Handbook of Reinforcement Learning and Control to be thought-provoking, instructive and informative.

This book offers a practical introduction to the use of artificial intelligence (AI) techniques to improve and optimise the various phases of the software development process, from the initial project planning to the latest deployment. All chapters were written by leading experts in the field and include practical and reproducible examples. Following the introductory chapter, Chapters 2-9 respectively apply AI techniques to the classic phases of the software development process: project management, requirement engineering, analysis and design, coding, cloud deployment, unit and system testing, and maintenance. Subsequently, Chapters 10 and 11 provide foundational tutorials on the AI techniques used in the preceding chapters: metaheuristics and machine learning. Given its scope and focus, the book represents a valuable resource for researchers, practitioners and students with a basic grasp of software engineering.

This book is the first comprehensive book about reservoir computing (RC). RC is a powerful and broadly applicable computational framework based on recurrent neural networks. Its advantages lie in small training data set requirements, fast training, inherent memory and high flexibility for various hardware implementations. It originated from computational neuroscience and machine learning but has, in recent years, spread dramatically, and has been introduced into a wide variety of fields, including complex systems science, physics, material science, biological science, quantum machine learning, optical communication systems, and robotics. Reviewing the current state of the art and providing a concise guide to the field, this book introduces readers to its basic concepts, theory, techniques, physical implementations and applications. The book is sub-structured into two major parts: theory and physical implementations. Both parts consist of a compilation of chapters, authored by leading experts in their respective fields. The first part is devoted to theoretical developments of RC, extending the framework from the conventional recurrent neural network context to a more general dynamical systems context. With this broadened perspective, RC is not restricted to the area of machine learning but is being connected to a much wider class of systems. The second part of the book focuses on the utilization of physical dynamical systems as reservoirs, a framework referred to as physical reservoir computing. A variety of physical systems and substrates have already been suggested and used for the implementation of reservoir computing. Among these physical systems which cover a wide range of spatial and temporal scales, are mechanical and optical systems, nanomaterials, spintronics, and quantum many body systems. This book offers a valuable resource for researchers (Ph.D. students and experts alike) and practitioners working in the field of machine learning, artificial intelligence, robotics, neuromorphic computing, complex systems, and physics.

This book aims to solve some key problems in the decision and optimization procedure for power market organizers and participants in data-driven approaches. It begins with an overview of the power market data and analyzes on their characteristics and importance for market clearing. Then, the first part of the book discusses the essential problem of bus load forecasting from the perspective of market organizers. The related works include load uncertainty modeling, bus load bad data correction, and monthly load forecasting. The following part of the book answers how much information can be obtained from public data in locational marginal price (LMP)-based markets. It introduces topics such as congestion identification, componential price forecasting, quantifying the impact of forecasting error, and financial transmission right investment. The final part of the book answers how to model the complex market bidding behaviors. Specific works include pattern extraction, aggregated supply curve forecasting, market simulation, and reward function identification in bidding. These methods are especially useful for market organizers to understand the bidding behaviors of market participants and make essential policies. It will benefit and inspire researchers, graduate students, and engineers in the related fields.

Artificial Intelligence, Machine Learning, and Mental Health in Pandemics: A Computational Approach provides a comprehensive guide for public health authorities, researchers and health professionals in psychological health. The book takes a unique approach by exploring how Artificial Intelligence (AI) and Machine Learning (ML) based solutions can assist with monitoring, detection and intervention for mental health at an early stage. Chapters include computational approaches, computational models, machine learning based anxiety and depression detection and artificial intelligence detection of mental health. With the increase in number of natural disasters and the ongoing pandemic, people are experiencing uncertainty, leading to fear, anxiety and depression, hence this is a timely resource on the latest updates in the field.

Tactile Sensing, Skill Learning and Robotic Dexterous Manipulation focuses on cross-disciplinary lines of research and groundbreaking research ideas in three research lines: tactile sensing, skill learning and dexterous control. The book introduces recent work about human dexterous skill representation and learning, along with discussions of tactile sensing and its applications on unknown objects' property recognition and reconstruction. Sections also introduce the adaptive control schema and its learning by imitation and exploration. Other chapters describe the fundamental part of relevant research, paying attention to the connection among different fields and showing the state-of-the-art in related branches. The book summarizes the different approaches and discusses the pros and cons of each. Chapters not only describe the research but also include basic knowledge that can help readers understand the proposed work, making it an excellent resource for researchers and professionals who work in the robotics industry, haptics and in machine learning.

Visual Question Answering (VQA) usually combines visual inputs like image and video with a natural language question concerning the input and generates a natural language answer as the output. This is by nature a multi-disciplinary research problem, involving computer vision (CV), natural language processing (NLP), knowledge representation and reasoning (KR), etc. Further, VQA is an ambitious undertaking, as it must overcome the challenges of general image understanding and the question-answering task, as well as the difficulties entailed by using large-scale databases with mixed-quality inputs. However, with the advent of deep learning (DL) and driven by the existence of advanced techniques in both CV and NLP and the availability of relevant large-scale datasets, we have recently seen enormous strides in VQA, with more systems and promising results emerging. This book provides a comprehensive overview of VQA, covering fundamental theories, models, datasets, and promising future directions. Given its scope, it can be used as a textbook on computer vision and natural language processing, especially for researchers and students in the area of visual question answering. It also highlights the key models used in VQA.

This book presents a summary of artificial intelligence and machine learning techniques in its first two chapters. The remaining chapters of the book provide everything one must know about the basic artificial intelligence to modern machine intelligence techniques including the hybrid computational intelligence technique, using the concepts of several real-life solved examples, design of projects and research ideas. The solved examples with more than 200 illustrations presented in the book are a great help to instructors, students, non-AI professionals, and researchers. Each example is discussed in detail with encoding, normalization, architecture, detailed design, process flow, and sample input/output. Summary of the fundamental concepts with solved examples is a unique combination and highlight of this book.

Deep Learning for Robot Perception and Cognition introduces a broad range of topics and methods in deep learning for robot perception and cognition together with end-to-end methodologies. The book provides the conceptual and mathematical background needed for approaching a large number of robot perception and cognition tasks from an end-to-end learning point-of-view. The book is suitable for students, university and industry researchers and practitioners in Robotic Vision, Intelligent Control, Mechatronics, Deep Learning, Robotic Perception and Cognition tasks.

Lifelong learning addresses situations in which a learner faces a series of different learning tasks providing the opportunity for synergy among them. Explanation-based neural network learning (EBNN) is a machine learning algorithm that transfers knowledge across multiple learning tasks. When faced with a new learning task, EBNN exploits domain knowledge accumulated in previous learning tasks to guide generalization in the new one. As a result, EBNN generalizes more accurately from less data than comparable methods. Explanation-Based Neural Network Learning: A Lifelong Learning Approach describes the basic EBNN paradigm and investigates it in the context of supervised learning, reinforcement learning, robotics, and chess. The paradigm of lifelong learning - using earlier learned knowledge to improve subsequent learning - is a promising direction for a new generation of machine learning algorithms. Given the need for more accurate learning methods, it is difficult to imagine a future for machine learning that does not include this paradigm.' From the Foreword by Tom M. Mitchell.

Computational Architectures Integrating Neural and Symbolic Processes: A Perspective on the State of the Art focuses on a currently emerging body of research. With the reemergence of neural networks in the 1980s with their emphasis on overcoming some of the limitations of symbolic AI, there is clearly a need to support some form of high-level symbolic processing in connectionist networks. As argued by many researchers, on both the symbolic AI and connectionist sides, many cognitive tasks, e.g. language understanding and common sense reasoning, seem to require high-level symbolic capabilities. How these capabilities are realized in connectionist networks is a difficult question and it constitutes the focus of this book. Computational Architectures Integrating Neural and Symbolic Processes addresses the underlying architectural aspects of the integration of neural and symbolic processes. In order to provide a basis for a deeper understanding of existing divergent approaches and provide insight for further developments in this field, this book presents: (1) an examination of specific architectures (grouped together according to their approaches), their strengths and weaknesses, why they work, and what they predict, and (2) a critique/comparison of these approaches. Computational Architectures Integrating Neural and Symbolic Processes is of interest to researchers, graduate students, and interested laymen, in areas such as cognitive science, artificial intelligence, computer science, cognitive psychology, and neurocomputing, in keeping up-to-date with the newest research trends. It is a comprehensive, in-depth introduction to this new emerging field.

A remarkable facet of the human brain is its ability to manage multiple tasks with apparent simultaneity. Knowledge learned from one task can then be used to enhance problem-solving in other related tasks. In machine learning, the idea of leveraging relevant information across related tasks as inductive biases to enhance learning performance has attracted significant interest. In contrast, attempts to emulate the human brain's ability to generalize in optimization - particularly in population-based evolutionary algorithms - have received little attention to date. Recently, a novel evolutionary search paradigm, Evolutionary Multi-Task (EMT) optimization, has been proposed in the realm of evolutionary computation. In contrast to traditional evolutionary searches, which solve a single task in a single run, evolutionary multi-tasking algorithm conducts searches concurrently on multiple search spaces corresponding to different tasks or optimization problems, each possessing a unique function landscape. By exploiting the latent synergies among distinct problems, the superior search performance of EMT optimization in terms of solution quality and convergence speed has been demonstrated in a variety of continuous, discrete, and hybrid (mixture of continuous and discrete) tasks. This book discusses the foundations and methodologies of developing evolutionary multi-tasking algorithms for complex optimization, including in domains characterized by factors such as multiple objectives of interest, high-dimensional search spaces and NP-hardness.

This book provides a coherent and complete overview of various Question Answering (QA) systems. It covers three main categories based on the source of the data that can be unstructured text (TextQA), structured knowledge graphs (KBQA), and the combination of both. Developing a QA system usually requires using a combination of various important techniques, including natural language processing, information retrieval and extraction, knowledge graph processing, and machine learning. After a general introduction and an overview of the book in Chapter 1, the history of QA systems and the architecture of different QA approaches are explained in Chapter 2. It starts with early close domain QA systems and reviews different generations of QA up to state-of-the-art hybrid models. Next, Chapter 3 is devoted to explaining the datasets and the metrics used for evaluating TextQA and KBQA. Chapter 4 introduces the neural and deep learning models used in QA systems. This chapter includes the required knowledge of deep learning and neural text representation models for comprehending the QA models over text and QA models over knowledge base explained in Chapters 5 and 6, respectively. In some of the KBQA models the textual data is also used as another source besides the knowledge base; these hybrid models are studied in Chapter 7. In Chapter 8, a detailed explanation of some well-known real applications of the QA systems is provided. Eventually, open issues and future work on QA are discussed in Chapter 9. This book delivers a comprehensive overview on QA over text, QA over knowledge base, and hybrid QA systems which can be used by researchers starting in this field. It will help its readers to follow the state-of-the-art research in the area by providing essential and basic knowledge.

Representation learning in heterogeneous graphs (HG) is intended to provide a meaningful vector representation for each node so as to facilitate downstream applications such as link prediction, personalized recommendation, node classification, etc. This task, however, is challenging not only because of the need to incorporate heterogeneous structural (graph) information consisting of multiple types of node and edge, but also the need to consider heterogeneous attributes or types of content (e.g. text or image) associated with each node. Although considerable advances have been made in homogeneous (and heterogeneous) graph embedding, attributed graph embedding and graph neural networks, few are capable of simultaneously and effectively taking into account heterogeneous structural (graph) information as well as the heterogeneous content information of each node. In this book, we provide a comprehensive survey of current developments in HG representation learning. More importantly, we present the state-of-the-art in this field, including theoretical models and real applications that have been showcased at the top conferences and journals, such as TKDE, KDD, WWW, IJCAI and AAAI. The book has two major objectives: (1) to provide researchers with an understanding of the fundamental issues and a good point of departure for working in this rapidly expanding field, and (2) to present the latest research on applying heterogeneous graphs to model real systems and learning structural features of interaction systems. To the best of our knowledge, it is the first book to summarize the latest developments and present cutting-edge research on heterogeneous graph representation learning. To gain the most from it, readers should have a basic grasp of computer science, data mining and machine learning.

This volume presents the current status of software development in the field of computational and theoretical chemistry and gives an overview of the emerging trends. The challenges of maintaining the legacy codes and their adaptation to the rapidly growing hardware capabilities and the new programming environments are surveyed in a series of topical reviews written by the core developers and maintainers of the popular quantum chemistry and molecular dynamics programs. Special emphasis is given to new computational methodologies and practical aspects of their implementation and application in the computational chemistry codes. Modularity of the computational chemistry software is an emerging concept that enables to bypass the development and maintenance bottleneck of the legacy software and to customize the software using the best available computational procedures implemented in the form of self-contained modules. Perspectives on modular design of the computer programs for modeling molecular electronic structure, non-adiabatic dynamics, kinetics, as well as for data visualization are presented by the researchers actively working in the field of software development and application. This volume is of interest to quantum and computational chemists as well as experimental chemists actively using and developing computational software for their research. Chapters "MLatom 2: An Integrative Platform for Atomistic Machine Learning" and "Evolution of the Automatic Rhodopsin Modeling (ARM) Protocol" are available open access under a CC BY 4.0 License via link.springer.com.

Currently, machine learning is playing a pivotal role in the progress of genomics. The applications of machine learning are helping all to understand the emerging trends and the future scope of genomics. This book provides comprehensive coverage of machine learning applications such as DNN, CNN, and RNN, for predicting the sequence of DNA and RNA binding proteins, expression of the gene, and splicing control. In addition, the book addresses the effect of multiomics data analysis of cancers using tensor decomposition, machine learning techniques for protein engineering, CNN applications on genomics, challenges of long noncoding RNAs in human disease diagnosis, and how machine learning can be used as a tool to shape the future of medicine. More importantly, it gives a comparative analysis and validates the outcomes of machine learning methods on genomic data to the functional laboratory tests or by formal clinical assessment. The topics of this book will cater interest to academicians, practitioners working in the field of functional genomics, and machine learning. Also, this book shall guide comprehensively the graduate, postgraduates, and Ph.D. scholars working in these fields.

This book describes the application of vision-sensing technologies in welding processes, one of the key technologies in intelligent welding manufacturing. Gas tungsten arc welding (GTAW) is one of the main welding techniques and has a wide range of applications in the manufacturing industry. As such, the book also explores the application of AI technologies, such as vision sensing and machine learning, in GTAW process sensing and feature extraction and monitoring, and presents the state-of-the-art in computer vision, image processing and machine learning to detect welding defects using non-destructive methods in order to improve welding productivity. Featuring the latest research from ORNL (Oak Ridge National Laboratory) using digital image correlation technology, this book will appeal to researchers, scientists and engineers in the field of advanced manufacturing.

Deep Learning in Bioinformatics: Techniques and Applications in Practice introduces the topic in an easy-to-understand way, exploring how it can be utilized for addressing important problems in bioinformatics, including drug discovery, de novo molecular design, sequence analysis, protein structure prediction, gene expression regulation, protein classification, biomedical image processing and diagnosis, biomolecule interaction prediction, and in systems biology. The book also presents theoretical and practical successes of deep learning in bioinformatics, pointing out problems and suggesting future research directions. Dr. Izadkhah provides valuable insights and will help researchers use deep learning techniques in their biological and bioinformatics studies.

This is the first book on synthetic data for deep learning, and its breadth of coverage may render this book as the default reference on synthetic data for years to come. The book can also serve as an introduction to several other important subfields of machine learning that are seldom touched upon in other books. Machine learning as a discipline would not be possible without the inner workings of optimization at hand. The book includes the necessary sinews of optimization though the crux of the discussion centers on the increasingly popular tool for training deep learning models, namely synthetic data. It is expected that the field of synthetic data will undergo exponential growth in the near future. This book serves as a comprehensive survey of the field. In the simplest case, synthetic data refers to computer-generated graphics used to train computer vision models. There are many more facets of synthetic data to consider. In the section on basic computer vision, the book discusses fundamental computer vision problems, both low-level (e.g., optical flow estimation) and high-level (e.g., object detection and semantic segmentation), synthetic environments and datasets for outdoor and urban scenes (autonomous driving), indoor scenes (indoor navigation), aerial navigation, and simulation environments for robotics. Additionally, it touches upon applications of synthetic data outside computer vision (in neural programming, bioinformatics, NLP, and more). It also surveys the work on improving synthetic data development and alternative ways to produce it such as GANs. The book introduces and reviews several different approaches to synthetic data in various domains of machine learning, most notably the following fields: domain adaptation for making synthetic data more realistic and/or adapting the models to be trained on synthetic data and differential privacy for generating synthetic data with privacy guarantees. This discussion is accompanied by an introduction into generative adversarial networks (GAN) and an introduction to differential privacy.

RDF-based knowledge graphs require additional formalisms to be fully context-aware, which is presented in this book. This book also provides a collection of provenance techniques and state-of-the-art metadata-enhanced, provenance-aware, knowledge graph-based representations across multiple application domains, in order to demonstrate how to combine graph-based data models and provenance representations. This is important to make statements authoritative, verifiable, and reproducible, such as in biomedical, pharmaceutical, and cybersecurity applications, where the data source and generator can be just as important as the data itself. Capturing provenance is critical to ensure sound experimental results and rigorously designed research studies for patient and drug safety, pathology reports, and medical evidence generation. Similarly, provenance is needed for cyberthreat intelligence dashboards and attack maps that aggregate and/or fuse heterogeneous data from disparate data sources to differentiate between unimportant online events and dangerous cyberattacks, which is demonstrated in this book. Without provenance, data reliability and trustworthiness might be limited, causing data reuse, trust, reproducibility and accountability issues. This book primarily targets researchers who utilize knowledge graphs in their methods and approaches (this includes researchers from a variety of domains, such as cybersecurity, eHealth, data science, Semantic Web, etc.). This book collects core facts for the state of the art in provenance approaches and techniques, complemented by a critical review of existing approaches. New research directions are also provided that combine data science and knowledge graphs, for an increasingly important research topic.