This book summarizes the state-of-the-art in unsupervised learning. The contributors discuss how with the proliferation of massive amounts of unlabeled data, unsupervised learning algorithms, which can automatically discover interesting and useful patterns in such data, have gained popularity among researchers and practitioners. The authors outline how these algorithms have found numerous applications including pattern recognition, market basket analysis, web mining, social network analysis, information retrieval, recommender systems, market research, intrusion detection, and fraud detection. They present how the difficulty of developing theoretically sound approaches that are amenable to objective evaluation have resulted in the proposal of numerous unsupervised learning algorithms over the past half-century. The intended audience includes researchers and practitioners who are increasingly using unsupervised learning algorithms to analyze their data. Topics of interest include anomaly detection, clustering, feature extraction, and applications of unsupervised learning. Each chapter is contributed by a leading expert in the field.

This textbook integrates important mathematical foundations, efficient computational algorithms, applied statistical inference techniques, and cutting-edge machine learning approaches to address a wide range of crucial biomedical informatics, health analytics applications, and decision science challenges. Each concept in the book includes a rigorous symbolic formulation coupled with computational algorithms and complete end-to-end pipeline protocols implemented as functional R electronic markdown notebooks. These workflows support active learning and demonstrate comprehensive data manipulations, interactive visualizations, and sophisticated analytics. The content includes open problems, state-of-the-art scientific knowledge, ethical integration of heterogeneous scientific tools, and procedures for systematic validation and dissemination of reproducible research findings.Complementary to the enormous challenges related to handling, interrogating, and understanding massive amounts of complex structured and unstructured data, there are unique opportunities that come with access to a wealth of feature-rich, high-dimensional, and time-varying information. The topics covered in Data Science and Predictive Analytics address specific knowledge gaps, resolve educational barriers, and mitigate workforce information-readiness and data science deficiencies. Specifically, it provides a transdisciplinary curriculum integrating core mathematical principles, modern computational methods, advanced data science techniques, model-based machine learning, model-free artificial intelligence, and innovative biomedical applications. The book's fourteen chapters start with an introduction and progressively build foundational skills from visualization to linear modeling, dimensionality reduction, supervised classification, black-box machine learning techniques, qualitative learning methods, unsupervised clustering, model performance assessment, feature selection strategies, longitudinal data analytics, optimization, neural networks, and deep learning. The second edition of the book includes additional learning-based strategies utilizing generative adversarial networks, transfer learning, and synthetic data generation, as well as eight complementary electronic appendices. This textbook is suitable for formal didactic instructor-guided course education, as well as for individual or team-supported self-learning. The material is presented at the upper-division and graduate-level college courses and covers applied and interdisciplinary mathematics, contemporary learning-based data science techniques, computational algorithm development, optimization theory, statistical computing, and biomedical sciences. The analytical techniques and predictive scientific methods described in the book may be useful to a wide range of readers, formal and informal learners, college instructors, researchers, and engineers throughout the academy, industry, government, regulatory, funding, and policy agencies. The supporting book website provides many examples, datasets, functional scripts, complete electronic notebooks, extensive appendices, and additional materials.

This book provides a hands-on introduction to Machine Learning (ML) from a multidisciplinary perspective that does not require a background in data science or computer science. It explains ML using simple language and a straightforward approach guided by real-world examples in areas such as health informatics, information technology, and business analytics. The book will help readers understand the various key algorithms, major software tools, and their applications. Moreover, through examples from the healthcare and business analytics fields, it demonstrates how and when ML can help them make better decisions in their disciplines. The book is chiefly intended for undergraduate and graduate students who are taking an introductory course in machine learning. It will also benefit data analysts and anyone interested in learning ML approaches.

This book constitutes the refereed post-conference proceedings of the Fourth IFIP TC 12 International Conference on Computational Intelligence in Data Science, ICCIDS 2021, held in Chennai, India, in March 2021. The 20 revised full papers presented were carefully reviewed and selected from 75 submissions. The papers cover topics such as computational intelligence for text analysis; computational intelligence for image and video analysis; blockchain and data science.

The new edition of this popular professional book on artificial intelligence (ML) and machine learning (ML) has been revised for classroom or training use. The new edition provides comprehensive coverage of combined AI and ML theory and applications. Rather than looking at the field from only a theoretical or only a practical perspective, this book unifies both perspectives to give holistic understanding. The first part introduces the concepts of AI and ML and their origin and current state. The second and third parts delve into conceptual and theoretic aspects of static and dynamic ML techniques. The fourth part describes the practical applications where presented techniques can be applied. The fifth part introduces the user to some of the implementation strategies for solving real life ML problems. Each chapter is accompanied with a set of exercises that will help the reader / student to apply the learnings from the chapter to a real-life problem. Completion of these exercises will help the reader / student to solidify the concepts learned. The book is appropriate for students in graduate and upper undergraduate courses in addition to researchers and professionals. It makes minimal use of mathematics to make the topics more intuitive and accessible. The book covers a large gamut of topics in the area of AI and ML and a professor can tailor a course on AI / ML based on the book by selecting and re-organizing the sequence of chapters to suit the needs.

Federated Learning: A Comprehensive Overview of Methods and Applications presents an in-depth discussion of the most important issues and approaches to federated learning for researchers and practitioners. Federated Learning (FL) is an approach to machine learning in which the training data are not managed centrally. Data are retained by data parties that participate in the FL process and are not shared with any other entity. This makes FL an increasingly popular solution for machine learning tasks for which bringing data together in a centralized repository is problematic, either for privacy, regulatory or practical reasons. This book explains recent progress in research and the state-of-the-art development of Federated Learning (FL), from the initial conception of the field to first applications and commercial use. To obtain this broad and deep overview, leading researchers address the different perspectives of federated learning: the core machine learning perspective, privacy and security, distributed systems, and specific application domains. Readers learn about the challenges faced in each of these areas, how they are interconnected, and how they are solved by state-of-the-art methods. Following an overview on federated learning basics in the introduction, over the following 24 chapters, the reader will dive deeply into various topics. A first part addresses algorithmic questions of solving different machine learning tasks in a federated way, how to train efficiently, at scale, and fairly. Another part focuses on providing clarity on how to select privacy and security solutions in a way that can be tailored to specific use cases, while yet another considers the pragmatics of the systems where the federated learning process will run. The book also covers other important use cases for federated learning such as split learning and vertical federated learning. Finally, the book includes some chapters focusing on applying FL in real-world enterprise settings.

First Published in 1987. Routledge is an imprint of Taylor & Francis, an informa company.

As genetic algorithms (GAs) become increasingly popular, they are applied to difficult problems that may require considerable computations. In such cases, parallel implementations of GAs become necessary to reach high-quality solutions in reasonable times. But, even though their mechanics are simple, parallel GAs are complex non-linear algorithms that are controlled by many parameters, which are not well understood. Efficient and Accurate Parallel Genetic Algorithms is about the design of parallel GAs. It presents theoretical developments that improve our understanding of the effect of the algorithm's parameters on its search for quality and efficiency. These developments are used to formulate guidelines on how to choose the parameter values that minimize the execution time while consistently reaching solutions of high quality. Efficient and Accurate Parallel Genetic Algorithms can be read in several ways, depending on the readers' interests and their previous knowledge about these algorithms. Newcomers to the field will find the background material in each chapter useful to become acquainted with previous work, and to understand the problems that must be faced to design efficient and reliable algorithms. Potential users of parallel GAs that may have doubts about their practicality or reliability may be more confident after reading this book and understanding the algorithms better. Those who are ready to try a parallel GA on their applications may choose to skim through the background material, and use the results directly without following the derivations in detail. These readers will find that using the results can help them to choose the type of parallel GA that best suits their needs, without having to invest the time to implement and test various options. Once that is settled, even the most experienced users dread the long and frustrating experience of configuring their algorithms by trial and error. The guidelines contained herein will shorten dramatically the time spent tweaking the algorithm, although some experimentation may still be needed for fine-tuning. Efficient and Accurate Parallel Genetic Algorithms is suitable as a secondary text for a graduate level course, and as a reference for researchers and practitioners in industry.

This open access book provides a wealth of hands-on examples that illustrate how hyperparameter tuning can be applied in practice and gives deep insights into the working mechanisms of machine learning (ML) and deep learning (DL) methods. The aim of the book is to equip readers with the ability to achieve better results with significantly less time, costs, effort and resources using the methods described here. The case studies presented in this book can be run on a regular desktop or notebook computer. No high-performance computing facilities are required. The idea for the book originated in a study conducted by Bartz & Bartz GmbH for the Federal Statistical Office of Germany (Destatis). Building on that study, the book is addressed to practitioners in industry as well as researchers, teachers and students in academia. The content focuses on the hyperparameter tuning of ML and DL algorithms, and is divided into two main parts: theory (Part I) and application (Part II). Essential topics covered include: a survey of important model parameters; four parameter tuning studies and one extensive global parameter tuning study; statistical analysis of the performance of ML and DL methods based on severity; and a new, consensus-ranking-based way to aggregate and analyze results from multiple algorithms. The book presents analyses of more than 30 hyperparameters from six relevant ML and DL methods, and provides source code so that users can reproduce the results. Accordingly, it serves as a handbook and textbook alike.

This book presents the proceedings of the 9th Asian South Pacific Association of Sport Psychology International Congress (ASPASP) 2022, Kuching, Malaysia, which entails the different sporting innovation themes, namely, Applied Sport and Social Psychology, Health and Exercise, Motor Control and Learning, Counselling and Clinical Psychology, Biomechanics, Data Mining and Machine Learning in Sports amongst others. It presents the state-of-the-art technological advancements towards the aforesaid themes and provides a platform to shape the future direction of sport science, specifically in the field sports and exercise psychology.  ​

This monograph offers an original broad and very diverse exploration of the seriation domain in data analysis, together with building a specific relation to clustering.Relative to a data table crossing a set of objects and a set of descriptive attributes, the search for orders which correspond respectively to these two sets is formalized mathematically and statistically. State-of-the-art methods are created and compared with classical methods and a thorough understanding of the mutual relationships between these methods is clearly expressed. The authors distinguish two families of methods: Geometric representation methods Algorithmic and Combinatorial methods Original and accurate methods are provided in the framework for both families. Their basis and comparison is made on both theoretical and experimental levels. The experimental analysis is very varied and very comprehensive. Seriation in Combinatorial and Statistical Data Analysis has a unique character in the literature falling within the fields of Data Analysis, Data Mining and Knowledge Discovery. It will be a valuable resource for students and researchers in the latter fields.

This book offers an introduction into quantum machine learning research, covering approaches that range from "near-term" to fault-tolerant quantum machine learning algorithms, and from theoretical to practical techniques that help us understand how quantum computers can learn from data. Among the topics discussed are parameterized quantum circuits, hybrid optimization, data encoding, quantum feature maps and kernel methods, quantum learning theory, as well as quantum neural networks. The book aims at an audience of computer scientists and physicists at the graduate level onwards. The second edition extends the material beyond supervised learning and puts a special focus on the developments in near-term quantum machine learning seen over the past few years.

This book provides tools and algorithms for solving a wide class of optimization tasks by learning from their repetitions. A unified framework is provided for learning algorithms that are based on the stochastic gradient (a golden standard in learning), including random simultaneous perturbations and the response surface the methodology. Original algorithms include model-free learning of short decision sequences as well as long sequences-relying on model-supported gradient estimation. Learning is based on whole sequences of a process observation that are either vectors or images. This methodology is applicable to repetitive processes, covering a wide range from (additive) manufacturing to decision making for COVID-19 waves mitigation. A distinctive feature of the algorithms is learning between repetitions-this idea extends the paradigms of iterative learning and run-to-run control. The main ideas can be extended to other decision learning tasks, not included in this book. The text is written in a comprehensible way with the emphasis on a user-friendly presentation of the algorithms, their explanations, and recommendations on how to select them. The book is expected to be of interest to researchers, Ph.D., and graduate students in computer science and engineering, operations research, decision making, and those working on the iterative learning control.

Machine learning (ML) has become a commonplace element in our everyday lives and a standard tool for many fields of science and engineering. To make optimal use of ML, it is essential to understand its underlying principles. This book approaches ML as the computational implementation of the scientific principle. This principle consists of continuously adapting a model of a given data-generating phenomenon by minimizing some form of loss incurred by its predictions. The book trains readers to break down various ML applications and methods in terms of data, model, and loss, thus helping them to choose from the vast range of ready-made ML methods. The book's three-component approach to ML provides uniform coverage of a wide range of concepts and techniques. As a case in point, techniques for regularization, privacy-preservation as well as explainability amount to specific design choices for the model, data, and loss of a ML method.

This book evaluates the role of innovative machine learning and deep learning methods in dealing with power system issues, concentrating on recent developments and advances that improve planning, operation, and control of power systems. Cutting-edge case studies from around the world consider prediction, classification, clustering, and fault/event detection in power systems, providing effective and promising solutions for many novel challenges faced by power system operators. Written by leading experts, the book will be an ideal resource for researchers and engineers working in the electrical power engineering and power system planning communities, as well as students in advanced graduate-level courses.

Hamiltonian Monte Carlo Methods in Machine Learning introduces methods for optimal tuning of HMC parameters, along with an introduction of Shadow and Non-canonical HMC methods with improvements and speedup. Lastly, the authors address the critical issues of variance reduction for parameter estimates of numerous HMC based samplers. The book offers a comprehensive introduction to Hamiltonian Monte Carlo methods and provides a cutting-edge exposition of the current pathologies of HMC-based methods in both tuning, scaling and sampling complex real-world posteriors. These are mainly in the scaling of inference (e.g., Deep Neural Networks), tuning of performance-sensitive sampling parameters and high sample autocorrelation. Other sections provide numerous solutions to potential pitfalls, presenting advanced HMC methods with applications in renewable energy, finance and image classification for biomedical applications. Readers will get acquainted with both HMC sampling theory and algorithm implementation.

This book collects different methodologies that permit metaheuristics and machine learning to solve real-world problems. This book has exciting chapters that employ evolutionary and swarm optimization tools combined with machine learning techniques. The fields of applications are from distribution systems until medical diagnosis, and they are also included different surveys and literature reviews that will enrich the reader. Besides, cutting-edge methods such as neuroevolutionary and IoT implementations are presented in some chapters. In this sense, the book provides theory and practical content with novel machine learning and metaheuristic algorithms. The chapters were compiled using a scientific perspective. Accordingly, the book is primarily intended for undergraduate and postgraduate students of Science, Engineering, and Computational Mathematics and can be used in courses on Artificial Intelligence, Advanced Machine Learning, among others. Likewise, the material can be helpful for research from the evolutionary computation, artificial intelligence communities.

This volumes presents the proceedings of the FASMI 2020 conference, held at Taipei Veterans General Hospital on November 20-22, 2020. It presents contributions on all aspects of molecular imaging, discovered by leading academic scientists and researchers. It also provides a premier interdisciplinary treatment of recent innovations, trend, and concerns as well as practical challenges and solutions in Molecular Imaging and put an emphasis on Artificial Intelligence applied to Imaging Data. FASMI is the annual meeting of the Federation of Asian Societies for Molecular Imaging

This book provides an overview of different deep learning-based methods for face recognition and related problems. Specifically, the authors present methods based on autoencoders, restricted Boltzmann machines, and deep convolutional neural networks for face detection, localization, tracking, recognition, etc. The authors also discuss merits and drawbacks of available approaches and identifies promising avenues of research in this rapidly evolving field. Even though there have been a number of different approaches proposed in the literature for face recognition based on deep learning methods, there is not a single book available in the literature that gives a complete overview of these methods. The proposed book captures the state of the art in face recognition using various deep learning methods, and it covers a variety of different topics related to face recognition. This book is aimed at graduate students studying electrical engineering and/or computer science. Biometrics is a course that is widely offered at both undergraduate and graduate levels at many institutions around the world: This book can be used as a textbook for teaching topics related to face recognition. In addition, the work is beneficial to practitioners in industry who are working on biometrics-related problems. The prerequisites for optimal use are the basic knowledge of pattern recognition, machine learning, probability theory, and linear algebra.

This book gives an overview of applications of Machine Learning (ML) in diverse fields of biological sciences, including healthcare, animal sciences, agriculture, and plant sciences. Machine learning has major applications in process modelling, computer vision, signal processing, speech recognition, and language understanding and processing and life, and health sciences. It is increasingly used in understanding DNA patterns and in precision medicine. This book is divided into eight major sections, each containing chapters that describe the application of ML in a certain field. The book begins by giving an introduction to ML and the various ML methods. It then covers interesting and timely aspects such as applications in genetics, cell biology, the study of plant-pathogen interactions, and animal behavior. The book discusses computational methods for toxicity prediction of environmental chemicals and drugs, which forms a major domain of research in the field of biology. It is of relevance to post-graduate students and researchers interested in exploring the interdisciplinary areas of use of machine learning and deep learning in life sciences.

This book uses machine-learning to identify the causes of conflict from among the top predictors of conflict. This methodology elevates some complex causal pathways that cause civil conflict over others, thus teasing out the complex interrelationships between the most important variables that cause civil conflict. Success in this realm will lead to scientific theories of conflict that will be useful in preventing and ending civil conflict. After setting out a current review of the literature and a case for using machine learning to analyze and predict civil conflict, the authors lay out the data set, important variables, and investigative strategy of their methodology. The authors then investigate institutional causes, economic causes, and sociological causes for civil conflict, and how that feeds into their model. The methodology provides an identifiable pathway for specifying causal models. This book will be of interest to scholars in the areas of economics, political science, sociology, and artificial intelligence who want to learn more about leveraging machine learning technologies to solve problems and who are invested in preventing civil conflict.

This book explores new and novel applications of machine learning, deep learning, and artificial intelligence that are related to major challenges in the field of cybersecurity. The provided research goes beyond simply applying AI techniques to datasets and instead delves into deeper issues that arise at the interface between deep learning and cybersecurity. This book also provides insight into the difficult "how" and "why" questions that arise in AI within the security domain. For example, this book includes chapters covering "explainable AI", "adversarial learning", "resilient AI", and a wide variety of related topics. It's not limited to any specific cybersecurity subtopics and the chapters touch upon a wide range of cybersecurity domains, ranging from malware to biometrics and more. Researchers and advanced level students working and studying in the fields of cybersecurity (equivalently, information security) or artificial intelligence (including deep learning, machine learning, big data, and related fields) will want to purchase this book as a reference. Practitioners working within these fields will also be interested in purchasing this book.

This is the first technical book that considers tests as public tools and examines how to engineer and process test data, extract the structure within the data to be visualized, and thereby make test results useful for students, teachers, and the society. The author does not differentiate test data analysis from data engineering and information visualization. This monograph introduces the following methods of engineering or processing test data, including the latest machine learning techniques: classical test theory (CTT), item response theory (IRT), latent class analysis (LCA), latent rank analysis (LRA), biclustering (co-clustering), and Bayesian network model (BNM). CTT and IRT are methods for analyzing test data and evaluating students' abilities on a continuous scale. LCA and LRA assess examinees by classifying them into nominal and ordinal clusters, respectively, where the adequate number of clusters is estimated from the data. Biclustering classifies examinees into groups (latent clusters) while classifying items into fields (factors). Particularly, the infinite relational model discussed in this book is a biclustering method feasible under the condition that neither the number of groups nor the number of fields is known beforehand. Additionally, the local dependence LRA, local dependence biclustering, and bicluster network model are methods that search and visualize inter-item (or inter-field) network structure using the mechanism of BNM. As this book offers a new perspective on test data analysis methods, it is certain to widen readers' perspective on test data analysis.

This book introduces the approach of Machine Learning (ML) based predictive models in the design of composite materials to achieve the required properties for certain applications. ML can learn from existing experimental data obtained from very limited number of experiments and subsequently can be trained to find solutions of the complex non-linear, multi-dimensional functional relationships without any prior assumptions about their nature. In this case the ML models can learn from existing experimental data obtained from (1) composite design based on various properties of the matrix material and fillers/reinforcements (2) material processing during fabrication (3) property relationships. Modelling of these relationships using ML methods significantly reduce the experimental work involved in designing new composites, and therefore offer a new avenue for material design and properties. The book caters to students, academics and researchers who are interested in the field of material composite modelling and design.