Lifelong Machine Learning, Second Edition is an introduction to an advanced machine learning paradigm that continuously learns by accumulating past knowledge that it then uses in future learning and problem solving. In contrast, the current dominant machine learning paradigm learns in isolation: given a training dataset, it runs a machine learning algorithm on the dataset to produce a model that is then used in its intended application. It makes no attempt to retain the learned knowledge and use it in subsequent learning. Unlike this isolated system, humans learn effectively with only a few examples precisely because our learning is very knowledge-driven: the knowledge learned in the past helps us learn new things with little data or effort. Lifelong learning aims to emulate this capability, because without it, an AI system cannot be considered truly intelligent. Research in lifelong learning has developed significantly in the relatively short time since the first edition of this book was published. The purpose of this second edition is to expand the definition of lifelong learning, update the content of several chapters, and add a new chapter about continual learning in deep neural networks-which has been actively researched over the past two or three years. A few chapters have also been reorganized to make each of them more coherent for the reader. Moreover, the authors want to propose a unified framework for the research area. Currently, there are several research topics in machine learning that are closely related to lifelong learning-most notably, multi-task learning, transfer learning, and meta-learning-because they also employ the idea of knowledge sharing and transfer. This book brings all these topics under one roof and discusses their similarities and differences. Its goal is to introduce this emerging machine learning paradigm and present a comprehensive survey and review of the important research results and latest ideas in the area. This book is thus suitable for students, researchers, and practitioners who are interested in machine learning, data mining, natural language processing, or pattern recognition. Lecturers can readily use the book for courses in any of these related fields.

Gain practical skills in machine learning for finance, healthcare, and retail. This book uses a hands-on approach by providing case studies from each of these domains: you'll see examples that demonstrate how to use machine learning as a tool for business enhancement. As a domain expert, you will not only discover how machine learning is used in finance, healthcare, and retail, but also work through practical case studies where machine learning has been implemented. Machine Learning Applications Using Python is divided into three sections, one for each of the domains (healthcare, finance, and retail). Each section starts with an overview of machine learning and key technological advancements in that domain. You'll then learn more by using case studies on how organizations are changing the game in their chosen markets. This book has practical case studies with Python code and domain-specific innovative ideas for monetizing machine learning. What You Will Learn Discover applied machine learning processes and principles Implement machine learning in areas of healthcare, finance, and retail Avoid the pitfalls of implementing applied machine learning Build Python machine learning examples in the three subject areas Who This Book Is For Data scientists and machine learning professionals.

This book constitutes the proceedings of the international workshops co-located with the 16th International Conference on Document Analysis and Recognition, ICDAR 2021, held in Lausanne, Switzerland, in September 2021.The total of 59 full and 12 short papers presented in this book were carefully selected from 96 submissions and divided into two volumes. Part II contains 30 full and 8 short papers that stem from the following meetings: Workshop on Machine Learning (WML); Workshop on Open Services and Tools for Document Analysis (OST); Workshop on Industrial Applications of Document Analysis and Recognition (WIADAR); Workshop on Computational Paleography (IWCP); Workshop on Document Images and Language (DIL); Workshop on Graph Representation Learning for Scanned Document Analysis (GLESDO).

This book constitutes the proceedings of the international workshops co-located with the 16th International Conference on Document Analysis and Recognition, ICDAR 2021, held in Lausanne, Switzerland, in September 2021.The total of 59 full and 12 short papers presented in this book were carefully selected from 96 contributions and divided into two volumes. Part I contains 29 full and 4 short papers that stem from the following meetings: ICDAR 2021 Workshop on Graphics Recognition (GREC); ICDAR 2021 Workshop on Camera-Based Document Analysis and Recognition (CBDAR); ICDAR 2021 Workshop on Arabic and Derived Script Analysis and Recognition (ASAR 2021); ICDAR 2021 Workshop on Computational Document Forensics (IWCDF). The main topics of the contributions are document processing; physical and logical layout analysis; text and symbol recognition; handwriting recognition; signature verification and document forensics, and others. "Accurate Graphic Symbol Detection in Ancient Document Digital Reproductions" is available open access under a Creative Commons Attribution 4.0 International License via link.springer.com.

This four-volume set of LNCS 12821, LNCS 12822, LNCS 12823 and LNCS 12824, constitutes the refereed proceedings of the 16th International Conference on Document Analysis and Recognition, ICDAR 2021, held in Lausanne, Switzerland in September 2021. The 182 full papers were carefully reviewed and selected from 340 submissions, and are presented with 13 competition reports. The papers are organized into the following topical sections: document analysis for literature search, document summarization and translation, multimedia document analysis, mobile text recognition, document analysis for social good, indexing and retrieval of documents, physical and logical layout analysis, recognition of tables and formulas, and natural language processing (NLP) for document understanding.

The multi-volume set LNAI 12975 until 12979 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2021, which was held during September 13-17, 2021. The conference was originally planned to take place in Bilbao, Spain, but changed to an online event due to the COVID-19 pandemic. The 210 full papers presented in these proceedings were carefully reviewed and selected from a total of 869 submissions. The volumes are organized in topical sections as follows: Research Track: Part I: Online learning; reinforcement learning; time series, streams, and sequence models; transfer and multi-task learning; semi-supervised and few-shot learning; learning algorithms and applications. Part II: Generative models; algorithms and learning theory; graphs and networks; interpretation, explainability, transparency, safety. Part III: Generative models; search and optimization; supervised learning; text mining and natural language processing; image processing, computer vision and visual analytics. Applied Data Science Track: Part IV: Anomaly detection and malware; spatio-temporal data; e-commerce and finance; healthcare and medical applications (including Covid); mobility and transportation. Part V: Automating machine learning, optimization, and feature engineering; machine learning based simulations and knowledge discovery; recommender systems and behavior modeling; natural language processing; remote sensing, image and video processing; social media.

The multi-volume set LNAI 12975 until 12979 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2021, which was held during September 13-17, 2021. The conference was originally planned to take place in Bilbao, Spain, but changed to an online event due to the COVID-19 pandemic. The 210 full papers presented in these proceedings were carefully reviewed and selected from a total of 869 submissions. The volumes are organized in topical sections as follows: Research Track: Part I: Online learning; reinforcement learning; time series, streams, and sequence models; transfer and multi-task learning; semi-supervised and few-shot learning; learning algorithms and applications. Part II: Generative models; algorithms and learning theory; graphs and networks; interpretation, explainability, transparency, safety. Part III: Generative models; search and optimization; supervised learning; text mining and natural language processing; image processing, computer vision and visual analytics. Applied Data Science Track: Part IV: Anomaly detection and malware; spatio-temporal data; e-commerce and finance; healthcare and medical applications (including Covid); mobility and transportation. Part V: Automating machine learning, optimization, and feature engineering; machine learning based simulations and knowledge discovery; recommender systems and behavior modeling; natural language processing; remote sensing, image and video processing; social media.

The multi-volume set LNAI 12975 until 12979 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2021, which was held during September 13-17, 2021. The conference was originally planned to take place in Bilbao, Spain, but changed to an online event due to the COVID-19 pandemic. The 210 full papers presented in these proceedings were carefully reviewed and selected from a total of 869 submissions. The volumes are organized in topical sections as follows: Research Track: Part I: Online learning; reinforcement learning; time series, streams, and sequence models; transfer and multi-task learning; semi-supervised and few-shot learning; learning algorithms and applications. Part II: Generative models; algorithms and learning theory; graphs and networks; interpretation, explainability, transparency, safety. Part III: Generative models; search and optimization; supervised learning; text mining and natural language processing; image processing, computer vision and visual analytics. Applied Data Science Track: Part IV: Anomaly detection and malware; spatio-temporal data; e-commerce and finance; healthcare and medical applications (including Covid); mobility and transportation. Part V: Automating machine learning, optimization, and feature engineering; machine learning based simulations and knowledge discovery; recommender systems and behavior modeling; natural language processing; remote sensing, image and video processing; social media.

The multi-volume set LNAI 12975 until 12979 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2021, which was held during September 13-17, 2021. The conference was originally planned to take place in Bilbao, Spain, but changed to an online event due to the COVID-19 pandemic. The 210 full papers presented in these proceedings were carefully reviewed and selected from a total of 869 submissions. The volumes are organized in topical sections as follows: Research Track: Part I: Online learning; reinforcement learning; time series, streams, and sequence models; transfer and multi-task learning; semi-supervised and few-shot learning; learning algorithms and applications. Part II: Generative models; algorithms and learning theory; graphs and networks; interpretation, explainability, transparency, safety. Part III: Generative models; search and optimization; supervised learning; text mining and natural language processing; image processing, computer vision and visual analytics. Applied Data Science Track: Part IV: Anomaly detection and malware; spatio-temporal data; e-commerce and finance; healthcare and medical applications (including Covid); mobility and transportation. Part V: Automating machine learning, optimization, and feature engineering; machine learning based simulations and knowledge discovery; recommender systems and behavior modeling; natural language processing; remote sensing, image and video processing; social media.

This four-volume set of LNCS 12821, LNCS 12822, LNCS 12823 and LNCS 12824, constitutes the refereed proceedings of the 16th International Conference on Document Analysis and Recognition, ICDAR 2021, held in Lausanne, Switzerland in September 2021. The 182 full papers were carefully reviewed and selected from 340 submissions, and are presented with 13 competition reports. The papers are organized into the following topical sections: historical document analysis, document analysis systems, handwriting recognition, scene text detection and recognition, document image processing, natural language processing (NLP) for document understanding, and graphics, diagram and math recognition.

The increasing abundance of large high-quality datasets, combined with significant technical advances over the last several decades have made machine learning into a major tool employed across a broad array of tasks including vision, language, finance, and security. However, success has been accompanied with important new challenges: many applications of machine learning are adversarial in nature. Some are adversarial because they are safety critical, such as autonomous driving. An adversary in these applications can be a malicious party aimed at causing congestion or accidents, or may even model unusual situations that expose vulnerabilities in the prediction engine. Other applications are adversarial because their task and/or the data they use are. For example, an important class of problems in security involves detection, such as malware, spam, and intrusion detection. The use of machine learning for detecting malicious entities creates an incentive among adversaries to evade detection by changing their behavior or the content of malicius objects they develop. The field of adversarial machine learning has emerged to study vulnerabilities of machine learning approaches in adversarial settings and to develop techniques to make learning robust to adversarial manipulation. This book provides a technical overview of this field. After reviewing machine learning concepts and approaches, as well as common use cases of these in adversarial settings, we present a general categorization of attacks on machine learning. We then address two major categories of attacks and associated defenses: decision-time attacks, in which an adversary changes the nature of instances seen by a learned model at the time of prediction in order to cause errors, and poisoning or training time attacks, in which the actual training dataset is maliciously modified. In our final chapter devoted to technical content, we discuss recent techniques for attacks on deep learning, as well as approaches for improving robustness of deep neural networks. We conclude with a discussion of several important issues in the area of adversarial learning that in our view warrant further research. Given the increasing interest in the area of adversarial machine learning, we hope this book provides readers with the tools necessary to successfully engage in research and practice of machine learning in adversarial settings.

This book constitutes the thoroughly refereed proceedings of the 5th International Conference on Information and Knowledge Systems, ICIKS 2021, which was held online during June 22-23, 2021.The International Conference on Information and Knowledge Systems (ICIKS 2021) gathered both researchers and practitioners in the fields of Information Systems, Artificial Intelligence, Knowledge Management and Decision Support. ICIKS seeks to promote discussions on various organizational, technological, and socio-cultural aspects of research in the design and use of information and knowledge systems in organizations. The 10 full and 2 short papers presented in this volume were carefully reviewed and selected from 32 submissions. They were organized in topical sections as follows: knowledge systems and decision making; machine learning, recommender systems, and knowledge systems; and security, artificial intelligence, and information systems.

This book focuses on methods that are unsupervised or require minimal supervision-vital in the low-resource domain. Over the past few years, rapid growth in Internet access across the globe has resulted in an explosion in user-generated text content in social media platforms. This effect is significantly pronounced in linguistically diverse areas of the world like South Asia, where over 400 million people regularly access social media platforms. YouTube, Facebook, and Twitter report a monthly active user base in excess of 200 million from this region. Natural language processing (NLP) research and publicly available resources such as models and corpora prioritize Web content authored primarily by a Western user base. Such content is authored in English by a user base fluent in the language and can be processed by a broad range of off-the-shelf NLP tools. In contrast, text from linguistically diverse regions features high levels of multilinguality, code-switching, and varied language skill levels. Resources like corpora and models are also scarce. Due to these factors, newer methods are needed to process such text. This book is designed for NLP practitioners well versed in recent advances in the field but unfamiliar with the landscape of low-resource multilingual NLP. The contents of this book introduce the various challenges associated with social media content, quantify these issues, and provide solutions and intuition. When possible, the methods discussed are evaluated on real-world social media data sets to emphasize their robustness to the noisy nature of the social media environment. On completion of the book, the reader will be well-versed with the complexity of text-mining in multilingual, low-resource environments; will be aware of a broad set of off-the-shelf tools that can be applied to various problems; and will be able to conduct sophisticated analyses of such text.

The unification of symbolist and connectionist models is a major trend in AI. The key is to keep the symbolic semantics unchanged. Unfortunately, present embedding approaches cannot. The approach in this book makes the unification possible. It is indeed a new and promising approach in AI. -Bo Zhang, Director of AI Institute, Tsinghua It is indeed wonderful to see the reviving of the important theme Nural Symbolic Model. Given the popularity and prevalence of deep learning, symbolic processing is often neglected or downplayed. This book confronts this old issue head on, with a historical look, incorporating recent advances and new perspectives, thus leading to promising new methods and approaches. -Ron Sun (RPI), on Governing Board of Cognitive Science Society Both for language and humor, approaches like those described in this book are the way to snickerdoodle wombats. -Christian F. Hempelmann (Texas A&M-Commerce) on Executive Board of International Society for Humor Studies

Learn how to harness modern deep-learning methods in many contexts. Packed with intuitive theory, practical implementation methods, and deep-learning case studies, this book reveals how to acquire the tools you need to design and implement like a deep-learning architect. It covers tools deep learning engineers can use in a wide range of fields, from biology to computer vision to business. With nine in-depth case studies, this book will ground you in creative, real-world deep learning thinking. You'll begin with a structured guide to using Keras, with helpful tips and best practices for making the most of the framework. Next, you'll learn how to train models effectively with transfer learning and self-supervised pre-training. You will then learn how to use a variety of model compressions for practical usage. Lastly, you will learn how to design successful neural network architectures and creatively reframe difficult problems into solvable ones. You'll learn not only to understand and apply methods successfully but to think critically about it. Modern Deep Learning Design and Methods is ideal for readers looking to utilize modern, flexible, and creative deep-learning design and methods. Get ready to design and implement innovative deep-learning solutions to today's difficult problems. What You'll Learn Improve the performance of deep learning models by using pre-trained models, extracting rich features, and automating optimization. Compress deep learning models while maintaining performance. Reframe a wide variety of difficult problems and design effective deep learning solutions to solve them. Use the Keras framework, with some help from libraries like HyperOpt, TensorFlow, and PyTorch, to implement a wide variety of deep learning approaches. Who This Book Is For Data scientists with some familiarity with deep learning to deep learning engineers seeking structured inspiration and direction on their next project. Developers interested in harnessing modern deep learning methods to solve a variety of difficult problems.

Master the new features in PySpark 3.1 to develop data-driven, intelligent applications. This updated edition covers topics ranging from building scalable machine learning models, to natural language processing, to recommender systems. Machine Learning with PySpark, Second Edition begins with the fundamentals of Apache Spark, including the latest updates to the framework. Next, you will learn the full spectrum of traditional machine learning algorithm implementations, along with natural language processing and recommender systems. You'll gain familiarity with the critical process of selecting machine learning algorithms, data ingestion, and data processing to solve business problems. You'll see a demonstration of how to build supervised machine learning models such as linear regression, logistic regression, decision trees, and random forests. You'll also learn how to automate the steps using Spark pipelines, followed by unsupervised models such as K-means and hierarchical clustering. A section on Natural Language Processing (NLP) covers text processing, text mining, and embeddings for classification. This new edition also introduces Koalas in Spark and how to automate data workflow using Airflow and PySpark's latest ML library. After completing this book, you will understand how to use PySpark's machine learning library to build and train various machine learning models, along with related components such as data ingestion, processing and visualization to develop data-driven intelligent applications What you will learn: Build a spectrum of supervised and unsupervised machine learning algorithms Use PySpark's machine learning library to implement machine learning and recommender systems Leverage the new features in PySpark's machine learning library Understand data processing using Koalas in Spark Handle issues around feature engineering, class balance, bias and variance, and cross validation to build optimally fit models Who This Book Is For Data science and machine learning professionals.

Practical AI for Healthcare Professionals Artificial Intelligence (AI) is a buzzword in the healthcare sphere today. However, notions of what AI actually is and how it works are often not discussed. Furthermore, information on AI implementation is often tailored towards seasoned programmers rather than the healthcare professional/beginner coder. This book gives an introduction to practical AI in the medical sphere, focusing on real-life clinical problems, how to solve them with actual code, and how to evaluate the efficacy of those solutions. You'll start by learning how to diagnose problems as ones that can and cannot be solved with AI. You'll then learn the basics of computer science algorithms, neural networks, and when each should be applied. Then you'll tackle the essential parts of basic Python programming relevant to data processing and making AI programs. The Tensorflow/Keras library along with Numpy and Scikit-Learn are covered as well. Once you've mastered those basic computer science and programming concepts, you can dive into projects with code, implementation details, and explanations. These projects give you the chance to explore using machine learning algorithms for issues such as predicting the probability of hospital admission from emergency room triage and patient demographic data. We will then use deep learning to determine whether patients have pneumonia using chest X-Ray images. The topics covered in this book not only encompass areas of the medical field where AI is already playing a major role, but also are engineered to cover as much as possible of AI that is relevant to medical diagnostics. Along the way, readers can expect to learn data processing, how to conceptualize problems that can be solved by AI, and how to program solutions to those problems. Physicians and other healthcare professionals who can master these skills will be able to lead AI-based research and diagnostic tool development, ultimately benefiting countless patients.

This book presents the conference proceedings of the 25th edition of the International Joint Conference on Industrial Engineering and Operations Management. The conference is organized by 6 institutions (from different countries and continents) that gather a large number of members in the field of operational management, industrial engineering and engineering management. This edition of the conference had the title: THE NEXT GENERATION OF PRODUCTION AND SERVICE SYSTEMS in order to emphasis unpredictable and very changeable future. This conference is aimed to enhance connection between academia and industry and to gather researchers and practitioners specializing in operation management, industrial engineering, engineering management and other related disciplines from around the world.

This book constitutes the proceedings of the Second International Conference on Spatial Data and Intelligence, SpatialDI 2021, which was held during April 22-24, 2021 in Hangzhou, China.The 14 full papers and 7 short papers presented in this volume were carefully reviewed and selected from 72 submissions. They are organized in the topical sections named: traffic management, data science, and city analysis.

This book highlights selected papers from the Mechanical Engineering track, with a focus on mechatronics and manufacturing, presented at the "Malaysian Technical Universities Conference on Engineering and Technology" (MUCET 2019). The conference brings together researchers and professionals in the fields of engineering, research and technology, providing a platform for future collaborations and the exchange of ideas.

The emerging biotechnologies have significantly advanced the study of biological mechanisms. However, biological data usually contain a great amount of missing information, e.g. missing features, missing labels or missing samples, which greatly limits the extensive usage of the data. In this book, we introduce different types of biological data missing scenarios and propose machine learning models to improve the data analysis, including deep recurrent neural network recovery for feature missings, robust information theoretic learning for label missings and structure-aware rebalancing for minor sample missings. Models in the book cover the fields of imbalance learning, deep learning, recurrent neural network and statistical inference, providing a wide range of references of the integration between artificial intelligence and biology. With simulated and biological datasets, we apply approaches to a variety of biological tasks, including single-cell characterization, genome-wide association studies, medical image segmentations, and quantify the performances in a number of successful metrics.The outline of this book is as follows. In Chapter 2, we introduce the statistical recovery of missing data features; in Chapter 3, we introduce the statistical recovery of missing labels; in Chapter 4, we introduce the statistical recovery of missing data sample information; finally, in Chapter 5, we summarize the full text and outlook future directions. This book can be used as references for researchers in computational biology, bioinformatics and biostatistics. Readers are expected to have basic knowledge of statistics and machine learning.

This book constitutes the proceedings of the 20th China National Conference on Computational Linguistics, CCL 2021, held in Hohhot, China, in August 2021.The 31 full presented in this volume were carefully reviewed and selected from 90 submissions. The conference papers covers the following topics such as Machine Translation and Multilingual Information Processing, Minority Language Information Processing, Social Computing and Sentiment Analysis, Text Generation and Summarization, Information Retrieval, Dialogue and Question Answering, Linguistics and Cognitive Science, Language Resource and Evaluation, Knowledge Graph and Information Extraction, and NLP Applications.

This two-volume set of LNCS 12836 and LNCS 12837 constitutes - in conjunction with the volume LNAI 12838 - the refereed proceedings of the 17th International Conference on Intelligent Computing, ICIC 2021, held in Shenzhen, China in August 2021. The 192 full papers of the three proceedings volumes were carefully reviewed and selected from 458 submissions. The ICIC theme unifies the picture of contemporary intelligent computing techniques as an integral concept that highlights the trends in advanced computational intelligence and bridges theoretical research with applications. The theme for this conference is "Advanced Intelligent Computing Methodologies and Applications." The papers are organized in the following subsections: Evolutionary Computation and Learning, Image and signal Processing, Information Security, Neural Networks, Pattern Recognition Swarm Intelligence and Optimization, and Virtual Reality and Human-Computer Interaction.

This two-volume set of LNCS 12836 and LNCS 12837 constitutes - in conjunction with the volume LNAI 12838 - the refereed proceedings of the 17th International Conference on Intelligent Computing, ICIC 2021, held in Shenzhen, China in August 2021. The 192 full papers of the three proceedings volumes were carefully reviewed and selected from 458 submissions. The ICIC theme unifies the picture of contemporary intelligent computing techniques as an integral concept that highlights the trends in advanced computational intelligence and bridges theoretical research with applications. The theme for this conference is "Advanced Intelligent Computing Methodologies and Applications." The papers are organized in the following subsections: Intelligent Computing in Computer Vision, Intelligent Control and Automation, Intelligent Modeling Technologies for Smart Cities, Machine Learning, and Theoretical Computational Intelligence and Applications.

This book provides a survey of deep learning approaches to domain adaptation in computer vision. It gives the reader an overview of the state-of-the-art research in deep learning based domain adaptation. This book also discusses the various approaches to deep learning based domain adaptation in recent years. It outlines the importance of domain adaptation for the advancement of computer vision, consolidates the research in the area and provides the reader with promising directions for future research in domain adaptation. Divided into four parts, the first part of this book begins with an introduction to domain adaptation, which outlines the problem statement, the role of domain adaptation and the motivation for research in this area. It includes a chapter outlining pre-deep learning era domain adaptation techniques. The second part of this book highlights feature alignment based approaches to domain adaptation. The third part of this book outlines image alignment procedures for domain adaptation. The final section of this book presents novel directions for research in domain adaptation. This book targets researchers working in artificial intelligence, machine learning, deep learning and computer vision. Industry professionals and entrepreneurs seeking to adopt deep learning into their applications will also be interested in this book.