The multi-volume set LNAI 12975 until 12979 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2021, which was held during September 13-17, 2021. The conference was originally planned to take place in Bilbao, Spain, but changed to an online event due to the COVID-19 pandemic. The 210 full papers presented in these proceedings were carefully reviewed and selected from a total of 869 submissions. The volumes are organized in topical sections as follows: Research Track: Part I: Online learning; reinforcement learning; time series, streams, and sequence models; transfer and multi-task learning; semi-supervised and few-shot learning; learning algorithms and applications. Part II: Generative models; algorithms and learning theory; graphs and networks; interpretation, explainability, transparency, safety. Part III: Generative models; search and optimization; supervised learning; text mining and natural language processing; image processing, computer vision and visual analytics. Applied Data Science Track: Part IV: Anomaly detection and malware; spatio-temporal data; e-commerce and finance; healthcare and medical applications (including Covid); mobility and transportation. Part V: Automating machine learning, optimization, and feature engineering; machine learning based simulations and knowledge discovery; recommender systems and behavior modeling; natural language processing; remote sensing, image and video processing; social media.

The multi-volume set LNAI 12975 until 12979 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2021, which was held during September 13-17, 2021. The conference was originally planned to take place in Bilbao, Spain, but changed to an online event due to the COVID-19 pandemic. The 210 full papers presented in these proceedings were carefully reviewed and selected from a total of 869 submissions. The volumes are organized in topical sections as follows: Research Track: Part I: Online learning; reinforcement learning; time series, streams, and sequence models; transfer and multi-task learning; semi-supervised and few-shot learning; learning algorithms and applications. Part II: Generative models; algorithms and learning theory; graphs and networks; interpretation, explainability, transparency, safety. Part III: Generative models; search and optimization; supervised learning; text mining and natural language processing; image processing, computer vision and visual analytics. Applied Data Science Track: Part IV: Anomaly detection and malware; spatio-temporal data; e-commerce and finance; healthcare and medical applications (including Covid); mobility and transportation. Part V: Automating machine learning, optimization, and feature engineering; machine learning based simulations and knowledge discovery; recommender systems and behavior modeling; natural language processing; remote sensing, image and video processing; social media.

This four-volume set of LNCS 12821, LNCS 12822, LNCS 12823 and LNCS 12824, constitutes the refereed proceedings of the 16th International Conference on Document Analysis and Recognition, ICDAR 2021, held in Lausanne, Switzerland in September 2021. The 182 full papers were carefully reviewed and selected from 340 submissions, and are presented with 13 competition reports. The papers are organized into the following topical sections: historical document analysis, document analysis systems, handwriting recognition, scene text detection and recognition, document image processing, natural language processing (NLP) for document understanding, and graphics, diagram and math recognition.

The increasing abundance of large high-quality datasets, combined with significant technical advances over the last several decades have made machine learning into a major tool employed across a broad array of tasks including vision, language, finance, and security. However, success has been accompanied with important new challenges: many applications of machine learning are adversarial in nature. Some are adversarial because they are safety critical, such as autonomous driving. An adversary in these applications can be a malicious party aimed at causing congestion or accidents, or may even model unusual situations that expose vulnerabilities in the prediction engine. Other applications are adversarial because their task and/or the data they use are. For example, an important class of problems in security involves detection, such as malware, spam, and intrusion detection. The use of machine learning for detecting malicious entities creates an incentive among adversaries to evade detection by changing their behavior or the content of malicius objects they develop. The field of adversarial machine learning has emerged to study vulnerabilities of machine learning approaches in adversarial settings and to develop techniques to make learning robust to adversarial manipulation. This book provides a technical overview of this field. After reviewing machine learning concepts and approaches, as well as common use cases of these in adversarial settings, we present a general categorization of attacks on machine learning. We then address two major categories of attacks and associated defenses: decision-time attacks, in which an adversary changes the nature of instances seen by a learned model at the time of prediction in order to cause errors, and poisoning or training time attacks, in which the actual training dataset is maliciously modified. In our final chapter devoted to technical content, we discuss recent techniques for attacks on deep learning, as well as approaches for improving robustness of deep neural networks. We conclude with a discussion of several important issues in the area of adversarial learning that in our view warrant further research. Given the increasing interest in the area of adversarial machine learning, we hope this book provides readers with the tools necessary to successfully engage in research and practice of machine learning in adversarial settings.

This book constitutes the thoroughly refereed proceedings of the 5th International Conference on Information and Knowledge Systems, ICIKS 2021, which was held online during June 22-23, 2021.The International Conference on Information and Knowledge Systems (ICIKS 2021) gathered both researchers and practitioners in the fields of Information Systems, Artificial Intelligence, Knowledge Management and Decision Support. ICIKS seeks to promote discussions on various organizational, technological, and socio-cultural aspects of research in the design and use of information and knowledge systems in organizations. The 10 full and 2 short papers presented in this volume were carefully reviewed and selected from 32 submissions. They were organized in topical sections as follows: knowledge systems and decision making; machine learning, recommender systems, and knowledge systems; and security, artificial intelligence, and information systems.

This book focuses on methods that are unsupervised or require minimal supervision-vital in the low-resource domain. Over the past few years, rapid growth in Internet access across the globe has resulted in an explosion in user-generated text content in social media platforms. This effect is significantly pronounced in linguistically diverse areas of the world like South Asia, where over 400 million people regularly access social media platforms. YouTube, Facebook, and Twitter report a monthly active user base in excess of 200 million from this region. Natural language processing (NLP) research and publicly available resources such as models and corpora prioritize Web content authored primarily by a Western user base. Such content is authored in English by a user base fluent in the language and can be processed by a broad range of off-the-shelf NLP tools. In contrast, text from linguistically diverse regions features high levels of multilinguality, code-switching, and varied language skill levels. Resources like corpora and models are also scarce. Due to these factors, newer methods are needed to process such text. This book is designed for NLP practitioners well versed in recent advances in the field but unfamiliar with the landscape of low-resource multilingual NLP. The contents of this book introduce the various challenges associated with social media content, quantify these issues, and provide solutions and intuition. When possible, the methods discussed are evaluated on real-world social media data sets to emphasize their robustness to the noisy nature of the social media environment. On completion of the book, the reader will be well-versed with the complexity of text-mining in multilingual, low-resource environments; will be aware of a broad set of off-the-shelf tools that can be applied to various problems; and will be able to conduct sophisticated analyses of such text.

Succeed on the AWS Machine Learning exam or in your next job as a machine learning specialist on the AWS Cloud platform with this hands-on guide As the most popular cloud service in the world today, Amazon Web Services offers a wide range of opportunities for those interested in the development and deployment of artificial intelligence and machine learning business solutions. The AWS Certified Machine Learning Study Guide: Specialty (MLS-CO1) Exam delivers hyper-focused, authoritative instruction for anyone considering the pursuit of the prestigious Amazon Web Services Machine Learning certification or a new career as a machine learning specialist working within the AWS architecture. From exam to interview to your first day on the job, this study guide provides the domain-by-domain specific knowledge you need to build, train, tune, and deploy machine learning models with the AWS Cloud. And with the practice exams and assessments, electronic flashcards, and supplementary online resources that accompany this Study Guide, you'll be prepared for success in every subject area covered by the exam. You'll also find: An intuitive and organized layout perfect for anyone taking the exam for the first time or seasoned professionals seeking a refresher on machine learning on the AWS Cloud Authoritative instruction on a widely recognized certification that unlocks countless career opportunities in machine learning and data science Access to the Sybex online learning resources and test bank, with chapter review questions, a full-length practice exam, hundreds of electronic flashcards, and a glossary of key terms AWS Certified Machine Learning Study Guide: Specialty (MLS-CO1) Exam is an indispensable guide for anyone seeking to prepare themselves for success on the AWS Certified Machine Learning Specialty exam or for a job interview in the field of machine learning, or who wishes to improve their skills in the field as they pursue a career in AWS machine learning.

The unification of symbolist and connectionist models is a major trend in AI. The key is to keep the symbolic semantics unchanged. Unfortunately, present embedding approaches cannot. The approach in this book makes the unification possible. It is indeed a new and promising approach in AI. -Bo Zhang, Director of AI Institute, Tsinghua It is indeed wonderful to see the reviving of the important theme Nural Symbolic Model. Given the popularity and prevalence of deep learning, symbolic processing is often neglected or downplayed. This book confronts this old issue head on, with a historical look, incorporating recent advances and new perspectives, thus leading to promising new methods and approaches. -Ron Sun (RPI), on Governing Board of Cognitive Science Society Both for language and humor, approaches like those described in this book are the way to snickerdoodle wombats. -Christian F. Hempelmann (Texas A&M-Commerce) on Executive Board of International Society for Humor Studies

Learn how to harness modern deep-learning methods in many contexts. Packed with intuitive theory, practical implementation methods, and deep-learning case studies, this book reveals how to acquire the tools you need to design and implement like a deep-learning architect. It covers tools deep learning engineers can use in a wide range of fields, from biology to computer vision to business. With nine in-depth case studies, this book will ground you in creative, real-world deep learning thinking. You'll begin with a structured guide to using Keras, with helpful tips and best practices for making the most of the framework. Next, you'll learn how to train models effectively with transfer learning and self-supervised pre-training. You will then learn how to use a variety of model compressions for practical usage. Lastly, you will learn how to design successful neural network architectures and creatively reframe difficult problems into solvable ones. You'll learn not only to understand and apply methods successfully but to think critically about it. Modern Deep Learning Design and Methods is ideal for readers looking to utilize modern, flexible, and creative deep-learning design and methods. Get ready to design and implement innovative deep-learning solutions to today's difficult problems. What You'll Learn Improve the performance of deep learning models by using pre-trained models, extracting rich features, and automating optimization. Compress deep learning models while maintaining performance. Reframe a wide variety of difficult problems and design effective deep learning solutions to solve them. Use the Keras framework, with some help from libraries like HyperOpt, TensorFlow, and PyTorch, to implement a wide variety of deep learning approaches. Who This Book Is For Data scientists with some familiarity with deep learning to deep learning engineers seeking structured inspiration and direction on their next project. Developers interested in harnessing modern deep learning methods to solve a variety of difficult problems.

Master the new features in PySpark 3.1 to develop data-driven, intelligent applications. This updated edition covers topics ranging from building scalable machine learning models, to natural language processing, to recommender systems. Machine Learning with PySpark, Second Edition begins with the fundamentals of Apache Spark, including the latest updates to the framework. Next, you will learn the full spectrum of traditional machine learning algorithm implementations, along with natural language processing and recommender systems. You'll gain familiarity with the critical process of selecting machine learning algorithms, data ingestion, and data processing to solve business problems. You'll see a demonstration of how to build supervised machine learning models such as linear regression, logistic regression, decision trees, and random forests. You'll also learn how to automate the steps using Spark pipelines, followed by unsupervised models such as K-means and hierarchical clustering. A section on Natural Language Processing (NLP) covers text processing, text mining, and embeddings for classification. This new edition also introduces Koalas in Spark and how to automate data workflow using Airflow and PySpark's latest ML library. After completing this book, you will understand how to use PySpark's machine learning library to build and train various machine learning models, along with related components such as data ingestion, processing and visualization to develop data-driven intelligent applications What you will learn: Build a spectrum of supervised and unsupervised machine learning algorithms Use PySpark's machine learning library to implement machine learning and recommender systems Leverage the new features in PySpark's machine learning library Understand data processing using Koalas in Spark Handle issues around feature engineering, class balance, bias and variance, and cross validation to build optimally fit models Who This Book Is For Data science and machine learning professionals.

Practical AI for Healthcare Professionals Artificial Intelligence (AI) is a buzzword in the healthcare sphere today. However, notions of what AI actually is and how it works are often not discussed. Furthermore, information on AI implementation is often tailored towards seasoned programmers rather than the healthcare professional/beginner coder. This book gives an introduction to practical AI in the medical sphere, focusing on real-life clinical problems, how to solve them with actual code, and how to evaluate the efficacy of those solutions. You'll start by learning how to diagnose problems as ones that can and cannot be solved with AI. You'll then learn the basics of computer science algorithms, neural networks, and when each should be applied. Then you'll tackle the essential parts of basic Python programming relevant to data processing and making AI programs. The Tensorflow/Keras library along with Numpy and Scikit-Learn are covered as well. Once you've mastered those basic computer science and programming concepts, you can dive into projects with code, implementation details, and explanations. These projects give you the chance to explore using machine learning algorithms for issues such as predicting the probability of hospital admission from emergency room triage and patient demographic data. We will then use deep learning to determine whether patients have pneumonia using chest X-Ray images. The topics covered in this book not only encompass areas of the medical field where AI is already playing a major role, but also are engineered to cover as much as possible of AI that is relevant to medical diagnostics. Along the way, readers can expect to learn data processing, how to conceptualize problems that can be solved by AI, and how to program solutions to those problems. Physicians and other healthcare professionals who can master these skills will be able to lead AI-based research and diagnostic tool development, ultimately benefiting countless patients.

This book presents the conference proceedings of the 25th edition of the International Joint Conference on Industrial Engineering and Operations Management. The conference is organized by 6 institutions (from different countries and continents) that gather a large number of members in the field of operational management, industrial engineering and engineering management. This edition of the conference had the title: THE NEXT GENERATION OF PRODUCTION AND SERVICE SYSTEMS in order to emphasis unpredictable and very changeable future. This conference is aimed to enhance connection between academia and industry and to gather researchers and practitioners specializing in operation management, industrial engineering, engineering management and other related disciplines from around the world.

This book constitutes the proceedings of the Second International Conference on Spatial Data and Intelligence, SpatialDI 2021, which was held during April 22-24, 2021 in Hangzhou, China.The 14 full papers and 7 short papers presented in this volume were carefully reviewed and selected from 72 submissions. They are organized in the topical sections named: traffic management, data science, and city analysis.

This book highlights selected papers from the Mechanical Engineering track, with a focus on mechatronics and manufacturing, presented at the "Malaysian Technical Universities Conference on Engineering and Technology" (MUCET 2019). The conference brings together researchers and professionals in the fields of engineering, research and technology, providing a platform for future collaborations and the exchange of ideas.

The emerging biotechnologies have significantly advanced the study of biological mechanisms. However, biological data usually contain a great amount of missing information, e.g. missing features, missing labels or missing samples, which greatly limits the extensive usage of the data. In this book, we introduce different types of biological data missing scenarios and propose machine learning models to improve the data analysis, including deep recurrent neural network recovery for feature missings, robust information theoretic learning for label missings and structure-aware rebalancing for minor sample missings. Models in the book cover the fields of imbalance learning, deep learning, recurrent neural network and statistical inference, providing a wide range of references of the integration between artificial intelligence and biology. With simulated and biological datasets, we apply approaches to a variety of biological tasks, including single-cell characterization, genome-wide association studies, medical image segmentations, and quantify the performances in a number of successful metrics.The outline of this book is as follows. In Chapter 2, we introduce the statistical recovery of missing data features; in Chapter 3, we introduce the statistical recovery of missing labels; in Chapter 4, we introduce the statistical recovery of missing data sample information; finally, in Chapter 5, we summarize the full text and outlook future directions. This book can be used as references for researchers in computational biology, bioinformatics and biostatistics. Readers are expected to have basic knowledge of statistics and machine learning.

This book constitutes the proceedings of the 20th China National Conference on Computational Linguistics, CCL 2021, held in Hohhot, China, in August 2021.The 31 full presented in this volume were carefully reviewed and selected from 90 submissions. The conference papers covers the following topics such as Machine Translation and Multilingual Information Processing, Minority Language Information Processing, Social Computing and Sentiment Analysis, Text Generation and Summarization, Information Retrieval, Dialogue and Question Answering, Linguistics and Cognitive Science, Language Resource and Evaluation, Knowledge Graph and Information Extraction, and NLP Applications.

This two-volume set of LNCS 12836 and LNCS 12837 constitutes - in conjunction with the volume LNAI 12838 - the refereed proceedings of the 17th International Conference on Intelligent Computing, ICIC 2021, held in Shenzhen, China in August 2021. The 192 full papers of the three proceedings volumes were carefully reviewed and selected from 458 submissions. The ICIC theme unifies the picture of contemporary intelligent computing techniques as an integral concept that highlights the trends in advanced computational intelligence and bridges theoretical research with applications. The theme for this conference is "Advanced Intelligent Computing Methodologies and Applications." The papers are organized in the following subsections: Evolutionary Computation and Learning, Image and signal Processing, Information Security, Neural Networks, Pattern Recognition Swarm Intelligence and Optimization, and Virtual Reality and Human-Computer Interaction.

This two-volume set of LNCS 12836 and LNCS 12837 constitutes - in conjunction with the volume LNAI 12838 - the refereed proceedings of the 17th International Conference on Intelligent Computing, ICIC 2021, held in Shenzhen, China in August 2021. The 192 full papers of the three proceedings volumes were carefully reviewed and selected from 458 submissions. The ICIC theme unifies the picture of contemporary intelligent computing techniques as an integral concept that highlights the trends in advanced computational intelligence and bridges theoretical research with applications. The theme for this conference is "Advanced Intelligent Computing Methodologies and Applications." The papers are organized in the following subsections: Intelligent Computing in Computer Vision, Intelligent Control and Automation, Intelligent Modeling Technologies for Smart Cities, Machine Learning, and Theoretical Computational Intelligence and Applications.

This book provides a survey of deep learning approaches to domain adaptation in computer vision. It gives the reader an overview of the state-of-the-art research in deep learning based domain adaptation. This book also discusses the various approaches to deep learning based domain adaptation in recent years. It outlines the importance of domain adaptation for the advancement of computer vision, consolidates the research in the area and provides the reader with promising directions for future research in domain adaptation. Divided into four parts, the first part of this book begins with an introduction to domain adaptation, which outlines the problem statement, the role of domain adaptation and the motivation for research in this area. It includes a chapter outlining pre-deep learning era domain adaptation techniques. The second part of this book highlights feature alignment based approaches to domain adaptation. The third part of this book outlines image alignment procedures for domain adaptation. The final section of this book presents novel directions for research in domain adaptation. This book targets researchers working in artificial intelligence, machine learning, deep learning and computer vision. Industry professionals and entrepreneurs seeking to adopt deep learning into their applications will also be interested in this book.

The most crucial ability for machine learning and data science is mathematical logic for grasping their essence rather than knowledge and experience. This textbook approaches the essence of sparse estimation by considering math problems and building R programs. Each chapter introduces the notion of sparsity and provides procedures followed by mathematical derivations and source programs with examples of execution. To maximize readers' insights into sparsity, mathematical proofs are presented for almost all propositions, and programs are described without depending on any packages. The book is carefully organized to provide the solutions to the exercises in each chapter so that readers can solve the total of 100 exercises by simply following the contents of each chapter. This textbook is suitable for an undergraduate or graduate course consisting of about 15 lectures (90 mins each). Written in an easy-to-follow and self-contained style, this book will also be perfect material for independent learning by data scientists, machine learning engineers, and researchers interested in linear regression, generalized linear lasso, group lasso, fused lasso, graphical models, matrix decomposition, and multivariate analysis. This book is one of a series of textbooks in machine learning by the same author. Other titles are: - Statistical Learning with Math and R (https://www.springer.com/gp/book/9789811575679) - Statistical Learning with Math and Python (https://www.springer.com/gp/book/9789811578762) - Sparse Estimation with Math and Python

This book is a compendium of the proceedings of the International Conference on Big-Data and Cloud Computing. The papers discuss the recent advances in the areas of big data analytics, data analytics in cloud, smart cities and grid, etc. This volume primarily focuses on the application of knowledge which promotes ideas for solving problems of the society through cutting-edge big-data technologies. The essays featured in this proceeding provide novel ideas that contribute for the growth of world class research and development. It will be useful to researchers in the area of advanced engineering sciences.

At the dawn of the 4th Industrial Revolution, the field of Deep Learning (a sub-field of Artificial Intelligence and Machine Learning) is growing continuously and rapidly, developing both theoretically and towards applications in increasingly many and diverse other disciplines. The book at hand aims at exposing its reader to some of the most significant recent advances in deep learning-based technological applications and consists of an editorial note and an additional fifteen (15) chapters. All chapters in the book were invited from authors who work in the corresponding chapter theme and are recognized for their significant research contributions. In more detail, the chapters in the book are organized into six parts, namely (1) Deep Learning in Sensing, (2) Deep Learning in Social Media and IOT, (3) Deep Learning in the Medical Field, (4) Deep Learning in Systems Control, (5) Deep Learning in Feature Vector Processing, and (6) Evaluation of Algorithm Performance. This research book is directed towards professors, researchers, scientists, engineers and students in computer science-related disciplines. It is also directed towards readers who come from other disciplines and are interested in becoming versed in some of the most recent deep learning-based technological applications. An extensive list of bibliographic references at the end of each chapter guides the readers to probe deeper into their application areas of interest.

This book highlights both theoretical and applied advances in cellular learning automata (CLA), a type of hybrid computational model that has been successfully employed in various areas to solve complex problems and to model, learn, or simulate complicated patterns of behavior. Owing to CLA's parallel and learning abilities, it has proven to be quite effective in uncertain, time-varying, decentralized, and distributed environments. The book begins with a brief introduction to various CLA models, before focusing on recently developed CLA variants. In turn, the research areas related to CLA are addressed as bibliometric network analysis perspectives. The next part of the book presents CLA-based solutions to several computer science problems in e.g. static optimization, dynamic optimization, wireless networks, mesh networks, and cloud computing. Given its scope, the book is well suited for all researchers in the fields of artificial intelligence and reinforcement learning.

This book constitutes the thoroughly refereed post-workshop proceedings of the 21st Chinese Lexical Semantics Workshop, CLSW 2020, held in Hong Kong, China in May 2020.Due to COVID-19, the conference was held virtually. The 76 full papers included in this volume were carefully reviewed and selected from 233 submissions. They are organized in the following topical sections: Lexical semantics and general linguistics, AI, Big Data, and NLP, Cognitive Science and experimental studies.

This book discusses the smooth integration of optical and RF networks in 5G and beyond (5G+) heterogeneous networks (HetNets), covering both planning and operational aspects. The integration of high-frequency air interfaces into 5G+ wireless networks can relieve the congested radio frequency (RF) bands. Visible light communication (VLC) is now emerging as a promising candidate for future generations of HetNets. Heterogeneous RF-optical networks combine the high throughput of visible light and the high reliability of RF. However, when implementing these HetNets in mobile scenarios, several challenges arise from both planning and operational perspectives. Since the mmWave, terahertz, and visible light bands share similar wave propagation characteristics, the concepts presented here can be broadly applied in all such bands. To facilitate the planning of RF-optical HetNets, the authors present an algorithm that specifies the joint optimal densities of the base stations by drawing on stochastic geometry in order to satisfy the users' quality-of-service (QoS) demands with minimum network power consumption. From an operational perspective, the book explores vertical handovers and multi-homing using a cooperative framework. For vertical handovers, it employs a data-driven approach based on deep neural networks to predict abrupt optical outages; and, on the basis of this prediction, proposes a reinforcement learning strategy that ensures minimal network latency during handovers. In terms of multi-homing support, the authors examine the aggregation of the resources from both optical and RF networks, adopting a two-timescale multi-agent reinforcement learning strategy for optimal power allocation. Presenting comprehensive planning and operational strategies, the book allows readers to gain an in-depth grasp of how to integrate future coexisting networks at high-frequency bands in a cooperative manner, yielding reliable and high-speed 5G+ HetNets.