With the development of Big Data platforms for managing massive amount of data and wide availability of tools for processing these data, the biggest limitation is the lack of trained experts who are qualified to process and interpret the results. This textbook is intended for graduate students and experts using methods of cluster analysis and applications in various fields. Suitable for an introductory course on cluster analysis or data mining, with an in-depth mathematical treatment that includes discussions on different measures, primitives (points, lines, etc.) and optimization-based clustering methods, Cluster Analysis and Applications also includes coverage of deep learning based clustering methods. With clear explanations of ideas and precise definitions of concepts, accompanied by numerous examples and exercises together with Mathematica programs and modules, Cluster Analysis and Applications may be used by students and researchers in various disciplines, working in data analysis or data science.

This book constitutes the thoroughly refereed post-workshop proceedings of the 21st Chinese Lexical Semantics Workshop, CLSW 2020, held in Hong Kong, China in May 2020.Due to COVID-19, the conference was held virtually. The 76 full papers included in this volume were carefully reviewed and selected from 233 submissions. They are organized in the following topical sections: Lexical semantics and general linguistics, AI, Big Data, and NLP, Cognitive Science and experimental studies.

The significantly expanded and updated new edition of a widely used text on reinforcement learning, one of the most active research areas in artificial intelligence. Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives while interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the field's key ideas and algorithms. This second edition has been significantly expanded and updated, presenting new topics and updating coverage of other topics. Like the first edition, this second edition focuses on core online learning algorithms, with the more mathematical material set off in shaded boxes. Part I covers as much of reinforcement learning as possible without going beyond the tabular case for which exact solutions can be found. Many algorithms presented in this part are new to the second edition, including UCB, Expected Sarsa, and Double Learning. Part II extends these ideas to function approximation, with new sections on such topics as artificial neural networks and the Fourier basis, and offers expanded treatment of off-policy learning and policy-gradient methods. Part III has new chapters on reinforcement learning's relationships to psychology and neuroscience, as well as an updated case-studies chapter including AlphaGo and AlphaGo Zero, Atari game playing, and IBM Watson's wagering strategy. The final chapter discusses the future societal impacts of reinforcement learning.

Machine Learning and Data Science in the Oil and Gas Industry explains how machine learning can be specifically tailored to oil and gas use cases. Petroleum engineers will learn when to use machine learning, how it is already used in oil and gas operations, and how to manage the data stream moving forward. Practical in its approach, the book explains all aspects of a data science or machine learning project, including the managerial parts of it that are so often the cause for failure. Several real-life case studies round out the book with topics such as predictive maintenance, soft sensing, and forecasting. Viewed as a guide book, this manual will lead a practitioner through the journey of a data science project in the oil and gas industry circumventing the pitfalls and articulating the business value.

This book constitutes the proceedings of the Third International Workshop on Explainable, Transparent AI and Multi-Agent Systems, EXTRAAMAS 2021, which was held virtually due to the COVID-19 pandemic. The 19 long revised papers and 1 short contribution were carefully selected from 32 submissions. The papers are organized in the following topical sections: XAI & machine learning; XAI vision, understanding, deployment and evaluation; XAI applications; XAI logic and argumentation; decentralized and heterogeneous XAI.

The book will focus on the applications of machine learning for sustainable development. Machine learning (ML) is an emerging technique whose diffusion and adoption in various sectors (such as energy, agriculture, internet of things, infrastructure) will be of enormous benefit. The state of the art of machine learning models is most useful for forecasting and prediction of various sectors for sustainable development.

This book constitutes the refereed proceedings of the 35th Annual IFIP WG 11.3 Conference on Data and Applications Security and Privacy, DBSec 2021, held in Calgary, Canada, in July 2021.*The 15 full papers and 8 short papers presented were carefully reviewed and selected from 45 submissions. The papers present high-quality original research from academia, industry, and government on theoretical and practical aspects of information security. They are organized in topical sections named differential privacy, cryptology, machine learning, access control and others. *The conference was held virtually due to the COVID-19 pandemic.

This book provides readers the "big picture" and a comprehensive survey of the domain of big data processing systems. For the past decade, the Hadoop framework has dominated the world of big data processing, yet recently academia and industry have started to recognize its limitations in several application domains and thus, it is now gradually being replaced by a collection of engines that are dedicated to specific verticals (e.g. structured data, graph data, and streaming data). The book explores this new wave of systems, which it refers to as Big Data 2.0 processing systems. After Chapter 1 presents the general background of the big data phenomena, Chapter 2 provides an overview of various general-purpose big data processing systems that allow their users to develop various big data processing jobs for different application domains. In turn, Chapter 3 examines various systems that have been introduced to support the SQL flavor on top of the Hadoop infrastructure and provide competing and scalable performance in the processing of large-scale structured data. Chapter 4 discusses several systems that have been designed to tackle the problem of large-scale graph processing, while the main focus of Chapter 5 is on several systems that have been designed to provide scalable solutions for processing big data streams, and on other sets of systems that have been introduced to support the development of data pipelines between various types of big data processing jobs and systems. Next, Chapter 6 focuses on covering the emerging frameworks and systems in the domain of scalable machine learning and deep learning processing. Lastly, Chapter 7 shares conclusions and an outlook on future research challenges. This new and considerably enlarged second edition not only contains the completely new chapter 6, but also offers a refreshed content for the state-of-the-art in all domains of big data processing over the last years. Overall, the book offers a valuable reference guide for professional, students, and researchers in the domain of big data processing systems. Further, its comprehensive content will hopefully encourage readers to pursue further research on the subject.

This book introduces machine learning methods in finance. It presents a unified treatment of machine learning and various statistical and computational disciplines in quantitative finance, such as financial econometrics and discrete time stochastic control, with an emphasis on how theory and hypothesis tests inform the choice of algorithm for financial data modeling and decision making. With the trend towards increasing computational resources and larger datasets, machine learning has grown into an important skillset for the finance industry. This book is written for advanced graduate students and academics in financial econometrics, mathematical finance and applied statistics, in addition to quants and data scientists in the field of quantitative finance. Machine Learning in Finance: From Theory to Practice is divided into three parts, each part covering theory and applications. The first presents supervised learning for cross-sectional data from both a Bayesian and frequentist perspective. The more advanced material places a firm emphasis on neural networks, including deep learning, as well as Gaussian processes, with examples in investment management and derivative modeling. The second part presents supervised learning for time series data, arguably the most common data type used in finance with examples in trading, stochastic volatility and fixed income modeling. Finally, the third part presents reinforcement learning and its applications in trading, investment and wealth management. Python code examples are provided to support the readers' understanding of the methodologies and applications. The book also includes more than 80 mathematical and programming exercises, with worked solutions available to instructors. As a bridge to research in this emergent field, the final chapter presents the frontiers of machine learning in finance from a researcher's perspective, highlighting how many well-known concepts in statistical physics are likely to emerge as important methodologies for machine learning in finance.

This book constitutes the refereed proceedings of the 25th Conference on Medical Image Understanding and Analysis, MIUA 2021, held in July 2021. Due to COVID-19 pandemic the conference was held virtually. The 32 full papers and 8 short papers presented were carefully reviewed and selected from 77 submissions. They were organized according to following topical sections: biomarker detection; image registration, and reconstruction; image segmentation; generative models, biomedical simulation and modelling; classification; image enhancement, quality assessment, and data privacy; radiomics, predictive models, and quantitative imaging.

This book constitutes the proceedings of the 14th International Conference on Social, Cultural, and Behavioral Modeling, SBP-BRiMS 2021, which was held online during July 6-9, 2021.The 32 full papers presented in this volume were carefully reviewed and selected from 56 submissions. The papers were organized in topical sections as follows: COVID-related focus; methodologies; social cybersecurity and social networks; and human and agent modeling. They represent a wide number of disciplines including computer science, psychology, sociology, communication science, public health, bioinformatics, political science, and organizational science. Numerous types of computational methods are used including, but not limited to, machine learning, language technology, social network analysis and visualization, agent-based simulation, and statistics.

Sometime in the future the intelligence of machines will exceed that of human brain power. So are we on the edge of an AI-pocalypse, with superintelligent devices superseding humanity, as predicted by Stephen Hawking? Or will this herald a kind of Utopia, with machines doing a far better job at complex tasks than us? You might not realise it, but you interact with AIs every day. They route your phone calls, approve your credit card transactions and help your doctor interpret results. Driverless cars will soon be on the roads with a decision-making computer in charge. But how do machines actually think and learn? In Machines That Think, AI experts and New Scientist explore how artificial intelligence helps us understand human intelligence, machines that compose music and write stories - and ask if AI is really a threat. ABOUT THE SERIES New Scientist Instant Expert books are definitive and accessible entry points to the most important subjects in science; subjects that challenge, attract debate, invite controversy and engage the most enquiring minds. Designed for curious readers who want to know how things work and why, the Instant Expert series explores the topics that really matter and their impact on individuals, society, and the planet, translating the scientific complexities around us into language that's open to everyone, and putting new ideas and discoveries into perspective and context.

Hardware Accelerator Systems for Artificial Intelligence and Machine Learning, Volume 122 delves into arti?cial Intelligence and the growth it has seen with the advent of Deep Neural Networks (DNNs) and Machine Learning. Updates in this release include chapters on Hardware accelerator systems for artificial intelligence and machine learning, Introduction to Hardware Accelerator Systems for Artificial Intelligence and Machine Learning, Deep Learning with GPUs, Edge Computing Optimization of Deep Learning Models for Specialized Tensor Processing Architectures, Architecture of NPU for DNN, Hardware Architecture for Convolutional Neural Network for Image Processing, FPGA based Neural Network Accelerators, and much more.

Machine Learning, Big Data, and IoT for Medical Informatics focuses on the latest techniques adopted in the field of medical informatics. In medical informatics, machine learning, big data, and IOT-based techniques play a significant role in disease diagnosis and its prediction. In the medical field, the structure of data is equally important for accurate predictive analytics due to heterogeneity of data such as ECG data, X-ray data, and image data. Thus, this book focuses on the usability of machine learning, big data, and IOT-based techniques in handling structured and unstructured data. It also emphasizes on the privacy preservation techniques of medical data. This volume can be used as a reference book for scientists, researchers, practitioners, and academicians working in the field of intelligent medical informatics. In addition, it can also be used as a reference book for both undergraduate and graduate courses such as medical informatics, machine learning, big data, and IoT.

This book constitutes the refereed proceedings of the 11th International Conference on Functional Imaging and Modeling of the Heart, which took place online during June 21-24, 2021, organized by the University of Stanford. The 65 revised full papers were carefully reviewed and selected from 68 submissions. They were organized in topical sections as follows: advanced cardiac and cardiovascular image processing; cardiac microstructure: measures and models; novel approaches to measuring heart deformation; cardiac mechanics: measures and models; translational cardiac mechanics; modeling electrophysiology, ECG, and arrhythmia; cardiovascular flow: measures and models; and atrial microstructure, modeling, and thrombosis prediction.

This book constitutes the refereed proceedings of the 26th International Conference on Applications of Natural Language to Information Systems, NLDB 2021, held online in July 2021. The 19 full papers and 14 short papers were carefully reviewed and selected from 82 submissions. The papers are organized in the following topical sections: role of learning; methodological approaches; semantic relations; classification; sentiment analysis; social media; linking documents; multimodality; applications.

This brief highlights the use of various Machine Learning (ML) algorithms to evaluate training and competitional strategies in Volleyball, as well as to identify high-performance players in the sport. Several psychological elements/strategies coupled with human performance parameters are discussed in view to ascertain their impact on performance in elite Volleyball competitions. It presents key performance indicators as well as human performance parameters that can be used in future evaluation of team performance and players. The details outlined in this brief are vital to coaches, club managers, talent identification experts, performance analysts as well as other important stakeholders in the evaluation of performance and to foster improvement in this sport.

The two-volume set LNCS 12765-12766 constitutes the refereed proceedings of the thematic area Human Interface and the Management of Information, HIMI 2021, which was held as part of HCI International 2021 and took place virtually during July 24-29, 2021.The total of 1276 papers and 241 posters included in the 39 HCII 2021 proceedings volumes was carefully reviewed and selected from 5222 submissions. The papers included in the HCII-HIMI volume set were organized in topical sections as follows: Part I: Information presentation; visualization and decision making support; information in VR and multimodal user interfaces; Part II: Learning in information-rich environments; supporting work, collaboration and design; intelligent information environments.

This book constitutes the refereed proceedings of the Second International Conference on Artificial Intelligence in HCI, AI-HCI 2021, which was held as part of HCI International 2021 and took place virtually during July 24-29, 2021.The total of 1276 papers and 241 posters included in the 39 HCII 2021 proceedings volumes was carefully reviewed and selected from 5222 submissions. The papers included in this volume were organized in topical sections as follows: Ethics, trust and explainability; human-centered AI; AI applications in HCI; and AI applications in smart environments.

This open access book covers the use of data science, including advanced machine learning, big data analytics, Semantic Web technologies, natural language processing, social media analysis, time series analysis, among others, for applications in economics and finance. In addition, it shows some successful applications of advanced data science solutions used to extract new knowledge from data in order to improve economic forecasting models. The book starts with an introduction on the use of data science technologies in economics and finance and is followed by thirteen chapters showing success stories of the application of specific data science methodologies, touching on particular topics related to novel big data sources and technologies for economic analysis (e.g. social media and news); big data models leveraging on supervised/unsupervised (deep) machine learning; natural language processing to build economic and financial indicators; and forecasting and nowcasting of economic variables through time series analysis. This book is relevant to all stakeholders involved in digital and data-intensive research in economics and finance, helping them to understand the main opportunities and challenges, become familiar with the latest methodological findings, and learn how to use and evaluate the performances of novel tools and frameworks. It primarily targets data scientists and business analysts exploiting data science technologies, and it will also be a useful resource to research students in disciplines and courses related to these topics. Overall, readers will learn modern and effective data science solutions to create tangible innovations for economic and financial applications.

This open access book covers the use of data science, including advanced machine learning, big data analytics, Semantic Web technologies, natural language processing, social media analysis, time series analysis, among others, for applications in economics and finance. In addition, it shows some successful applications of advanced data science solutions used to extract new knowledge from data in order to improve economic forecasting models. The book starts with an introduction on the use of data science technologies in economics and finance and is followed by thirteen chapters showing success stories of the application of specific data science methodologies, touching on particular topics related to novel big data sources and technologies for economic analysis (e.g. social media and news); big data models leveraging on supervised/unsupervised (deep) machine learning; natural language processing to build economic and financial indicators; and forecasting and nowcasting of economic variables through time series analysis. This book is relevant to all stakeholders involved in digital and data-intensive research in economics and finance, helping them to understand the main opportunities and challenges, become familiar with the latest methodological findings, and learn how to use and evaluate the performances of novel tools and frameworks. It primarily targets data scientists and business analysts exploiting data science technologies, and it will also be a useful resource to research students in disciplines and courses related to these topics. Overall, readers will learn modern and effective data science solutions to create tangible innovations for economic and financial applications.

This book constitutes revised and selected papers from the scientific satellite events held in conjunction with the18th International Conference on Service-Oriented Computing, ICSOC 2020. The conference was held virtually during December 14-17, 2020. A total of 125 submissions were received for the satellite events. The volume includes 9 papers from the PhD Symposium Track, 4 papers from the Demonstration Track, and 45 papers from the following workshops: International Workshop on Artificial Intelligence for IT Operations (AIOps) International Workshop on Cyber Forensics and Threat Investigations Challenges in Emerging Infrastructures (CFTIC 2020) 2nd Workshop on Smart Data Integration and Processing (STRAPS 2020) International Workshop on AI-enabled Process Automation (AI-PA 2020) International Workshop on Artificial Intelligence in the IoT Security Services (AI-IOTS 2020)

The three-volume set LNCS 12771-12773 constitutes the refereed proceedings of the 13th International Conference on Cross-Cultural Design, CCD 2021, which was held as part of HCI International 2021 and took place virtually during July 24-29, 2021.The total of 1276 papers and 241 posters included in the 39 HCII 2021 proceedings volumes was carefully reviewed and selected from 5222 submissions. The papers included in the HCII-CCD volume set were organized in topical sections as follows: Part I: Cross-cultural experience design; cross-cultural product design; cultural differences and cross-cultural communication; Part II: Culture, arts and creativity; culture, learning and well-being; social change and social development; Part III: CCD in cultural heritage and tourism; CCD in autonomous vehicles and driving; CCD in virtual agents, robots and intelligent assistants.

The three-volume set LNCS 12771-12773 constitutes the refereed proceedings of the 13th International Conference on Cross-Cultural Design, CCD 2021, which was held as part of HCI International 2021 and took place virtually during July 24-29, 2021.The total of 1276 papers and 241 posters included in the 39 HCII 2021 proceedings volumes was carefully reviewed and selected from 5222 submissions. The papers included in the HCII-CCD volume set were organized in topical sections as follows: Part I: Cross-cultural experience design; cross-cultural product design; cultural differences and cross-cultural communication; Part II: Culture, arts and creativity; culture, learning and well-being; social change and social development; Part III: CCD in cultural heritage and tourism; CCD in autonomous vehicles and driving; CCD in virtual agents, robots and intelligent assistants.

Learning to solve sequential decision-making tasks is difficult. Humans take years exploring the environment essentially in a random way until they are able to reason, solve difficult tasks, and collaborate with other humans towards a common goal. Artificial Intelligent agents are like humans in this aspect. Reinforcement Learning (RL) is a well-known technique to train autonomous agents through interactions with the environment. Unfortunately, the learning process has a high sample complexity to infer an effective actuation policy, especially when multiple agents are simultaneously actuating in the environment. However, previous knowledge can be leveraged to accelerate learning and enable solving harder tasks. In the same way humans build skills and reuse them by relating different tasks, RL agents might reuse knowledge from previously solved tasks and from the exchange of knowledge with other agents in the environment. In fact, virtually all of the most challenging tasks currently solved by RL rely on embedded knowledge reuse techniques, such as Imitation Learning, Learning from Demonstration, and Curriculum Learning. This book surveys the literature on knowledge reuse in multiagent RL. The authors define a unifying taxonomy of state-of-the-art solutions for reusing knowledge, providing a comprehensive discussion of recent progress in the area. In this book, readers will find a comprehensive discussion of the many ways in which knowledge can be reused in multiagent sequential decision-making tasks, as well as in which scenarios each of the approaches is more efficient. The authors also provide their view of the current low-hanging fruit developments of the area, as well as the still-open big questions that could result in breakthrough developments. Finally, the book provides resources to researchers who intend to join this area or leverage those techniques, including a list of conferences, journals, and implementation tools. This book will be useful for a wide audience; and will hopefully promote new dialogues across communities and novel developments in the area.