The two volume set LNCS 13052 and 13053 constitutes the refereed proceedings of the 19th International Conference on Computer Analysis of Images and Patterns, CAIP 2021, held virtually, in September 2021. The 87 papers presented were carefully reviewed and selected from 129 submissions. The papers are organized in the following topical sections across the 2 volumes: 3D vision, biomedical image and pattern analysis; machine learning; feature extractions; object recognition; face and gesture, guess the age contest, biometrics, cryptography and security; and segmentation and image restoration.

This open access book provides a comprehensive overview of the state of the art in research and applications of Foundation Models and is intended for readers familiar with basic Natural Language Processing (NLP) concepts.  Over the recent years, a revolutionary new paradigm has been developed for training models for NLP. These models are first pre-trained on large collections of text documents to acquire general syntactic knowledge and semantic information. Then, they are fine-tuned for specific tasks, which they can often solve with superhuman accuracy. When the models are large enough, they can be instructed by prompts to solve new tasks without any fine-tuning. Moreover, they can be applied to a wide range of different media and problem domains, ranging from image and video processing to robot control learning. Because they provide a blueprint for solving many tasks in artificial intelligence, they have been called Foundation Models.  After a brief introduction to basic NLP models the main pre-trained language models BERT, GPT and sequence-to-sequence transformer are described, as well as the concepts of self-attention and context-sensitive embedding. Then, different approaches to improving these models are discussed, such as expanding the pre-training criteria, increasing the length of input texts, or including extra knowledge. An overview of the best-performing models for about twenty application areas is then presented, e.g., question answering, translation, story generation, dialog systems, generating images from text, etc. For each application area, the strengths and weaknesses of current models are discussed, and an outlook on further developments is given. In addition, links are provided to freely available program code. A concluding chapter summarizes the economic opportunities, mitigation of risks, and potential developments of AI.

This book constitutes the refereed proceedings of the 27th China Conference on Information Retrieval, CCIR 2021, held in Dalian, China, in October 2021.The 15 full papers presented were carefully reviewed and selected from 124 submissions. The papers are organized in topical sections: search and recommendation, NLP for IR, IR in Education, and IR in Biomedicine.

Reinforcement and Systemic Machine Learning for Decision Making

There are always difficulties in making machines that learn from experience. Complete information is not always available--or it becomes available in bits and pieces over a period of time. With respect to systemic learning, there is a need to understand the impact of decisions and actions on a system over that period of time. This book takes a holistic approach to addressing that need and presents a new paradigm--creating new learning applications and, ultimately, more intelligent machines.

The first book of its kind in this new and growing field, Reinforcement and Systemic Machine Learning for Decision Making focuses on the specialized research area of machine learning and systemic machine learning. It addresses reinforcement learning and its applications, incremental machine learning, repetitive failure-correction mechanisms, and multiperspective decision making.

Chapters include: Introduction to Reinforcement and Systemic Machine LearningFundamentals of Whole-System, Systemic, and Multiperspective Machine LearningSystemic Machine Learning and ModelInference and Information IntegrationAdaptive LearningIncremental Learning and Knowledge RepresentationKnowledge Augmentation: A Machine Learning PerspectiveBuilding a Learning System With the potential of this paradigm to become one of the more utilized in its field, professionals in the area of machine and systemic learning will find this book to be a valuable resource.

In the last few years the scientific community has realized that obtaining a better understanding of interactions between natural systems and the man-made environment across different scales demands more research efforts in remote sensing. An integrated Earth system observatory that merges surface-based, air-borne, space-borne, and even underground sensors with comprehensive and predictive capabilities indicates promise for revolutionizing the study of global water, energy, and carbon cycles as well as land use and land cover changes. The aim of this book is to present a suite of relevant concepts, tools, and methods of integrated multisensor data fusion and machine learning technologies to promote environmental sustainability. The process of machine learning for intelligent feature extraction consists of regular, deep, and fast learning algorithms. The niche for integrating data fusion and machine learning for remote sensing rests upon the creation of a new scientific architecture in remote sensing science that is designed to support numerical as well as symbolic feature extraction managed by several cognitively oriented machine learning tasks at finer scales. By grouping a suite of satellites with similar nature in platform design, data merging may come to help for cloudy pixel reconstruction over the space domain or concatenation of time series images over the time domain, or even both simultaneously. Organized in 5 parts, from Fundamental Principles of Remote Sensing; Feature Extraction for Remote Sensing; Image and Data Fusion for Remote Sensing; Integrated Data Merging, Data Reconstruction, Data Fusion, and Machine Learning; to Remote Sensing for Environmental Decision Analysis, the book will be a useful reference for graduate students, academic scholars, and working professionals who are involved in the study of Earth systems and the environment for a sustainable future. The new knowledge in this book can be applied successfully in many areas of environmental science and engineering.

Meaningful use of advanced Bayesian methods requires a good understanding of the fundamentals. This engaging book explains the ideas that underpin the construction and analysis of Bayesian models, with particular focus on computational methods and schemes. The unique features of the text are the extensive discussion of available software packages combined with a brief but complete and mathematically rigorous introduction to Bayesian inference. The text introduces Monte Carlo methods, Markov chain Monte Carlo methods, and Bayesian software, with additional material on model validation and comparison, transdimensional MCMC, and conditionally Gaussian models. The inclusion of problems makes the book suitable as a textbook for a first graduate-level course in Bayesian computation with a focus on Monte Carlo methods. The extensive discussion of Bayesian software - R/R-INLA, OpenBUGS, JAGS, STAN, and BayesX - makes it useful also for researchers and graduate students from beyond statistics.

This SpringerBrief presents the underlying principles of machine learning and how to deploy various deep learning tools and techniques to tackle and solve certain challenges facing the cybersecurity industry. By implementing innovative deep learning solutions, cybersecurity researchers, students and practitioners can analyze patterns and learn how to prevent cyber-attacks and respond to changing malware behavior. The knowledge and tools introduced in this brief can also assist cybersecurity teams to become more proactive in preventing threats and responding to active attacks in real time. It can reduce the amount of time spent on routine tasks and enable organizations to use their resources more strategically. In short, the knowledge and techniques provided in this brief can help make cybersecurity simpler, more proactive, less expensive and far more effective Advanced-level students in computer science studying machine learning with a cybersecurity focus will find this SpringerBrief useful as a study guide. Researchers and cybersecurity professionals focusing on the application of machine learning tools and techniques to the cybersecurity domain will also want to purchase this SpringerBrief.

This book covers the essential theory and implementation of popular Bayesian optimization techniques in an intuitive and well-illustrated manner. The techniques covered in this book will enable you to better tune the hyperparemeters of your machine learning models and learn sample-efficient approaches to global optimization. The book begins by introducing different Bayesian Optimization (BO) techniques, covering both commonly used tools and advanced topics. It follows a “develop from scratch� method using Python, and gradually builds up to more advanced libraries such as BoTorch, an open-source project introduced by Facebook recently. Along the way, you’ll see practical implementations of this important discipline along with thorough coverage and straightforward explanations of essential theories. This book intends to bridge the gap between researchers and practitioners, providing both with a comprehensive, easy-to-digest, and useful reference guide. After completing this book, you will have a firm grasp of Bayesian optimization techniques, which you’ll be able to put into practice in your own machine learning models. What You Will Learn Apply Bayesian Optimization to build better machine learning models Understand and research existing and new Bayesian Optimization techniques Leverage high-performance libraries such as BoTorch, which offer you the ability to dig into and edit the inner working Dig into the inner workings of common optimization algorithms used to guide the search process in Bayesian optimization Who This Book Is ForBeginner to intermediate level professionals in machine learning, analytics or other roles relevant in data science.

This book contains a selection of the best papers of the 32nd Benelux Conference on Artificial Intelligence, BNAIC/Benelearn 2020, held in Leiden, The Netherlands, in November 2020. Due to the COVID-19 pandemic the conference was held online. The 12 papers presented in this volume were carefully reviewed and selected from 41 regular submissions. They address various aspects of artificial intelligence such as natural language processing, agent technology, game theory, problem solving, machine learning, human-agent interaction, AI and education, and data analysis. The chapter 11 is published open access under a CC BY license (Creative Commons Attribution 4.0 International License) Chapter "Gaining Insight into Determinants of Physical Activity Using Bayesian Network Learning" is available open access under a Creative Commons Attribution 4.0 International License via link.springer.com..

Learn the science of collecting information to make effective decisions

Everyday decisions are made without the benefit of accurate information. "Optimal Learning "develops the needed principles for gathering information to make decisions, especially when collecting information is time-consuming and expensive. Designed for readers with an elementary background in probability and statistics, the book presents effective and practical policies illustrated in a wide range of applications, from energy, homeland security, and transportation to engineering, health, and business.

This book covers the fundamental dimensions of a learning problem and presents a simple method for testing and comparing policies for learning. Special attention is given to the knowledge gradient policy and its use with a wide range of belief models, including lookup table and parametric and for online and offline problems. Three sections develop ideas with increasing levels of sophistication: Fundamentals explores fundamental topics, including adaptive learning, ranking and selection, the knowledge gradient, and bandit problemsExtensions and Applications features coverage of linear belief models, subset selection models, scalar function optimization, optimal bidding, and stopping problems Advanced Topics explores complex methods including simulation optimization, active learning in mathematical programming, and optimal continuous measurements

Each chapter identifies a specific learning problem, presents the related, practical algorithms for implementation, and concludes with numerous exercises. A related website features additional applications and downloadable software, including MATLAB and the Optimal Learning Calculator, a spreadsheet-based package that provides an introduc-tion to learning and a variety of policies for learning.

The three-volume proceedings set LNCS 13655,13656 and 13657 constitutes the refereedproceedings of the 4th International Conference on Machine Learning for Cyber Security, ML4CS 2022, which taking place during December 2-4, 2022, held in Guangzhou, China. The 100 full papers and 46 short papers were included in these proceedings were carefully reviewed and selected from 367 submissions.

This book constitutes the proceedings of the 11th Workshop on Clinical Image-Based Procedures, CLIP 2022, which was held in conjunction with MICCAI 2022, in Singapore in September 2022. The 9 full papers included in this book were carefully reviewed and selected from 12 submissions. They focus on the applicability of basic research methods in the clinical practice by creating holistic patient models as an important step towards personalized healthcare.

This book provides a concise but comprehensive guide to representation, which forms the core of Machine Learning (ML). State-of-the-art practical applications involve a number of challenges for the analysis of high-dimensional data. Unfortunately, many popular ML algorithms fail to perform, in both theory and practice, when they are confronted with the huge size of the underlying data. Solutions to this problem are aptly covered in the book. In addition, the book covers a wide range of representation techniques that are important for academics and ML practitioners alike, such as Locality Sensitive Hashing (LSH), Distance Metrics and Fractional Norms, Principal Components (PCs), Random Projections and Autoencoders. Several experimental results are provided in the book to demonstrate the discussed techniques' effectiveness.

This book provides a comprehensive overview of core concepts and technological foundations for continuous engineering of Web streams. It presents various systems and applications and includes real-world examples. Last not least, it introduces the readers to RSP4J, a novel open-source project that aims to gather community efforts in software engineering and empirical research. The book starts with an introductory chapter that positions the work by explaining what motivates the design of specific techniques for processing data streams using Web technologies. Chapter 2 briefly summarizes the necessary background concepts and models needed to understand the remaining content of the book. Subsequently, chapter 3 focuses on processing RDF streams, taming data velocity in an open environment characterized by high data variety. It introduces query answering algorithms with RSP-QL and analytics functions over streaming data. Chapter 4 presents the life cycle of streaming linked data, it focuses on publishing streams on the Web as a prerequisite aspect to make data findable and accessible for applications. Chapter 5 touches on the problems of benchmarks and systems that analyze Web streams to foster technological progress. It surveys existing benchmarks and introduces guidelines that may support new practitioners in approaching the issue of continuous analytics. Finally, chapter 6 presents a list of examples and exercises that will help the reader to approach the area, get used to its practices and become confident in its technological possibilities. Overall, this book is mainly written for graduate students and researchers in Web and stream data management. It collects research results and will guide the next generation of researchers and practitioners.

Machine learning (ML) has become a commonplace element in our everyday lives and a standard tool for many fields of science and engineering. To make optimal use of ML, it is essential to understand its underlying principles. This book approaches ML as the computational implementation of the scientific principle. This principle consists of continuously adapting a model of a given data-generating phenomenon by minimizing some form of loss incurred by its predictions. The book trains readers to break down various ML applications and methods in terms of data, model, and loss, thus helping them to choose from the vast range of ready-made ML methods. The book's three-component approach to ML provides uniform coverage of a wide range of concepts and techniques. As a case in point, techniques for regularization, privacy-preservation as well as explainability amount to specific design choices for the model, data, and loss of a ML method.

The three-volume proceedings set LNCS 13655,13656 and 13657 constitutes the refereedproceedings of the 4th International Conference on Machine Learning for Cyber Security, ML4CS 2022, which taking place during December 2-4, 2022, held in Guangzhou, China. The 100 full papers and 46 short papers were included in these proceedings were carefully reviewed and selected from 367 submissions.

Computational approaches to music composition and style imitation have engaged musicians, music scholars, and computer scientists since the early days of computing. Music generation research has generally employed one of two strategies: knowledge-based methods that model style through explicitly formalized rules, and data mining methods that apply machine learning to induce statistical models of musical style. The five chapters in this book illustrate the range of tasks and design choices in current music generation research applying machine learning techniques and highlighting recurring research issues such as training data, music representation, candidate generation, and evaluation. The contributions focus on different aspects of modeling and generating music, including melody, chord sequences, ornamentation, and dynamics. Models are induced from audio data or symbolic data. This book was originally published as a special issue of the Journal of Mathematics and Music.

This volume offers a wealth of interdisciplinary approaches to artificial intelligence, machine learning and optimization tools, which contribute to the optimization of urban features towards forming smart, sustainable, and livable future cities. Special features include: New research on the design of city elements and smart systems with respect to new technologies and scientific thinking Discussions on the theoretical background that lead to smart cities for the future New technologies and principles of research that can promote ideas of artificial intelligence and machine learning in optimized urban environments The book engages students and researchers in the subjects of artificial intelligence, machine learning, and optimization tools in smart sustainable cities as eminent international experts contribute their research results and thinking in its chapters. Overall, its audience can benefit from a variety of disciplines including, architecture, engineering, physics, mathematics, computer science, and related fields.

The book discusses various aspects of biophysics. It starts from the popular article on neurobiology to quantum biology and ends up with the consciousness of a human being and in the universe. The authors have covered eight nine different aspects of natural intelligence, starting from time crystal found in the chemical biology to the vibrations and the resonance of proteins. They have covered a wide spectrum of hierarchical communication among different biological systems. Most importantly, authors have taken an utmost care that even school-level students fall in love with biophysics; it is simple and more of a textbook and definitely bring the readers to a world of biology and physics like never before. Most authors are experienced academicians, and they have used lucid and simple language to make the content interesting for the readers.

As explored in this open access book, higher education in STEM fields is influenced by many factors, including education research, government and school policies, financial considerations, technology limitations, and acceptance of innovations by faculty and students. In 2018, Drs. Ryoo and Winkelmann explored the opportunities, challenges, and future research initiatives of innovative learning environments (ILEs) in higher education STEM disciplines in their pioneering project: eXploring the Future of Innovative Learning Environments (X-FILEs). Workshop participants evaluated four main ILE categories: personalized and adaptive learning, multimodal learning formats, cross/extended reality (XR), and artificial intelligence (AI) and machine learning (ML). This open access book gathers the perspectives expressed during the X-FILEs workshop and its follow-up activities. It is designed to help inform education policy makers, researchers, developers, and practitioners about the adoption and implementation of ILEs in higher education.

Hawkes processes are studied and used in a wide range of disciplines: mathematics, social sciences, and earthquake modelling, to name a few. This book presents a selective coverage of the core and recent topics in the broad field of Hawkes processes. It consists of three parts. Parts I and II summarise and provide an overview of core theory (including key simulation methods) and inference methods, complemented by a selection of recent research developments and applications. Part III is devoted to case studies in seismology and finance that connect the core theory and inference methods to practical scenarios. This book is designed primarily for applied probabilists, statisticians, and machine learners. However, the mathematical prerequisites have been kept to a minimum so that the content will also be of interest to undergraduates in advanced mathematics and statistics, as well as machine learning practitioners. Knowledge of matrix theory with basics of probability theory, including Poisson processes, is considered a prerequisite. Colour-blind-friendly illustrations are included.

This book provides a valuable combination of relevant research works on developing smart city ecosystem from the artificial intelligence (AI) and Internet of things (IoT) perspective. The technical research works presented here are focused on a number of aspects of smart cities: smart mobility, smart living, smart environment, smart citizens, smart government, and smart waste management systems as well as related technologies and concepts. This edited book offers critical insight to the key underlying research themes within smart cities, highlighting the limitations of current developments and potential future directions.

An Introduction to the Machine Learning Empowered Intelligent Data Center Networking Fundamentals of Machine Learning in Data Center Networks. This book reviews the common learning paradigms that are widely used in data centernetworks, and offers an introduction to data collection and data processing in data centers. Additionally, it proposes a multi-dimensional and multi-perspective solution quality assessment system called REBEL-3S. The book offers readers a solid foundation for conducting research in the field of AI-assisted data center networks. Comprehensive Survey of AI-assisted Intelligent Data Center Networks. This book comprehensively investigates the peer-reviewed literature published in recent years. The wide range of machine learning techniques is fully reflected to allow fair comparisons. In addition, the book provides in-depth analysis and enlightening discussions on the effectiveness of AI in DCNs from various perspectives, covering flow prediction, flow classification, load balancing, resource management, energy management, routing optimization, congestion control, fault management, and network security.Provides a Broad Overview with Key Insights. This book introduces several novel intelligent networking concepts pioneered by real-world industries, such as Knowledge Defined Networks, Self-Driving Networks, Intent-driven Networks and Intent-based Networks. Moreover, it shares unique insights into the technological evolution of the fusion of artificial intelligence and data center networks, together with selected challenges and future research opportunities.

This edited book is a collection of selected research papers presented at the 2022 3rd International Conference on Artificial Intelligence in Education Technology (AIET 2022), held in Wuhan, China, on July 1-3, 2022. AIET establishes a platform for AI in education researchers to present research, exchange innovative ideas, propose new models, as well as demonstrate advanced methodologies and novel systems. The book is divided into five main sections - 1) AI in Education in the Post-COVID New Norm, 2) Emerging AI Technologies, Methods, Systems and Infrastructure, 3) Innovative Practices of Teaching and Assessment Driven by AI and Education Technologies, 4) Curriculum, Teacher Professional Development and Policy for AI in Education, and 5) Issues and Discussions on AI In Education and Future Development. Through these sections, the book provides a comprehensive picture of the current status, emerging trends, innovations, theory, applications, challenges and opportunities of current AI in education research. This timely publication is well aligned with UNESCO's Beijing Consensus on Artificial Intelligence (AI) and Education. It is committed to exploring how AI may play a role in bringing more innovative practices, transforming education in the post-pandemic new norm and triggering an exponential leap toward the achievement of the Education 2030 Agenda. Providing broad coverage of recent technology-driven advances and addressing a number of learning-centric themes, the book is an informative and useful resource for researchers, practitioners, education leaders and policy-makers who are involved or interested in AI and education.

This book describes a novel machine-learning based approach to answer some traditional archaeological problems, relating to archaeological site detection and site locational preferences. Institutional data collected from six Swiss regions (Zurich, Aargau, Grisons, Vaud, Geneva and Fribourg) have been analyzed with an original conceptual framework based on the Random Forest algorithm. It is shown how the algorithm can assist in the modelling process in connection with heterogeneous, incomplete archaeological datasets and related cultural heritage information. Moreover, an in-depth review of past and more recent works of quantitative methods for archaeological predictive modelling is provided. The book guides the readers to set up their own protocol for: i) dealing with uncertain data, ii) predicting archaeological site location, iii) establishing environmental features importance, iv) and suggest a model validation procedure. It addresses both academics and professionals in archaeology and cultural heritage management, and offers a source of inspiration for future research directions in the field of digital humanities and computational archaeology.