This open access book provides a wealth of hands-on examples that illustrate how hyperparameter tuning can be applied in practice and gives deep insights into the working mechanisms of machine learning (ML) and deep learning (DL) methods. The aim of the book is to equip readers with the ability to achieve better results with significantly less time, costs, effort and resources using the methods described here. The case studies presented in this book can be run on a regular desktop or notebook computer. No high-performance computing facilities are required. The idea for the book originated in a study conducted by Bartz & Bartz GmbH for the Federal Statistical Office of Germany (Destatis). Building on that study, the book is addressed to practitioners in industry as well as researchers, teachers and students in academia. The content focuses on the hyperparameter tuning of ML and DL algorithms, and is divided into two main parts: theory (Part I) and application (Part II). Essential topics covered include: a survey of important model parameters; four parameter tuning studies and one extensive global parameter tuning study; statistical analysis of the performance of ML and DL methods based on severity; and a new, consensus-ranking-based way to aggregate and analyze results from multiple algorithms. The book presents analyses of more than 30 hyperparameters from six relevant ML and DL methods, and provides source code so that users can reproduce the results. Accordingly, it serves as a handbook and textbook alike.

This book involves a collection of selected papers presented at International Conference on Machine Learning and Autonomous Systems (ICMLAS 2021), held in Tamil Nadu, India, during 24-25 September 2021. It includes novel and innovative work from experts, practitioners, scientists and decision-makers from academia and industry. It covers selected papers in the area of emerging modern mobile robotic systems and intelligent information systems and autonomous systems in agriculture, health care, education, military and industries.

Someday computers will be artists. They'll be able to write amusing and original stories, invent and play games of unsurpassed complexity and inventiveness, tell jokes and suffer writer's block. But these things will require computers that can both achieve artistic goals and be creative. Both capabilities are far from accomplished.
This book presents a theory of creativity that addresses some of the many hard problems which must be solved to build a creative computer. It also presents an exploration of the kinds of goals and plans needed to write simple short stories. These theories have been implemented in a computer program called MINSTREL which tells stories about King Arthur and his knights. While far from being the silicon author of the future, MINSTREL does illuminate many of the interesting and difficult issues involved in constructing a creative computer.
The results presented here should be of interest to at least three different groups of people. Artificial intelligence researchers should find this work an interesting application of symbolic AI to the problems of story-telling and creativity. Psychologists interested in creativity and imagination should benefit from the attempt to build a detailed, explicit model of the creative process. Finally, authors and others interested in how people write should find MINSTREL's model of the author-level writing process thought-provoking.

This monograph offers an original broad and very diverse exploration of the seriation domain in data analysis, together with building a specific relation to clustering.Relative to a data table crossing a set of objects and a set of descriptive attributes, the search for orders which correspond respectively to these two sets is formalized mathematically and statistically. State-of-the-art methods are created and compared with classical methods and a thorough understanding of the mutual relationships between these methods is clearly expressed. The authors distinguish two families of methods: Geometric representation methods Algorithmic and Combinatorial methods Original and accurate methods are provided in the framework for both families. Their basis and comparison is made on both theoretical and experimental levels. The experimental analysis is very varied and very comprehensive. Seriation in Combinatorial and Statistical Data Analysis has a unique character in the literature falling within the fields of Data Analysis, Data Mining and Knowledge Discovery. It will be a valuable resource for students and researchers in the latter fields.

This book offers a practical introduction to the use of artificial intelligence (AI) techniques to improve and optimise the various phases of the software development process, from the initial project planning to the latest deployment. All chapters were written by leading experts in the field and include practical and reproducible examples. Following the introductory chapter, Chapters 2-9 respectively apply AI techniques to the classic phases of the software development process: project management, requirement engineering, analysis and design, coding, cloud deployment, unit and system testing, and maintenance. Subsequently, Chapters 10 and 11 provide foundational tutorials on the AI techniques used in the preceding chapters: metaheuristics and machine learning. Given its scope and focus, the book represents a valuable resource for researchers, practitioners and students with a basic grasp of software engineering.

This book provides a valuable combination of relevant research works on developing smart city ecosystem from the artificial intelligence (AI) and Internet of things (IoT) perspective. The technical research works presented here are focused on a number of aspects of smart cities: smart mobility, smart living, smart environment, smart citizens, smart government, and smart waste management systems as well as related technologies and concepts. This edited book offers critical insight to the key underlying research themes within smart cities, highlighting the limitations of current developments and potential future directions.

This book provides a comprehensive introduction to processing-in-memory (PIM) technology, from its architectures to circuits implementations on multiple memory types and describes how it can be a viable computer architecture in the era of AI and big data. The authors summarize the challenges of AI hardware systems, processing-in-memory (PIM) constraints and approaches to derive system-level requirements for a practical and feasible PIM solution. The presentation focuses on feasible PIM solutions that can be implemented and used in real systems, including architectures, circuits, and implementation cases for each major memory type (SRAM, DRAM, and ReRAM).

The juxtaposition of 'machine learning' and 'pure mathematics and theoretical physics' may first appear as contradictory in terms. The rigours of proofs and derivations in the latter seem to reside in a different world from the randomness of data and statistics in the former. Yet, an often under-appreciated component of mathematical discovery, typically not presented in a final draft, is experimentation: both with ideas and with mathematical data. Think of the teenage Gauss, who conjectured the Prime Number Theorem by plotting the prime-counting function, many decades before complex analysis was formalized to offer a proof.Can modern technology in part mimic Gauss's intuition? The past five years saw an explosion of activity in using AI to assist the human mind in uncovering new mathematics: finding patterns, accelerating computations, and raising conjectures via the machine learning of pure, noiseless data. The aim of this book, a first of its kind, is to collect research and survey articles from experts in this emerging dialogue between theoretical mathematics and machine learning. It does not dwell on the well-known multitude of mathematical techniques in deep learning, but focuses on the reverse relationship: how machine learning helps with mathematics. Taking a panoramic approach, the topics range from combinatorics to number theory, and from geometry to quantum field theory and string theory. Aimed at PhD students as well as seasoned researchers, each self-contained chapter offers a glimpse of an exciting future of this symbiosis.

This book gives a comprehensive view of graph theory in informational retrieval (IR) and natural language processing(NLP). This book provides number of graph techniques for IR and NLP applications with examples. It also provides understanding of graph theory basics, graph algorithms and networks using graph. The book is divided into three parts and contains nine chapters. The first part gives graph theory basics and graph networks, and the second part provides basics of IR with graph-based information retrieval. The third part covers IR and NLP recent and emerging applications with case studies using graph theory. This book is unique in its way as it provides a strong foundation to a beginner in applying mathematical structure graph for IR and NLP applications. All technical details that include tools and technologies used for graph algorithms and implementation in Information Retrieval and Natural Language Processing with its future scope are explained in a clear and organized format.

Entering the field of artificial intelligence and data science can seem daunting to beginners with little to no prior background, especially those with no programming experience. The concepts used in self-driving cars and virtual assistants like Amazon's Alexa may seem very complex and difficult to grasp. The aim of Artificial Intelligence in Python is to make AI accessible and easy to understand for people with little to no programming experience though practical exercises. Newcomers will gain the necessary knowledge on how to create such systems, which are capable of executing tasks that require some form of human-like intelligence. This book introduces readers to various topics and examples of programming in Python, as well as key concepts in artificial intelligence. Python programming skills will be imparted as we go along. Concepts and code snippets will be covered in a step-by-step manner, to guide and instill confidence in beginners. Complex subjects in deep learning and machine learning will be broken down into easy-to-digest content and examples. Artificial intelligence implementations will also be shared, allowing beginners to generate their own artificial intelligence algorithms for reinforcement learning, style transfer, chatbots, speech, and natural language processing.

This is the first book primarily dedicated to clustering using multiobjective genetic algorithms with extensive real-life applications in data mining and bioinformatics. The authors first offer detailed introductions to the relevant techniques - genetic algorithms, multiobjective optimization, soft computing, data mining and bioinformatics. They then demonstrate systematic applications of these techniques to real-world problems in the areas of data mining, bioinformatics and geoscience. The authors offer detailed theoretical and statistical notes, guides to future research, and chapter summaries. The book can be used as a textbook and as a reference book by graduate students and academic and industrial researchers in the areas of soft computing, data mining, bioinformatics and geoscience.

This book highlights recent advance in the area of Machine Learning and IoT, and their applications to solve societal issues/problems or useful for various users in the society. It is known that many smart devices are interconnected and the data generated is being analyzed and processed with machine learning models for prediction, classification, etc., to solve human needs in various sectors like health, road safety, agriculture, and education. This contributed book puts together chapters concerning the use of intelligent techniques in various aspects related to the IoT domain from protocols to applications, to give the reader an up-to-date picture of the state-of-the-art on the connection between computational intelligence, machine learning, and IoT.

This book provides a collection of recent research works addressing theoretical issues on improving the learning process and the generalization of GANs as well as state-of-the-art applications of GANs to various domains of real life. Adversarial learning fascinates the attention of machine learning communities across the world in recent years. Generative adversarial networks (GANs), as the main method of adversarial learning, achieve great success and popularity by exploiting a minimax learning concept, in which two networks compete with each other during the learning process. Their key capability is to generate new data and replicate available data distributions, which are needed in many practical applications, particularly in computer vision and signal processing. The book is intended for academics, practitioners, and research students in artificial intelligence looking to stay up to date with the latest advancements on GANs' theoretical developments and their applications.

For some time, all branches of the military have used a wide range of sensors to provide data for many purposes, including surveillance, reconnoitring, target detection and battle damage assessment. Many nations have also attempted to utilise these sensors for civilian applications, such as crop monitoring, agricultural disease tracking, environmental diagnostics, cartography, ocean temperature profiling, urban planning, and the characterisation of the Ozone Hole above Antarctica. The recent convergence of several important technologies has made possible new, advanced, high performance, sensor based applications relying on the near-simultaneous fusion of data from an ensemble of different types of sensors. The book examines the underlying principles of sensor operation and data fusion, the techniques and technologies that enable the process, including the operation of 'fusion engines'. Fundamental theory and the enabling technologies of data fusion are presented in a systematic and accessible manner. Applications are discussed in the areas of medicine, meteorology, BDA and targeting, transportation, cartography, the environment, agriculture, and manufacturing and process control.

Machine Learning and Pattern Recognition Methods in Chemistry from Multivariate and Data Driven Modeling outlines key knowledge in this area, combining critical introductory approaches with the latest advanced techniques. Beginning with an introduction of univariate and multivariate statistical analysis, the book then explores multivariate calibration and validation methods. Soft modeling in chemical data analysis, hyperspectral data analysis, and autoencoder applications in analytical chemistry are then discussed, providing useful examples of the techniques in chemistry applications. Drawing on the knowledge of a global team of researchers, this book will be a helpful guide for chemists interested in developing their skills in multivariate data and error analysis.

This book collects different methodologies that permit metaheuristics and machine learning to solve real-world problems. This book has exciting chapters that employ evolutionary and swarm optimization tools combined with machine learning techniques. The fields of applications are from distribution systems until medical diagnosis, and they are also included different surveys and literature reviews that will enrich the reader. Besides, cutting-edge methods such as neuroevolutionary and IoT implementations are presented in some chapters. In this sense, the book provides theory and practical content with novel machine learning and metaheuristic algorithms. The chapters were compiled using a scientific perspective. Accordingly, the book is primarily intended for undergraduate and postgraduate students of Science, Engineering, and Computational Mathematics and can be used in courses on Artificial Intelligence, Advanced Machine Learning, among others. Likewise, the material can be helpful for research from the evolutionary computation, artificial intelligence communities.

This volumes presents the proceedings of the FASMI 2020 conference, held at Taipei Veterans General Hospital on November 20-22, 2020. It presents contributions on all aspects of molecular imaging, discovered by leading academic scientists and researchers. It also provides a premier interdisciplinary treatment of recent innovations, trend, and concerns as well as practical challenges and solutions in Molecular Imaging and put an emphasis on Artificial Intelligence applied to Imaging Data. FASMI is the annual meeting of the Federation of Asian Societies for Molecular Imaging

Multimedia Streaming in SDN/NFV and 5G Networks A comprehensive overview of Quality of Experience control and management of multimedia services in future networks In Multimedia Streaming in SDN/NFV and 5G Networks, renowned researchers deliver a high-level exploration of Quality of Experience (QoE) control and management solutions for multimedia services in future softwarized and virtualized 5G networks. The book offers coverage of network softwarization and virtualization technologies, including SDN, NFV, MEC, and Fog/Cloud Computing, as critical elements for the management of multimedia services in future networks, like 5G and 6G networks and beyond. Providing a fulsome examination of end-to-end QoE control and management solutions in softwarized and virtualized networks, the book concludes with discussions of probable future challenges and research directions in emerging multimedia services and applications, 5G network management and orchestration, network slicing and collaborative service management of multimedia services in softwarized networks, and QoE-oriented business models. The distinguished authors also explore: Thorough introductions to 5G networks, including definitions and requirements, as well as Quality of Experience management of multimedia streaming services Comprehensive explorations of multimedia streaming services over the internet and network softwarization and virtualization in future networks Practical discussions of QoE management using SDN and NFV in future networks, as well as QoE management of multimedia services in emerging architectures, including MEC, ICN, and Fog/Cloud Computing In-depth examinations of QoE in emerging applications, 5G network slicing architectures and implementations, and 5G network slicing orchestration and resource management Perfect for researchers and engineers in multimedia services and telecoms, Multimedia Streaming in SDN/NFV and 5G Networks will also earn a place in the libraries of graduate and senior undergraduate students with interests in computer science, communication engineering, and telecommunication systems.

The book reports on a novel approach for holistically identifying the relevant state drivers of complex, multi-stage manufacturing systems. This approach is able to utilize complex, diverse and high-dimensional data sets, which often occur in manufacturing applications, and to integrate the important process intra- and interrelations. The approach has been evaluated using three scenarios from different manufacturing domains (aviation, chemical and semiconductor). The results, which are reported in detail in this book, confirmed that it is possible to incorporate implicit process intra- and interrelations on both a process and programme level by applying SVM-based feature ranking. In practice, this method can be used to identify the most important process parameters and state characteristics, the so-called state drivers, of a manufacturing system. Given the increasing availability of data and information, this selection support can be directly utilized in, e.g., quality monitoring and advanced process control. Importantly, the method is neither limited to specific products, manufacturing processes or systems, nor by specific quality concepts.

This book summarizes the state-of-the-art in unsupervised learning. The contributors discuss how with the proliferation of massive amounts of unlabeled data, unsupervised learning algorithms, which can automatically discover interesting and useful patterns in such data, have gained popularity among researchers and practitioners. The authors outline how these algorithms have found numerous applications including pattern recognition, market basket analysis, web mining, social network analysis, information retrieval, recommender systems, market research, intrusion detection, and fraud detection. They present how the difficulty of developing theoretically sound approaches that are amenable to objective evaluation have resulted in the proposal of numerous unsupervised learning algorithms over the past half-century. The intended audience includes researchers and practitioners who are increasingly using unsupervised learning algorithms to analyze their data. Topics of interest include anomaly detection, clustering, feature extraction, and applications of unsupervised learning. Each chapter is contributed by a leading expert in the field.

This book provides tools and algorithms for solving a wide class of optimization tasks by learning from their repetitions. A unified framework is provided for learning algorithms that are based on the stochastic gradient (a golden standard in learning), including random simultaneous perturbations and the response surface the methodology. Original algorithms include model-free learning of short decision sequences as well as long sequences-relying on model-supported gradient estimation. Learning is based on whole sequences of a process observation that are either vectors or images. This methodology is applicable to repetitive processes, covering a wide range from (additive) manufacturing to decision making for COVID-19 waves mitigation. A distinctive feature of the algorithms is learning between repetitions-this idea extends the paradigms of iterative learning and run-to-run control. The main ideas can be extended to other decision learning tasks, not included in this book. The text is written in a comprehensible way with the emphasis on a user-friendly presentation of the algorithms, their explanations, and recommendations on how to select them. The book is expected to be of interest to researchers, Ph.D., and graduate students in computer science and engineering, operations research, decision making, and those working on the iterative learning control.

Quantum-enhanced machine learning refers to quantum algorithms that solve tasks in machine learning, thereby improving a classical machine learning method. Such algorithms typically require one to encode the given classical dataset into a quantum computer, so as to make it accessible for quantum information processing. After this, quantum information processing routines can be applied and the result of the quantum computation is read out by measuring the quantum system. While many proposals of quantum machine learning algorithms are still purely theoretical and require a full-scale universal quantum computer to be tested, others have been implemented on small-scale or special purpose quantum devices.

This book offers a comprehensible overview of Big Data Preprocessing, which includes a formal description of each problem. It also focuses on the most relevant proposed solutions. This book illustrates actual implementations of algorithms that helps the reader deal with these problems. This book stresses the gap that exists between big, raw data and the requirements of quality data that businesses are demanding. This is called Smart Data, and to achieve Smart Data the preprocessing is a key step, where the imperfections, integration tasks and other processes are carried out to eliminate superfluous information. The authors present the concept of Smart Data through data preprocessing in Big Data scenarios and connect it with the emerging paradigms of IoT and edge computing, where the end points generate Smart Data without completely relying on the cloud. Finally, this book provides some novel areas of study that are gathering a deeper attention on the Big Data preprocessing. Specifically, it considers the relation with Deep Learning (as of a technique that also relies in large volumes of data), the difficulty of finding the appropriate selection and concatenation of preprocessing techniques applied and some other open problems. Practitioners and data scientists who work in this field, and want to introduce themselves to preprocessing in large data volume scenarios will want to purchase this book. Researchers that work in this field, who want to know which algorithms are currently implemented to help their investigations, may also be interested in this book.

Humans have the most advanced method of communication, which is known as natural language. While humans can use computers to send voice and text messages to each other, computers do not innately know how to process natural language. In recent years, deep learning has primarily transformed the perspectives of a variety of fields in artificial intelligence (AI), including speech, vision, and natural language processing (NLP). The extensive success of deep learning in a wide variety of applications has served as a benchmark for the many downstream tasks in AI. The field of computer vision has taken great leaps in recent years and surpassed humans in tasks related to detecting and labeling objects thanks to advances in deep learning and neural networks. Deep Learning Research Applications for Natural Language Processing explains the concepts and state-of-the-art research in the fields of NLP, speech, and computer vision. It provides insights into using the tools and libraries in Python for real-world applications. Covering topics such as deep learning algorithms, neural networks, and advanced prediction, this premier reference source is an excellent resource for computational linguists, software engineers, IT managers, computer scientists, students and faculty of higher education, libraries, researchers, and academicians.