The four-volume proceedings LNCS 13108, 13109, 13110, and 13111 constitutes the proceedings of the 28th International Conference on Neural Information Processing, ICONIP 2021, which was held during December 8-12, 2021. The conference was planned to take place in Bali, Indonesia but changed to an online format due to the COVID-19 pandemic. The total of 226 full papers presented in these proceedings was carefully reviewed and selected from 1093 submissions. The papers were organized in topical sections as follows: Part I: Theory and algorithms; Part II: Theory and algorithms; human centred computing; AI and cybersecurity; Part III: Cognitive neurosciences; reliable, robust, and secure machine learning algorithms; theory and applications of natural computing paradigms; advances in deep and shallow machine learning algorithms for biomedical data and imaging; applications; Part IV: Applications.

The four-volume proceedings LNCS 13108, 13109, 13110, and 13111 constitutes the proceedings of the 28th International Conference on Neural Information Processing, ICONIP 2021, which was held during December 8-12, 2021. The conference was planned to take place in Bali, Indonesia but changed to an online format due to the COVID-19 pandemic. The total of 226 full papers presented in these proceedings was carefully reviewed and selected from 1093 submissions. The papers were organized in topical sections as follows: Part I: Theory and algorithms; Part II: Theory and algorithms; human centred computing; AI and cybersecurity; Part III: Cognitive neurosciences; reliable, robust, and secure machine learning algorithms; theory and applications of natural computing paradigms; advances in deep and shallow machine learning algorithms for biomedical data and imaging; applications; Part IV: Applications.

The four-volume proceedings LNCS 13108, 13109, 13110, and 13111 constitutes the proceedings of the 28th International Conference on Neural Information Processing, ICONIP 2021, which was held during December 8-12, 2021. The conference was planned to take place in Bali, Indonesia but changed to an online format due to the COVID-19 pandemic. The total of 226 full papers presented in these proceedings was carefully reviewed and selected from 1093 submissions. The papers were organized in topical sections as follows: Part I: Theory and algorithms; Part II: Theory and algorithms; human centred computing; AI and cybersecurity; Part III: Cognitive neurosciences; reliable, robust, and secure machine learning algorithms; theory and applications of natural computing paradigms; advances in deep and shallow machine learning algorithms for biomedical data and imaging; applications; Part IV: Applications.

This book proposes tools for analysis of multidimensional and metric data, by establishing a state-of-the-art of the existing solutions and developing new ones. It mainly focuses on visual exploration of these data by a human analyst, relying on a 2D or 3D scatter plot display obtained through Dimensionality Reduction. Performing diagnosis of an energy system requires identifying relations between observed monitoring variables and the associated internal state of the system. Dimensionality reduction, which allows to represent visually a multidimensional dataset, constitutes a promising tool to help domain experts to analyse these relations. This book reviews existing techniques for visual data exploration and dimensionality reduction such as tSNE and Isomap, and proposes new solutions to challenges in that field. In particular, it presents the new unsupervised technique ASKI and the supervised methods ClassNeRV and ClassJSE. Moreover, MING, a new approach for local map quality evaluation is also introduced. These methods are then applied to the representation of expert-designed fault indicators for smart-buildings, I-V curves for photovoltaic systems and acoustic signals for Li-ion batteries.

This handbook discusses challenges and limitations in existing solutions, and presents state-of-the-art advances from both academia and industry, in big data analytics and digital forensics. The second chapter comprehensively reviews IoT security, privacy, and forensics literature, focusing on IoT and unmanned aerial vehicles (UAVs). The authors propose a deep learning-based approach to process cloud's log data and mitigate enumeration attacks in the third chapter. The fourth chapter proposes a robust fuzzy learning model to protect IT-based infrastructure against advanced persistent threat (APT) campaigns. Advanced and fair clustering approach for industrial data, which is capable of training with huge volume of data in a close to linear time is introduced in the fifth chapter, as well as offering an adaptive deep learning model to detect cyberattacks targeting cyber physical systems (CPS) covered in the sixth chapter. The authors evaluate the performance of unsupervised machine learning for detecting cyberattacks against industrial control systems (ICS) in chapter 7, and the next chapter presents a robust fuzzy Bayesian approach for ICS's cyber threat hunting. This handbook also evaluates the performance of supervised machine learning methods in identifying cyberattacks against CPS. The performance of a scalable clustering algorithm for CPS's cyber threat hunting and the usefulness of machine learning algorithms for MacOS malware detection are respectively evaluated. This handbook continues with evaluating the performance of various machine learning techniques to detect the Internet of Things malware. The authors demonstrate how MacOSX cyberattacks can be detected using state-of-the-art machine learning models. In order to identify credit card frauds, the fifteenth chapter introduces a hybrid model. In the sixteenth chapter, the editors propose a model that leverages natural language processing techniques for generating a mapping between APT-related reports and cyber kill chain. A deep learning-based approach to detect ransomware is introduced, as well as a proposed clustering approach to detect IoT malware in the last two chapters. This handbook primarily targets professionals and scientists working in Big Data, Digital Forensics, Machine Learning, Cyber Security Cyber Threat Analytics and Cyber Threat Hunting as a reference book. Advanced level-students and researchers studying and working in Computer systems, Computer networks and Artificial intelligence will also find this reference useful.

This book discusses and evaluates AI and machine learning (ML) algorithms in dealing with challenges that are primarily related to public health. It also helps find ways in which we can measure possible consequences and societal impacts by taking the following factors into account: open public health issues and common AI solutions (with multiple case studies, such as TB and SARS: COVID-19), AI in sustainable health care, AI in precision medicine and data privacy issues. Public health requires special attention as it drives economy and education system. COVID-19 is an example-a truly infectious disease outbreak. The vision of WHO is to create public health services that can deal with abovementioned crucial challenges by focusing on the following elements: health protection, disease prevention and health promotion. For these issues, in the big data analytics era, AI and ML tools/techniques have potential to improve public health (e.g., existing healthcare solutions and wellness services). In other words, they have proved to be valuable tools not only to analyze/diagnose pathology but also to accelerate decision-making procedure especially when we consider resource-constrained regions.

Cognitive Big Data Intelligence with a Metaheuristic Approach presents an exact and compact organization of content relating to the latest metaheuristics methodologies based on new challenging big data application domains and cognitive computing. The combined model of cognitive big data intelligence with metaheuristics methods can be used to analyze emerging patterns, spot business opportunities, and take care of critical process-centric issues in real-time. Various real-time case studies and implemented works are discussed in this book for better understanding and additional clarity. This book presents an essential platform for the use of cognitive technology in the field of Data Science. It covers metaheuristic methodologies that can be successful in a wide variety of problem settings in big data frameworks.

This book constitutes the refereed proceedings of the 22nd International Conference on Intelligent Data Engineering and Automated Learning, IDEAL 2021, which took place during November 25-27, 2021. The conference was originally planned to take place in Manchester, UK, but was held virtually due to the COVID-19 pandemic.The 61 full papers included in this book were carefully reviewed and selected from 85 submissions. They deal with emerging and challenging topics in intelligent data analytics and associated machine learning paradigms and systems. Special sessions were held on clustering for interpretable machine learning; machine learning towards smarter multimodal systems; and computational intelligence for computer vision and image processing.

Learn how to harness modern deep-learning methods in many contexts. Packed with intuitive theory, practical implementation methods, and deep-learning case studies, this book reveals how to acquire the tools you need to design and implement like a deep-learning architect. It covers tools deep learning engineers can use in a wide range of fields, from biology to computer vision to business. With nine in-depth case studies, this book will ground you in creative, real-world deep learning thinking. You'll begin with a structured guide to using Keras, with helpful tips and best practices for making the most of the framework. Next, you'll learn how to train models effectively with transfer learning and self-supervised pre-training. You will then learn how to use a variety of model compressions for practical usage. Lastly, you will learn how to design successful neural network architectures and creatively reframe difficult problems into solvable ones. You'll learn not only to understand and apply methods successfully but to think critically about it. Modern Deep Learning Design and Methods is ideal for readers looking to utilize modern, flexible, and creative deep-learning design and methods. Get ready to design and implement innovative deep-learning solutions to today's difficult problems. What You'll Learn Improve the performance of deep learning models by using pre-trained models, extracting rich features, and automating optimization. Compress deep learning models while maintaining performance. Reframe a wide variety of difficult problems and design effective deep learning solutions to solve them. Use the Keras framework, with some help from libraries like HyperOpt, TensorFlow, and PyTorch, to implement a wide variety of deep learning approaches. Who This Book Is For Data scientists with some familiarity with deep learning to deep learning engineers seeking structured inspiration and direction on their next project. Developers interested in harnessing modern deep learning methods to solve a variety of difficult problems.

This book constitutes refereed proceedings of the 7th International Conference on Technologies and Innovation, CITI 2021, held in Guayaquil, Ecuador, in November 2021.The 14 full papers presented in this volume were carefully reviewed and selected from 36 submissions. They are organized in topical sections named: semantic technologies and machine learning; natural language processing; mobile and collaborative technologies; networks and IoT technologies; ICT for agronomy and environment.

This book constitutes the refereed proceedings of the 10th International Workshop on Clinical Image-Based Procedures, CLIP 2021, Second MICCAI Workshop on Distributed and Collaborative Learning, DCL 2021, First MICCAI Workshop, LL-COVID19, First Secure and Privacy-Preserving Machine Learning for Medical Imaging Workshop and Tutorial, PPML 2021, held in conjunction with MICCAI 2021, in October 2021. The workshops were planned to take place in Strasbourg, France, but were held virtually due to the COVID-19 pandemic.CLIP 2021 accepted 9 papers from the 13 submissions received. It focuses on holistic patient models for personalized healthcare with the goal to bring basic research methods closer to the clinical practice. For DCL 2021, 4 papers from 7 submissions were accepted for publication. They deal with machine learning applied to problems where data cannot be stored in centralized databases and information privacy is a priority. LL-COVID19 2021 accepted 2 papers out of 3 submissions dealing with the use of AI models in clinical practice. And for PPML 2021, 2 papers were accepted from a total of 6 submissions, exploring the use of privacy techniques in the medical imaging community.

Learn to develop and deploy dashboards as web apps using the Python programming language, and how to integrate algorithms into web apps. Author Tshepo Chris Nokeri begins by introducing you to the basics of constructing and styling static and interactive charts and tables before exploring the basics of HTML, CSS, and Bootstrap, including an approach to building web pages with HTML. From there, he'll show you the key Python web frameworks and techniques for building web apps with them. You'll then see how to style web apps and incorporate themes, including interactive charts and tables to build dashboards, followed by a walkthrough of creating URL routes and securing web apps. You'll then progress to more advanced topics, like building machine learning algorithms and integrating them into a web app. The book concludes with a demonstration of how to deploy web apps in prevalent cloud platforms. Web App Development and Real-Time Web Analytics with Python is ideal for intermediate data scientists, machine learning engineers, and web developers, who have little or no knowledge about building web apps that implement bootstrap technologies. After completing this book, you will have the knowledge necessary to create added value for your organization, as you will understand how to link front-end and back-end development, including machine learning. What You Will Learn Create interactive graphs and render static graphs into interactive ones Understand the essentials of HTML, CSS, and Bootstrap Gain insight into the key Python web frameworks, and how to develop web applications using them Develop machine learning algorithms and integrate them into web apps Secure web apps and deploy them to cloud platforms Who This Book Is For Intermediate data scientists, machine learning engineers, and web developers.

This book constitutes the proceedings of the 10th International Conference on Health Information Science, HIS 2021, which took place in Melbourne, Australia, in October 2021. The 16 full papers and 7 short papers presented in this volume were carefully reviewed and selected from 56 submissions. They are organized in topical sections named: COVID-19, EEG data processing, Medical Data Analysis, Medical Record Mining (I), Medical Data Mining (II), Medical Data Processing.

The two volume set LNCS 13052 and 13053 constitutes the refereed proceedings of the 19th International Conference on Computer Analysis of Images and Patterns, CAIP 2021, held virtually, in September 2021. The 87 papers presented were carefully reviewed and selected from 129 submissions. The papers are organized in the following topical sections across the 2 volumes: 3D vision, biomedical image and pattern analysis; machine learning; feature extractions; object recognition; face and gesture, guess the age contest, biometrics, cryptography and security; and segmentation and image restoration.

This book presents covariance matrix estimation and related aspects of random matrix theory. It focuses on the sample covariance matrix estimator and provides a holistic description of its properties under two asymptotic regimes: the traditional one, and the high-dimensional regime that better fits the big data context. It draws attention to the deficiencies of standard statistical tools when used in the high-dimensional setting, and introduces the basic concepts and major results related to spectral statistics and random matrix theory under high-dimensional asymptotics in an understandable and reader-friendly way. The aim of this book is to inspire applied statisticians, econometricians, and machine learning practitioners who analyze high-dimensional data to apply the recent developments in their work.

This book constitutes the refereed proceedings of the 10th International Conference on Theory and Practice of Natural Computing, TPNC 2021, held virtually, in December 2021. The 9 full papers presented together with 3 invited talks, in this book were carefully reviewed and selected from 14 submissions. The papers are organized in topical sections named Applications of Natural Computing, Deep Learning and Transfer Learning, Evolutionary and Swarm Algorithms.

This volume looks at applications of artificial intelligence (AI), machine learning (ML), and deep learning (DL) in drug design. The chapters in this book describe how AI/ML/DL approaches can be applied to accelerate and revolutionize traditional drug design approaches such as: structure- and ligand-based, augmented and multi-objective de novo drug design, SAR and big data analysis, prediction of binding/activity, ADMET, pharmacokinetics and drug-target residence time, precision medicine and selection of favorable chemical synthetic routes. How broadly are these approaches applied and where do they maximally impact productivity today and potentially in the near future. Written in the highly successful Methods in Molecular Biology series format, chapters include introductions to their respective topics, lists of the necessary software and tools, step-by-step, readily reproducible modeling protocols, and tips on troubleshooting and avoiding known pitfalls. Cutting-edge and unique, Artificial Intelligence in Drug Design is a valuable resource for structural and molecular biologists, computational and medicinal chemists, pharmacologists and drug designers.

The most crucial ability for machine learning and data science is mathematical logic for grasping their essence rather than knowledge and experience. This textbook approaches the essence of sparse estimation by considering math problems and building Python programs. Each chapter introduces the notion of sparsity and provides procedures followed by mathematical derivations and source programs with examples of execution. To maximize readers' insights into sparsity, mathematical proofs are presented for almost all propositions, and programs are described without depending on any packages. The book is carefully organized to provide the solutions to the exercises in each chapter so that readers can solve the total of 100 exercises by simply following the contents of each chapter. This textbook is suitable for an undergraduate or graduate course consisting of about 15 lectures (90 mins each). Written in an easy-to-follow and self-contained style, this book will also be perfect material for independent learning by data scientists, machine learning engineers, and researchers interested in linear regression, generalized linear lasso, group lasso, fused lasso, graphical models, matrix decomposition, and multivariate analysis. This book is one of a series of textbooks in machine learning by the same Author. Other titles are: Statistical Learning with Math and R (https://www.springer.com/gp/book/9789811575679) Statistical Learning with Math and Pyth (https://www.springer.com/gp/book/9789811578762) Sparse Estimation with Math and R

This book constitutes the refereed post-conference proceedings of the 11th EAI International Conference on Research in Computer science and its Applications, CNRIA 2021, held in June 2021. Due to COVID-19 pandemic the conference was held virtually. The 11 full papers presented were selected from 24 submissions and issue different problems in underserved and unserved areas. The papers are arranged in 3 tracks: data science and artificial intelligence; telecom and artificial intelligence; IoT and ICT applications.

This book meets the present and future needs for the interaction between various science and technology/engineering areas on the one hand and different branches of soft computing on the other. Soft computing is the recent development about the computing methods which include fuzzy set theory/logic, evolutionary computation (EC), probabilistic reasoning, artificial neural networks, machine learning, expert systems, etc. Soft computing refers to a partnership of computational techniques in computer science, artificial intelligence, machine learning, and some other engineering disciplines, which attempt to study, model, and analyze complex problems from different interdisciplinary problems. This, as opposed to traditional computing, deals with approximate models and gives solutions to complex real-life problems. Unlike hard computing, soft computing is tolerant of imprecision, uncertainty, partial truth, and approximations. Interdisciplinary sciences include various challenging problems of science and engineering. Recent developments in soft computing are the bridge to handle different interdisciplinary science and engineering problems. In recent years, the correspondingly increased dialog between these disciplines has led to this new book. This is done, firstly, by encouraging the ways that soft computing may be applied in traditional areas, as well as point towards new and innovative areas of applications and secondly, by encouraging other scientific disciplines to engage in a dialog with the above computation algorithms outlining their problems to both access new methods as well as to suggest innovative developments within itself.

This book presents the proceedings of the 2020 2nd International Conference on Machine Learning and Big Data Analytics for IoT Security and Privacy (SPIoT-2021), online conference, on 30 October 2021. It provides comprehensive coverage of the latest advances and trends in information technology, science and engineering, addressing a number of broad themes, including novel machine learning and big data analytics methods for IoT security, data mining and statistical modelling for the secure IoT and machine learning-based security detecting protocols, which inspire the development of IoT security and privacy technologies. The contributions cover a wide range of topics: analytics and machine learning applications to IoT security; data-based metrics and risk assessment approaches for IoT; data confidentiality and privacy in IoT; and authentication and access control for data usage in IoT. Outlining promising future research directions, the book is a valuable resource for students, researchers and professionals and provides a useful reference guide for newcomers to the IoT security and privacy field.

The aim of this book is to discuss the fundamental ideas which lie behind the statistical theory of learning and generalization. It considers learning as a general problem of function estimation based on empirical data. Omitting proofs and technical details, the author concentrates on discussing the main results of learning theory and their connections to fundamental problems in statistics. These include: * the setting of learning problems based on the model of minimizing the risk functional from empirical data * a comprehensive analysis of the empirical risk minimization principle including necessary and sufficient conditions for its consistency * non-asymptotic bounds for the risk achieved using the empirical risk minimization principle * principles for controlling the generalization ability of learning machines using small sample sizes based on these bounds * the Support Vector methods that control the generalization ability when estimating function using small sample size. The second edition of the book contains three new chapters devoted to further development of the learning theory and SVM techniques. These include: * the theory of direct method of learning based on solving multidimensional integral equations for density, conditional probability, and conditional density estimation * a new inductive principle of learning. Written in a readable and concise style, the book is intended for statisticians, mathematicians, physicists, and computer scientists. Vladimir N. Vapnik is Technology Leader AT&T Labs-Research and Professor of London University. He is one of the founders of statistical learning theory, and the author of seven books published in English, Russian, German, and Chinese.

This book provides tools and algorithms for solving a wide class of optimization tasks by learning from their repetitions. A unified framework is provided for learning algorithms that are based on the stochastic gradient (a golden standard in learning), including random simultaneous perturbations and the response surface the methodology. Original algorithms include model-free learning of short decision sequences as well as long sequences-relying on model-supported gradient estimation. Learning is based on whole sequences of a process observation that are either vectors or images. This methodology is applicable to repetitive processes, covering a wide range from (additive) manufacturing to decision making for COVID-19 waves mitigation. A distinctive feature of the algorithms is learning between repetitions-this idea extends the paradigms of iterative learning and run-to-run control. The main ideas can be extended to other decision learning tasks, not included in this book. The text is written in a comprehensible way with the emphasis on a user-friendly presentation of the algorithms, their explanations, and recommendations on how to select them. The book is expected to be of interest to researchers, Ph.D., and graduate students in computer science and engineering, operations research, decision making, and those working on the iterative learning control.

Apply supervised and unsupervised learning to solve practical and real-world big data problems. This book teaches you how to engineer features, optimize hyperparameters, train and test models, develop pipelines, and automate the machine learning (ML) process. The book covers an in-memory, distributed cluster computing framework known as PySpark, machine learning framework platforms known as scikit-learn, PySpark MLlib, H2O, and XGBoost, and a deep learning (DL) framework known as Keras. The book starts off presenting supervised and unsupervised ML and DL models, and then it examines big data frameworks along with ML and DL frameworks. Author Tshepo Chris Nokeri considers a parametric model known as the Generalized Linear Model and a survival regression model known as the Cox Proportional Hazards model along with Accelerated Failure Time (AFT). Also presented is a binary classification model (logistic regression) and an ensemble model (Gradient Boosted Trees). The book introduces DL and an artificial neural network known as the Multilayer Perceptron (MLP) classifier. A way of performing cluster analysis using the K-Means model is covered. Dimension reduction techniques such as Principal Components Analysis and Linear Discriminant Analysis are explored. And automated machine learning is unpacked. This book is for intermediate-level data scientists and machine learning engineers who want to learn how to apply key big data frameworks and ML and DL frameworks. You will need prior knowledge of the basics of statistics, Python programming, probability theories, and predictive analytics. What You Will Learn Understand widespread supervised and unsupervised learning, including key dimension reduction techniques Know the big data analytics layers such as data visualization, advanced statistics, predictive analytics, machine learning, and deep learning Integrate big data frameworks with a hybrid of machine learning frameworks and deep learning frameworks Design, build, test, and validate skilled machine models and deep learning models Optimize model performance using data transformation, regularization, outlier remedying, hyperparameter optimization, and data split ratio alteration Who This Book Is For Data scientists and machine learning engineers with basic knowledge and understanding of Python programming, probability theories, and predictive analytics

This book constitutes the refereed proceedings of the 14th International Conference on Similarity Search and Applications, SISAP 2021, held in Dortmund, Germany, in September/October 2021. The conference was held virtually due to the COVID-19 pandemic.The 23 full papers presented together with 5 short and 3 doctoral symposium papers were carefully reviewed and selected from 50 submissions. The papers are organized in the topical sections named: Similarity Search and Retrieval; Intrinsic Dimensionality; Clustering and Classification; Applications of Similarity Search; Similarity Search in Graph-Structured Data; Doctoral Symposium.