The Spark distributed data processing platform provides an easy-to-implement tool for ingesting, streaming, and processing data from any source. In Spark in Action, Second Edition, you'll learn to take advantage of Spark's core features and incredible processing speed, with applications including real-time computation, delayed evaluation, and machine learning. Unlike many Spark books written for data scientists, Spark in Action, Second Edition is designed for data engineers and software engineers who want to master data processing using Spark without having to learn a complex new ecosystem of languages and tools. You'll instead learn to apply your existing Java and SQL skills to take on practical, real-world challenges. Key Features * Lots of examples based in the Spark Java APIs using real-life dataset and scenarios * Examples based on Spark v2.3 Ingestion through files, databases, and streaming * Building custom ingestion process * Querying distributed datasets with Spark SQL For beginning to intermediate developers and data engineers comfortable programming in Java. No experience with functional programming, Scala, Spark, Hadoop, or big data is required. About the technology Spark is a powerful general-purpose analytics engine that can handle massive amounts of data distributed across clusters with thousands of servers. Optimized to run in memory, this impressive framework can process data up to 100x faster than most Hadoop-based systems. Author Bio An experienced consultant and entrepreneur passionate about all things data, Jean-Georges Perrin was the first IBM Champion in France, an honor he's now held for ten consecutive years. Jean-Georges has managed many teams of software and data engineers.

Deep Learning in Bioinformatics: Techniques and Applications in Practice introduces the topic in an easy-to-understand way, exploring how it can be utilized for addressing important problems in bioinformatics, including drug discovery, de novo molecular design, sequence analysis, protein structure prediction, gene expression regulation, protein classification, biomedical image processing and diagnosis, biomolecule interaction prediction, and in systems biology. The book also presents theoretical and practical successes of deep learning in bioinformatics, pointing out problems and suggesting future research directions. Dr. Izadkhah provides valuable insights and will help researchers use deep learning techniques in their biological and bioinformatics studies.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

This book provides comprehensive coverage on a new direction in computational mathematics research: automatic search for formulas. Formulas must be sought in all areas of science and life: these are the laws of the universe, the macro and micro world, fundamental physics, engineering, weather and natural disasters forecasting; the search for new laws in economics, politics, sociology. Accumulating many years of experience in the development and application of numerical methods of symbolic regression to solving control problems, the authors offer new possibilities not only in the field of control automation, but also in the design of completely different optimal structures in many fields. For specialists in the field of control, Machine Learning Control by Symbolic Regression opens up a new promising direction of research and acquaints scientists with the methods of automatic construction of control systems.For specialists in the field of machine learning, the book opens up a new, much broader direction than neural networks: methods of symbolic regression. This book makes it easy to master this new area in machine learning and apply this approach everywhere neural networks are used. For mathematicians, the book opens up a new approach to the construction of numerical methods for obtaining analytical solutions to unsolvable problems; for example, numerical analytical solutions of algebraic equations, differential equations, non-trivial integrals, etc. For specialists in the field of artificial intelligence, the book offers a machine way to solve problems, framed in the form of analytical relationships.

This book provides tools and algorithms for solving a wide class of optimization tasks by learning from their repetitions. A unified framework is provided for learning algorithms that are based on the stochastic gradient (a golden standard in learning), including random simultaneous perturbations and the response surface the methodology. Original algorithms include model-free learning of short decision sequences as well as long sequences-relying on model-supported gradient estimation. Learning is based on whole sequences of a process observation that are either vectors or images. This methodology is applicable to repetitive processes, covering a wide range from (additive) manufacturing to decision making for COVID-19 waves mitigation. A distinctive feature of the algorithms is learning between repetitions-this idea extends the paradigms of iterative learning and run-to-run control. The main ideas can be extended to other decision learning tasks, not included in this book. The text is written in a comprehensible way with the emphasis on a user-friendly presentation of the algorithms, their explanations, and recommendations on how to select them. The book is expected to be of interest to researchers, Ph.D., and graduate students in computer science and engineering, operations research, decision making, and those working on the iterative learning control.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

This book evaluates the role of innovative machine learning and deep learning methods in dealing with power system issues, concentrating on recent developments and advances that improve planning, operation, and control of power systems. Cutting-edge case studies from around the world consider prediction, classification, clustering, and fault/event detection in power systems, providing effective and promising solutions for many novel challenges faced by power system operators. Written by leading experts, the book will be an ideal resource for researchers and engineers working in the electrical power engineering and power system planning communities, as well as students in advanced graduate-level courses.

This book covers a large set of methods in the field of Artificial Intelligence - Deep Learning applied to real-world problems. The fundamentals of the Deep Learning approach and different types of Deep Neural Networks (DNNs) are first summarized in this book, which offers a comprehensive preamble for further problem-oriented chapters. The most interesting and open problems of machine learning in the framework of Deep Learning are discussed in this book and solutions are proposed. This book illustrates how to implement the zero-shot learning with Deep Neural Network Classifiers, which require a large amount of training data. The lack of annotated training data naturally pushes the researchers to implement low supervision algorithms. Metric learning is a long-term research but in the framework of Deep Learning approaches, it gets freshness and originality. Fine-grained classification with a low inter-class variability is a difficult problem for any classification tasks. This book presents how it is solved, by using different modalities and attention mechanisms in 3D convolutional networks. Researchers focused on Machine Learning, Deep learning, Multimedia and Computer Vision will want to buy this book. Advanced level students studying computer science within these topic areas will also find this book useful.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

This book investigates in detail the deep learning (DL) techniques in electromagnetic (EM) near-field scattering problems, assessing its potential to replace traditional numerical solvers in real-time forecast scenarios. Studies on EM scattering problems have attracted researchers in various fields, such as antenna design, geophysical exploration and remote sensing. Pursuing a holistic perspective, the book introduces the whole workflow in utilizing the DL framework to solve the scattering problems. To achieve precise approximation, medium-scale data sets are sufficient in training the proposed model. As a result, the fully trained framework can realize three orders of magnitude faster than the conventional FDFD solver. It is worth noting that the 2D and 3D scatterers in the scheme can be either lossless medium or metal, allowing the model to be more applicable. This book is intended for graduate students who are interested in deep learning with computational electromagnetics, professional practitioners working on EM scattering, or other corresponding researchers.

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 2022, held in Tel Aviv, Israel, during October 23-27, 2022. The 1645 papers presented in these proceedings were carefully reviewed and selected from a total of 5804 submissions. The papers deal with topics such as computer vision; machine learning; deep neural networks; reinforcement learning; object recognition; image classification; image processing; object detection; semantic segmentation; human pose estimation; 3d reconstruction; stereo vision; computational photography; neural networks; image coding; image reconstruction; object recognition; motion estimation.

The discovery in 2012 of the Higgs boson at the Large Hadron Collider (LHC) represents a milestone for the Standard Model (SM) of particle physics. Most of the SM Higgs production and decay rates have been measured at the LHC with increased precision. However, despite its experimental success, the SM is known to be only an effective manifestation of a more fundamental description of nature. The scientific research at the LHC is strongly focused on extending the SM by searching, directly or indirectly, for indications of New Physics. The extensive physics program requires increasingly advanced computational and algorithmic techniques. In the last decades, Machine Learning (ML) methods have made a prominent appearance in the field of particle physics, and promise to address many challenges faced by the LHC. This thesis presents the analysis that led to the observation of the SM Higgs boson decay into pairs of bottom quarks. The analysis exploits the production of a Higgs boson associated with a vector boson whose signatures enable efficient triggering and powerful background reduction. The main strategy to maximise the signal sensitivity is based on a multivariate approach. The analysis is performed on a dataset corresponding to a luminosity of 79.8/fb collected by the ATLAS experiment during Run-2 at a centre-of-mass energy of 13 TeV. An excess of events over the expected background is found with an observed (expected) significance of 4.9 (4.3) standard deviation. A combination with results from other \Hbb searches provides an observed (expected) significance of 5.4 (5.5). The corresponding ratio between the signal yield and the SM expectation is 1.01 +- 0.12 (stat.)+ 0.16-0.15(syst.). The 'observation' analysis was further extended to provide a finer interpretation of the V H(H bb) signal measurement. The cross sections for the VH production times the H bb branching ratio have been measured in exclusive regions of phase space. These measurements are used to search for possible deviations from the SM with an effective field theory approach, based on anomalous couplings of the Higgs boson. The results of the cross-section measurements, as well as the constraining of the operators that affect the couplings of the Higgs boson to the vector boson and the bottom quarks, have been documented and discussed in this thesis. This thesis also describes a novel technique for the fast simulation of the forward calorimeter response, based on similarity search methods. Such techniques constitute a branch of ML and include clustering and indexing methods that enable quick and efficient searches for vectors similar to each other. The new simulation approach provides optimal results in terms of detector resolution response and reduces the computational requirements of a standard particles simulation.

This textbook presents methods and techniques for time series analysis and forecasting and shows how to use Python to implement them and solve data science problems. It covers not only common statistical approaches and time series models, including ARMA, SARIMA, VAR, GARCH and state space and Markov switching models for (non)stationary, multivariate and financial time series, but also modern machine learning procedures and challenges for time series forecasting. Providing an organic combination of the principles of time series analysis and Python programming, it enables the reader to study methods and techniques and practice writing and running Python code at the same time. Its data-driven approach to analyzing and modeling time series data helps new learners to visualize and interpret both the raw data and its computed results. Primarily intended for students of statistics, economics and data science with an undergraduate knowledge of probability and statistics, the book will equally appeal to industry professionals in the fields of artificial intelligence and data science, and anyone interested in using Python to solve time series problems.

Digital forensics deals with the acquisition, preservation, examination, analysis and presentation of electronic evidence. Computer networks, cloud computing, smartphones, embedded devices and the Internet of Things have expanded the role of digital forensics beyond traditional computer crime investigations. Practically every crime now involves some aspect of digital evidence; digital forensics provides the techniques and tools to articulate this evidence in legal proceedings. Digital forensics also has myriad intelligence applications; furthermore, it has a vital role in cyber security -- investigations of security breaches yield valuable information that can be used to design more secure and resilient systems.Advances in Digital Forensics XVII describes original research results and innovative applications in the discipline of digital forensics. In addition, it highlights some of the major technical and legal issues related to digital evidence and electronic crime investigations. The areas of coverage include: themes and issues, forensic techniques, filesystem forensics, cloud forensics, social media forensics, multimedia forensics, and novel applications. This book is the seventeenth volume in the annual series produced by the International Federation for Information Processing (IFIP) Working Group 11.9 on Digital Forensics, an international community of scientists, engineers and practitioners dedicated to advancing the state of the art of research and practice in digital forensics. The book contains a selection of thirteen edited papers from the Seventeenth Annual IFIP WG 11.9 International Conference on Digital Forensics, held virtually in the winter of 2021. Advances in Digital Forensics XVII is an important resource for researchers, faculty members and graduate students, as well as for practitioners and individuals engaged in research and development efforts for the law enforcement and intelligence communities.

The power of data drives the digital economy of the 21st century. It has been argued that data is as vital a resource as oil was during the industrial revolution. An upward trend in the number of research publications using machine learning in some of the top journals in combination with an increasing number of academic recruiters within psychology asking for Python knowledge from applicants indicates a growing demand for these skills in the market. While there are plenty of books covering data science, rarely, if ever, books in the market address the need of social science students with no computer science background. They are typically written by engineers or computer scientists for people of their discipline. As a result, often such books are filled with technical jargon and examples irrelevant to psychological studies or projects. In contrast, this book was written by a psychologist in a simple, easy-to-understand way that is brief and accessible. The aim for this book was to make the learning experience on this topic as smooth as possible for psychology students/researchers with no background in programming or data science. Completing this book will also open up an enormous amount of possibilities for quantitative researchers in psychological science, as it will enable them to explore newer types of research questions.

This book takes the notions of adaptivity and learning from the realm of engineering into the realm of biology and natural processes. It introduces a Hebbian-LMS algorithm, an integration of unsupervised Hebbian learning and supervised LMS learning in neural networks, as a mathematical representation of a general theory for synaptic learning in the brain, and adaptation and functional control of homeostasis in living systems. Written in a language that is able to address students and scientists with different backgrounds, this book accompanies readers on a unique journey through various homeostatic processes in living organisms, such as body temperature control and synaptic plasticity, explaining how the Hebbian-LMS algorithm can help understand them, and suggesting some open questions for future research. It also analyses cell signalling pathways from an unusual perspective, where hormones and hormone receptors are shown to be regulated via the principles of the Hebbian-LMS algorithm. It further discusses addiction and pain, and various kinds of mood disorders alike, showing how they can be modelled with the Hebbian-LMS algorithm. For the first time, the Hebbian-LMS algorithm, which has been derived from a combination of Hebbian theory from the neuroscience field and the LMS algorithm from the engineering field of adaptive signal processing, becomes a potent model for understanding how biological regulation works. Thus, this book is breaking new ground in neuroscience by providing scientists with a general theory for how nature does control synaptic learning. It then goes beyond that, showing that the same principles apply to hormone-mediated regulation of physiological processes. In turn, the book tackles in more depth the concept of learning. It covers computer simulations and strategies for training neural networks with the Hebbian-LMS algorithm, demonstrating that the resulting algorithms are able to identify relationships between unknown input patterns. It shows how this can translate in useful ideas to understand human memory and design cognitive structures. All in all, this book offers an absolutely, unique, inspiring reading for biologists, physiologists, and engineers, paving the way for future studies on what we could call the nature's secret learning algorithm.

This book constitutes revised selected papers from the refereed proceedings of the 11th International Conference on Computational Advances in Bio and Medical Sciences, ICCABS 2021, held as a virtual event during December 16-18, 2021. The 13 full papers included in this book were carefully reviewed and selected from 17 submissions. They were organized in topical sections as follows: Computational advances in bio and medical sciences; and computational advances in molecular epidemiology.

This volume provides readers with a compact, stimulating and multifaceted introduction to interpretability, a key issue for developing insightful statistical and machine learning approaches as well as for communicating modelling results in business and industry.Different views in the context of Industry 4.0 are offered in connection with the concepts of explainability of machine learning tools, generalizability of model outputs and sensitivity analysis. Moreover, the book explores the integration of Artificial Intelligence and robust analysis of variance for big data mining and monitoring in Additive Manufacturing, and sheds new light on interpretability via random forests and flexible generalized additive models together with related software resources and real-world examples.

This book offers an introduction into quantum machine learning research, covering approaches that range from "near-term" to fault-tolerant quantum machine learning algorithms, and from theoretical to practical techniques that help us understand how quantum computers can learn from data. Among the topics discussed are parameterized quantum circuits, hybrid optimization, data encoding, quantum feature maps and kernel methods, quantum learning theory, as well as quantum neural networks. The book aims at an audience of computer scientists and physicists at the graduate level onwards. The second edition extends the material beyond supervised learning and puts a special focus on the developments in near-term quantum machine learning seen over the past few years.

The thesis contains several pioneering results at the intersection of state-of-the-art materials characterization techniques and machine learning. The use of machine learning empowers the information extraction capability of neutron and photon spectroscopies. In particular, new knowledge and new physics insights to aid spectroscopic analysis may hold great promise for next-generation quantum technology. As a prominent example, the so-called proximity effect at topological material interfaces promises to enable spintronics without energy dissipation and quantum computing with fault tolerance, yet the characteristic spectral features to identify the proximity effect have long been elusive. The work presented within permits a fine resolution of its spectroscopic features and a determination of the proximity effect which could aid further experiments with improved interpretability. A few novel machine learning architectures are proposed in this thesis work which leverage the case when the data is scarce and utilize the internal symmetry of the system to improve the training quality. The work sheds light on future pathways to apply machine learning to augment experiments.