This book provides readers the "big picture" and a comprehensive survey of the domain of big data processing systems. For the past decade, the Hadoop framework has dominated the world of big data processing, yet recently academia and industry have started to recognize its limitations in several application domains and thus, it is now gradually being replaced by a collection of engines that are dedicated to specific verticals (e.g. structured data, graph data, and streaming data). The book explores this new wave of systems, which it refers to as Big Data 2.0 processing systems. After Chapter 1 presents the general background of the big data phenomena, Chapter 2 provides an overview of various general-purpose big data processing systems that allow their users to develop various big data processing jobs for different application domains. In turn, Chapter 3 examines various systems that have been introduced to support the SQL flavor on top of the Hadoop infrastructure and provide competing and scalable performance in the processing of large-scale structured data. Chapter 4 discusses several systems that have been designed to tackle the problem of large-scale graph processing, while the main focus of Chapter 5 is on several systems that have been designed to provide scalable solutions for processing big data streams, and on other sets of systems that have been introduced to support the development of data pipelines between various types of big data processing jobs and systems. Next, Chapter 6 focuses on covering the emerging frameworks and systems in the domain of scalable machine learning and deep learning processing. Lastly, Chapter 7 shares conclusions and an outlook on future research challenges. This new and considerably enlarged second edition not only contains the completely new chapter 6, but also offers a refreshed content for the state-of-the-art in all domains of big data processing over the last years. Overall, the book offers a valuable reference guide for professional, students, and researchers in the domain of big data processing systems. Further, its comprehensive content will hopefully encourage readers to pursue further research on the subject.

Die Haupteigenschaften des in der Wirtschaft "ausschlaggebenden" Menschen werden sich andern. Wir verlassen die "Bauerngesellschaft" der ruhigen, pflichttreuen Menschen, die Tradition, Erfahrung und Orndung herrschen lassen (Old Economy). die neue Zeit "kampft" mit neuen Geschaftsmodellen und immer schnelleren Technologiezyklen um die Milliarden, die der Erste im Markt erringen kann. Keine Zeit mehr fur Erfahrung & Co. Wie wird das sein - in E-Man's World? Besser? Mit 40 Millionar oder Burnout? Wie lange tobt der Umbruch? E-Man muss vor allem kreativ, proaktiv, authentisch, erneuerungs- und risikofahig sein, voller Verrtrauen im starksten Wandel.

Ein Bericht aus der Turbulenzzone des Managements und des Innermenschlichen. Wie gewohnt spannend, provokativ, streitbar und leidenschaftlich subjektiv Die dritte Auflage wurde um ein Nachwort des Autors erganzt.

This is the first comprehensive introduction to Support Vector Machines (SVMs), a new generation learning system based on recent advances in statistical learning theory. Students will find the book both stimulating and accessible, while practitioners will be guided smoothly through the material required for a good grasp of the theory and its applications. The concepts are introduced gradually in accessible and self-contained stages, while the presentation is rigorous and thorough. Pointers to relevant literature and web sites containing software make it an ideal starting point for further study.

This book constitutes revised selected papers of the 9th International Conference on Analysis of Images, Social Networks and Texts, AIST 2020, held in Moscow, Russia, in october 2020. Due to the COVID-19 pandemic the conference was held online. The 14 full papers, 9 short papers and 4 poster papers were carefully reviewed and selected from 108 qualified submissions. The papers are organized in topical sections on natural language processing; computer vision; social network analysis; data analysis and machine learning; theoretical machine learning and optimization; process mining; posters.

Hybride Leistungsbundel (HLB) dienen dazu, ein innovatives und nutzenorientiertes Produktverstandnis von Sach- und Dienstleistungen zu etablieren. Hochkomplexe Anlagen lassen sich durch diese integrierte Betrachtung von Sach- und Dienstleistungsanteilen deutlich besser vermarkten. Der Band liefert einen Uberblick zu diesem Konzept und stellt entsprechende Methoden und Werkzeuge zur Entwicklung von Sach- und Dienstleistungen vor. Dabei berucksichtigen die Autoren den gesamten Zyklus: von der Planung und Entwicklung bis zur Erbringung und Nutzung."

This book presents a step by step Asset Health Management Optimization Approach Using Internet of Things (IoT). The authors provide a comprehensive study which includes the descriptive, diagnostic, predictive, and prescriptive analysis in detail. The presentation focuses on the challenges of the parameter selection, statistical data analysis, predictive algorithms, big data storage and selection, data pattern recognition, machine learning techniques, asset failure distribution estimation, reliability and availability enhancement, condition based maintenance policy, failure detection, data driven optimization algorithm, and a multi-objective optimization approach, all of which can significantly enhance the reliability and availability of the system.

Predator-prey interactions are ubiquitous, govern the flow of energy up trophic levels, and strongly influence the structure of ecological systems. They are typically quantified using the functional response - the relationship between a predator's foraging rate and the availability of food. As such, the functional response is central to how all ecological communities function - since all communities contain foragers - and a principal driver of the abundance, diversity, and dynamics of ecological communities. The functional response also reflects all the behaviors, traits, and strategies that predators use to hunt prey and that prey use to evade predation. It is thus both a clear reflection of past evolution, including predator-prey arms races, and a major force driving the future evolution of both predator and prey. Despite their importance, there have been remarkably few attempts to synthesize or even briefly review functional responses. This novel and accessible book fills this gap, clearly demonstrating their crucial role as the link between individuals, evolution, and community properties, representing a highly-integrated and measurable aspect of ecological function. It provides a clear entry point for students, a refresher for more advanced researchers, and a motivator for future research. Predator Ecology is an advanced textbook suitable for graduate students and researchers in ecology and evolutionary biology seeking a broad, up-to-date, and authoritative coverage of the field. It will also be of relevance and use to mathematical ecologists, wildlife biologists, and anyone interested in predator-prey interactions.

The LNCS journal Transactions on Large-Scale Data- and Knowledge-Centered Systems focuses on data management, knowledge discovery, and knowledge processing, which are core and hot topics in computer science. Since the 1990s, the Internet has become the main driving force behind application development in all domains. An increase in the demand for resource sharing (e.g., computing resources, services, metadata, data sources) across different sites connected through networks has led to an evolution of data- and knowledge management systems from centralized systems to decentralized systems enabling large-scale distributed applications providing high scalability. This, the 48th issue of Transactions on Large-Scale Data- and Knowledge-Centered Systems, contains 8 invited papers dedicated to the memory of Prof. Dr. Roland Wagner. The topics covered include distributed database systems, NewSQL, scalable transaction management, strong consistency, caches, data warehouse, ETL, reinforcement learning, stochastic approximation, multi-agent systems, ontology, model-driven development, organisational modelling, digital government, new institutional economics and data governance.

This two-volume set, LNCS 11317 and 12318, constitutes the thoroughly refereed proceedings of the 4th International Joint Conference, APWeb-WAIM 2020, held in Tianjin, China, in September 2020. Due to the COVID-19 pandemic the conference was organizedas a fully online conference. The 42 full papers presented together with 17 short papers, and 6 demonstration papers were carefully reviewed and selected from 180 submissions. The papers are organized around the following topics: Big Data Analytics; Graph Data and Social Networks; Knowledge Graph; Recommender Systems; Information Extraction and Retrieval; Machine Learning; Blockchain; Data Mining; Text Analysis and Mining; Spatial, Temporal and Multimedia Databases; Database Systems; and Demo.

This volume presents the latest advances in statistics and data science, including theoretical, methodological and computational developments and practical applications related to classification and clustering, data gathering, exploratory and multivariate data analysis, statistical modeling, and knowledge discovery and seeking. It includes contributions on analyzing and interpreting large, complex and aggregated datasets, and highlights numerous applications in economics, finance, computer science, political science and education. It gathers a selection of peer-reviewed contributions presented at the 16th Conference of the International Federation of Classification Societies (IFCS 2019), which was organized by the Greek Society of Data Analysis and held in Thessaloniki, Greece, on August 26-29, 2019.

Explore how User Research has been influenced over the years by a range of disciplines, such as HCI, usability, anthropology, cognitive psychology, ergonomics etc. This book aims to contribute to the User Research community and covers topics that will help UX professionals, students and stakeholders to gain a better understanding of what User Research is. Throughout the book you will acquire a practical skill set, ranging from how to get the research going, to building a case in order to receive the budget and resources needed. It will provide you with a clear account of how to organise your research, how to plan it, and how to manage stakeholders' expectations throughout the project. You'll see how to fit User Research into your organization and incorporate it through the different product development phases (Discovery, Alpha, Beta until Live), as well as how to grow a User Research team. Practical User Research reviews the methodologies used for User Research, looks at how to recruit participants along with how to collect and analyse data, finally focusing on how to interpret and present your findings. Cross-cultural research, accessibility and assisted digital research will also be discussed throughout this book. The final chapter gives you 10 project briefs, with which you will be able to apply your new skill set and put into practice what you have learnt. What You'll Learn Integrate user research into your business Apply user research to your product development cycle Review the appropriate processes necessary to carry out user research Take a pragmatic approach to user research, method by method Who This Book Is For Anyone that wants to understand more about user research.

There's growing interest in learning how to analyze streaming data in large-scale systems such as web traffic, financial transactions, machine logs, industrial sensors, and many others. But analyzing data streams at scale has been difficult to do well--until now. This practical book delivers a deep introduction to Apache Flink, a highly innovative open source stream processor with a surprising range of capabilities. Authors Ellen Friedman and Kostas Tzoumas show technical and nontechnical readers alike how Flink is engineered to overcome significant tradeoffs that have limited the effectiveness of other approaches to stream processing. You'll also learn how Flink has the ability to handle both stream and batch data processing with one technology. * Learn the consequences of not doing streaming well--in retail and marketing, IoT, telecom, and banking and finance* Explore how to design data architecture to gain the best advantage from stream processing* Get an overview of Flink's capabilities and features, along with examples of how companies use Flink, including in production* Take a technical dive into Flink, and learn how it handles time and stateful computation* Examine how Flink processes both streaming (unbounded) and batch (bounded) data without sacrificing performance

This book constitutes the proceedings of the 7th International Conference on Analysis of Images, Social Networks and Texts, AIST 2018, held in Moscow, Russia, in July 2018. The 29 full papers were carefully reviewed and selected from 107 submissions (of which 26 papers were rejected without being reviewed). The papers are organized in topical sections on natural language processing; analysis of images and video; general topics of data analysis; analysis of dynamic behavior through event data; optimization problems on graphs and network structures; and innovative systems.

Discover a variety of data-mining algorithms that are useful for selecting small sets of important features from among unwieldy masses of candidates, or extracting useful features from measured variables. As a serious data miner you will often be faced with thousands of candidate features for your prediction or classification application, with most of the features being of little or no value. You'll know that many of these features may be useful only in combination with certain other features while being practically worthless alone or in combination with most others. Some features may have enormous predictive power, but only within a small, specialized area of the feature space. The problems that plague modern data miners are endless. This book helps you solve this problem by presenting modern feature selection techniques and the code to implement them. Some of these techniques are: Forward selection component analysis Local feature selection Linking features and a target with a hidden Markov model Improvements on traditional stepwise selection Nominal-to-ordinal conversion All algorithms are intuitively justified and supported by the relevant equations and explanatory material. The author also presents and explains complete, highly commented source code. The example code is in C++ and CUDA C but Python or other code can be substituted; the algorithm is important, not the code that's used to write it. What You Will Learn Combine principal component analysis with forward and backward stepwise selection to identify a compact subset of a large collection of variables that captures the maximum possible variation within the entire set. Identify features that may have predictive power over only a small subset of the feature domain. Such features can be profitably used by modern predictive models but may be missed by other feature selection methods. Find an underlying hidden Markov model that controls the distributions of feature variables and the target simultaneously. The memory inherent in this method is especially valuable in high-noise applications such as prediction of financial markets. Improve traditional stepwise selection in three ways: examine a collection of 'best-so-far' feature sets; test candidate features for inclusion with cross validation to automatically and effectively limit model complexity; and at each step estimate the probability that our results so far could be just the product of random good luck. We also estimate the probability that the improvement obtained by adding a new variable could have been just good luck. Take a potentially valuable nominal variable (a category or class membership) that is unsuitable for input to a prediction model, and assign to each category a sensible numeric value that can be used as a model input. Who This Book Is For Intermediate to advanced data science programmers and analysts.

Analyze vast amounts of data in record time using Apache Spark with Databricks in the Cloud. Learn the fundamentals, and more, of running analytics on large clusters in Azure and AWS, using Apache Spark with Databricks on top. Discover how to squeeze the most value out of your data at a mere fraction of what classical analytics solutions cost, while at the same time getting the results you need, incrementally faster. This book explains how the confluence of these pivotal technologies gives you enormous power, and cheaply, when it comes to huge datasets. You will begin by learning how cloud infrastructure makes it possible to scale your code to large amounts of processing units, without having to pay for the machinery in advance. From there you will learn how Apache Spark, an open source framework, can enable all those CPUs for data analytics use. Finally, you will see how services such as Databricks provide the power of Apache Spark, without you having to know anything about configuring hardware or software. By removing the need for expensive experts and hardware, your resources can instead be allocated to actually finding business value in the data. This book guides you through some advanced topics such as analytics in the cloud, data lakes, data ingestion, architecture, machine learning, and tools, including Apache Spark, Apache Hadoop, Apache Hive, Python, and SQL. Valuable exercises help reinforce what you have learned. What You Will Learn Discover the value of big data analytics that leverage the power of the cloud Get started with Databricks using SQL and Python in either Microsoft Azure or AWS Understand the underlying technology, and how the cloud and Apache Spark fit into the bigger picture See how these tools are used in the real world Run basic analytics, including machine learning, on billions of rows at a fraction of a cost or free Who This Book Is For Data engineers, data scientists, and cloud architects who want or need to run advanced analytics in the cloud. It is assumed that the reader has data experience, but perhaps minimal exposure to Apache Spark and Azure Databricks. The book is also recommended for people who want to get started in the analytics field, as it provides a strong foundation.

This book constitutes the refereed joint proceedings of the 4th International Workshop on Large-Scale Annotation of Biomedical Data and Expert Label Synthesis, LABELS 2019, the First International Workshop on Hardware Aware Learning for Medical Imaging and Computer Assisted Intervention, HAL-MICCAI 2019, and the Second International Workshop on Correction of Brainshift with Intra-Operative Ultrasound, CuRIOUS 2019, held in conjunction with the 22nd International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2019, in Shenzhen, China, in October 2019. The 8 papers presented at LABELS 2019, the 5 papers presented at HAL-MICCAI 2019, and the 3 papers presented at CuRIOUS 2019 were carefully reviewed and selected from numerous submissions. The LABELS papers present a variety of approaches for dealing with a limited number of labels, from semi-supervised learning to crowdsourcing. The HAL-MICCAI papers cover a wide set of hardware applications in medical problems, including medical image segmentation, electron tomography, pneumonia detection, etc. The CuRIOUS papers provide a snapshot of the current progress in the field through extended discussions and provide researchers an opportunity to characterize their image registration methods on newly released standardized datasets of iUS-guided brain tumor resection.

This handbook is a comprehensive reference guide for researchers, funding agencies and organizations engaged in survey research. Drawing on research from a world-class team of experts, this collection addresses the challenges facing survey-based data collection today as well as the potential opportunities presented by new approaches to survey research, including in the development of policy. It examines innovations in survey methodology and how survey scholars and practitioners should think about survey data in the context of the explosion of new digital sources of data. The Handbook is divided into four key sections: the challenges faced in conventional survey research; opportunities to expand data collection; methods of linking survey data with external sources; and, improving research transparency and data dissemination, with a focus on data curation, evaluating the usability of survey project websites, and the credibility of survey-based social science. Chapter 23 of this book is open access under a CC BY 4.0 license at link.springer.com.

The social sciences are becoming datafied. The questions once considered the domain of sociologists are now answered by data scientists operating on large datasets and breaking with methodological tradition, for better or worse. The traditional social sciences, such as sociology or anthropology, are under the double threat of becoming marginalized or even irrelevant, both from new methods of research which require more computational skills and from increasing competition from the corporate world which gains an additional advantage based on data access. However, unlike data scientists, sociologists and anthropologists have a long history of doing qualitative research. The more quantified datasets we have, the more difficult it is to interpret them without adding layers of qualitative interpretation. Big Data therefore needs Thick Data. This book presents the available arsenal of new methods and tools for studying society both quantitatively and qualitatively, opening ground for the social sciences to take the lead in analysing digital behaviour. It shows that Big Data can and should be supplemented and interpreted through thick data as well as cultural analysis. Thick Big Data is critically important for students and researchers in the social sciences to understand the possibilities of digital analysis, both in the quantitative and qualitative area, and to successfully build mixed-methods approaches.

What is latent class analysis? If you asked that question thirty or forty years ago you would have gotten a different answer than you would today. Closer to its time of inception, latent class analysis was viewed primarily as a categorical data analysis technique, often framed as a factor analysis model where both the measured variable indicators and underlying latent variables are categorical. Today, however, it rests within much broader mixture and diagnostic modeling framework, integrating measured and latent variables that may be categorical and/or continuous, and where latent classes serve to define the subpopulations for whom many aspects of the focal measured and latent variable model may differ. For latent class analysis to take these developmental leaps required contributions that were methodological, certainly, as well as didactic. Among the leaders on both fronts was C. Mitchell "Chan" Dayton, at the University of Maryland, whose work in latent class analysis spanning several decades helped the method to expand and reach its current potential. The current volume in the Center for Integrated Latent Variable Research (CILVR) series reflects the diversity that is latent class analysis today, celebrating work related to, made possible by, and inspired by Chan's noted contributions, and signaling the even more exciting future yet to come.

In the age of big data, being able to make sense of data is an important key to success. Interactive Visual Data Analysis advocates the synthesis of visualization, interaction, and automatic computation to facilitate insight generation and knowledge crystallization from large and complex data. The book provides a systematic and comprehensive overview of visual, interactive, and analytical methods. It introduces criteria for designing interactive visual data analysis solutions, discusses factors influencing the design, and examines the involved processes. The reader is made familiar with the basics of visual encoding and gets to know numerous visualization techniques for multivariate data, temporal data, geo-spatial data, and graph data. A dedicated chapter introduces general concepts for interacting with visualizations and illustrates how modern interaction technology can facilitate the visual data analysis in many ways. Addressing today's large and complex data, the book covers relevant automatic analytical computations to support the visual data analysis. The book also sheds light on advanced concepts for visualization in multi-display environments, user guidance during the data analysis, and progressive visual data analysis. The authors present a top-down perspective on interactive visual data analysis with a focus on concise and clean terminology. Many real-world examples and rich illustrations make the book accessible to a broad interdisciplinary audience from students, to experts in the field, to practitioners in data-intensive application domains. Features: Dedicated to the synthesis of visual, interactive, and analysis methods Systematic top-down view on visualization, interaction, and automatic analysis Broad coverage of fundamental and advanced visualization techniques Comprehensive chapter on interacting with visual representations Extensive integration of automatic computational methods Accessible portrayal of cutting-edge visual analytics technology Foreword by Jack van Wijk For more information, you can also visit the author website, where the book's figures are made available under the CC BY Open Access license.

Enterprise Resource Planning (ERP), Supply Chain Management (SCM), Customer Relationship Management (CRM), Business Intelligence (BI) and Big Data Analytics (BDA) are business related tasks and processes, which are supported by standardized software solutions. The book explains that this requires business oriented thinking and acting from IT specialists and data scientists. It is a good idea to let students experience this directly from the business perspective, for example as executives of a virtual company. The course simulates the stepwise integration of the linked business process chain ERP-SCM-CRM-BI-Big Data of four competing groups of companies. The course participants become board members with full P&L responsibility for business units of one of four beer brewery groups managing supply chains from production to retailer.

Power BI Data Analysis and Visualization provides a roadmap to vendor choices and highlights why Microsoft's Power BI is a very viable, cost effective option for data visualization. The book covers the fundamentals and most commonly used features of Power BI, but also includes an in-depth discussion of advanced Power BI features such as natural language queries; embedding Power BI dashboards; and live streaming data. It discusses real solutions to extract data from the ERP application, Microsoft Dynamics CRM, and also offers ways to host the Power BI Dashboard as an Azure application, extracting data from popular data sources like Microsoft SQL Server and open-source PostgreSQL. Authored by Microsoft experts, this book uses real-world coding samples and screenshots to spotlight how to create reports, embed them in a webpage, view them across multiple platforms, and more. Business owners, IT professionals, data scientists, and analysts will benefit from this thorough presentation of Power BI and its functions.

This book constitutes the proceedings of the 22nd Annual Conference on Research in Computational Molecular Biology, RECOMB 2018, held in Paris, France, in April 2018. The 16 extended and 22 short abstracts presented were carefully reviewed and selected from 193 submissions. The short abstracts are included in the back matter of the volume. They report on original research in all areas of computational molecular biology and bioinformatics.

PRAISE FOR THE ANALYTICS LIFECYCLE TOOLKIT "Full of wisdom and experience about analytics, this book's greatest strength is its lifecycle approach. From framing the question to getting results, you'll learn how analytics can really have an impact on organizations." Thomas H. Davenport, Ph.D., Author of Competing on Analytics and Only Humans Need Apply "This book condenses a lot of deep thinking on the wide field of analytics strategy. Analytics is not easy there are no quickie AI/BI/ML shortcuts to understanding your data, your business, or your processes. You have to build a diverse team of talent. You have to respect the hazards of 'fishing expeditions' that may need false-discovery-rate adjustments. You should consider designed experiments to get the true behavior of a process, something that observational data may hint at, but not provide complete understanding. There are dimensions of data wrangling, feature engineering, and data sense-making that all call for different skills. But with deep investment in analytics comes deep insight into processes and tremendous opportunity for improvements. This book puts analytics in the context of a strategic business system, with all its dimensions." John Sall, Ph.D., SAS co-founder and chief architect of JMP "The Analytics Lifecycle Toolkit provides a clear prescription for organizations aiming to develop a high-performing and scalable analytics capability. Greg organizes and develops with unusual clarity some of the critical nontechnical aspects of the analytics value-chain, and links them with the technical as building blocks in a comprehensive practice. Studying this map of how to negotiate the challenges to effectiveness and efficiency in analytics could save organizations months, or even years of painful trial and error on the road to proficiency." Scott Radcliffe, Executive Director, Data Analytics at Cox Communications "Many books exist that answer the question 'what is the right tool to solve a problem?' This is one of the few books I've read that answers the much more difficult question 'how do we make analytics become transformative throughout our organization?' Incorporating elements of data science, design thinking, and organizational theory, this book is a valuable resource for executives looking to build analytics into their organizational DNA, data scientists looking to expand their organizational reach, and analytics programs that teach students not just how to do data science, but how to use data science to affect tangible change." Jeremy Petranka, Ph.D., Assistant Dean Master of Quantitative Management at Duke University's Fuqua School of Business "This book is the 'thinking person's guide to analytics.' Greg has gone deep on some topics and provided considerable references across the analytics lifecycle. This is one of the best books on analytics I have read...and I think I have read them all!" Bob Gladden, Vice President, Enterprise Analytics, Highmark Health

Get started using Python in data analysis with this compact practical guide. This book includes three exercises and a case study on getting data in and out of Python code in the right format. Learn Data Analysis with Python also helps you discover meaning in the data using analysis and shows you how to visualize it. Each lesson is, as much as possible, self-contained to allow you to dip in and out of the examples as your needs dictate. If you are already using Python for data analysis, you will find a number of things that you wish you knew how to do in Python. You can then take these techniques and apply them directly to your own projects. If you aren't using Python for data analysis, this book takes you through the basics at the beginning to give you a solid foundation in the topic. As you work your way through the book you will have a better of idea of how to use Python for data analysis when you are finished. What You Will Learn Get data into and out of Python code Prepare the data and its format Find the meaning of the data Visualize the data using iPython Who This Book Is For Those who want to learn data analysis using Python. Some experience with Python is recommended but not required, as is some prior experience with data analysis or data science.