Look at Python from a data science point of view and learn proven techniques for data visualization as used in making critical business decisions. Starting with an introduction to data science with Python, you will take a closer look at the Python environment and get acquainted with editors such as Jupyter Notebook and Spyder. After going through a primer on Python programming, you will grasp fundamental Python programming techniques used in data science. Moving on to data visualization, you will see how it caters to modern business needs and forms a key factor in decision-making. You will also take a look at some popular data visualization libraries in Python. Shifting focus to data structures, you will learn the various aspects of data structures from a data science perspective. You will then work with file I/O and regular expressions in Python, followed by gathering and cleaning data. Moving on to exploring and analyzing data, you will look at advanced data structures in Python. Then, you will take a deep dive into data visualization techniques, going through a number of plotting systems in Python. In conclusion, you will complete a detailed case study, where you'll get a chance to revisit the concepts you've covered so far. What You Will Learn Use Python programming techniques for data science Master data collections in Python Create engaging visualizations for BI systems Deploy effective strategies for gathering and cleaning data Integrate the Seaborn and Matplotlib plotting systems Who This Book Is For Developers with basic Python programming knowledge looking to adopt key strategies for data analysis and visualizations using Python.

A core task in statistical analysis, especially in the era of Big Data, is the fitting of flexible, high-dimensional, and non-linear models to noisy data in order to capture meaningful patterns. This can often result in challenging non-linear and non-convex global optimization problems. The large data volume that must be handled in Big Data applications further increases the difficulty of these problems. Swarm Intelligence Methods for Statistical Regression describes methods from the field of computational swarm intelligence (SI), and how they can be used to overcome the optimization bottleneck encountered in statistical analysis. Features Provides a short, self-contained overview of statistical data analysis and key results in stochastic optimization theory Focuses on methodology and results rather than formal proofs Reviews SI methods with a deeper focus on Particle Swarm Optimization (PSO) Uses concrete and realistic data analysis examples to guide the reader Includes practical tips and tricks for tuning PSO to extract good performance in real world data analysis challenges

The Charter of the United Nations was signed in 1945 by 51 countries representing all continents, paving the way for the creation of the United Nations on 24 October 1945. The Statute of the International Court of Justice forms part of the Charter. The aim of the Charter is to save humanity from war; to reaffirm human rights and the dignity and worth of the human person; to proclaim the equal rights of men and women and of nations large and small; and to promote the prosperity of all humankind. The Charter is the foundation of international peace and security.

This book is a timely and critical introduction for those interested in what data science is (and isn't), and how it should be applied. The language is conversational and the content is accessible for readers without a quantitative or computational background; but, at the same time, it is also a practical overview of the field for the more technical readers. The overarching goal is to demystify the field and teach the reader how to develop an analytical mindset instead of following recipes. The book takes the scientist's approach of focusing on asking the right question at every step as this is the single most important factor contributing to the success of a data science project. Upon finishing this book, the reader should be asking more questions than I have answered. This book is, therefore, a practising scientist's approach to explaining data science through questions and examples.

Engineering analytics is becoming a necessary skill for every engineer. Areas such as Operations Research, Simulation, and Machine Learning can be totally transformed through massive volumes of data. This book is intended to be an introduction to Engineering Analytics that can be used to improve performance tracking, customer segmentation for resource optimization, patterns and classification strategies, and logistics control towers. Basic methods in the areas of visual, descriptive, predictive, and prescriptive analytics and Big Data are introduced. Industrial case studies and example problem demonstrations are used throughout the book to reinforce the concepts and applications. The book goes on to cover visual analytics and its relationships, simulation from the respective dimensions and Machine Learning and Artificial Intelligence from different paradigms viewpoints. The book is intended for professionals wanting to work on analytical problems, for Engineering students, Researchers, Chief-Technology Officers, and Directors that work within the areas and fields of Industrial Engineering, Computer Science, Statistics, Electrical Engineering Operations Research, and Big Data.

In today's fast growing digital world, the web, mobile, social networks and other digital platforms are producing enormous amounts of data that hold intelligence and valuable information. Correctly used it has the power to create sustainable value in different forms for businesses. The commonly used term for this data is Big Data, which includes structured, unstructured and hybrid structured data. However, Big Data is of limited value unless insightful information can be extracted from the sources of data. The solution is Big Data analytics, and how managers and executives can capture value from this vast resource of information and insights. This book develops a simple framework and a non-technical approach to help the reader understand, digest and analyze data, and produce meaningful analytics to make informed decisions. It will support value creation within businesses, from customer care to product innovation, from sales and marketing to operational performance. The authors provide multiple case studies on global industries and business units, chapter summaries and discussion questions for the reader to consider and explore. Big Data for Managers also presents small cases and challenges for the reader to work on - making this a thorough and practical guide for students and managers.

*Covers not just the basics of storytelling with data but also the more complex issues of data searching, cleaning and scraping from a journalist's, rather than a computer scientist's, perspective. *Data Journalism courses are taught at BA and MA level on most Journalism degrees around the world, both as compulsory and elective modules. *Mike Reilley is a leading authority in this area- he founded the Journalist's Toolbox newsletter which shares digital and data tools and has over 51k followers on Twitter, so his name will draw a lot of attention to this book.

Enterprise Process Management Systems: Engineering Process-Centric Enterprise Systems using BPMN 2.0 proposes a process-centric paradigm to replace the traditional data-centric paradigm for Enterprise Systems (ES)--ES should be reengineered from the present data-centric enterprise architecture to process-centric process architecture to be called as Enterprise Process Management Systems (EPMS). The real significance of business processes can be understood in the context of current heightened priority on digital transformation or digitalization of enterprises. Conceiving the roadmap to realize a digitalized enterprise via the business model innovation becomes amenable only from the process-centric view of the enterprise. This pragmatic book: Introduces Enterprise Process Management Systems (EPMS) solutions that enable an agile enterprise. Describes distributed systems and Service Oriented Architecture (SOA) that paved the road to EPMS. Leverages SOA to explain the cloud-based realization of business processes in terms of Web Services. Describes how BPMN 2.0 addresses the requirements for agility by ensuring a seamless methodological path from process requirements modeling to execution and back (to enable process improvements). Presents the spreadsheet-driven Spreadsheeter Application Development (SAD) methodology for the design and development of process-centric application systems. Describes process improvement programs ranging right from disruptive programs like BPR to continuous improvement programs like lean, six sigma and TOC. Enterprise Process Management Systems: Engineering Process-Centric Enterprise Systems using BPMN 2.0 describes how BPMN 2.0 can not only capture business requirements but it can also provide the backbone of the actual solution implementation. Thus, the same diagram prepared by the business analyst to describe the business's desired To-Be process can also be used to automate the execution of that process on a modern process engine.

This book is designed to help practitioners and students in a wide range of construction project management professions to understand what building information modelling (BIM) and big data could mean for them and how they should prepare to work successfully on BIM-compliant projects and maintain their competencies in this essential and expanding area. In this book, the state-of-the-art information technologies that support high-profile BIM implementation are introduced, and case studies show how BIM has integrated core quantity surveying and cost management responsibilities and how big data can enable informed decision-making for cost control and cost planning. The authors' combined professional and academic experience demonstrates, with practical examples, the importance of using BIM and particularly the fusion of BIM and big data, to sharpen competitiveness in global and domestic markets. This book is a highly valuable guide for people in a wide range of construction project management and quantity surveying roles. In addition, implications for project management, facilities management, contract administration, and dispute resolution are also explored through the case studies, making this book essential reading for built environment and engineering professionals.

To be effective, data-intensive systems require extensive ongoing customisation to reflect changing user requirements, organisational policies, and the structure and interpretation of the data they hold. Manual customisation is expensive, time-consuming, and error-prone. In large complex systems, the value of the data can be such that exhaustive testing is necessary before any new feature can be added to the existing design. In most cases, the precise details of requirements, policies and data will change during the lifetime of the system, forcing a choice between expensive modification and continued operation with an inefficient design. Engineering Agile Big-Data Systems outlines an approach to dealing with these problems in software and data engineering, describing a methodology for aligning these processes throughout product lifecycles. It discusses tools which can be used to achieve these goals, and, in a number of case studies, shows how the tools and methodology have been used to improve a variety of academic and business systems.

The past decade has seen a dramatic increase in the amount and variety of information that is generated and stored electronically by business enterprises. Storing this increased volume of information has not been a problem to date, but as these information stores grow larger and larger, multiple challenges arise for senior management: namely, questions such as "How much is our data worth?" "Are we storing our data in the most cost-effective way?" "Are we managing our data effectively and efficiently?" "Do we know which data is most important?" "Are we extracting business insight from the right data?" "Are our data adding to the value of our business?" "Are our data a liability?" "What is the potential for monetizing our data?" and "Do we have an appropriate risk management plan in place to protect our data?" To answer these value-based questions, data must be treated with the same rigor and discipline as other tangible and intangible assets. In other words, corporate data should be treated as a potential asset and should have its own asset valuation methodology that is accepted by the business community, the accounting and valuation community, and other important stakeholder groups. Valuing Data: An Open Framework is a first step in that direction. Its purpose is to: Provide the reader with some background on the nature of data Present the common categories of business data Explain the importance of data management Report the current thinking on data valuation Offer some business reasons to value data Present an "open framework"-along with some proposed methods-for valuing data The book does not aim to prescribe exactly how data should be valued monetarily, but rather it is a "starting point" for a discussion of data valuation with the objective of developing a stakeholder consensus, which, in turn, will become accepted standards and practices.

Public Policy Analytics: Code & Context for Data Science in Government teaches readers how to address complex public policy problems with data and analytics using reproducible methods in R. Each of the eight chapters provides a detailed case study, showing readers: how to develop exploratory indicators; understand 'spatial process' and develop spatial analytics; how to develop 'useful' predictive analytics; how to convey these outputs to non-technical decision-makers through the medium of data visualization; and why, ultimately, data science and 'Planning' are one and the same. A graduate-level introduction to data science, this book will appeal to researchers and data scientists at the intersection of data analytics and public policy, as well as readers who wish to understand how algorithms will affect the future of government.

In recent years, a considerable amount of effort has been devoted, both in industry and academia, to improving maintenance. Time is a critical factor in maintenance, and efforts are placed to monitor, analyze, and visualize machine or asset data in order to anticipate to any possible failure, prevent damage, and save costs. The MANTIS Book aims to highlight the underpinning fundamentals of Condition-Based Maintenance related conceptual ideas, an overall idea of preventive maintenance, the economic impact and technical solution. The core content of this book describes the outcome of the Cyber-Physical System based Proactive Collaborative Maintenance project, also known as MANTIS, and funded by EU ECSEL Joint Undertaking under Grant Agreement n 662189. The ambition has been to support the creation of a maintenance-oriented reference architecture that support the maintenance data lifecycle, to enable the use of novel kinds of maintenance strategies for industrial machinery. The key enabler has been the fine blend of collecting data through Cyber-Physical Systems, and the usage of machine learning techniques and advanced visualization for the enhanced monitoring of the machines. Topics discussed include, in the context of maintenance: Cyber-Physical Systems, Communication Middleware, Machine Learning, Advanced Visualization, Business Models, Future Trends. An important focus of the book is the application of the techniques in real world context, and in fact all the work is driven by the pilots, all of them centered on real machines and factories. This book is suitable for industrial and maintenance managers that want to implement a new strategy for maintenance in their companies. It should give readers a basic idea on the first steps to implementing a maintenance-oriented platform or information system.

DataOps is a new way of delivering data and analytics that is proven to get results. It enables IT and users to collaborate in the delivery of solutions that help organisations to embrace a data-driven culture. The DataOps Revolution: Delivering the Data-Driven Enterprise is a narrative about real world issues involved in using DataOps to make data-driven decisions in modern organisations. The book is built around real delivery examples based on the author's own experience and lays out principles and a methodology for business success using DataOps. Presenting practical design patterns and DataOps approaches, the book shows how DataOps projects are run and presents the benefits of using DataOps to implement data solutions. Best practices are introduced in this book through the telling of a story, which relates how a lead manager must find a way through complexity to turn an organisation around. This narrative vividly illustrates DataOps in action, enabling readers to incorporate best practices into everyday projects. The book tells the story of an embattled CIO who turns to a new and untested project manager charged with a wide remit to roll out DataOps techniques to an entire organisation. It illustrates a different approach to addressing the challenges in bridging the gap between IT and the business. The approach presented in this story lines up to the six IMPACT pillars of the DataOps model that Kinaesis (www.kinaesis.com) has been using through its consultants to deliver successful projects and turn around failing deliveries. The pillars help to organise thinking and structure an approach to project delivery. The pillars are broken down and translated into steps that can be applied to real-world projects that can deliver satisfaction and fulfillment to customers and project team members.

It's axiomatic to state that people fear what they do not understand, and this is especially true when it comes to technology. However, despite their prevalence, computers remain shrouded in mystery, and many users feel apprehensive when interacting with them. Smartphones have only exacerbated the issue. Indeed, most users of these devices leverage only a small fraction of the power they hold in their hands. How Things Work: The Computer Science Edition is a roadmap for readers who want to overcome their technophobia and harness the full power of everyday technology. Beginning with the basics, the book demystifies the mysterious world of computer science, explains its fundamental concepts in simple terms, and answers the questions many users feel too intimidated to ask. By the end of the book, readers will understand how computers and smart devices function and, more important, how they can make these devices work for them. To complete the picture, the book also introduces readers to the darker side of modern technology: security and privacy concerns, identity theft, and threats from the Dark Web.

The creation, accumulation, and use of copious amounts of data are driving rapid change across a wide variety of industries and academic disciplines. This 'Big Data' phenomenon is the result of recent developments in computational technology and improved data gathering techniques that have led to substantial innovation in the collection, storage, management, and analysis of data. Real Estate Analysis in the Information Age: Techniques for Big Data and Statistical Modeling focuses on the real estate discipline, guiding researchers and practitioners alike on the use of data-centric methods and analysis from applied and theoretical perspectives. In it, the authors detail the integration of Big Data into conventional real estate research and analysis. The book is process-oriented, not only describing Big Data and associated methods, but also showing the reader how to use these methods through case studies supported by supplemental online material. The running theme is the construction of efficient, transparent, and reproducible research through the systematic organization and application of data, both traditional and 'big'. The final chapters investigate legal issues, particularly related to those data that are publicly available, and conclude by speculating on the future of Big Data in real estate.

Convergence of Blockchain, AI and IoT: A Digital Platform discusses the convergence of three powerful technologies that play into the digital revolution and blur the lines between biological, digital, and physical objects. This book covers novel algorithms, solutions for addressing issues in applications, security, authentication, and privacy. Discusses innovative technological upgradation and significant challenges in the current era Gives an overview of clinical scientific research that enables smart diagnosis through artificial intelligence Provides an insight into how disruptive technology enabled with the self-running devices and protection mechanism is involved in an augmented reality with blockchain mechanism Talks about neural science being capable of enhancing deep brain waves to predict an overall improvement in human thoughts and behaviours Covers the digital currency mechanism in detail Enhances the knowledge of the readers about smart contract and ledger mechanism with artificial intelligence and blockchain mechanism Targeted audiences range from those interested in the technical revolution of blockchain, big data and the Internet of Things, to research scholars and the professional market.

The rapid increase of cloud computing, high performance computing (HPC) and the vast growth in Internet and Social Media use have aroused the interest in energy consumption and the carbon footprint of Data Centres. Data Centres primarily contain electronic equipment used for data processing (servers), data storage (storage equipment), and communications (network equipment). Collectively, this equipment processes, stores, and transmits digital information and is known as information technology (IT) equipment. Advanced Concepts for Renewable Energy Supply of Data Centres introduces a number of technical solutions for the supply of power and cooling energy into Data Centres with enhanced utilisation of renewable energy sources in order to achieve low energy Data Centres. Because of the high energy density nature of these unique infrastructures, it is essential to implement energy efficiency measures and reduce consumption before introducing any renewable energy source. A holistic approach is used with the objective of integrating many technical solutions such as management of the IT (Information Technology) load, efficient electrical supply to the IT systems, Low-Ex air-conditioning systems, interaction with district heating and cooling networks, re-use of heat, free cooling (air, seawater, groundwater), optimal use of heat and cold storage, electrical storage and integration in smart grids. This book is therefore a catalogue of advanced technical concepts that could be integrated into Data Centres portfolio in order to increase the overall efficiency and the share of renewable energies in power and cooling supply. Based on dynamic energy models implemented in TRNSYS some concepts are deeply evaluated through yearly simulations. The results of the simulation are illustrated with Sankey charts, where the energy flows per year within the subsystems of each concept for a selected scenario are shown, and graphs showing the results of parametric analysis. A set of environmental metrics (as the non-renewable primary energy) and financial metrics (CAPEX and OPEX) as well of energy efficiency metrics like the well-known PUE, are described and used to evaluate the different technical concepts.

Due to the increasing complexity in application workloads and query engines, database administrators are turning to automated tuning tools that systematically explore the space of physical design alternatives. A critical element of such tuning is physical database design since the choice of physical structures has a significant impact on the performance of the database system. Automated Physical Database Design and Tuning presents a detailed overview of the fundamental ideas and algorithms for automatically recommending changes to the physical design of a database system. The first part of the book introduces the necessary technical background. The author explains SQL, the space of execution plans for answering SQL queries, query optimization, how the choice of access paths (e.g., indexes) is crucial to performance, and the complexity of the physical design problem. The second part extensively discusses automated physical design techniques, covering fundamental research ideas in the last 15 years that have resulted in a new generation of tuning tools. The text focuses on the search space of alternatives, the necessity of a cost model to compare such alternatives, different mechanisms to traverse and enumerate the search space, and practical aspects in real-world tuning tools. In the third part, the author explores new advances in automated physical design. He applies previous approaches to other physical structures, such as materialized views, partitioning, and multidimensional clustering. He also analyzes workload models for new types of applications, generalizes the optimizing function of current physical design tools to cope with other application scenarios, and examines open-ended challenges in physical database design. This book offers valuable insights on well-established principles and cutting-edge research results in automated physical design. It helps readers gain a deeper understanding of how automated tuning tools work in database installations as well as the challenges and opportunities involved in designing next-generation tuning tools.

An emerging topic in software engineering and data mining, specification mining tackles software maintenance and reliability issues that cost economies billions of dollars each year. The first unified reference on the subject, Mining Software Specifications: Methodologies and Applications describes recent approaches for mining specifications of software systems. Experts in the field illustrate how to apply state-of-the-art data mining and machine learning techniques to address software engineering concerns. In the first set of chapters, the book introduces a number of studies on mining finite state machines that employ techniques, such as grammar inference, partial order mining, source code model checking, abstract interpretation, and more. The remaining chapters present research on mining temporal rules/patterns, covering techniques that include path-aware static program analyses, lightweight rule/pattern mining, statistical analysis, and other interesting approaches. Throughout the book, the authors discuss how to employ dynamic analysis, static analysis, and combinations of both to mine software specifications. According to the US National Institute of Standards and Technology in 2002, software bugs have cost the US economy 59.5 billion dollars a year. This volume shows how specification mining can help find bugs and improve program understanding, thereby reducing unnecessary financial losses. The book encourages the industry adoption of specification mining techniques and the assimilation of these techniques in standard integrated development environments (IDEs).

Data Mining for Design and Marketing shows how to design and integrate data mining tools into human thinking processes in order to make better business decisions, especially in designing and marketing products and systems. The expert contributors discuss how data mining can identify valuable consumer patterns, which aid marketers and designers in detecting consumers' needs. They also explore visualization tools based on the computational methods of data mining. Discourse analysis, chance discovery, knowledge discovery, formal concept analysis, and an adjacency matrix are just some of the novel approaches covered. The book explains how these methods can be applied to website design, the retrieval of scientific articles from a database, personalized e-commerce support tools, and more. Through the techniques of data mining, this book demonstrates how to effectively design business processes and develop competitive products and services. By embracing data mining tools, businesses can better understand the behavior and needs of their customers.

Traditional methods for handling spatial data are encumbered by the assumption of separate origins for horizontal and vertical measurements, but modern measurement systems operate in a 3-D spatial environment. The 3-D Global Spatial Data Model: Principles and Applications, Second Edition maintains a new model for handling digital spatial data, the global spatial data model or GSDM. The GSDM preserves the integrity of three-dimensional spatial data while also providing additional benefits such as simpler equations, worldwide standardization, and the ability to track spatial data accuracy with greater specificity and convenience. This second edition expands to new topics that satisfy a growing need in the GIS, professional surveyor, machine control, and Big Data communities while continuing to embrace the earth center fixed coordinate system as the fundamental point of origin of one, two, and three-dimensional data sets. Ideal for both beginner and advanced levels, this book also provides guidance and insight on how to link to the data collected and stored in legacy systems.

Interest in predictive analytics of big data has grown exponentially in the four years since the publication of Statistical and Machine-Learning Data Mining: Techniques for Better Predictive Modeling and Analysis of Big Data, Second Edition. In the third edition of this bestseller, the author has completely revised, reorganized, and repositioned the original chapters and produced 13 new chapters of creative and useful machine-learning data mining techniques. In sum, the 43 chapters of simple yet insightful quantitative techniques make this book unique in the field of data mining literature. What is new in the Third Edition: The current chapters have been completely rewritten. The core content has been extended with strategies and methods for problems drawn from the top predictive analytics conference and statistical modeling workshops. Adds thirteen new chapters including coverage of data science and its rise, market share estimation, share of wallet modeling without survey data, latent market segmentation, statistical regression modeling that deals with incomplete data, decile analysis assessment in terms of the predictive power of the data, and a user-friendly version of text mining, not requiring an advanced background in natural language processing (NLP). Includes SAS subroutines which can be easily converted to other languages. As in the previous edition, this book offers detailed background, discussion, and illustration of specific methods for solving the most commonly experienced problems in predictive modeling and analysis of big data. The author addresses each methodology and assigns its application to a specific type of problem. To better ground readers, the book provides an in-depth discussion of the basic methodologies of predictive modeling and analysis. While this type of overview has been attempted before, this approach offers a truly nitty-gritty, step-by-step method that both tyros and experts in the field can enjoy playing with.

The book presents a comprehensive study of various cognitive and affective aspects of web searching for translation problem solving. Research into the use of the web as an external aid of consultation has frequently occupied a secondary position in the investigation of translation processes. The book aims to bridge this gap in the literature. Beginning with a detailed survey of previous studies of these processes, it then focuses on web search behaviors using qualitative and quantitative analysis that presents a multifaceted overview of translation-oriented web searching. The book concludes by addressing the implications for the teaching of and research into translators' web searching skills. With regard to teaching, the book's didactic discussions will make it a valuable tool for both translator trainers and translation students wanting to familiarize themselves with the intricacies of Web searching and to reflect upon the pedagogical implications of the study for acquiring online information literacy in translator training.

In the constant battle between human intelligence and machine intelligence, machines are close to surpassing human intelligence. The unrestrained use of digital technologies in automating processes is one of the prime advantages of the third industrial revolution. As a result, all developed and developing nations have started to digitalize mundane tasks. Thus, digital technologies for information and communication technologies (ICT) have achieved high market space in terms of infrastructure building, employment generation, education sector reforms, funds mobilization, electronic governance, hardware manufacturing, software development, etc. Hence, it is evident that every segment of society has been penetrated by ICT or digitalization. This book attempts to spotlight areas where AI is thriving. FEATURES Impact of digitalization and AI on governance Novel AI practices being followed across the global community in security, healthcare, crime prevention and detection, education, agriculture, sensor networks, etc. Innovative techniques that can be adopted to ensure better quality and better delivery of services to the society Avenues for further research by the research community and student fraternity This book is a guide for university students (especially those from technical backgrounds), industries, NGOs, and policy makers.