Chapter 3

Question 1

Organization Prerequisites

Answer 1

• data management and Big Data governance frameworks
• Sound processes and sufficient skillsets
• the quality of the data processing by Big Data solutions needs to be assessed
• well planned roadmap to use big data

Question 2

Data Procurement

Answer 2

means getting data

1. open-source platforms
2. external data sources, ex gov data, commercial data markets

Question 3

Privacy

Answer 3

data can reveal private information when the datasets are analyzed jointly

Question 4

telemetry data

Answer 4

sending data methods, car diagnosis, fit bit

Question 5

security

Answer 5

Securing Big Data involves ensuring that the data networks and repositories are sufficiently secured via
authentication and authorization mechanisms.

Question 6

provenance

Answer 6

• Provenance refers to information about the source of the data and how it has been processed.
• helps determine the authenticity and quality of data,
  and it can be used for auditing purposes
• Ultimately, the goal of capturing provenance is to be able to reason over the generated analytic results with the knowledge of the origin of the data

Question 7

Limited Realtime Support

Answer 7

Approaches that achieve near-realtime

results often process transactional data as it arrives and combine it with previously summarized batch-processed data.

Question 8

Distinct Performance Challenges

Answer 8

1. large datasets coupled with complex search algorithms can lead to long query times.
2. network bandwidth- the time to transfer a unit of data can exceed its actual data processing time

Question 9

Distinct Governance Requirements

Answer 9

• standardization of how data is tagged and the metadata used for tagging
• policies that regulate the kind of external data that may be acquired
• policies regarding the management of data privacy and data anonymization
• policies for the archiving of data sources and analysis results
• policies that establish guidelines for data cleansing and filtering

Question 10

Distinct Methodology

Answer 10

A methodology will be required to control how data flows into and out of Big Data solutions

Question 11

Clouds

Answer 11

clouds provide remote environments that can host IT

infrastructure for large-scale storage and processing, among other things

Question 12

Big Data analytics lifecycle

Answer 12

1. Business Case Evaluation
2. Data Identification
3. Data Acquisition & Filtering
4. Data Extraction
5. Data Validation & Cleansing
6. Data Aggregation & Representation
7. Data Analysis
8. Data Visualization
9. Utilization of Analysis Results

Question 13

At different stages in the analytics lifecycle,

data will be in different states, which are __, ___, ___

Answer 13

data-in-motion (transmitted)
data-in-use (processed)
data-at-rest (storage)

Question 14

Business Case Evaluation

Answer 14

1. define what are the goals and motivation
2. identify KPIs, if not, then SMART goal, which stands for specific, measurable, attainable, relevant and timely
3. Determine the budget, and any required purchases

Question 15

Data Identification

Answer 15

Identifying a wider variety of data sources

Question 16

Data Acquisition & Filtering

Answer 16

• gather all of the data sources that were identified during the previous stage
• filtering for the removal of corrupt data

Question 17

Data Extraction

Answer 17

is dedicated to extracting disparate data and transforming it
into a format that the underlying Big Data solution

Question 18

Data Validation & Cleansing

Answer 18

dedicated to establishing often complex validation rules and removing any known invalid data

Question 19

Data Aggregation & Representation

Answer 19

is dedicated to integrating multiple datasets together using common fields

Question 20

Confirmatory data analysis

Answer 20

deductive approach where the cause of the phenomenon being investigated is proposed beforehand.
The proposed cause or assumption is called a hypothesis.
The data is then analyzed to prove or disprove the hypothesis and provide definitive answers to specific questions

Question 21

Exploratory data analysis

Answer 21

is an inductive approach that is closely associated with data mining.
No hypothesis or predetermined assumptions are generated.
it may not provide definitive answers