Big Data Intro - Week 1

Question 1

Big Data: 5 V’s?

Answer 1

5 Vs: volume, variety, velocity, veracity, and value.

Question 2

What does veracity mean?

Answer 2

Veracity – Data Trustworthiness: refers to uncertainty due to data inconsistency & incompleteness, ambiguities, latency, deception, model approximations.

Question 3

Big Data Characteristics (the other 5 v’s)

Answer 3

● Validity: correctness of data
● Variability: dynamic behaviour
● Volatility: tendency to change in time
● Vulnerability: vulnerable to breach or attacks
● Visualization: visualizing meaningful usage of data

Question 4

What are some challenges of processing big data?

Answer 4

○ The analysis of Big Data which uses data structures which do not conform to traditional notions of data structure
○ The storage of data that exceeds the capacity of conventional computer systems
○ The processing of Big Data that may require computational resources exceeding the computation capacities of conventional computing systems.

Question 5

What is prescriptive referring to?

Answer 5

Prescriptive
○ Answers what should be done based on data.
○ Provides actionable intelligence.

Question 6

What are 4 types of Big Data Analytics?

Answer 6

Descriptive, Predictive, presciptive, diagnostic

Question 7

What are the stages of big data analytics?

Answer 7

● Problem identification & data requirement
● Data pre-processing
● Data Analytics
● Data Visualization

Question 8

What is quasi structured data?

Answer 8

Somewhat structured data that can become structured through algorithms, tools, and time.

Question 9

What is spark used for in one sentence?

Answer 9

Spark is used for real time data analytic processing

Question 10

In one word, what is PIG used for?

Answer 10

Analytics

Question 11

In less than one sentence, describe what HIVE is used for

Answer 11

Data warehousing