Chapter 1: Introduction

Question 1

Big Data Lifecycle

Answer 1

1. Generation
2. Collection
3. Storage
4. Processing
5. Analysis
6. Visualization
7. Disposal

Question 2

Failure of Traditional DB in Handling Big Data

Answer 2

• Exponential increase in volume
• Majority of semi-structured/unstructured data

Question 3

3 V’s of Big Data

Answer 3

• Volume: the size of the data
• Velocity: the rate at which data is generated and processed
• Variety: the format of the data

Question 4

Human-Generated Data

Answer 4

• Data generated as an outcome of interactions of humans with the machines

Question 5

Machine-Generated Data

Answer 5

• Data generated by computer applications or hardware devices without active human intervention

Question 6

Types of Data

Answer 6

• Structured
• Unstructured
• Semi-structured

Question 7

Hadoop

Answer 7

• Open-source framework to support processing of large data sets
• Core components: HDFS, Hadoop common, and MapReduce

Question 8

Hadoop Distributed File System (HDFS)

Answer 8

• Designed to store large data sets with streaming access pattern running on low-cost community hardware

Question 9

MapReduce

Answer 9

• Uses divide and conquer
• Scalable, reliable, and fault-tolerant
• Used in parallel and distributed computing

Question 10

Challenges with Big Data (Textbook)

Answer 10

• Heterogeneity and incompleteness
• Volume and velocity
• Storage
• Privacy