Big Data

Question 1

What are the 5 V’s?

Answer 1

• Volume - the sheer size of the data
• Velocity - the speed at which data arrives and is processed
• Variety - the number of different formats that data comes in
• Variability - the variations in meaning, the context dependence
• Veracity - the uncertainty of data quality

Question 2

What is empirical science?

Answer 2

Science paradigm used thousands of years ago, which involves describing natural phenomena

Question 3

What is theoretical branch science?

Answer 3

Science paradigm used in the last few hundred years, which involves using models and generalizations

Question 4

What is computational branch science?

Answer 4

Science paradigm used in the last few decades, which involves simulating complex phenomena

Question 5

What is data exploration science (eScience)?

Answer 5

Science paradigm used today, which involves unifying a theory, experimenting and simulation

Question 6

What do big data frameworks deal with? (3)

Answer 6

• Distribution of data
• Mapping computation to distributed data
• Handling resource failures

Question 7

What is Hadoop?

Answer 7

An ecosystem of big data technologies that are available as open source, originally developed by Yahoo.

Question 8

What is the MapReduce algorithm?

Answer 8

Allows users to specify a map a function for distributed processing and a reduce function for aggregation of results