Introduction

Question 1

What launch the Big Data era ?

Answer 1

The combination of growing data and on demand cloud computing

Question 2

What steps are required for processing unstructured data ?

Answer 2

Data Acquisition, Storage, Retrieval, Cleaning, Processing

Question 3

What are the 4 technologies helping handle unstructured data ?

Answer 3

Hadoop, Storm, Spark, NoSQL

Question 4

What is Hadoop ?

Answer 4

Open source framework designed to handle big amount of unstructured data

Question 5

What are Storm and Spark ?

Answer 5

Frameworks for real time processing of a big amount of data

Question 6

What is Neo4J ?

Answer 6

A graph database

Question 7

What is Cassandra ?

Answer 7

A Key-Value Pairs database

Question 8

Where does the value of Big Data come ?

Answer 8

Value comes from integrating different types of data source and analysing them at scale

Question 9

What are 3 advantages of integrating data sources leading to an increased data collaboration ?

Answer 9

It reduces complexity, it increases data availability, it unifies the data systems

Question 10

What are the 5 Vs - characteristics of Big Data ?

Answer 10

The 5 Vs are Volume, Variety, Velocity, Veracity, Valence

Question 11

What could be the 6th V completing the 5 characteristics of Big Data coined by Doug Laney of Gartner?

Answer 11

It could be Value.

Question 12

What are the original 3 Vs - Characteristics of Big Data ?

Answer 12

The 3 first V’s are Volume, Variety, Velocity

Question 13

What does Valence refer to ?

Answer 13

This refers to how big data can be bond with each other, forming connections between otherwise disparate datasets. It also refers to the connectiveness of big data in the form of Graphs.

Question 14

What does Volume refer to ?

Answer 14

This refers to the vast amounts of data that is generated every second/minute/hour/day in our digitized world. Dimension of Big Data related to its size and its exponential growth.

Question 15

What does Variety refers to ?

Answer 15

This refers to the ever-increasing different forms that data can come in, e.g., text, images, voice, geospatial. The variety refer to the additional complexity related to different kinds of data that needed to store, combine and process

Question 16

What does Velocity refer to ?

Answer 16

This refers to the speed at which data is being generated and the pace at which data moves from one point to the next.

Question 17

What does Veracity refer to ?

Answer 17

This refers to the quality of the data, which can vary greatly. It sometimes gets referred to as validity or volatility referring to the lifetime of the data.

Question 18

What does Value refer to ?

Answer 18

Processing big data must bring value from insights gained to support decision-making.

Question 19

What are the challenges related to the Volume ?

Answer 19

The challenges of the Volume include the costs, scalability and performance related to there storage, access and processing

Question 20

What should be considered to assess a situtation ?

Answer 20

Risks, Benefits, Contigencies, Regulations, Resources, Requirements

Question 21

How can you define goals ?

Answer 21

Define objectives and success criteria

Question 22

What are the 5 P’s ?

Answer 22

Purpose, People, Process, Platforms, Programmability

Question 23

What are the 5 steps in the data science process?

Answer 23

Acquire, prepare, analyse, report, act

Question 24

Give 5 graph types for visualizing data

Answer 24

Heat map, histogramm, Boxplot, line graphs, scatter plots

Question 25

What is YARN

Answer 25

The ressource manager for Hadoop. Yet another ressource negociator.

Question 26

What is HDFS

Answer 26

The distributed data storage.