Week 12

Question 1

Big Data - Name this member of the Five Vs:

the vast amount of data that is generated every
second/minute/hour/day in the digitized world

Answer 1

Volume

Examples: Online transcations (banking), sensors like GPS, accelerometer, facebook & twitter

Question 2

Big Data - Name this member of the Five Vs:

refers to the speed at which data is being
generated and the pace at which data moves from
one point to the next

Answer 2

Velocity

Question 3

Big Data - Name this member of the Five Vs:

refers to the ever-increasing different forms of data
that can come in.

Brings challenges in terms of data integration,
transformation, processing and storage

Answer 3

Variety

Question 4

Big Data - Name this member of the Five Vs: refers to the quality of the data, which can vary
greatly. Lack of this could mean there is noise that needs to removed

Answer 4

Veracity

Noise means meaningless/corrupt/distorted data

Question 5

Big Data - Name this member of the Five Vs: Refers to the usefulness of data for
an enterprise

Answer 5

Value

Question 6

The longer it takes data to be turned into meaningful info, the less value is has for the business. This means _____ and ____ are inversely related

Answer 6

value and time

Question 7

This is a tightly coupled collection of servers or nodes. These servers usually have the same hardware and are connected together on a network, and act as a single unit.

Answer 7

Cluster

Question 8

T/F - Each node in the cluster shares it resources

Answer 8

False. Each node has its own dedicated resources (memory, processor, hdd)

Question 9

T/F - A cluster can execute a task by splitting it into small pieces and distributing those pieces to different computers in the cluster

Answer 9

True

Question 10

T/F - A file system provides a logical view of data, sorting it into a tree structure

Answer 10

True

Question 11

T/F - Distributed file systems can appear local to the client

Answer 11

True (logically, physically they’re not local)

Question 12

Distributed file systems store large _____ spread across nodes of a ______

Answer 12

files spread across nodes of a cluster

Question 13

This is the process of horizontally partitioning a large dataset into a collection of smaller, more manageable dataset

Answer 13

Sharding

Question 14

Shards are distributed across multiple _____, which in this context are ______s or ________s

Answer 14

nodes; servers, machines

Question 15

T/F - In sharding, each shard is stored on the same node

Answer 15

False, they’re stored on separate nodes

Question 16

T/F - In sharding, each node is responsible for only the data stored on it

Answer 16

True

Question 17

T/F - Each shard shares the same schema, and together collectively represent the complete dataset

Answer 17

True

Question 18

This allows the distribution of processing loads across multiple nodes, to achieve horizontal scalability

Answer 18

Sharding

Question 19

What is horizontal scaling in relation to system capacity?

Answer 19

Adding similar or higher capacity resources alongside existing resources, to increase system capacity