Week 4 Flashcards

1
Q

In GFS, does file creation require a lock on the directory structure?

A

no

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what does a read lock do

A

prevents a dir from being deleted, renamed or snapshotted

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what does a write lock do

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what do you do when:

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What do you do when:

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q
A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

after a file is deleted, does GFS reclaim the space immedietly

A

no, does it lazily during garbage collection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What exactly happens when a file is deleted in GFS

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the role of heart beats in garbage collection

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what causes a stale chunk replica

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what does working with stale replicas cause

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What 3 things happen when a master grants a new lease on chunk

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Is the GFS optimized for large number of small files

A

no

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what are the primary nature of operations on files in GFS

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

in mapred, what happends when the config property is set to local

A

whole job will be done in a single jvm

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what does the submit() call do on a job object

A

creates an instance of a JobSubmitter

17
Q

What does the tasktracker do

A
18
Q

what does a taskrunner do?

A
19
Q

how is time split up between tasks in the reducer?

A
20
Q

what does the % in the mapper mean

A
21
Q

Who sends heartbeats to the jobtracker every 5 seconds

A

tasktracker

22
Q

what does the jobtracker do

A
23
Q

What is the main purpose of YARN

A
24
Q

what is the resource manager in YARN

A
25
Q

what is the node manager in YARN

A
26
Q

what is the application master in YARN

A
27
Q

What is a small job?

A
28
Q

What happens when a child task fails in classic MR

A
29
Q

what is the type of failure which hadoop has no mechanism for dealing with

A

jobtracker failure

30
Q
A