MapReduce Algorithm

Question 1

Explain data-level parallelism

Answer 1

same computing on chunks of data

Question 2

What is MapReduce

Answer 2

a systematic approach to algorithm design that is inherently parallelisable

Question 3

What are the characteristics of MapReduce

Answer 3

1. Data aware: data location is considered in scheduling jobs 2. Simple: programmer is freed from parallelization and concurency control 3. Manageable: programmer is freed from data management 4. Scalable: simply increase number of nodes 5. Fault tolerant: built in redundancy 6. Efficient and atutomatic distribution of data and workload across machines

Question 4

What’s Hadoop

Answer 4

it implements the mapreduce algorithm with a single master node and many worker nodes. Client submits a job to master node and the master splits each job into tasks (map/reduce) to worker nodes