Introduction to Apache Spark and Scala Programming

Question 1

What is Spark?

Answer 1

Spark is an execution engine that can do fast computations on big datasets.

Question 2

True or false: Spark offers a big data storage solution.

Answer 2

False.

Question 3

What does Spark focus on?

Answer 3

Fast computation.

Question 4

What is Spark’s computational method?

Answer 4

Spark replaces Hadoop’s implementation of MapReduce with its own implementation.

Question 5

What storage does Hadoop have and what does Spark have?

Answer 5

Hadoop has Hadoop Distributed File System while Spark has none.

Question 6

What MapReduce does Hadoop have and what does Spark have?

Answer 6

Hadoop has built-in and Spark has an optimized built-in.

Question 7

What speed does Hadoop have and what does Spark have?

Answer 7

Hadoop is considered fast but Spark is 10-100 times faster.

Question 8

What resource management does Hadoop have and what does Spark have?

Answer 8

Hadoop has YARN and Spark has its standalone.

Question 9

How is fault tolerance achieved?

Answer 9

Resilient Distributed Datasets (RDDs).

Question 10

What is Scala?

Answer 10

Scalable Language (Scala) is an object-orientated and functional programming language.

Question 11

Why does Spark use Scala?

Answer 11

Scala is the preferred writing because it works with the JVM so interaction with Hadoop is easier.

Question 12

What message broker model does Kafka use?