Getting Started with Azure Databricks

Question 1

IaaS

Answer 1

Infrastructure as a Service: Hardware hosted in the cloud, managed by the subscriber

Question 2

PaaS

Answer 2

Platform as a Service: Application platforms that require minimal hardware configurations.

Question 3

SaaS

Answer 3

Software as a Service: Instant access to software such as Office 365

Question 4

Azure Account

Answer 4

Identifies who you are.

Question 5

Azure Subscription

Answer 5

Identifies resources that have been provisioned to you for billing purposes

Question 6

Resource Group

Answer 6

A container(logical grouping) that stores resources you create.

Question 7

What is a workspace?

Answer 7

A workspace can refer to three different things. Azure Databricks service, Databricks web interface, Databricks File storage.

Question 8

Virtual Machine

Answer 8

Physical Machines divided into multiple simulated machines.

Question 9

Containerization

Answer 9

Manage many application instances automatically to support scaling.

Question 10

What is a cluster?

Answer 10

Provide compute resources needed to run Spark applications.

Question 11

What are libraries?

Answer 11

A collection of functions that extend the feature of a language

Question 12

What are Notebooks?

Answer 12

Databricks programs which can include code and rich annotations.

Question 13

What are Jobs?

Answer 13

Schedules of when to automatically run Databricks notebooks

Question 14

Cluster Mode Standard

Answer 14

A Standard cluster can only be used by one user.

Question 15

Cluster Mode High Concurrency

Answer 15

Create clusters shared amongst multiple users. Does not support Scala

Question 16

Pool

Answer 16

Speeds up cluster creation by using existing available Azure Virtual Machines.

Question 17

Databricks Runtime Version

Answer 17

Determines what programming languages will be supported.

Question 18

Enable Auto Scaling

Answer 18

Automatically dynamically size the cluster based on the estimated number of nodes required to support the submitted job.

Question 19

Terminate after x minutes of inactivity

Answer 19

Determines how long a cluster will remain online before the cluster is automatically shutdown to save on compute resources.

Question 20

Worker type

Answer 20

This is set based on the needs of a given workload. GPU based hardware is available for intensive task.

Question 21

Driver Type

Answer 21

This is the hardware configuration for the driver.