GCP & ML Fundamentals Flashcards by Laura Powell

Big data challenges are…

Migrating existing data solutions
Analysing large datasets at scale
Building streaming pipeline
Applying machine learning

How well did you know this?

Not at all

Perfectly

Google Cloud platform is made up of three layers…

Top: Big Data & ML Products

Middle: Compute Power, Storage, Networking

Bottom: Security

How well did you know this?

Not at all

Perfectly

Google cloud bucket names have to be…

Globally unique.

How well did you know this?

Not at all

Perfectly

What is the command line command for google cloud?

gsutil

How well did you know this?

Not at all

Perfectly

Are we charged when a virtual machine is ‘stopped’?

Yes - but only for the disk space (keep the VM and the software which is installed on it).

How well did you know this?

Not at all

Perfectly

Why does cloud computing differ from desktop computing?

In cloud computing - compute power and storage are independent.

How well did you know this?

Not at all

Perfectly

What are the 4 types of google cloud storage?

Standard, Nearline, Coldline and Archive

How well did you know this?

Not at all

Perfectly

What is Stardard Storage?

Best for frequently accessed data and for data which is not going to be stored for a long time.

How well did you know this?

Not at all

Perfectly

What is nearline storage?

Low cost and highly durable for data which is read/modified once a month.

How well did you know this?

Not at all

Perfectly

What is coldline storage?

Lower cost than nearline and highly durable for data which is read/modified once a quarter.

How well did you know this?

Not at all

Perfectly

What is archive storage?

Lowest cost for storing data, archived as a online backup.

How well did you know this?

Not at all

Perfectly

What is a project?

Base level organising entity for creating and using resources, managing billing, APIs and permissions.

How well did you know this?

Not at all

Perfectly

What is a folder?

A folder contains multiple projects within an organisation.

How well did you know this?

Not at all

Perfectly

What is the root node of the GCP hierarchy?

Organisation

Organisation -> Folder -> Project -> Resources e.g. BQ dataset

How well did you know this?

Not at all

Perfectly

What google service controls GCP resources?

Identity and Access Management

How well did you know this?

Not at all

Perfectly

What is IAMs and what does it do?

Identity and Access Management - it allows you to fine tune access control to all the GCP resources in use.

What is the main benefit of networking?

We don’t have to do everything on one machine if we have a fast enough network. Googles data center network enables separation of compute and storage (process data without copying it).

What are edge points of presence (in networking)?

Edge points of presence are where the private google network connects to the public one.

What are the different levels of security you can have?

On-premise (full responsibility)
Infrastructure as a Service (IaaS)
Platform as a Service (PaaS)
Managed Services (Least Responsibility)

What google tool helps to implement security policies?

IAMs (Identity and Access Management)

How can BigQuery be accessed?

Command Line, REST API, Web UI and third party tools (e.g. matillion).

What is Compute Engine?

Lets you run virtual machines on demand in the cloud = IaaS solution.

What are the 3 types of compute engine available on GCP?

Custom Machines - optimal cpu and memory for problem.
Spot Machines - reduce computing cost by 91%
Predefined Machines

What is Google Kubernetes Engine (GKE)?

GKE is clusters of machines running containers, it is way to orchestrate code which is running in containers.

What is a container?

A container is a package of code and its dependencies - it is highly portable and resource efficient.

What is App Engine?

Googles PaaS which is a way to run code without worrying about infrastructure.

What are Cloud Functions?

Serverless execution environments (FaaS (function as a service)) - it executes code in response to an event and google scales resources as required.

What are Googles database managed services?

Cloud BigTable, Storage, SQL, Spanner and Datasource.

What roles exist in an analytics team?

- Data Engineer - Decision Makers - Analysts - Statisticians - Applied ML Engineer - Data Scientists

What is a recommendation system?

Model recommends products based on preferences e.g. Netflix or YouTube. - They must scale to meet demand. - Prediction can be stream or batch.

Where should you store unstructured data?

Cloud Storage

Where should you store data which is structured and has a latency in seconds?

BigQuery

Where should you store data which is structured and has a latency in milli-seconds?

Cloud BigTable

Where should you store data which is structured and is a No SQL workload?

Cloud DataStore

Where should you store data which is structured, is SQL based and where 1 database is enough?

Cloud SQL

Where did Big Data Tools evolve from?

- Hadoop = MapReduce (map; performs filter and reduce; summary operations). - Cloud Services = seperate, specialise and connect.

What are clusters?

Clusters are a fungible resource, they are used when required and manged automatically through dataproc. - Clusters can be up and running in 90seconds.

What can we do to clusters to avoid under or over provisioning?

- Auto Scaling = turn on or off according to job size. | - Incorporate Premptible VMs - affordable (80% cheaper) and short lived but limited.