Extract-Transform-Load

Question 1

In Extract-Transform-Load, what does extract refer to?

Answer 1

Taking data from the format you find it and and reading it so you can work with it

Question 2

In Extract-Transform-Load, what does transform refer to?

Answer 2

Any steps required to get the data into a useful format

Question 3

In Extract-Transform-Load, what does load refer to?

Answer 3

Saving the workable data then loading it into the next pipeline step

Question 4

What is Extract-Transform-Load?

Answer 4

Getting your data into a nice format so it can be used

Question 5

What are some things you might do as part of the transform step?

Answer 5

Fix types
Split strings
Aggregate data
Pivot data
Filter data
Join data
De-identification
Clean data

Question 6

What are some options to save your data in?

Answer 6

CSV, JSON not efficient
Databases
HDF5, optimized for data sets
Parquet