Data Engineering Fundamentals - Data Skew Techniques

Question 1

______________ unequal distribution or imbalance of data across various nodes or partitions in distributed computing systems.

a) indexing
b) Partitioning
c) Data Skew

Answer 1

Data Skew

Even partitioning doesn’t work if your traffic is uneven.
Like IMDB - actor id and has and distribute across partitions. Whatever partition has more traffic will overload.

Question 2

Non __________ distribution of data.

Is a cause for data skew.

Answer 2

Uniform.

Question 3

Inadequate partitioning strategy, Temporal skew.

Are causes for ___________

a) Data Skew
b) Indexing

Answer 3

Data Skew

Question 4

Adaptive Partitioning,
Salting
RePartitioning,
Sampling,
Custom Partitioning

are ways to address _____________

a) indexing
b) Data Skew

Answer 4

Data Skew