Production Machine Learning Systems Flashcards

1
Q

What is static and dynamic prediction?

A
  • Static prediction - caculate prediction in batches, store it to databse and take the results of a prediction from a database on request
  • Dynamic prediction - calculate prediction on the fly
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is Peakedness and Cardianality and how it is realated to choosing between static and dynamic model serving?

A

Peakedness - how much is data concentrated aroud the mean
Cardinality - number of values in the set

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the options to make your training faster?

A
  1. Use a more powerful device
  2. Optimize your input pipeline
  3. Distributed training
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a distributed training?

A

Splitting your training workload across multiple worker nodes (potentially with multiple GPU each) connected over a network

How well did you know this?
1
Not at all
2
3
4
5
Perfectly