Modellering Tentaplugg Flashcards
A performance metric is used for what?
It is used to describe, measure and extrapolate information from data. Measure effectiveness and performance.
What does a performance metric contain?
Count of how many times events occur, duration of time intervals, size of parameters. It also derives a value from these parts.
A good performance metric has what characteristics?
Allows accurate and detailed comparisons, leads to correct conclusions, is well understood by everyone and has a quantitative basis. Also, a good metric helps avoid erroneous conclusions.
ADC | Accurate, Detailed, Correct
What is a congestion collapse?
Offered load increases, whilst the work done decreases. A network becomes HIGHLY congested, leading to a significant drop in performance.
Congestion collapses occur frequently in complex systems, but why does it happen?
Might happen because:
- The cost per job increases with the load
- Impatience, where jobs leave before completing
- Rejection, where jobs get rejected before completing
How do we avoid congestion collapses?
With TCP congestion control and/or admission control in web servers
What is a latent congestion collapse?
Think of it as a hidden congestion collapse, that has not yet collapsed. It is a fuse, ready to be set off. Some sort of bottleneck is preventing the collapse, but when resources gets added more and more, it might tip over and reveal the congestion collapse.
What is response time?
The elapsed time from request, to response
What is throughput?
Jobs / Operations completed per time unit
What is bandwidth?
Bits per second
What is Ad hoc metrics?
Metrics that will be defined for specific purposes
What is jitter?
Variation in time delay
What is delay?
Time taken to complete an action
What is resolution?
Smallest increment between two possible measurements
What is accuracy?
How close the mean of the distribution of measurements is to the true value
What is precision?
The level of repeatability and consistency in measurements
What does variability tell us? And what is variability also known as?
It tells us how far apart all the measured values are from eachother.
Variability is known as spread, or scatter
How can we quantify variability?
Histograms: Equally sized buckets of observed data, with 6-7 buckets minimum
Box plots: A type of graph where each box has a line, showing max val, min val, quartiles and mean
Sample variance:
Standard deviation:
What is variance?
A measurement that represents the deviation of observed values, from expected values. A high variance indicates greater dispersion between values, whilst a low variance suggests that the datapoints are closer to the mean.
What is standard deviation?
A statistic that measures the dispersion of a dataset relative to its mean, and is calculated as the square root of the variance
What is a QQplot?
A graphical tool used to compare the distribution of a dataset, to a theoretical distribution, or another dataset. It helps assess whether or not the data come from a population with a known or assumed distribution, such as a normal distribution