Correlation Flashcards
What is Correlation?
A measure of the degree of relationship between two measures (e.g. weight and height), and can be anywhere between -1 and +1. How strongly related the two variables are.
In regard to human measurement techniques, how is correlation used?
Used for evaluating the reliability and validity of tests.
What is a Correlation Coefficient?
A number between +1 and −1 calculated so as to represent the linear interdependence of two variables or sets of data. This number can be regarded as both a descriptive statistic (describing the strength and direction of a relationship) and a measure of effect size.
What does a Correlation Coefficient of +1 mean?
Perfect relationship. As one measure increases, the other also increases. One predicts the other reliably (not independent).
What does a Correlation Coefficient of 0 mean?
No relationship. The two measures are completely independent of one another.
What does a Correlation Coefficient of -1 mean?
Perfect inverse relationship. As one measure increases, the other decreases.
What is the best way to visualise a correlation?
Using a scatterplot.
What does it mean when we say that there is a high correlation or they are highly correlated?
It means that the variables are NOT independent. One predicts the other very reliably.
What is an outlier?
A value that lies outside most of the other values in a set data.
How would a test to measure electrician ability (performance of tasks) be useful in the real world?
- It could be used as a selection tool if you’re looking to hire electricians
- For electricians to advertise to customers
- To help trainees evaluate and choose electrician training courses
How would you find out if your test to measure electrician ability was any good (the validity of the test)?
You need to see whether the test correlates with real job performance. The higher the correlation the more valid the test.
How do you calculate validity coefficient in regards to electricians?
Calculate correlation between participant’s test scores and their actual job performance ratings. This correlation would be a validity coefficient for the test.
What is a perfect correlation?
Correlation coefficient of 1. You can draw a straight line through all the people.
What is a pretty good correlation?
Correlation would be about 0.8. The further each person is from the best fit line, the lower the correlation (the less accurate the test score is at predicting job performance).
What is an ok correlation?
Correlation would be about 0.4 (not great but probably better than not using the test and hiring at chance).
What is a disastrous correlation?
Correlation would be about 0. Test score and job performance completely independent. Test score gives you no information about job performance.
What does it mean when someone gets a high test score but a low job performance rating?
Correlation would be about 0. Test score and job performance completely independent. Test score gives you no information about job performance.
What is the magnitude of the correlation coefficient dependent on?
The amount of “noise” or scatter in the relationship (the less noise, the stronger the relationship). Also the direction of the correlation coefficient.
If you were given perfect correlations with varying slopes, would this still be considered a correlation of 1? Why?
Yes. Because correlation involves standardising both variables (both variables turn into Z scores), meaning correlation is independent of the scale you are using.
Is correlation only a linear relationship?
Yes
Why must both measures have some decent variability (variance / standard deviation) in their scores?
Because the variation is all that is being measured.
In regards to correlation, it is important to design a measure that yields a decent range of scores. T/F
True
Why is it important to have decent variability in your scores?
If the spread is truncated (restriction of range) then the correlation magnitude may be reduced (i.e. it will give a false impression that the underlying relationship is smaller than it actually is).
Using electricians as an example, how would you ensure variability with their scores?
For the electrician’s test, you would need to ensure that you have tasks of appropriate difficulty so you can tell apart electricians of different levels. Also, recruit participants with an appropriate range of skill levels to evaluate the validity and reliability of your test.