Chapter 8- Bivariate correlational research Flashcards
Bivariate correlation
An association that involves exactly 2 variables
Graphing associations when one variable is categorical
You can use a scatter plot to evaluate categorical data as well. The lines will be vertical, and you check to see if they slope up from right to left, slope down, or slope flat. The researchers can also plot categorical data using a bar graph- the mean marital satisfaction rating is graphed for each category
How can you tell a study is correlational?
No matter what kind of graph you see, when both variables are measured, the study is correlational and can support an association claim- an association claim is supported by study design. If a variable is manipulated, that would be an experiment
Construct validity
How well was each variable measured?
How to interrogate the construct validity of an association claim
In a study investigating the associations between deep conversations and well being, you would ask how each variable was operationalized. Once you know that, you could ask questions to assess the construct validity of each. Does the measure have good reliability? Is it measuring what it’s intended to measure? What is the evidence for its face validity, its concurrent validity, and its discriminant and convergent validity?
Effect size
Describes the strength of a relationship between 2 or more variables. Judgements of effect size depend on context, but r values of .1, .3, and .5 are considered weak, moderate, and strong, respectively
Are small effect sizes important?
Larger effect size is often considered more important than a small one if all else is equal. However, small effect sizes can compound over many observations and have an important impact. Ex- star batters in baseball are more likely to get on base during any one at bat, r= .05. This seems small, but over hundreds of at bats during the season, the star batters score many more runs. Small effect sizes can become more important when they are aggregated over many people as well. In one study about the effect of growth mindset, teens assigned to the growth mindset group had better grades, with an effect size of r= .05. This effect size was large enough to prevent 79,000 US teens from scoring in the D or F grade range.
What is the average effect size in psychology?
The average effect size in psychology studies is r= .2, and it will rarely be as high as r= .4
Confidence interval
To communicate the precision of their estimate of r, researchers report a 95% confidence interval. The CI calculations ensure that 95% of CIs will contain the true population correlation. Analogy- a contractor might estimate that repair costs are between $1000-$1500.
How does sample size affect confidence interval?
When an estimate is based on a small sample, it’s less stable. Therefore, they have wider confidence intervals. Have to be wider to capture the degree of uncertainty we have when the sample is small
Statistically significant
A statistically significant correlation is unlikely to have come from a population in which the association is zero. An association is said to be statistically significant when the confidence interval doesn’t contain zero
Replication
Another way to estimate the population association is to conduct the study again and find multiple estimates- this is called replication.
Outlier
An extreme score, a single case or a few cases that stand out from the pack- it exerts disproportionate influence. Adding one outlier data point can change the correlation coefficient drastically, making the relationship appear stronger or weaker than it actually is
When are outliers considered problematic with bivariate correlation?
In a bivariate correlation, outliers are mainly problematic when they involve extreme scores on both variables. When interrogating an association claim, you should ask if there were any outliers. The best way to determine this is to look at the scatter plot and see if any data points stand out
Restriction of range
If there is not a full range of scores on one of the variables in an association, it can make the correlation appear smaller than it really is. Ex- a college only admits students who get a 1200 or higher on their SAT. When looking at the correlation between SAT scores and first year college grades, the correlation between the two for students at that college doesn’t seem very strong. However, looking at the full range of data points for all SAT scores makes the correlation much stronger. The college restricted the range of SAT scores (1200-1600) for students at their college, underestimating the true correlation between SAT scores and grades