Exam 2 Homework Questions Flashcards
If you want to know that a test measures some underlying psychological construct, what type of validity evidence would you want to collect?
Construct Validity
If you correlate scores from your test with some other valid measure that assesses the same set of abilities, what type of validity evidence are your collecting?
Criterion Validity
Cronbach’s Alpha is used to calculate what?
Internal Consistency Reliability
Two trained professionals observe the behavior of children in a classroom. They each rate observed behaviors using the same form and the number of items that were rated the same is calculated. This is an example of which type of reliability?
Interrater
The maximum level of validity possible is equal to what?
The square root of the reliability coefficient
What would the inter-rater reliability be for a 50 item measure in which the number of agreements between Rater 1 and Rater 2 was 45?
0.90
If data are not reliable or not valid, the results of any test or hypothesis…
are inconclusive
Which of the following is concerned with monitoring estimates of present performance and predictions of future performance?
Predictive Validity
This type of validity is determined by the association between the test scores and some specified present or future criterion.
Criterion Validity
This explores the question “how do I know that the test, scale, instrument, etc. measures what it is supposed to?”
Validity
The treatment variable in an analysis is called the…
Independent Variable
The actual or measured score is called _______
The observed score
This is the level of measurement where outcomes are based on some underlying continuum where it is possible to speak about how much more a higher performance is than a lower one:
Interval
What is the key to establishing Criterion Validity?
Quality of Criterion
The correlation between scores from time 1 and time 2 is called:
Test-Retest Reliability
This is the difference between the observed and true scores:
The Error Score
Only this level of measurement has a true zero
Ratio
In terms of the reliability of test scores, there are multiple elements to each person’s score. The score that is actually recorded is the…
Observed Score
High school class rank is highly correlated with college GPA. This is an example of what type of validity?
Predictive Validity
The outcome variable in an analysis is called the…
Dependent Variable
What is the annotation for the experimental population?
Mu 1
What is the annotation for the general population?
Mu2
Optimally, it is possible to generalize you results from ________ to _________.
Your sample/A Larger Population
What type of hypothesis posits a difference between groups where the difference is specified?
Directional hypothesis
Which of the following is an example of a nondirectional hypothesis?
There is a relationship between a high-fat diet and weight gain.
Which of the following is an example of a directional hypothesis?
There is a positive relationship between a high-fat diet and weight gain.
Which of the following means “before the fact”?
A priori
What test would you want to use to test a nondirectional research hypothesis?
Two-tailed Test
If there is no difference between sample and population values, you will have:
No sampling error
A hypothesis is best defined as ______________.
An educated guess
A statement that postulates a relationship between variables is referred to as a ___________.
Research hypothesis
The null hypothesis refers to the ___________, whereas the research hypothesis refers to the __________.
Population/Sample