Stats Flashcards

1
Q

When is a MANOVA used

A

With one or more independent variables and two or more dependent variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Between subjects versus Within subjects designs

And MIXED

A

Between-subjects (or between-groups) study design: different people test each condition, so that each person is only exposed to a single user interface.
Within-subjects (or repeated-measures) study design: the same person tests all the conditions (i.e., all the user interfaces).
MIXED study design utilizes both BETWEEN GROUPS subjects AND WITHIN GROUPS variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

SEM Standard Error of Measurement in creating Confidence Intervals

A

68% confidence interval is the score given + or - the SEM
95% confidence interval is the given score + or - TWICE (x 1.96) the SEM
99% confidence is the given score + or - 2 1/2 times SEM (x 2.58)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

A test developer is calculating a test’s _____ when dividing the number of true positives ID by the test by the number of true positives PLUS false negatives

A

Sensitivity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

The WAIS-IV’s Global Ability Index (GAI) is based on subtests for which of the following Indexes?

A

Verbal Comprehension and Perceptual Reasoning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Taylor-Russell Tables provide an estimate of the incremental validity of a test.

A

The greatest validity comes with a selection ratio of __ and a base rate of __.
Need BASE RATE, SELECTION RATIO, and VALIDITY COEFFICIENT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What happens to the SEM when sample size increases?

A
  • SEM decreases as sample size increases.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Test Unfairness

A

Occurs when for 2 groups (ie men /women):

Criterion-related Validity is SAME
Criterion scores are SAME/SIMILAR, but
Predictor Scores are significantly DIFFERENT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Rancho Los Amigos Level of Cognitive Functioning Scale

A

A patient who receives a rating of Level V (Confused – Inappropriate Response) is confused but non-agitated, responds to simple commands, gives random or fragmented responses to complex stimuli, has impaired memory and selective attention, and is unable to retain new information.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Co-efficient of stability

A

Measures reliability of test across 2 occasions with separate examinees

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Co-efficiency of Internal Consistency

A

Measures the reliability of a factor that fluctuates in intensity or severity over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Test Bias: What does Slope Bias describe?

A

When a predictor’s validity co-efficient differs for different groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Wonderlic Personelle Test - R evaluates what?

A

A brief test of mental ability for adults.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Solomon 4 Group Design

A

Evaluates the effects of pre-testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

SAT Reasoning Test’s purpose

A

Predict the college success of high school seniors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What type of test is the EPPP

A

A measure of basic psychology knowledge

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Multiple Regression Analyses advantages over ANOVA

A
  • Eliminates need for 2-stage analysis involving Global Significance Test followed by “fine grain” significance tests
  • Not limited to categorical variables
  • Enables researchers to determine if adding additional independent variables affects dependent variable beyond the effects found by the initial independent variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Rational Economic model of decision making views decision makers as attempting to make

A

Optimal decisions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

3 Components of a Needs Assessment

A

Organization Analysis, Task Analysis, and Person Analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Example of a point-biserial correlation

A

pregnant or not with multiple item stress test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are you finding out about a predictor when you divide the number of (true positives) by the number of (true positives plus false negatives)

A

A predictor’s SENSITIVITY

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

A psychologist that is testing people would likely find that in comparison with people with a low need for achievement, people with a high need for achievement would prefer which level of task difficulty?

A

MODERATE difficulty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Spearman- Brown formula is used for what?

A

Reliability coeffecient- To estimate the effects of increasing or decreasing the length of a test on it’s reliability coefficient RANKS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What kind of distribution has a mean that is less than the median and a median that is less than the mode?

A

Negatively Skewed

Don’t forget left (lower) and right (higher)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Canonical Correlation
IE: when using scores on 8 subscales of a test to predict the scores on 5 subscales of another test
26
Why would you chose a MANOVA over 2 ANOVAs?
Control for experimentwise error rate; see which factor(s) are truly important; may reveal differences that aren't apparent when doing them separately.
27
Moderator vs Mediator variable
A moderator variable effects the direction or strength of the relationship A mediator variable explains the relationship - HOW or WHY
28
Understand confidence intervals and relationship to SE of measurement
68% confidence interval would be the raw score plus and minus (+ and -) the SE of the measurement
29
In an ANOVA that is comparing the effect of 4 individual variables on 1 dependent variable. What is a significant F value?
When it is greater than 1.0. OR the when the numerator is greater in a ratio of mean square between (numerator) over mean square within (denom)
30
High scores on scales 4 and 9 on the MMPI would likely look like what type of behavior?
Antisocial behavior and impulsivity | 4= psychopathic deviant; 9=hypomania
31
The Theory of Work adjustment indicates that what is the biggest predictor of a worker being forced out of a position is what?
"Satisfactoriness"
32
When will there be more false positives than false negatives?
When a populations base rate is low, and the accuracy of a test is high (over 50%; ie:95%). Because it will be more likely to misdiagnose those NOT having the condition than misdiagnosing those having it that do not.
33
What does G. Herek (1992) attribute to violence against LGBTQ folks?
Heterosexism
34
What are the Raven Colored Progressive Matrices?
A item Intelligence test for 5 -11 year olds; older adults (65+), or those with moderate to severe learning difficulties
35
What does Item Response Theory reflect?
Status of latent trait or ability- good for Criterion-Keyed. Tailored, and Diagnostic/Employment screening; but NOT for TEACHER-MADE tests (too big of sample needed?)
36
ANCOVA
Statistically remove error variance from an extraneous variable
37
What approach was used to define the Big 5 Personality Traits?
Lexical - WORDS- based on definitions in the dictionary originally; personality comes through via language
38
A discrimination score of "0" means what on an academic achievement test?
That there was no difference in answering between low achieving students and high achieving students
39
Which has the lowest reliability out of a 3-point, 7-point, True False, or Free Recall test?
True False
40
Confidence Intervals need what numerical component?
Standard Error of Measurement
41
What is a Wide Range Achievement test?
It is a brief achievement test that measures reading comprehension, spelling, and arithmatic
42
Using an ANOVA: when?
When there are 2 or more independent variables
43
What is Structural Behavior Modeling used for?
Evaluate the predictive influences of multiple latent factors
44
Leptokurtik means what about a distribution?
A higher than normal peak
45
Difference between parametric and not parametric tests?
Important to know if sample not random
46
Research Design 1: Counterbalanced
A WITHIN SUBJECTS design; Used to control "carryover effects"; using different levels of the independent variable with different participants or groups, in a different order.
47
Research Design 2: Randomized Block Design
Used to control the effects of a confounding variable by making sure the individuals or groups are equal on that variable blocked into groups) before then randomly assigning individuals to treatment groups
48
Research Design 3: Solomon 4 Group Design
Special factorial design to evaluate the effects of pretesting on post-test scores. Int/Ext VALIDITY
49
Design 4: Non-equivalent Groups Design
A quasi-experimental research design in which participants CANNOT BE RANDOMLY ASSIGNED to different treatment groups.
50
If a tests reliability coefficient is zero, what else do we know?
That the Standard Error of Measurement for the test is equal to the test's standard deviation
51
Types of Test Construction
1. Factor Analytic method (correlations with some items and less with others) 2. Theoretical method (reflect traits identified by experts as reflective of a specific personality theory 3. Criterion (empirical criterion keying- items that have been shown to distinguish between people who have the trait and people who don't)
52
BARS evaluation
- Behaviorally Anchored Rating Scales - A criticism is that it requires raters to guess at what kinds of behaviors they would expect rather than actual observed behaviors
53
What does research say about effects when comparing day, swing, and night shifts
Night shift has the most with detrimental effects to health, and may or may not be similar to swing shift with regard to impact on social lives
54
What does research say about Single-session Psychological Debriefing?
It does not prevent PTSD but may actually exacerbate symptoms
55
Interrupted Time Series research design
Using a SINGLE Group DV measured at regular intervals before and after treatment
56
What type of scoring would be most useful when scores will determine how much participants learned during a 2-week workshop
Percentage scores | % of each domain mastered
57
Compliance
When a person changes their behavior due to social influence in order to obtain reinforcement or avoid punishment
58
ICC- What is an Item Characteristic Curve?
The relationship between a latent ability and the performance on a test item
59
Fleider's Contingency Model of Leadership (LPC)
A low LPC focuses on completing tasks
60
What scale on the MMPI identifies if someone may be malingering, trying to look bad, or is being careless when answering
F Scale
61
MANCOVA
To control for a confounding correlating variable, multiple dependent variables
62
Meta analysis utilizes an "effect size" to show what?
Mean differences between experimental and control groups
63
Moderator vs Mediator
Moderator- effects the STRENGTH of the relationship | Mediator- are RESPONSIBLE for
64
What is a NONLINEAR TRANSFORMATION?
When score transformations alters the rank order and relative size of the distance between scores
65
What will raising a cutoff score due to T/F Positive and Negatives?
Raising the cutoff score will decrease T and F positives and increase T and F negatives
66
Stepwise Multiple Regression would be used for what?
To reduce the number of predictors needed to account for criterion variability.
67
What part of the Rorschach test is useful for evaluating intelligence?
Organizational Activity
68
With regard to Holland's Self-Directed Search, what is the frequency with which a respondent's CODE occurred in the standardized population is called what?
Commonness
69
KUDER - RICHARDSON 20 test
A high correlation (>.8 or .9) is associated with a homogenous test
70
Latin Square is what kind of statistic??
Administering each level of the independent variable to each participants so that it is given the same number of times to each, IN EACH POSITION
71
What test is based on the PASS model of intelligence?
A measure of basic cognitive processes; The Cognitive Assessment System is based on the PASS model (Planning, Attention, Simultaneous processing and Sequential processing.
72
If a researcher changes is alpha level from .01 to .001, what is likely the result with regard to correctly or incorrectly rejecting or retaining a true or false null hypothesis?
Less likely to incorrectly reject a true null hypothesis
73
If a researcher gets a .85 correlation for participants raw scores and predicted scores, what correlation co-efficient will he get if he converts those scores to non-normalized t-scores?
Also .85
74
What area of scoring would you expect an child with ASD without language impairment to obtain the lowest scores on a WISC-V?
Coding and Symbol Search (processing speed)
75
Student's t-test
Compare the means of scores obtained by 2 groups
76
2 Way ANOVA
Two independent variables
77
Chi Square
Analyzes frequency (nominal) data t
78
What information does the slope of the Item Characteristic Curve tell us?
Discrimination (between low and high achievers), Item difficulty, and probability of getting an item correct by guessing!
79
A test developer is wanting to evaluate the effects of a training program on sales success of newbies; which type of test validity would be important?
Criterion-related
80
If designing achievement test where reliability was most important, what type of test design would you be LEAST likely to choose?
T/F | NOT M/C, essay, FIB
81
When an assumption in an ANOVA is violated, what is the best strategy to use to analyze the data
Krusty-Wallis LOL | Kruskal
82
When conducting an Item Analysis, one item has a p-value of .85. What does this mean?
That the item is easy.
83
P-Values with Item Analysis
Lower = more difficult | Higher + easier (more people answered it correctly)
84
How to discriminate using an Item Analysis?
Calculating D statistic; this is the number of people who got it wrong from the number of people that got it right
85
What is Bonferroni for?
- Control experiment-wise error rate | - Reduce significance level for each comparison
86
When factors are OBLIQUE, what does that mean?
That correlation coefficient for any two factors is greater than 0.
87
OBLIQUE vs ORTHOGONAL
Non-correlated vs Correlated
88
When using a split-half method for reliability, what should you remember?
Splitting using even or odd numbers will likely result in a reliability co-efficient that over-estimates the reliability
89
What statistic (correlation coefficient) would you use when correlating associations between 2 variables that have been artificially dichotomized?
Tetrachoric. Used for comparing 2 artificially dichotomized normal distributions.
90
Eta correlation coefficient
Used for continuous, non-linear variables
91
When would you not want to use autocorrelation?
With a repeated measures design
92
What does "Test the Limits" mean in testing, and when would you do this?
allows extended time or attempts in an effort to evaluate maximum abilities in the individual completing the test. Used after administering the test using standard procedures.
93
Shrinkage
Associated with cross-validation
94
When KNOWLEDGE of a person's score on one test effects how that person is rated on a subsequent test, what is this called?
Criterion Contamination
95
Construct validity
High correlation w/test representing same attributes and low correlation w/test representing opposite attributes
96
A low selection ratio and moderate base rate are useful for what?
Maximizing incremental validity