Stats Flashcards

1
Q

When is a MANOVA used

A

With one or more independent variables and two or more dependent variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Between subjects versus Within subjects designs

And MIXED

A

Between-subjects (or between-groups) study design: different people test each condition, so that each person is only exposed to a single user interface.
Within-subjects (or repeated-measures) study design: the same person tests all the conditions (i.e., all the user interfaces).
MIXED study design utilizes both BETWEEN GROUPS subjects AND WITHIN GROUPS variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

SEM Standard Error of Measurement in creating Confidence Intervals

A

68% confidence interval is the score given + or - the SEM
95% confidence interval is the given score + or - TWICE (x 1.96) the SEM
99% confidence is the given score + or - 2 1/2 times SEM (x 2.58)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

A test developer is calculating a test’s _____ when dividing the number of true positives ID by the test by the number of true positives PLUS false negatives

A

Sensitivity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

The WAIS-IV’s Global Ability Index (GAI) is based on subtests for which of the following Indexes?

A

Verbal Comprehension and Perceptual Reasoning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Taylor-Russell Tables provide an estimate of the incremental validity of a test.

A

The greatest validity comes with a selection ratio of __ and a base rate of __.
Need BASE RATE, SELECTION RATIO, and VALIDITY COEFFICIENT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What happens to the SEM when sample size increases?

A
  • SEM decreases as sample size increases.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Test Unfairness

A

Occurs when for 2 groups (ie men /women):

Criterion-related Validity is SAME
Criterion scores are SAME/SIMILAR, but
Predictor Scores are significantly DIFFERENT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Rancho Los Amigos Level of Cognitive Functioning Scale

A

A patient who receives a rating of Level V (Confused – Inappropriate Response) is confused but non-agitated, responds to simple commands, gives random or fragmented responses to complex stimuli, has impaired memory and selective attention, and is unable to retain new information.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Co-efficient of stability

A

Measures reliability of test across 2 occasions with separate examinees

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Co-efficiency of Internal Consistency

A

Measures the reliability of a factor that fluctuates in intensity or severity over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Test Bias: What does Slope Bias describe?

A

When a predictor’s validity co-efficient differs for different groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Wonderlic Personelle Test - R evaluates what?

A

A brief test of mental ability for adults.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Solomon 4 Group Design

A

Evaluates the effects of pre-testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

SAT Reasoning Test’s purpose

A

Predict the college success of high school seniors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What type of test is the EPPP

A

A measure of basic psychology knowledge

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Multiple Regression Analyses advantages over ANOVA

A
  • Eliminates need for 2-stage analysis involving Global Significance Test followed by “fine grain” significance tests
  • Not limited to categorical variables
  • Enables researchers to determine if adding additional independent variables affects dependent variable beyond the effects found by the initial independent variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Rational Economic model of decision making views decision makers as attempting to make

A

Optimal decisions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

3 Components of a Needs Assessment

A

Organization Analysis, Task Analysis, and Person Analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Example of a point-biserial correlation

A

pregnant or not with multiple item stress test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are you finding out about a predictor when you divide the number of (true positives) by the number of (true positives plus false negatives)

A

A predictor’s SENSITIVITY

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

A psychologist that is testing people would likely find that in comparison with people with a low need for achievement, people with a high need for achievement would prefer which level of task difficulty?

A

MODERATE difficulty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Spearman- Brown formula is used for what?

A

Reliability coeffecient- To estimate the effects of increasing or decreasing the length of a test on it’s reliability coefficient RANKS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What kind of distribution has a mean that is less than the median and a median that is less than the mode?

A

Negatively Skewed

Don’t forget left (lower) and right (higher)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Canonical Correlation

A

IE: when using scores on 8 subscales of a test to predict the scores on 5 subscales of another test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Why would you chose a MANOVA over 2 ANOVAs?

A

Control for experimentwise error rate; see which factor(s) are truly important; may reveal differences that aren’t apparent when doing them separately.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Moderator vs Mediator variable

A

A moderator variable effects the direction or strength of the relationship
A mediator variable explains the relationship - HOW or WHY

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Understand confidence intervals and relationship to SE of measurement

A

68% confidence interval would be the raw score plus and minus (+ and -) the SE of the measurement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

In an ANOVA that is comparing the effect of 4 individual variables on 1 dependent variable. What is a significant F value?

A

When it is greater than 1.0. OR the when the numerator is greater in a ratio of mean square between (numerator) over mean square within (denom)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

High scores on scales 4 and 9 on the MMPI would likely look like what type of behavior?

A

Antisocial behavior and impulsivity

4= psychopathic deviant; 9=hypomania

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

The Theory of Work adjustment indicates that what is the biggest predictor of a worker being forced out of a position is what?

A

“Satisfactoriness”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

When will there be more false positives than false negatives?

A

When a populations base rate is low, and the accuracy of a test is high (over 50%; ie:95%). Because it will be more likely to misdiagnose those NOT having the condition than misdiagnosing those having it that do not.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What does G. Herek (1992) attribute to violence against LGBTQ folks?

A

Heterosexism

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What are the Raven Colored Progressive Matrices?

A

A item Intelligence test for 5 -11 year olds; older adults (65+), or those with moderate to severe learning difficulties

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What does Item Response Theory reflect?

A

Status of latent trait or ability- good for Criterion-Keyed. Tailored, and Diagnostic/Employment screening; but NOT for TEACHER-MADE tests (too big of sample needed?)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

ANCOVA

A

Statistically remove error variance from an extraneous variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What approach was used to define the Big 5 Personality Traits?

A

Lexical - WORDS- based on definitions in the dictionary originally; personality comes through via language

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

A discrimination score of “0” means what on an academic achievement test?

A

That there was no difference in answering between low achieving students and high achieving students

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Which has the lowest reliability out of a 3-point, 7-point, True False, or Free Recall test?

A

True False

40
Q

Confidence Intervals need what numerical component?

A

Standard Error of Measurement

41
Q

What is a Wide Range Achievement test?

A

It is a brief achievement test that measures reading comprehension, spelling, and arithmatic

42
Q

Using an ANOVA: when?

A

When there are 2 or more independent variables

43
Q

What is Structural Behavior Modeling used for?

A

Evaluate the predictive influences of multiple latent factors

44
Q

Leptokurtik means what about a distribution?

A

A higher than normal peak

45
Q

Difference between parametric and not parametric tests?

A

Important to know if sample not random

46
Q

Research Design 1: Counterbalanced

A

A WITHIN SUBJECTS design; Used to control “carryover effects”; using different levels of the independent variable with different participants or groups, in a different order.

47
Q

Research Design 2: Randomized Block Design

A

Used to control the effects of a confounding variable by making sure the individuals or groups are equal on that variable blocked into groups) before then randomly assigning individuals to treatment groups

48
Q

Research Design 3: Solomon 4 Group Design

A

Special factorial design to evaluate the effects of pretesting on post-test scores. Int/Ext VALIDITY

49
Q

Design 4: Non-equivalent Groups Design

A

A quasi-experimental research design in which participants CANNOT BE RANDOMLY ASSIGNED to different treatment groups.

50
Q

If a tests reliability coefficient is zero, what else do we know?

A

That the Standard Error of Measurement for the test is equal to the test’s standard deviation

51
Q

Types of Test Construction

A
  1. Factor Analytic method (correlations with some items and less with others)
  2. Theoretical method (reflect traits identified by experts as reflective of a specific personality theory
  3. Criterion (empirical criterion keying- items that have been shown to distinguish between people who have the trait and people who don’t)
52
Q

BARS evaluation

A
  • Behaviorally Anchored Rating Scales
  • A criticism is that it requires raters to guess at what kinds of behaviors they would expect rather than actual observed behaviors
53
Q

What does research say about effects when comparing day, swing, and night shifts

A

Night shift has the most with detrimental effects to health, and may or may not be similar to swing shift with regard to impact on social lives

54
Q

What does research say about Single-session Psychological Debriefing?

A

It does not prevent PTSD but may actually exacerbate symptoms

55
Q

Interrupted Time Series research design

A

Using a SINGLE Group DV measured at regular intervals before and after treatment

56
Q

What type of scoring would be most useful when scores will determine how much participants learned during a 2-week workshop

A

Percentage scores

% of each domain mastered

57
Q

Compliance

A

When a person changes their behavior due to social influence in order to obtain reinforcement or avoid punishment

58
Q

ICC- What is an Item Characteristic Curve?

A

The relationship between a latent ability and the performance on a test item

59
Q

Fleider’s Contingency Model of Leadership (LPC)

A

A low LPC focuses on completing tasks

60
Q

What scale on the MMPI identifies if someone may be malingering, trying to look bad, or is being careless when answering

A

F Scale

61
Q

MANCOVA

A

To control for a confounding correlating variable, multiple dependent variables

62
Q

Meta analysis utilizes an “effect size” to show what?

A

Mean differences between experimental and control groups

63
Q

Moderator vs Mediator

A

Moderator- effects the STRENGTH of the relationship

Mediator- are RESPONSIBLE for

64
Q

What is a NONLINEAR TRANSFORMATION?

A

When score transformations alters the rank order and relative size of the distance between scores

65
Q

What will raising a cutoff score due to T/F Positive and Negatives?

A

Raising the cutoff score will decrease T and F positives and increase T and F negatives

66
Q

Stepwise Multiple Regression would be used for what?

A

To reduce the number of predictors needed to account for criterion variability.

67
Q

What part of the Rorschach test is useful for evaluating intelligence?

A

Organizational Activity

68
Q

With regard to Holland’s Self-Directed Search, what is the frequency with which a respondent’s CODE occurred in the standardized population is called what?

A

Commonness

69
Q

KUDER - RICHARDSON 20 test

A

A high correlation (>.8 or .9) is associated with a homogenous test

70
Q

Latin Square is what kind of statistic??

A

Administering each level of the independent variable to each participants so that it is given the same number of times to each, IN EACH POSITION

71
Q

What test is based on the PASS model of intelligence?

A

A measure of basic cognitive processes; The Cognitive Assessment System is based on the PASS model (Planning, Attention, Simultaneous processing and Sequential processing.

72
Q

If a researcher changes is alpha level from .01 to .001, what is likely the result with regard to correctly or incorrectly rejecting or retaining a true or false null hypothesis?

A

Less likely to incorrectly reject a true null hypothesis

73
Q

If a researcher gets a .85 correlation for participants raw scores and predicted scores, what correlation co-efficient will he get if he converts those scores to non-normalized t-scores?

A

Also .85

74
Q

What area of scoring would you expect an child with ASD without language impairment to obtain the lowest scores on a WISC-V?

A

Coding and Symbol Search (processing speed)

75
Q

Student’s t-test

A

Compare the means of scores obtained by 2 groups

76
Q

2 Way ANOVA

A

Two independent variables

77
Q

Chi Square

A

Analyzes frequency (nominal) data t

78
Q

What information does the slope of the Item Characteristic Curve tell us?

A

Discrimination (between low and high achievers), Item difficulty, and probability of getting an item correct by guessing!

79
Q

A test developer is wanting to evaluate the effects of a training program on sales success of newbies; which type of test validity would be important?

A

Criterion-related

80
Q

If designing achievement test where reliability was most important, what type of test design would you be LEAST likely to choose?

A

T/F

NOT M/C, essay, FIB

81
Q

When an assumption in an ANOVA is violated, what is the best strategy to use to analyze the data

A

Krusty-Wallis LOL

Kruskal

82
Q

When conducting an Item Analysis, one item has a p-value of .85. What does this mean?

A

That the item is easy.

83
Q

P-Values with Item Analysis

A

Lower = more difficult

Higher + easier (more people answered it correctly)

84
Q

How to discriminate using an Item Analysis?

A

Calculating D statistic; this is the number of people who got it wrong from the number of people that got it right

85
Q

What is Bonferroni for?

A
  • Control experiment-wise error rate

- Reduce significance level for each comparison

86
Q

When factors are OBLIQUE, what does that mean?

A

That correlation coefficient for any two factors is greater than 0.

87
Q

OBLIQUE vs ORTHOGONAL

A

Non-correlated vs Correlated

88
Q

When using a split-half method for reliability, what should you remember?

A

Splitting using even or odd numbers will likely result in a reliability co-efficient that over-estimates the reliability

89
Q

What statistic (correlation coefficient) would you use when correlating associations between 2 variables that have been artificially dichotomized?

A

Tetrachoric. Used for comparing 2 artificially dichotomized normal distributions.

90
Q

Eta correlation coefficient

A

Used for continuous, non-linear variables

91
Q

When would you not want to use autocorrelation?

A

With a repeated measures design

92
Q

What does “Test the Limits” mean in testing, and when would you do this?

A

allows extended time or attempts in an effort to evaluate maximum abilities in the individual completing the test. Used after administering the test using standard procedures.

93
Q

Shrinkage

A

Associated with cross-validation

94
Q

When KNOWLEDGE of a person’s score on one test effects how that person is rated on a subsequent test, what is this called?

A

Criterion Contamination

95
Q

Construct validity

A

High correlation w/test representing same attributes and low correlation w/test representing opposite attributes

96
Q

A low selection ratio and moderate base rate are useful for what?

A

Maximizing incremental validity