Validity, reliability and replication 2.3

Question 1

Validity

Answer 1

are you measuring/manipulating what

you say you are measuring/manipulating?

Question 2

types of validity

Answer 2

•Internal validity
•External validity
•Ecological validity
•Face validity
•Content validity
•Criterion validity
-Predictive validity
-Concurrent validity
•Construct validity

Question 3

Concurrent validity

Answer 3

How does your operational definition
compare to an established operational
definition of the same construct?

Question 4

Evaluating homogeneity

Answer 4

•Establish convergent validity
•Yes, it is measuring the construct of interest
•Demonstrate a positive correlation with other measures of the same
construct (concurrent validity)

• Establish divergent validity
• No, it is not measuring other constructs
• Demonstrate that it is not correlation with measures of similar constructs

Question 5

Predictive Validity

Answer 5

Predictive validity is the extent to which performance on a test is related to later performance that the test was designed to predict

Question 6

Reliability

Answer 6

How similar are the values when you remeasure the same thing?

Question 7

Methods for assessing reliability

Answer 7

• Test re-test reliability
• Split-half reliability
• Parallel forms reliability
• Intercoder reliability

Question 8

Replication

Answer 8

•Conceptual replication
•Conceptually similar to the original study but the
methods differ
•Operational definitions, stimuli, task etc. may differ

•Direct replication
•Attempt to reproduce the original methods as
closely as possible
•Original methods need to be clearly documented
•Not very incentivized
•Often done in conjunction with an extension