RM: Validity and Reliability Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

What is reliability?

A

-if results are consistent (when same methods are used)
-reliable methodologies will produce similar results each time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is internal reliability?

A

the consistency between measures in a study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is external reliability?

A

If the measure is reliable when repeated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is test-retest reliability?

A

-measures test consistency (over time)
-study is repeated using the same procedures and the correlation between the two results are tested
-0.8 or above means reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is inter-rater reliability?

A

-the degree of agreement among raters/observers
-2+ observers record the same observation using the same behavioral categories
-then test the correlation of their results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is validity?

A

-the extent to which something is measuring what it claims to
-valid methods measure the construct they are supposed to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is internal validity?

A

-whether it is the IV that affects the DV
-if the DV is changed by other factors/uncontrolled EVs, there is low internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is external validity?

A

-questions if a study’s findings can be generalized to the outside world

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is ecological validity?

A

-setting
-the extent that the findings of a study can be generalized to other environments/real world

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is population validity?

A

-people
-the extent the sample used can be generalised to the whole population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is temporal validity?

A

-time
-the extent the results of a study can be generalised to other time periods
-are past experiments still valid?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is construct validity?

A

-if something is measuring what you think it’s measuring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is concurrent validity?

A

-the extent that data from a new test is similar to the data from the old test of the same variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is predictive validity?

A

-the extent results can predict what will happen in the future

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is face validity?

A

-the extent the test appear to measure what it claims to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How to improve internal validity?

A

-random allocation
-standard procedures
-counterbalancing
-single & double blind trials
-peer review

17
Q

How to improve external validity?

A

-replicating findings in multiple sample groups

18
Q

How to use observations to improve reliability?

A

-improve the training given to observers (improves observation to the correct behavioral category)
-pilot studies can be used to identify weaknesses

19
Q

How to use interviews to improve reliability?

A

-use structured rather than unstructured
-scripts with interviews

20
Q

How to use questionnaires to improve reliability?

A

-closed questions (reduce range of responses)
-use established rather than new questionnaires

21
Q

How to use experiments to improve reliability?

A

-use standardized procedures
-use established rather than new ones

22
Q

What is a correlation coefficient?

A

-measure of how closely related variables are
-if there is strong correlation, the variables are closely related