Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

PSYCH 600 Research Methods > 5. Measuring Variables and Sampling > Flashcards

5. Measuring Variables and Sampling Flashcards

You may prefer our related Brainscape-certified flashcards:
Psychology 101 flashcards GRE® Psychology flashcards
0
Q

nominal scale

A

variables that are categorical in nature. They have no innate ranking or order, and only serve to describe the type of an attribute. If only two types are possible, the variable can also be called binary or boolean.

(eg. gender, marital status, memory strategy, personality type, college major, type of therapy, experimental condition [treatment vs. control] )

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
1
Q

variable

A

a condition or characteristic that can take on different values

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

ordinal

A

variables that have an innate ranking, but the distance between the rankings is not necessarily the same.

(eg. position in the family, placement in a race, strength of agreement or disagreement)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

interval

A

a variable which can be quantitatively measured, where the distance between rankings is the same, but the measurement of 0 does not imply the absence of the thing being measured. (ie. an arbitrary 0 point)

(eg. temperature scales (Farenheit or Celsius), IQ scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

ratio measurement

A

a quantitative measurement with an absolute zero point

eg. age, Kelvin temperature measurement, response time, height, income

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the four distinguishing characteristics of the four levels of measurement?

A

The four levels of measurement can be distinguished by whether they refer to a quantity or type (nominal), whether the distance between increments is the same or different (ordinal), and whether the scale has an absolute zero point (interval or ratio).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the two necessary properties for good measurement?

A

reliability and validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

reliability

A

the consistency (or stability) of the measurements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

validity

A

the extent to which the measurements actually measure what the researchers intend for them to measure. Accuracy of the interpretations, inferences or actions made on the basis of the measurements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

reliability coefficient

A

a specific correlation coefficient that acts as an index to suggest the reliability of a measure. The stronger and more positive the better. (ie. > 0.70)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the types of reliability tests?

A

test-retest reliability
equivalent-forms reliability
internal consistency
interrater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

test-retest reliability

A

refers to the consistency of measures over time. to evaluate this reliability, the second set of measurements should be taken without a treatment condition present, seeking to maximize reliability. It is challenging to determine the appropriate time interval, and generally the longer the time interval, the lower the reliability coefficient will be.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

equivalent forms reliability

A

refers to the consistency of measurement across two different research instruments, designed to measure the same thing. In order to have a high reliability coefficient, individuals should have similar scores on each instrument.

(eg. ACT / SAT or GRE/MAT )

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

internal consistency reliability

A

the consistency with which the items on a single instrument measure a single construct. Generally, as the length of these instruments grows, so too does the internal consistency reliability. Measuring this only requires one administration of the instrument. (generally called coefficient alpha or cronbach’s alpha)

(eg. personality tests)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

interrater reliability

A

the consistency or degree of agreement between two or more scores, raters, judges, etc. (also measured by inter-observer agreement - the percentage of time that different observers’ ratings are in agreement)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How does a researcher obtain evidence of reliability in measurement?

A

Depending on the type of reliability they seek to determine :

  • repeat the measure on the same group after a time interval - measures test-retest reliability
  • measure the # of agreement between different judges of the same observation measures interrater reliability
  • measure the degree of consistency between items that measure the same construct measures internal consistency reliability
  • measure the degree to which individual scores are consistent across two different instruments measures equivalent forms reliability
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

operational definition

A

the way a construct is defined, represented, and measured in a research study. (ie. set the definition for the construct for the purposes of the study)

(eg. “disadvantaged people” may be operationalized as “individuals who have incomes below the poverty level for the past six months”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is the key challenge in creating an operational definition?

A

An operational definition must be specific enough to be VALID for the study you are conducting, but not so specific that it lacks ecological validity and therefore has no relevance in the outside world.
“Is your definition truly representative?”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

validation

A

the continuous process of gathering evidence regarding the soundness of inferences made from measurements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

content validity

A

judgement by experts of the degree to which items, task or questions on a test adequately represent the construct. (ie. prima facie - do they appear to measure it? is anything excluded? in anything extraneous included? generally requires the judgement of multiple experts

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

multidimensional construct

A

a construct consisting of two or more dimensions, as contrasted with a unidimensional construct. (ie. MBTI test measures personality type on the basis of four constructs - E/I , N/S, F/T, P/J)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Factor analysis

A

a statistical analysis procedure used to determine the number of dimensions present in a set of items. this is important because it is necessary in order to correctly interpret the resulting scores of the instrument.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

homogeneity

A

the degree to which a set of items measures a single construct or trait.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

validity coefficient

A

a correlation coefficient used in validity evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

criterion-related validity

A

the degree to which scores predict or relate to a known criterion such as a future performance or an already-established test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

predictive validity

A

the degree to which scores obtained at one time correctly predict the scores on a criterion at a later time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

concurrent validity

A

the degree to which test scores obtained at one time correctly related to the scores on a known criterion obtained at approximately the same time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

convergent validity evidence

A

validity evidence based on the degree to which the focal test scores correlate with independent measures of the same construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

discriminant validity evidence

A

validity evidence based on the degree to which the focal test scores do not correlate with measures of different constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

known groups validity evidence

A

the degree to which groups that are known to differ on a construct actually differ according to the test used to measure the construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

How does one obtain evidence of validity in based on content?

A

experts on the construct examine the instrument and determine whether the contents adequately represent the construct

31
Q

norming group

A

the reference group upon which reported reliability and validity evidence is based.

32
Q

What are some sources of information about psychometric tests and measures?

A

APA PsychINFO, PsychARTICLES,

33
Q

How do researchers gather validity evidence based on internal structure?

A

They use factor analysis, which indicates how many constructs are present in the set of items, the homogeneity of each set by calculating item to total correlation and coefficient alpha

34
Q

How do researchers obtain evidence of validity based on relations to other variables?

A

They determine if the scores are related to known criterion by collecting concurrent and predictive validity evidence.

35
Q

sample

A

a set of elements selected from a population

36
Q

sampling

A

the process of drawing a sample from a population

37
Q

representative sample

A

a sample that resembles the population

38
Q

equal probability of selection method

A

sampling method in which each individual element has an equal probability of selection into the sample

39
Q

statistic

A

a numerical characteristic of sample data

40
Q

parameter

A

a numerical characteristic of a population

41
Q

sampling error

A

differences between sample values and the true population parameter

42
Q

census

A

collection of data from everyone in the population

43
Q

sampling frame

A

a list of all the elements in a population

44
Q

response rate

A

the percentage of individuals selected to be in a sample and who participate in the research study

45
Q

biased sample

A

a sample that is nonrepresentative

46
Q

proximal similarity

A

generalization to people, places, settings, and contexts that are similar to those described in the research study

47
Q

simple random sampling

A

a popular and basic equal probability selection method, where every individual has an equal chance of being included in the sample. (eg. random number generator)

48
Q

stratified random sampling

A

division of population elements into mutually exclusive groups and then selection of a random sample from each group

49
Q

stratification variable

A

the variable on which the population elements are divided for the purpose of stratified sampling

50
Q

proportional stratified sampling

A

where the stratified samples drawn match the proportions of the stratification variables in the population.
(ie. 20% are women, so 2 of the 10 in the sample are women)

51
Q

disproportional stratified sampling

A

stratified sampling where the sample proportions are made to be different from the population proportions on the stratification variable.

52
Q

cluster random sampling

A

sampling method where clusters are randomly selected (eg. neighborhoods, schools, workplaces, etc.)

53
Q

one stage cluster sampling

A

clusters are randomly selected and all the elements in the selected clusters constitute the sample

54
Q

two stage cluster sampling

A

clusters are randomly selected, and a random sample of elements is drawn from each of the selected clusters

55
Q

systematic sampling

A

the sampling method where one determines the sampling interval (k), randomly selects an element between 1 and k, and then selects every kth element. (sampling interval is the population size divided by the desired sample size
)

56
Q

periodicity

A

a problematic situation in systematic sampling that can occur if there is a cyclical pattern in the sampling frame

57
Q

What are some strengths and weaknesses of the major random sampling techniques?

A
  • systematic sampling
  • cluster random sampling
  • stratified random sampling
  • simple random sampling
58
Q

convenience sampling

A

use of individuals who are readily available, volunteer, or are easily recruited for inclusion in a sample (eg. psychology 101 students)

59
Q

quota sampling

A

a researcher decides on the desired sample size, and quotas for groups identified in the sample. The researcher then fills the sample by convenience according to those quotas. (eg. 50% men and women in sample from psychology 101 course, even though course is 80% women)

60
Q

purposive sampling

A

a researcher specifies the characteristics of the population of interest and then locates individuals who have those characteristics

61
Q

snowball sampling

A

each sampled person is asked to identify other potential participants with the inclusion characteristic. (particularly useful for hard-to-find populations)

62
Q

What are the key characteristics of the different types of non random sampling methods?

A
  • convenience sample
  • quota sample
  • purposive sample
  • snowball sample
63
Q

random selection

A

selection of participants using a random sampling method

64
Q

random assignment

A

placement of participants into experimental conditions on the basis of a chance process.

65
Q

What is the purpose of random selection?

A

The purpose of random selection is to obtain a sample that is representative of the population.

66
Q

What is the purpose of random assignment?

A

The purpose of random assignment is to produce equivalent groups for use in the experiment.

67
Q

sample size calculator

A

a statistical program used to provide a recommended sample size

68
Q

what are some general suggestions in determining the ideal sample size?

A
  • if the population is less than 100 people, try to include the entire population
  • try to get a relatively large sample size when possible
  • examine other research studies in the topic to see what has been done before
  • use a sample size calculator
  • use larger sample sizes when you want to break down the data into multiple subcategories.
  • larger sample sizes when you want to obtain a relatively narrow confidence interval
  • certain statistical techniques require larger or smaller sample sizes. (see page 268)
69
Q

mixed sampling

A

use of a combination of quantitative and qualitative sampling methods

70
Q

maximum variation sampling

A

identification / selection of a wide range of cases for data collection and analysis (eg. psychotherapy clients with high-medium and low self-esteem)

71
Q

extreme case sampling

A

identification/selection of cases from the extremes or poles of a dimension (ie. highest and lowest rank in a class)

72
Q

homogeneous sample selection

A

identification and selection of a small and homogeneous group or a set of homogeneous cases for intensive study
(eg. adolescent girls for a focus group on diet and body images)

73
Q

typical case sampling

A

finding what is believed to the the typical or average case

74
Q

critical case sampling

A

identification/selection of particularly important cases

75
Q

negative case sampling

A

cases that you believe will probably disconfirm your generalizations so that you can make sure that you are not just selectively finding cases to support your theory.

PSYCH 600 Research Methods (5 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions