chap 3 Flashcards

1
Q

What is the primary focus of behavioral scientists when conducting research?

A

Defining and measuring the variables they study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the two key criteria used to evaluate the quality of a measurement procedure?

A
  • Validity
  • Reliability
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Define an artifact in the context of research.

A

An artifact can influence the results of a research study, such as experimenter bias and demand characteristics.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What did previous research indicate about heterosexual men’s perception of women wearing red?

A

They perceive women as being more attractive when wearing red.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

In the study by Guéguen and Jacob (2012), what was the outcome regarding male customers’ tipping behavior?

A

Male customers gave significantly bigger tips to waitresses wearing red.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are constructs in behavioral science?

A

Hypothetical variables that cannot be directly observed or measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is an operational definition?

A

A procedure for indirectly measuring and defining a variable that cannot be observed or measured directly.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a limitation of operational definitions?

A

There is not a one-to-one relationship between the variable being measured and the actual measurements produced.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is an example of a construct that can be operationally defined?

A

Intelligence, as measured by an IQ test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Fill in the blank: The operational definition of hunger can include _______.

A

the number of hours of food deprivation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

True or False: Operational definitions always capture every component of a construct.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the goal of an operational definition?

A

To provide a definition and a method for measuring a hypothetical construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Define validity in the context of measurement.

A

The degree to which the measurement process measures the variable that it claims to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is face validity?

A

The superficial appearance or face value of a measurement procedure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What type of relationship is indicated when two measurements change together in the same direction?

A

Positive relationship

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What type of relationship is indicated when one measurement increases while the other decreases?

A

Negative relationship

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Explain the role of multiple measures in evaluating constructs.

A

Using two or more different procedures to measure the same variable helps reduce the risk of leaving out important components.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is a scatter plot used for in research?

A

To illustrate the consistency of the relationship between two different measurements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is the main idea behind operationalizing a construct?

A

To define and measure variables that cannot be directly observed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What can affect the performance on a measurement task, such as an exam?

A

Physical illness or fatigue.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What does it mean to operationalize a construct?

A

To define and measure a hypothetical construct using observable behaviors.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What are the two general criteria used to evaluate the quality of any measurement procedure?

A
  • Validity
  • Reliability
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is validity in measurement procedures?

A

The degree to which the measurement process measures the variable that it claims to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Define face validity.

A

The superficial appearance of a measurement procedure; if it looks like it measures what it claims to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is concurrent validity?

A

Establishing validity by demonstrating that scores from a new measurement are directly related to scores from an established measurement of the same variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What does predictive validity indicate?

A

When measurements of a construct accurately predict behavior according to a theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Define construct validity.

A

Scores obtained from a measurement procedure behave exactly the same as the variable itself.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What is convergent validity?

A

Demonstrated by a strong relationship between scores obtained from two different methods of measuring the same construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is divergent validity?

A

Demonstrated by showing little or no relationship between the measurements of two different constructs.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What is reliability in measurement procedures?

A

The ability of a measurement procedure to produce identical or nearly identical results when used repeatedly under the same conditions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What are common sources of measurement error?

A
  • Observer error
  • Environmental changes
  • Participant changes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What is the relationship between error and reliability?

A

When error is large, reliability is low; when error is small, reliability is high.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What is test-retest reliability?

A

The reliability estimate obtained by comparing scores from two successive measurements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

True or False: Face validity is a scientific form of validity.

A

False.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What is the significance of a correlation near +1.00?

A

It indicates a consistent positive relationship between two measurements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What does a correlation near zero indicate?

A

An inconsistent relationship between two measurements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Fill in the blank: A measurement procedure is said to have _______ if it produces identical results when used repeatedly.

A

[reliability]

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What is the main goal of establishing construct validity?

A

To show that the measurement procedure produces scores that behave in accordance with everything known about the construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

How do researchers demonstrate convergent validity?

A

By showing strong relationships among different methods measuring the same construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

What is an example of observer error?

A

A baseball umpire making inconsistent calls on balls and strikes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What is the role of past research in establishing construct validity?

A

To document how the specific variable behaves across different situations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Why might high face validity create problems in research?

A

Participants may adjust their answers if they know what is being measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

What is the outcome if a measurement has low construct validity?

A

It does not accurately capture the variable it is supposed to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Fill in the blank: High scores on the Student Risk Screening Scale (SRSS) predict higher _______ referrals.

A

[discipline]

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

What is reliability in the context of measurement?

A

The stability or consistency of the measurements produced by a specific measurement procedure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

What is test-retest reliability?

A

The reliability estimate obtained by comparing scores from two successive measurements of the same individuals.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

What is parallel-forms reliability?

A

The reliability measure obtained when different versions of the measuring instrument are used for test and retest.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

What is inter-rater reliability?

A

The degree of agreement between two observers who simultaneously record measurements of behaviors.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

What is split-half reliability?

A

A measure obtained by splitting the items on a questionnaire or test in half and computing the degree of consistency between the two scores.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

What is the equation that expresses the relationship between measured score, true score, and error?

A

Measured Score = True Score + Error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

True or False: A measurement can be reliable without being valid.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
52
Q

What is the main assumption behind the concept of reliability?

A

The variable being measured is stable or constant.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
53
Q

What happens to the error component in measurements over a series of trials?

A

It generally averages to zero.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
54
Q

What is the relationship between reliability and validity?

A

Reliability is a prerequisite for validity; a measurement cannot be valid unless it is reliable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
55
Q

Fill in the blank: A measure cannot be _______ unless it is reliable.

A

valid

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
56
Q

What kind of relationship exists between educational TV and high school grades according to research?

A

Positive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
57
Q

What type of validity is demonstrated when participants who scored high on a self-esteem test made more eye contact?

A

Concurrent validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
58
Q

What are the four scales of measurement?

A
  • Nominal
  • Ordinal
  • Interval
  • Ratio
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
59
Q

True or False: A measurement process can be valid and reliable even if it is not accurate.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
60
Q

What is the meaning of a ratio scale’s zero point?

A

It is a meaningful point representing none (a complete absence) of the variable being measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
61
Q

What is the key characteristic of a ratio scale?

A

An absolute, non-arbitrary zero point.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
62
Q

What is internal consistency in measurement?

A

The degree of consistency among different items measuring the same construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
63
Q

What does a ratio scale allow you to measure?

A

The distance from zero and compare measurements in terms of ratios

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
64
Q

How does a glass with 8 ounces of water compare to a glass with 4 ounces?

A

The glass with 8 ounces has twice as much as the glass with 4 ounces

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
65
Q

What can be measured with a ratio scale?

A
  • Physical measures (height, weight)
  • Variables (reaction time, number of errors on a test)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
66
Q

What is the key difference between an interval scale and a ratio scale?

A

The definition of the zero point

67
Q

In a ratio measurement, how does an 80-pound child compare to a 40-pound child?

A

The 80-pound child weighs twice as much as the 40-pound child

68
Q

What happens when the zero point is defined as the average weight for a group?

A

Measurements form an interval scale

69
Q

What score does a child who is 12 pounds above average receive?

A

+12 pounds

70
Q

What score does a child who is 4 pounds below average receive?

A

-4 pounds

71
Q

True or False: The distinction between interval and ratio scales has significant practical implications.

A

False

72
Q

What do nominal scales allow you to determine?

A

Whether two scores are the same or different

73
Q

What information can ordinal scales provide beyond nominal scales?

A

The direction of the difference

74
Q

Fill in the blank: The ability to measure _______ is often more important than the ability to measure ratios.

A

distances

75
Q

What is a key limitation of nominal measurements?

A

You cannot measure the size of the difference between scores

76
Q

What does an interval scale provide information about?

A

The distance between two scores

77
Q

For most applications, what is more important: the ability to measure distances or ratios?

A

The ability to measure distances

78
Q

What is a characteristic of ratio scales in relation to zero?

A

Zero corresponds to none of the quantity being measured

79
Q

How do interval scales differ from ratio scales in terms of information provided?

A
  • Provide the same information about distance
  • Do not allow for ratio comparisons
80
Q

What type of scale only allows you to determine whether two scores are the same or different?

A

Nominal scale

81
Q

What kind of scores does a child receive on an interval scale if they are measured relative to an average?

A

Scores based on their difference from the average

82
Q

What are the four types of measurement scales identified by researchers?

A

Nominal, ordinal, interval, and ratio

These scales differ based on the relationships among categories and the information provided.

83
Q

What does a nominal scale represent?

A

Qualitative differences in the variable measured

Categories are not related in any systematic way, e.g., academic majors.

84
Q

What can measurements from a nominal scale determine?

A

Whether two individuals are the same or different

Quantitative comparison is not possible.

85
Q

How are categories organized in an ordinal scale?

A

In an ordered series

Examples include ranks like first, second, third.

86
Q

What is a limitation of ordinal scales?

A

Do not allow determination of the magnitude of the difference

We know the direction of difference but not how much.

87
Q

What distinguishes interval and ratio scales from nominal and ordinal scales?

A

Categories are organized sequentially with equal intervals

Examples include measures of time, weight, and temperature.

88
Q

What is a characteristic of an interval scale?

A

Has an arbitrary zero point

For example, 0 degrees Fahrenheit does not mean absence of temperature.

89
Q

What is the main difference between interval and ratio scales?

A

The presence of a true zero point in ratio scales

Ratio scales indicate the total absence of the variable measured.

90
Q

What are the three modalities of measurement?

A

Self-report, physiological, and behavioral

These modalities help define and measure constructs.

91
Q

What type of data is usually preferred for most research situations?

A

Interval or ratio scale data

These scales allow hypothesis testing and produce meaningful values.

92
Q

True or False: Ordinal measurements produce meaningful values for means and variances.

A

False

Ordinal measurements are not suitable for many commonly used hypothesis tests.

93
Q

Fill in the blank: The categories of an ordinal scale are organized in a _______.

A

Ordered series

94
Q

What is an example of a construct that cannot be directly observed?

A

Fear

Researchers measure external expressions of fear to evaluate it.

95
Q

What problem arises in classifying IQ scores as interval or ordinal?

A

Uncertainty about the size of one point of IQ

The difference between scores may not be consistent across the scale.

96
Q

What type of measurement scale is often used in rating scales from 1 to 5?

A

Ordinal scale

Even if they appear to have equal intervals, the distances between labels may not be equal.

97
Q

What scale is used to rate the degree of agreement with statements?

A

A scale from 1 to 5

Labeled as Somewhat Strongly Agree, Somewhat Agree, Neutral, Disagree, Strongly Disagree.

98
Q

What is the key difference between ordinal and interval scales?

A

Ordinal scales indicate direction of difference, while interval scales indicate direction and magnitude.

99
Q

What is a nominal scale capable of indicating?

A

It can only indicate that a difference exists.

100
Q

What does a ratio scale measure?

A

Direction, magnitude, and ratio of the difference.

101
Q

How do researchers traditionally treat ambiguous scales like IQ scores?

A

As if they were from an interval scale.

102
Q

What is the term for the problem when scores cluster at the high end of a scale?

A

Ceiling effect.

103
Q

What is the term for the problem when scores cluster at the low end of a scale?

A

Floor effect.

104
Q

What is an artifact in the context of a research study?

A

A nonnatural feature that may influence or distort measurements.

105
Q

What is experimenter bias?

A

When a researcher unintentionally influences results based on their expectations.

106
Q

What is one advantage of physiological measures?

A

They provide accurate and objective measurements.

107
Q

What is a potential disadvantage of physiological measures?

A

They require expensive equipment and may create unnatural situations.

108
Q

Fill in the blank: The _______ of measurement refers to the extent to which it can detect changes.

A

sensitivity

109
Q

What is the primary advantage of self-report measures?

A

They provide direct insights from individuals about their own experiences.

110
Q

What are behavioral measures?

A

Measures that observe and quantify overt behaviors.

111
Q

Using a PET scan to measure brain activity is an example of what modality of measurement?

A

Physiological.

112
Q

Using an anonymous questionnaire to determine how many times students send or receive text messages is an example of what modality of measurement?

A

Self-report.

113
Q

Counting the number of times a student leaves their seat without permission is an example of which modality of measurement?

A

Behavioral.

114
Q

What is the purpose of using multiple measures in research?

A

To obtain a more complete measure of a construct.

115
Q

What does the term ‘range effect’ refer to?

A

Sensitivity problems when scores cluster at one end of a measurement scale.

116
Q

True or False: Self-report measures are immune to distortion.

A

False.

117
Q

What problem can arise from combining multiple measures?

A

Confusion in the interpretation of results if measures do not behave the same.

118
Q

What is one way to limit problems associated with multiple measures?

A

Combine them into a single score for each individual.

119
Q

What is the requirement for measuring time to detect subtle changes?

A

Time must be measured in units small enough to detect the change.

For example, if changes are expected to be 1/100 of a second, measuring in seconds may not suffice.

120
Q

What is a single-blind research study?

A

A research study in which the researcher does not know the predicted outcome.

121
Q

What is a double-blind research study?

A

A research study in which both the researcher and the participants are unaware of the predicted outcome.

122
Q

Define demand characteristics in research studies.

A

Cues or features that suggest the purpose and hypothesis of a study, influencing participants’ behavior.

123
Q

What is reactivity in the context of research studies?

A

When participants modify their natural behavior in response to awareness of being observed or measured.

124
Q

What is experimenter bias?

A

When measurements in a study are influenced by the experimenter’s expectations or beliefs regarding the outcome.

125
Q

List some ways an experimenter can influence participant behavior.

A
  • Paralinguistic cues (tone of voice)
  • Kinesthetic cues (body posture, facial expressions)
  • Verbal reinforcement of responses
  • Misjudgment of responses
  • Errors in recording data.
126
Q

What is the ceiling effect?

A

A situation where scores are so high that it prevents measuring improvement.

127
Q

What is the purpose of standardizing or automating an experiment?

A

To limit personal contact between the experimenter and participant and reduce experimenter bias.

128
Q

What is the difference between a laboratory setting and a field setting?

A
  • Laboratory setting: Perceived as artificial
  • Field setting: Perceived as a natural environment.
129
Q

What factors should be considered when selecting a measurement procedure?

A
  • Reliability and validity of past research
  • Sensitivity of the measurement
  • Scale of measurement (nominal, ordinal, interval, ratio).
130
Q

Define the good subject role in research participants.

A

Participants who identify the hypothesis and try to produce responses that support it.

131
Q

What is the negativistic subject role?

A

Participants who identify the hypothesis and try to act contrary to it, often to sabotage the study.

132
Q

What is the apprehensive subject role?

A

Participants who are overly concerned about how they are perceived and respond in socially desirable ways instead of truthfully.

133
Q

What is the faithful subject role?

A

Participants who follow instructions carefully and avoid acting on any suspicions about the study’s purpose.

134
Q

What is the impact of participant reactivity on research validity?

A

It can distort the measurements, leading to results that do not accurately reflect true behaviors.

135
Q

How can researchers reduce the effects of reactivity?

A
  • Observing participants in their natural environment
  • Disguising the measurement process
  • Reassuring participants about confidentiality.
136
Q

What does it mean when participants are described as ‘naive’ in research?

A

Participants are unaware of the hypothesis or expected outcomes of the study.

137
Q

What are the four scales of measurement?

A
  • Nominal
  • Ordinal
  • Interval
  • Ratio.
138
Q

What additional information does an ordinal scale provide compared to a nominal scale?

A

Ordinal scale provides information about the order of the data.

139
Q

What additional information does an interval scale provide compared to an ordinal scale?

A

Interval scale provides information about the magnitude of differences between data points.

140
Q

What additional information does a ratio scale provide compared to an interval scale?

A

Ratio scale includes a true zero point, allowing for the comparison of absolute magnitudes.

141
Q

Fill in the blank: A researcher might evaluate the reliability of a questionnaire by assessing _______.

A

[inter-rater reliability].

142
Q

True or False: The faithful subject role is the ideal role for participants in research studies.

A

True.

143
Q

What is a nominal scale?

A

A scale of measurement that classifies data into distinct categories without any order

Examples include gender, race, or types of fruits.

144
Q

What is an interval scale?

A

A scale of measurement that has ordered categories with equal intervals between them, but no true zero point

Examples include temperature in Celsius or Fahrenheit.

145
Q

What is a ratio scale?

A

A scale of measurement that has ordered categories, equal intervals, and a true zero point

Examples include weight, height, and age.

146
Q

What is an operational definition?

A

A specific procedure used to measure a variable, often necessary for intangible concepts

Operational definitions clarify how constructs are quantified.

147
Q

What are the three modalities of measurement?

A
  • Self-report
  • Physiological
  • Behavioral
148
Q

What is the difference between self-report measures and behavioral measures?

A

Self-report measures rely on individuals’ accounts, while behavioral measures observe actual behavior

Self-reports can be biased, while behaviors may not always reflect internal states.

149
Q

What is validity in measurement?

A

The extent to which a measure truly assesses the variable it claims to assess

Types of validity include face, concurrent, predictive, construct, convergent, and divergent validity.

150
Q

Define reliability in measurement.

A

The consistency and stability of a measure over time

Reliability can be assessed through test-retest, inter-rater, and split-half methods.

151
Q

What is concurrent validity?

A

The degree to which a new measure correlates with an established measure of the same construct

It is used to evaluate whether a new test is valid by comparing it with a known standard.

152
Q

What is a ceiling effect?

A

A situation where a measurement instrument cannot detect differences at the high end of the scale

This can lead to underestimating the variability in scores.

153
Q

What is a floor effect?

A

A situation where a measurement instrument cannot detect differences at the low end of the scale

This can obscure the true performance of participants.

154
Q

What are demand characteristics?

A

Cues in an experiment that inform participants of the expected behavior, influencing their responses

Demand characteristics can lead to biased results if participants alter their behavior based on perceived expectations.

155
Q

What is experimenter bias?

A

When a researcher’s expectations influence the outcomes of the study

This can be mitigated through double-blind research designs.

156
Q

True or False: A valid measure is not necessarily reliable.

A

True

157
Q

What is the purpose of using operational definitions?

A

To provide clarity and specificity in measuring intangible constructs

Operational definitions help in replicating research and ensuring consistency.

158
Q

Fill in the blank: A _______ scale has ordered categories with equal intervals and a true zero point.

A

[ratio scale]

159
Q

Describe the strengths of self-report measures.

A
  • Easy to administer
  • Can gather subjective data
  • Cost-effective
160
Q

Describe the weaknesses of behavioral measures.

A
  • May not capture internal states
  • Can be influenced by external factors
  • More time-consuming to analyze
161
Q

What is reactivity in research?

A

When participants alter their behavior because they are aware they are being observed

This can affect the validity of the measurement.

162
Q

What is a good subject role?

A

When participants try to provide results that align with the research hypothesis

This can lead to biased data if not managed properly.

163
Q

What is a negativistic subject role?

A

When participants intentionally provide data that contradict the research hypothesis

This can skew results and complicate data interpretation.