chap 3 Flashcards
(163 cards)
1
Q
What is the primary focus of behavioral scientists when conducting research?
A
Defining and measuring the variables they study
2
Q
What are the two key criteria used to evaluate the quality of a measurement procedure?
A
- Validity
- Reliability
3
Q
Define an artifact in the context of research.
A
An artifact can influence the results of a research study, such as experimenter bias and demand characteristics.
4
Q
What did previous research indicate about heterosexual men’s perception of women wearing red?
A
They perceive women as being more attractive when wearing red.
5
Q
In the study by Guéguen and Jacob (2012), what was the outcome regarding male customers’ tipping behavior?
A
Male customers gave significantly bigger tips to waitresses wearing red.
6
Q
What are constructs in behavioral science?
A
Hypothetical variables that cannot be directly observed or measured.
7
Q
What is an operational definition?
A
A procedure for indirectly measuring and defining a variable that cannot be observed or measured directly.
8
Q
What is a limitation of operational definitions?
A
There is not a one-to-one relationship between the variable being measured and the actual measurements produced.
9
Q
What is an example of a construct that can be operationally defined?
A
Intelligence, as measured by an IQ test.
10
Q
Fill in the blank: The operational definition of hunger can include _______.
A
the number of hours of food deprivation
11
Q
True or False: Operational definitions always capture every component of a construct.
A
False
12
Q
What is the goal of an operational definition?
A
To provide a definition and a method for measuring a hypothetical construct.
13
Q
Define validity in the context of measurement.
A
The degree to which the measurement process measures the variable that it claims to measure.
14
Q
What is face validity?
A
The superficial appearance or face value of a measurement procedure.
15
Q
What type of relationship is indicated when two measurements change together in the same direction?
A
Positive relationship
16
Q
What type of relationship is indicated when one measurement increases while the other decreases?
A
Negative relationship
17
Q
Explain the role of multiple measures in evaluating constructs.
A
Using two or more different procedures to measure the same variable helps reduce the risk of leaving out important components.
18
Q
What is a scatter plot used for in research?
A
To illustrate the consistency of the relationship between two different measurements.
19
Q
What is the main idea behind operationalizing a construct?
A
To define and measure variables that cannot be directly observed.
20
Q
What can affect the performance on a measurement task, such as an exam?
A
Physical illness or fatigue.
21
Q
What does it mean to operationalize a construct?
A
To define and measure a hypothetical construct using observable behaviors.
22
Q
What are the two general criteria used to evaluate the quality of any measurement procedure?
A
- Validity
- Reliability
23
Q
What is validity in measurement procedures?
A
The degree to which the measurement process measures the variable that it claims to measure.
24
Q
Define face validity.
A
The superficial appearance of a measurement procedure; if it looks like it measures what it claims to measure.
25
What is concurrent validity?
Establishing validity by demonstrating that scores from a new measurement are directly related to scores from an established measurement of the same variable.
26
What does predictive validity indicate?
When measurements of a construct accurately predict behavior according to a theory.
27
Define construct validity.
Scores obtained from a measurement procedure behave exactly the same as the variable itself.
28
What is convergent validity?
Demonstrated by a strong relationship between scores obtained from two different methods of measuring the same construct.
29
What is divergent validity?
Demonstrated by showing little or no relationship between the measurements of two different constructs.
30
What is reliability in measurement procedures?
The ability of a measurement procedure to produce identical or nearly identical results when used repeatedly under the same conditions.
31
What are common sources of measurement error?
* Observer error
* Environmental changes
* Participant changes
32
What is the relationship between error and reliability?
When error is large, reliability is low; when error is small, reliability is high.
33
What is test-retest reliability?
The reliability estimate obtained by comparing scores from two successive measurements.
34
True or False: Face validity is a scientific form of validity.
False.
35
What is the significance of a correlation near +1.00?
It indicates a consistent positive relationship between two measurements.
36
What does a correlation near zero indicate?
An inconsistent relationship between two measurements.
37
Fill in the blank: A measurement procedure is said to have _______ if it produces identical results when used repeatedly.
[reliability]
38
What is the main goal of establishing construct validity?
To show that the measurement procedure produces scores that behave in accordance with everything known about the construct.
39
How do researchers demonstrate convergent validity?
By showing strong relationships among different methods measuring the same construct.
40
What is an example of observer error?
A baseball umpire making inconsistent calls on balls and strikes.
41
What is the role of past research in establishing construct validity?
To document how the specific variable behaves across different situations.
42
Why might high face validity create problems in research?
Participants may adjust their answers if they know what is being measured.
43
What is the outcome if a measurement has low construct validity?
It does not accurately capture the variable it is supposed to measure.
44
Fill in the blank: High scores on the Student Risk Screening Scale (SRSS) predict higher _______ referrals.
[discipline]
45
What is reliability in the context of measurement?
The stability or consistency of the measurements produced by a specific measurement procedure.
46
What is test-retest reliability?
The reliability estimate obtained by comparing scores from two successive measurements of the same individuals.
47
What is parallel-forms reliability?
The reliability measure obtained when different versions of the measuring instrument are used for test and retest.
48
What is inter-rater reliability?
The degree of agreement between two observers who simultaneously record measurements of behaviors.
49
What is split-half reliability?
A measure obtained by splitting the items on a questionnaire or test in half and computing the degree of consistency between the two scores.
50
What is the equation that expresses the relationship between measured score, true score, and error?
Measured Score = True Score + Error
51
True or False: A measurement can be reliable without being valid.
True
52
What is the main assumption behind the concept of reliability?
The variable being measured is stable or constant.
53
What happens to the error component in measurements over a series of trials?
It generally averages to zero.
54
What is the relationship between reliability and validity?
Reliability is a prerequisite for validity; a measurement cannot be valid unless it is reliable.
55
Fill in the blank: A measure cannot be _______ unless it is reliable.
valid
56
What kind of relationship exists between educational TV and high school grades according to research?
Positive
57
What type of validity is demonstrated when participants who scored high on a self-esteem test made more eye contact?
Concurrent validity
58
What are the four scales of measurement?
* Nominal
* Ordinal
* Interval
* Ratio
59
True or False: A measurement process can be valid and reliable even if it is not accurate.
True
60
What is the meaning of a ratio scale's zero point?
It is a meaningful point representing none (a complete absence) of the variable being measured.
61
What is the key characteristic of a ratio scale?
An absolute, non-arbitrary zero point.
62
What is internal consistency in measurement?
The degree of consistency among different items measuring the same construct.
63
What does a ratio scale allow you to measure?
The distance from zero and compare measurements in terms of ratios
64
How does a glass with 8 ounces of water compare to a glass with 4 ounces?
The glass with 8 ounces has twice as much as the glass with 4 ounces
65
What can be measured with a ratio scale?
* Physical measures (height, weight)
* Variables (reaction time, number of errors on a test)
66
What is the key difference between an interval scale and a ratio scale?
The definition of the zero point
67
In a ratio measurement, how does an 80-pound child compare to a 40-pound child?
The 80-pound child weighs twice as much as the 40-pound child
68
What happens when the zero point is defined as the average weight for a group?
Measurements form an interval scale
69
What score does a child who is 12 pounds above average receive?
+12 pounds
70
What score does a child who is 4 pounds below average receive?
-4 pounds
71
True or False: The distinction between interval and ratio scales has significant practical implications.
False
72
What do nominal scales allow you to determine?
Whether two scores are the same or different
73
What information can ordinal scales provide beyond nominal scales?
The direction of the difference
74
Fill in the blank: The ability to measure _______ is often more important than the ability to measure ratios.
distances
75
What is a key limitation of nominal measurements?
You cannot measure the size of the difference between scores
76
What does an interval scale provide information about?
The distance between two scores
77
For most applications, what is more important: the ability to measure distances or ratios?
The ability to measure distances
78
What is a characteristic of ratio scales in relation to zero?
Zero corresponds to none of the quantity being measured
79
How do interval scales differ from ratio scales in terms of information provided?
* Provide the same information about distance
* Do not allow for ratio comparisons
80
What type of scale only allows you to determine whether two scores are the same or different?
Nominal scale
81
What kind of scores does a child receive on an interval scale if they are measured relative to an average?
Scores based on their difference from the average
82
What are the four types of measurement scales identified by researchers?
Nominal, ordinal, interval, and ratio
## Footnote
These scales differ based on the relationships among categories and the information provided.
83
What does a nominal scale represent?
Qualitative differences in the variable measured
## Footnote
Categories are not related in any systematic way, e.g., academic majors.
84
What can measurements from a nominal scale determine?
Whether two individuals are the same or different
## Footnote
Quantitative comparison is not possible.
85
How are categories organized in an ordinal scale?
In an ordered series
## Footnote
Examples include ranks like first, second, third.
86
What is a limitation of ordinal scales?
Do not allow determination of the magnitude of the difference
## Footnote
We know the direction of difference but not how much.
87
What distinguishes interval and ratio scales from nominal and ordinal scales?
Categories are organized sequentially with equal intervals
## Footnote
Examples include measures of time, weight, and temperature.
88
What is a characteristic of an interval scale?
Has an arbitrary zero point
## Footnote
For example, 0 degrees Fahrenheit does not mean absence of temperature.
89
What is the main difference between interval and ratio scales?
The presence of a true zero point in ratio scales
## Footnote
Ratio scales indicate the total absence of the variable measured.
90
What are the three modalities of measurement?
Self-report, physiological, and behavioral
## Footnote
These modalities help define and measure constructs.
91
What type of data is usually preferred for most research situations?
Interval or ratio scale data
## Footnote
These scales allow hypothesis testing and produce meaningful values.
92
True or False: Ordinal measurements produce meaningful values for means and variances.
False
## Footnote
Ordinal measurements are not suitable for many commonly used hypothesis tests.
93
Fill in the blank: The categories of an ordinal scale are organized in a _______.
Ordered series
94
What is an example of a construct that cannot be directly observed?
Fear
## Footnote
Researchers measure external expressions of fear to evaluate it.
95
What problem arises in classifying IQ scores as interval or ordinal?
Uncertainty about the size of one point of IQ
## Footnote
The difference between scores may not be consistent across the scale.
96
What type of measurement scale is often used in rating scales from 1 to 5?
Ordinal scale
## Footnote
Even if they appear to have equal intervals, the distances between labels may not be equal.
97
What scale is used to rate the degree of agreement with statements?
A scale from 1 to 5
## Footnote
Labeled as Somewhat Strongly Agree, Somewhat Agree, Neutral, Disagree, Strongly Disagree.
98
What is the key difference between ordinal and interval scales?
Ordinal scales indicate direction of difference, while interval scales indicate direction and magnitude.
99
What is a nominal scale capable of indicating?
It can only indicate that a difference exists.
100
What does a ratio scale measure?
Direction, magnitude, and ratio of the difference.
101
How do researchers traditionally treat ambiguous scales like IQ scores?
As if they were from an interval scale.
102
What is the term for the problem when scores cluster at the high end of a scale?
Ceiling effect.
103
What is the term for the problem when scores cluster at the low end of a scale?
Floor effect.
104
What is an artifact in the context of a research study?
A nonnatural feature that may influence or distort measurements.
105
What is experimenter bias?
When a researcher unintentionally influences results based on their expectations.
106
What is one advantage of physiological measures?
They provide accurate and objective measurements.
107
What is a potential disadvantage of physiological measures?
They require expensive equipment and may create unnatural situations.
108
Fill in the blank: The _______ of measurement refers to the extent to which it can detect changes.
sensitivity
109
What is the primary advantage of self-report measures?
They provide direct insights from individuals about their own experiences.
110
What are behavioral measures?
Measures that observe and quantify overt behaviors.
111
Using a PET scan to measure brain activity is an example of what modality of measurement?
Physiological.
112
Using an anonymous questionnaire to determine how many times students send or receive text messages is an example of what modality of measurement?
Self-report.
113
Counting the number of times a student leaves their seat without permission is an example of which modality of measurement?
Behavioral.
114
What is the purpose of using multiple measures in research?
To obtain a more complete measure of a construct.
115
What does the term 'range effect' refer to?
Sensitivity problems when scores cluster at one end of a measurement scale.
116
True or False: Self-report measures are immune to distortion.
False.
117
What problem can arise from combining multiple measures?
Confusion in the interpretation of results if measures do not behave the same.
118
What is one way to limit problems associated with multiple measures?
Combine them into a single score for each individual.
119
What is the requirement for measuring time to detect subtle changes?
Time must be measured in units small enough to detect the change.
## Footnote
For example, if changes are expected to be 1/100 of a second, measuring in seconds may not suffice.
120
What is a single-blind research study?
A research study in which the researcher does not know the predicted outcome.
121
What is a double-blind research study?
A research study in which both the researcher and the participants are unaware of the predicted outcome.
122
Define demand characteristics in research studies.
Cues or features that suggest the purpose and hypothesis of a study, influencing participants' behavior.
123
What is reactivity in the context of research studies?
When participants modify their natural behavior in response to awareness of being observed or measured.
124
What is experimenter bias?
When measurements in a study are influenced by the experimenter's expectations or beliefs regarding the outcome.
125
List some ways an experimenter can influence participant behavior.
* Paralinguistic cues (tone of voice)
* Kinesthetic cues (body posture, facial expressions)
* Verbal reinforcement of responses
* Misjudgment of responses
* Errors in recording data.
126
What is the ceiling effect?
A situation where scores are so high that it prevents measuring improvement.
127
What is the purpose of standardizing or automating an experiment?
To limit personal contact between the experimenter and participant and reduce experimenter bias.
128
What is the difference between a laboratory setting and a field setting?
* Laboratory setting: Perceived as artificial
* Field setting: Perceived as a natural environment.
129
What factors should be considered when selecting a measurement procedure?
* Reliability and validity of past research
* Sensitivity of the measurement
* Scale of measurement (nominal, ordinal, interval, ratio).
130
Define the good subject role in research participants.
Participants who identify the hypothesis and try to produce responses that support it.
131
What is the negativistic subject role?
Participants who identify the hypothesis and try to act contrary to it, often to sabotage the study.
132
What is the apprehensive subject role?
Participants who are overly concerned about how they are perceived and respond in socially desirable ways instead of truthfully.
133
What is the faithful subject role?
Participants who follow instructions carefully and avoid acting on any suspicions about the study's purpose.
134
What is the impact of participant reactivity on research validity?
It can distort the measurements, leading to results that do not accurately reflect true behaviors.
135
How can researchers reduce the effects of reactivity?
* Observing participants in their natural environment
* Disguising the measurement process
* Reassuring participants about confidentiality.
136
What does it mean when participants are described as 'naive' in research?
Participants are unaware of the hypothesis or expected outcomes of the study.
137
What are the four scales of measurement?
* Nominal
* Ordinal
* Interval
* Ratio.
138
What additional information does an ordinal scale provide compared to a nominal scale?
Ordinal scale provides information about the order of the data.
139
What additional information does an interval scale provide compared to an ordinal scale?
Interval scale provides information about the magnitude of differences between data points.
140
What additional information does a ratio scale provide compared to an interval scale?
Ratio scale includes a true zero point, allowing for the comparison of absolute magnitudes.
141
Fill in the blank: A researcher might evaluate the reliability of a questionnaire by assessing _______.
[inter-rater reliability].
142
True or False: The faithful subject role is the ideal role for participants in research studies.
True.
143
What is a nominal scale?
A scale of measurement that classifies data into distinct categories without any order
## Footnote
Examples include gender, race, or types of fruits.
144
What is an interval scale?
A scale of measurement that has ordered categories with equal intervals between them, but no true zero point
## Footnote
Examples include temperature in Celsius or Fahrenheit.
145
What is a ratio scale?
A scale of measurement that has ordered categories, equal intervals, and a true zero point
## Footnote
Examples include weight, height, and age.
146
What is an operational definition?
A specific procedure used to measure a variable, often necessary for intangible concepts
## Footnote
Operational definitions clarify how constructs are quantified.
147
What are the three modalities of measurement?
* Self-report
* Physiological
* Behavioral
148
What is the difference between self-report measures and behavioral measures?
Self-report measures rely on individuals' accounts, while behavioral measures observe actual behavior
## Footnote
Self-reports can be biased, while behaviors may not always reflect internal states.
149
What is validity in measurement?
The extent to which a measure truly assesses the variable it claims to assess
## Footnote
Types of validity include face, concurrent, predictive, construct, convergent, and divergent validity.
150
Define reliability in measurement.
The consistency and stability of a measure over time
## Footnote
Reliability can be assessed through test-retest, inter-rater, and split-half methods.
151
What is concurrent validity?
The degree to which a new measure correlates with an established measure of the same construct
## Footnote
It is used to evaluate whether a new test is valid by comparing it with a known standard.
152
What is a ceiling effect?
A situation where a measurement instrument cannot detect differences at the high end of the scale
## Footnote
This can lead to underestimating the variability in scores.
153
What is a floor effect?
A situation where a measurement instrument cannot detect differences at the low end of the scale
## Footnote
This can obscure the true performance of participants.
154
What are demand characteristics?
Cues in an experiment that inform participants of the expected behavior, influencing their responses
## Footnote
Demand characteristics can lead to biased results if participants alter their behavior based on perceived expectations.
155
What is experimenter bias?
When a researcher's expectations influence the outcomes of the study
## Footnote
This can be mitigated through double-blind research designs.
156
True or False: A valid measure is not necessarily reliable.
True
157
What is the purpose of using operational definitions?
To provide clarity and specificity in measuring intangible constructs
## Footnote
Operational definitions help in replicating research and ensuring consistency.
158
Fill in the blank: A _______ scale has ordered categories with equal intervals and a true zero point.
[ratio scale]
159
Describe the strengths of self-report measures.
* Easy to administer
* Can gather subjective data
* Cost-effective
160
Describe the weaknesses of behavioral measures.
* May not capture internal states
* Can be influenced by external factors
* More time-consuming to analyze
161
What is reactivity in research?
When participants alter their behavior because they are aware they are being observed
## Footnote
This can affect the validity of the measurement.
162
What is a good subject role?
When participants try to provide results that align with the research hypothesis
## Footnote
This can lead to biased data if not managed properly.
163
What is a negativistic subject role?
When participants intentionally provide data that contradict the research hypothesis
## Footnote
This can skew results and complicate data interpretation.
