chap 3 Flashcards
What is the primary focus of behavioral scientists when conducting research?
Defining and measuring the variables they study
What are the two key criteria used to evaluate the quality of a measurement procedure?
- Validity
- Reliability
Define an artifact in the context of research.
An artifact can influence the results of a research study, such as experimenter bias and demand characteristics.
What did previous research indicate about heterosexual men’s perception of women wearing red?
They perceive women as being more attractive when wearing red.
In the study by Guéguen and Jacob (2012), what was the outcome regarding male customers’ tipping behavior?
Male customers gave significantly bigger tips to waitresses wearing red.
What are constructs in behavioral science?
Hypothetical variables that cannot be directly observed or measured.
What is an operational definition?
A procedure for indirectly measuring and defining a variable that cannot be observed or measured directly.
What is a limitation of operational definitions?
There is not a one-to-one relationship between the variable being measured and the actual measurements produced.
What is an example of a construct that can be operationally defined?
Intelligence, as measured by an IQ test.
Fill in the blank: The operational definition of hunger can include _______.
the number of hours of food deprivation
True or False: Operational definitions always capture every component of a construct.
False
What is the goal of an operational definition?
To provide a definition and a method for measuring a hypothetical construct.
Define validity in the context of measurement.
The degree to which the measurement process measures the variable that it claims to measure.
What is face validity?
The superficial appearance or face value of a measurement procedure.
What type of relationship is indicated when two measurements change together in the same direction?
Positive relationship
What type of relationship is indicated when one measurement increases while the other decreases?
Negative relationship
Explain the role of multiple measures in evaluating constructs.
Using two or more different procedures to measure the same variable helps reduce the risk of leaving out important components.
What is a scatter plot used for in research?
To illustrate the consistency of the relationship between two different measurements.
What is the main idea behind operationalizing a construct?
To define and measure variables that cannot be directly observed.
What can affect the performance on a measurement task, such as an exam?
Physical illness or fatigue.
What does it mean to operationalize a construct?
To define and measure a hypothetical construct using observable behaviors.
What are the two general criteria used to evaluate the quality of any measurement procedure?
- Validity
- Reliability
What is validity in measurement procedures?
The degree to which the measurement process measures the variable that it claims to measure.
Define face validity.
The superficial appearance of a measurement procedure; if it looks like it measures what it claims to measure.
What is concurrent validity?
Establishing validity by demonstrating that scores from a new measurement are directly related to scores from an established measurement of the same variable.
What does predictive validity indicate?
When measurements of a construct accurately predict behavior according to a theory.
Define construct validity.
Scores obtained from a measurement procedure behave exactly the same as the variable itself.
What is convergent validity?
Demonstrated by a strong relationship between scores obtained from two different methods of measuring the same construct.
What is divergent validity?
Demonstrated by showing little or no relationship between the measurements of two different constructs.
What is reliability in measurement procedures?
The ability of a measurement procedure to produce identical or nearly identical results when used repeatedly under the same conditions.
What are common sources of measurement error?
- Observer error
- Environmental changes
- Participant changes
What is the relationship between error and reliability?
When error is large, reliability is low; when error is small, reliability is high.
What is test-retest reliability?
The reliability estimate obtained by comparing scores from two successive measurements.
True or False: Face validity is a scientific form of validity.
False.
What is the significance of a correlation near +1.00?
It indicates a consistent positive relationship between two measurements.
What does a correlation near zero indicate?
An inconsistent relationship between two measurements.
Fill in the blank: A measurement procedure is said to have _______ if it produces identical results when used repeatedly.
[reliability]
What is the main goal of establishing construct validity?
To show that the measurement procedure produces scores that behave in accordance with everything known about the construct.
How do researchers demonstrate convergent validity?
By showing strong relationships among different methods measuring the same construct.
What is an example of observer error?
A baseball umpire making inconsistent calls on balls and strikes.
What is the role of past research in establishing construct validity?
To document how the specific variable behaves across different situations.
Why might high face validity create problems in research?
Participants may adjust their answers if they know what is being measured.
What is the outcome if a measurement has low construct validity?
It does not accurately capture the variable it is supposed to measure.
Fill in the blank: High scores on the Student Risk Screening Scale (SRSS) predict higher _______ referrals.
[discipline]
What is reliability in the context of measurement?
The stability or consistency of the measurements produced by a specific measurement procedure.
What is test-retest reliability?
The reliability estimate obtained by comparing scores from two successive measurements of the same individuals.
What is parallel-forms reliability?
The reliability measure obtained when different versions of the measuring instrument are used for test and retest.
What is inter-rater reliability?
The degree of agreement between two observers who simultaneously record measurements of behaviors.
What is split-half reliability?
A measure obtained by splitting the items on a questionnaire or test in half and computing the degree of consistency between the two scores.
What is the equation that expresses the relationship between measured score, true score, and error?
Measured Score = True Score + Error
True or False: A measurement can be reliable without being valid.
True
What is the main assumption behind the concept of reliability?
The variable being measured is stable or constant.
What happens to the error component in measurements over a series of trials?
It generally averages to zero.
What is the relationship between reliability and validity?
Reliability is a prerequisite for validity; a measurement cannot be valid unless it is reliable.
Fill in the blank: A measure cannot be _______ unless it is reliable.
valid
What kind of relationship exists between educational TV and high school grades according to research?
Positive
What type of validity is demonstrated when participants who scored high on a self-esteem test made more eye contact?
Concurrent validity
What are the four scales of measurement?
- Nominal
- Ordinal
- Interval
- Ratio
True or False: A measurement process can be valid and reliable even if it is not accurate.
True
What is the meaning of a ratio scale’s zero point?
It is a meaningful point representing none (a complete absence) of the variable being measured.
What is the key characteristic of a ratio scale?
An absolute, non-arbitrary zero point.
What is internal consistency in measurement?
The degree of consistency among different items measuring the same construct.
What does a ratio scale allow you to measure?
The distance from zero and compare measurements in terms of ratios
How does a glass with 8 ounces of water compare to a glass with 4 ounces?
The glass with 8 ounces has twice as much as the glass with 4 ounces
What can be measured with a ratio scale?
- Physical measures (height, weight)
- Variables (reaction time, number of errors on a test)