Exam 1 Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

Intuition

A

we are relying on our guts, our emotions, and/or our instincts to guide us

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Authority

A

This method involves accepting new ideas because some authority figure states that they are true

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Rationalism

A

involves using logic and reasoning to acquire new knowledge

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Empiricism

A

involves acquiring knowledge through observation and experience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Scientific Method

A

is a process of systematically collecting and evaluating evidence to test ideas and answer questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Systematic Empiricism

A

refers to learning based on observation, and scientists learn about the natural world systematically, by carefully planning, making, recording, and analyzing observations of it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Empirical Question

A

These are questions about the way the world actually is and, therefore, can be answered by systematically observing it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Public Knowledge

A

This usually means writing an article for publication in a professional journal, in which they put their research question in the context of previous research, describe in detail the methods they used to answer their question, and clearly present their results and conclusions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Pseudoscience

A

refers to activities and beliefs that are claimed to be scientific by their proponents—and may appear to be scientific at first glance—but are not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

falsifiable

A

A scientific claim that must be expressed in such a way that there are observations that would—if they were made—count as evidence against the claim

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

to describe

A

is achieved by making careful observations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

To predict

A

Once we have observed with some regularity that two behaviors or events are systematically related to one another we can use that information to predict whether an event or behavior will occur in a certain situation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

To explain

A

goal involves determining the causes of behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Basic research

A

Research conducted primarily for the sake of achieving a more detailed and accurate understanding of human behavior, without necessarily trying to address any particular practical problem.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Applied Research

A

Research conducted primarily to address some practical problem

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Folk psychology

A

Intuitive beliefs about people’s behavior, thoughts, and feelings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

heuristics

A

Mental shortcuts in forming and maintaining our beliefs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

confirmation bias

A

Tendency to focus on cases that confirm our intuitive beliefs and to disregard cases that disconfirm our beliefs.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

skepticism

A

Pausing to consider alternatives and to search for evidence—especially systematically collected empirical evidence—when there is enough at stake to justify doing so

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

tolerance for uncertainty

A

Accepting that there are many things that we simply do not know

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

empirically supported treatments.

A

A treatment that that has been shown through systematic observation to lead to better outcomes when compared to no-treatment or placebo control groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Three of the most common sources of inspiration

A

informal observations, practical problems, and previous research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Informal observations

A

include direct observations of our own and others’ behavior as well as secondhand observations from non-scientific sources such as newspapers, books, blogs, and so on

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Practical problems

A

can also inspire research ideas, leading directly to applied research in such domains as law, health, education, and sports

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

previous research

A

Recall that science is a kind of large-scale collaboration in which many different researchers read and evaluate each other’s work and conduct new studies to build on it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

research literature

A

All the published research in that field

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Professional journals

A

Are periodicals that publish original research articles.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Empirical research reports

A

Research reports that describe one or more new empirical studies conducted by the authors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Review articles

A

Articles that summarize previously published research on a topic and usually present new ways to organize or explain the results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

meta-analysis

A

A review article that provides a statistical summary of all of the previous results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

theoretical article

A

A review article that is devoted primarily to presenting a new theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

double-blind peer review

A

A process in which the reviewers of a research article do not know the identity of the researcher(s) and vice versa.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Scholarly books

A

Books written by researchers and practitioners mainly for use by other researchers and practitioners

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

monograph

A

A coherent written presentation of a topic much like an extended review article written by a single author or a small group of authors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Edited volumes

A

Books that are collections of chapters written by different authors on different aspects of the same topic, and overseen by one or more editors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

PsycINFO

A

A comprehensive electronic database covering thousands of professional journals and scholarly books going back more than 100 years—that for most purposes its content is synonymous with the research literature in psychology.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

empirically testable research questions

A

questions expressed in terms of a single variable or relationship between variables.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Evaluating Research Questions

A

This means they must have some way of evaluating the research questions they generate so that they can choose which ones to pursue.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

interestingness

A

How interesting the question is to people generally or the scientific community. Three things need to be considered: Is the answer in doubt, fills a gap in research literature, and has important practical implications.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

feasibility

A

How likely is the research question going to be successfully answered depending on the amount of time, money, equipment and materials, technical knowledge and skill, and access to research participants there will be

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

theory

A

A coherent explanation or interpretation of one or more phenomena

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

hypothesis

A

A specific prediction about a new phenomenon that should be observed if a particular theory is accurate.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

hypothetico-deductive method

A

A cyclical process of theory development, starting with an observed phenomenon, then developing or using a theory to make a specific prediction of what should happen if that theory is correct, testing that prediction, refining the theory in light of the findings, and using that refined theory to develop new hypotheses, and so on.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

testable and falsifiable

A

The ability to test the hypothesis using the methods of science and the possibility to gather evidence that will disconfirm the hypothesis if it is indeed false.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

logical

A

Hypotheses should be informed by previous theories or observations and logical reasoning.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

deductive reasoning

A

to generate a more specific hypothesis to test based on that theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

inductive reasoning

A

involves using specific observations or research findings to form a more general hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

positive

A

the hypothesis should make a positive statement about the existence of a relationship or effect, rather than a statement that a relationship or effect does not exist

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

variable

A

A quantity or quality that varies across people or situations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

quantitative variable

A

A quantity, such as height, that is typically measured by assigning a number to each individual.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

categorical variable

A

A variable that represents a characteristic of an individual, such as chosen major, and is typically measured by assigning each individual’s response to one of several categories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
52
Q

operational definition

A

A definition of the variable in terms of precisely how it is to be measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
53
Q

population

A

A large group of people about whom researchers in psychology are usually interested in drawing conclusions, and from whom the sample is drawn.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
54
Q

Sample

A

A smaller portion of the population the researcher would like to study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
55
Q

Simple Random Sampling

A

which every member of the population has an equal chance of being selected for the sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
56
Q

convenience sampling

A

A common method of non-probability sampling in which the sample consists of individuals who happen to be easily available and willing to participate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
57
Q

Experimental Research

A

Researchers who want to test hypotheses about causal relationships between variables need to use an experimental method.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
58
Q

independent variable

A

The variable the experimenter manipulates

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
59
Q

dependent variable

A

The variable the experimenter measures (it is the presumed effect)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
60
Q

Extraneous variables

A

Any variable other than the dependent and independent variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
61
Q

Confounds

A

A specific type of extraneous variable that systematically varies along with the variables under investigation and therefore provides an alternative explanation for the results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
62
Q

Non-Experimental Research

A

Researchers who are simply interested in describing characteristics of people, describing relationships between variables, and using those relationships to make predictions simply measures variables as they naturally occur, but they do not manipulate them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
63
Q

laboratory study

A

A study that is conducted in the laboratory environment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
64
Q

field study

A

A study that is conducted in a “real world” environment outside the laboratory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
65
Q

internal validity

A

Refers to the degree to which we can confidently infer a causal relationship between variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
66
Q

External validity

A

Refers to the degree to which we can generalize the findings to other circumstances or settings, like the real-world environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
67
Q

field experiments

A

A type of field study where an independent variable is manipulated in a natural setting and extraneous variables are controlled as much as possible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
68
Q

Descriptive Statistics

A

used to organize or summarize a set of data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
69
Q

mode

A

The most frequently occurring score in a distribution.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
70
Q

median

A

The midpoint of a distribution of scores in the sense that half the scores in the distribution are less than it and half are greater than it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
71
Q

mean

A

The average of a distribution of scores (symbolized M) where the sum of the scores are divided by the number of scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
72
Q

Range

A

A measure of dispersion that measures the distance between the highest and lowest scores in a distribution.

73
Q

standard deviation

A

sophisticated measure of dispersion that measures the average distance of scores from the mean

74
Q

variance

A

A measurement of the average distance of scores from the mean.

75
Q

correlation coefficient

A

Describes the strength and direction of the relationship between two variables

76
Q

Inferential statistics

A

A research method that allows researchers to draw conclusions or infer about a population based on data from a sample

77
Q

statistically significant

A

An effect that is unlikely due to random chance and therefore likely represents a real effect in the population.

78
Q

Type I error

A

A false positive in which the researcher concludes that their results are statistically significant when in reality there is no real effect in the population and the results are due to chance. In other words, rejecting the null hypothesis when it is true.

79
Q

Type II Error

A

A missed opportunity in which the researcher concludes that their results are not statistically significant when in reality there is a real effect in the population and they just missed detecting it. In other words, retaining the null hypothesis when it is false.

80
Q

Randomized controlled trial

A

Experimental design/study

81
Q

Cohort study

A

Student population, non experimental study

82
Q

Case control study

A

Non experimental study

83
Q

Peer review

A

Non basis reviewing

84
Q

Parsimony

A

Simple explanation

85
Q

Testability

A

Explanation that you can test

86
Q

Ethics

A

The branch of philosophy that is concerned with morality—what it means to behave morally and how people can achieve that goal.

87
Q

confederate

A

A helper who pretended to be a real participant in a study

88
Q

autonomy

A

A persons right to make their own choices and take their own actions free from coercion

89
Q

informed consent

A

This means that researchers obtain and document people’s agreement to participate in a study after having informed them of everything that might reasonably be expected to affect their decision.

90
Q

privacy

A

A persons right to decide what information about them is shared with others.

91
Q

confidentiality

A

An agreement not to disclose participants’ personal information without their consent or some appropriate legal authorization.

92
Q

anonymity

A

When a participants name and other personally identifiable information is not collected at all.

93
Q

Nuremberg Code

A

A set of 10 ethical principles for research written in 1947 in conjunction with the Nuremberg trials of Nazi physicians accused of war crimes against prisoners in concentration camps. Set of ethical guidelines developed for research with human sujects

94
Q

Declaration of Helsinki

A

An ethics code that was created by the World Medical Council in 1964.

95
Q

protocol

A

A detailed description of the research—that is reviewed by an independent committee.

96
Q

Belmont Report

A

A set of federal guidelines written in 1978 as a response to the abuses of the Tuskegee study that recognize three important principles in research with humans: justice, respect for persons, and beneficience, and that formed the basis for federal regulations applied to research.

97
Q

respect for persons

A

One of the Belmont report principles that emphasizes the need for participants to exercise autonomy and protection for those with reduced autonomy, often through informed consent

98
Q

beneficence

A

Underscores the importance of maximizing the benefits of research while minimizing harms to participants and society.

99
Q

Federal Policy for the Protection of Human Subjects

A

A set of laws based on the Belmont Report that apply to research conducted, supported, or regulated by the federal government.

100
Q

institutional review board (IRB

A

A committee that is responsible for reviewing research protocols for potential ethical problems.

101
Q

Exempt research

A

Research on the effectiveness of normal educational activities, the use of standard psychological measures and surveys of a nonsensitive nature that are administered in a way that maintains confidentiality, and research using existing data from public sources.

102
Q

Expedited research

A

Research reviewed by the IRB that is not anonymous and/or may involve potentially stigmatizing information, or invasive or uncomfortable procedures, but exposes participants to risks that are no greater than minimal risk

103
Q

greater than minimal risk research

A

Research that poses greater than minimal risk to participants and must be reviewed by the full board of IRB members.

104
Q

APA Ethics Code

A

Stands for the APA’s Ethical Principles of Psychologists and Code of Conduct. It was first published in 1953 and includes about 150 specific ethical standards that psychologists and their students are expected to follow.

105
Q

Deception

A

Misinforming participants about the purpose of a study, using confederates, using phony equipment like Milgram’s shock generator, and presenting participants with false feedback about their performance

106
Q

debriefing

A

This is the process of informing research participants as soon as possible of the purpose of the study, revealing any deception, and correcting any other misconceptions they might have as a result of participating.

107
Q

pre-screening

A

A way to minimize risks in a study and to identify and eliminate participants who are at high risk.

108
Q

Coercion

A

Without their consent or threatening them

109
Q

Ethical guidelines in research

A

Modify protocol, pre-screening, maintain privacy and confidentiality, identify and minimize deception

110
Q

Demand characteristics

A

When participants change their behavior because of the purposes of the study

111
Q

Ethical guidelines for nonhuman subjects

A

Justification, everyone involved must be trained in animal care, care and housing, must treat animals humanly, institutional animal care and use committees

112
Q

Scholarly integrity

A

Error in data that are reported, plagiarism, self plagiarism

113
Q

Measurement

A

Is the assignment of scores to individuals so that the scores represent some characteristic of the individuals.

114
Q

psychometrics

A

A subfield of psychology concerned with the theories and techniques of psychological measurement

115
Q

constructs

A

Psychological variables that represent an individual’s mental state or experience, often not directly observable, such as personality traits, emotional states, attitudes, and abilities.

116
Q

conceptual definition

A

Describes the behaviors and internal processes that make up a psychological construct, along with how it relates to other variables.

117
Q

operational definition

A

definition of the variable in terms of precisely how it is to be measured.

118
Q

Self-report measures

A

Measures in which participants report on their own thoughts, feelings, and actions.

119
Q

Behavioral measures

A

Measures in which some other aspect of participants’ behavior is observed and recorded

120
Q

physiological measures

A

Measures that involve recording any of a wide variety of physiological processes, including heart rate and blood pressure, galvanic skin response, hormone levels, and electrical activity and blood flow in the brain.

121
Q

converging operations

A

When psychologists use multiple operational definitions of the same construct—either within a study or across studies.

122
Q

levels of measurement

A

Four categories, or scales, of measurement are nominal, ordinal, interval, and ratio that specify the types of information that a set of scores can have, and the types of statistical procedures that can be used with the scores.

123
Q

nominal level

A

A measurement used for categorical variables and involves assigning scores that are category labels.

124
Q

ordinal level

A

A measurement that involves assigning scores so that they represent the rank order of the individuals.

125
Q

interval level

A

A measurement that involves assigning scores using numerical scales in which intervals have the same interpretation throughout

126
Q

ratio level

A

A measurement that involves assigning scores in such a way that there is a true zero point that represents the complete absence of the quantity.

127
Q

Reliability

A

Refers to the consistency of a measure.

128
Q

Test-retest reliability

A

When researchers measure a construct that they assume to be consistent across time, then the scores they obtain should also be consistent across time.

129
Q

internal consistency

A

The consistency of people’s responses across the items on a multiple-item measure.

130
Q

split-half correlation

A

A score that is derived by splitting the items into two sets and examining the relationship between the two sets of scores in order to assess the internal consistency of a measure.

131
Q

Cronbach’s α

A

A statistic that measures internal consistency among items in a measure

132
Q

Inter-rater reliability

A

The extent to which different observers are consistent in their judgments

133
Q

Validity

A

The extent to which the scores from a measure represent the variable they are intended to.

134
Q

Face validity

A

The extent to which a measurement method appears, on superficial examination, to measure the construct of interest.

135
Q

Content validity

A

The extent to which a measure reflects all aspects of the construct of interest.

136
Q

Criterion validity

A

The extent to which people’s scores on a measure are correlated with other variables (known as criteria) that one would expect them to be correlated with.

137
Q

criterion

A

A variable that theoretically should be correlated with the construct being measured

138
Q

concurrent validity

A

A form of criterion validity, where the criterion is measured at the same time (concurrently) as the construct.

139
Q

predictive validity

A

A form of validity whereby the criterion is measured at some point in the future (after the construct has been measured), to determine that the construct “predicts” the criterion.

140
Q

convergent validity

A

A form of criterion validity whereby new measures are correlated with existing established measures of the same construct.

141
Q

Discriminant validity

A

The extent to which scores on a measure of a construct are not correlated with measures of other, conceptually distinct, constructs and thus discriminate between them.

142
Q

socially desirable responding

A

When participants respond in ways that they think are socially acceptable.

143
Q

Survey research

A

A quantitative and qualitative method with two important characteristics; variables are measured using self-reports and considerable attention is paid to the issue of sampling.

144
Q

respondents

A

Participants in a survey or study

145
Q

Cognitive Model

A

interpret the question, retrieve relevant information from memory, form a tentative judgment, convert the tentative judgment into one of the response options provided (e.g., a rating on a 1-to-7 scale), and finally edit their response as necessary.

146
Q

context effects

A

Unintended influences on respondents’ answers because they are not related to the content of the item but to the context in which the item appears.

147
Q

item-order effect

A

When the order in which the items are presented affects people’s responses

148
Q

Open-ended items

A

Simply ask a question and allow participants to answer in whatever way they choose.

149
Q

Closed-ended items

A

Questionnaire items that ask a question and provide a limited set of response options for participants to choose from.

150
Q

rating scale

A

An ordered set of responses that participants must choose from.

151
Q

BRUSO

A

An acronym that stands for “brief,” “relevant,” “unambiguous,” “specific,” and “objective,” which is used to create effective questionnaire items that are brief and to the point.

152
Q

Probability sampling

A

Occurs when the researcher can specify the probability that each member of the population will be selected for the sample.

153
Q

Non-probability sampling

A

Occurs when the researcher cannot specify the probability that each member of the population will be selected for the sample

154
Q

Convenience sampling

A

A common method of non-probability sampling in which the sample consists of individuals who happen to be easily available and willing to participate (such as introductory psychology students).

155
Q

snowball sampling

A

A form of non-probability sampling in which existing research participants help recruit additional participants for the study.

156
Q

quota sampling

A

A form of non-probability sampling in which subgroups in the sample are recruited to be proportional to those subgroups in the population.

157
Q

sampling frame

A

A list of all the members of the population from which to select the respondents

158
Q

Simple random sampling

A

A probability sampling method in which each individual in the population has an equal probability of being selected for the sample

159
Q

stratified random sampling

A

A common alternative to simple random sampling in which the population is divided into different subgroups or “strata” (usually based on demographic characteristics) and then a random sample is taken from each “stratum.”

160
Q

Proportionate stratified random sampling

A

Is used to select a sample in which the proportion of respondents in each of various subgroups matches the proportion in the population.

161
Q

Disproportionate stratified random sampling

A

Is used to sample extra respondents from particularly small subgroups—allowing valid conclusions to be drawn about those subgroups.

162
Q

cluster sampling

A

A type of probability sampling in which larger clusters of individuals are randomly sampled and then individuals within each cluster are randomly sampled.

163
Q

Sampling bias

A

Occurs when a sample is selected in such a way that it is not representative of the entire population and therefore produces inaccurate results.

164
Q

non-response bias

A

Occurs when there is a systemic difference between survey non-responders from survey responders.

165
Q

Correlation

A

Statistical measure of how strongly two or more variables are related to each other

166
Q

Strongest possible positive correlation

A

1

167
Q

Weakest possible positive correlation

A

-1

168
Q

No correlation

A

0

169
Q

Balance

A

Extremely unlikely, somewhat unlikely, as likely as not, somewhat likely, extremely likely

170
Q

Unbalanced

A

Unlikely, somewhat likely, likely, very likely, extremely likely

171
Q

Midpoints

A

Zero/neutral

172
Q

Relevant

A

Do not ask questions related to outcome of interest

173
Q

Unambiguous

A

Can be only one way to interpret question

174
Q

Negatively worded questions

A

Negating phrasing may be confusing and difficult to interpret

175
Q

innerconsistency

A

Intentionally use both negative and positive in the same question to see people respond similarly

176
Q

Specific

A

Clearly worded questions

177
Q

Objective

A

Do not reveal researchers own opinion, wording leads to particular response pushing opinion

178
Q

Coding

A

Process of categorizing data, and be analyzed or interpret

179
Q

Reverse coding

A

Numerical scoring statements run in opposite directions for negatively/positively worded questions such that low vs high scores represent same opinion/behavior