Exam 3 Flashcards

1
Q

the most common research data collection methods in 205?

A

questionnaires and surveys

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what are examples of large scale survey industries?

A

Pew- political
Gallup- consumer opinion
youGov- international public opinion
nielsenn- tv ratings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

key parts of a questionairre

A

items
variables
responses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

each question within a questionnaire is called an

A

item

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

each item in a questionnaire can be used as a

A

variable
(can be a part or all of an operational definition)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

responses from a questionnaire should be treated as

A

confidential

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is a criterion variable?

A

the survey form of the dependent variable
the focus of your survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what is an example of a criterion variable?

A

Did you watch the superbowl?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what is a predictor variable?

A

the survey form of an IV
the factors that influence he criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what is a demographic variable?

A

variable such as age gender or access to TV
(can also be a predictor variable)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is an example of a demographic variable question?

A

what demographic is most likely to watch the superbowl?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

data depends on

A

how the question is answered

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what are the 4 questions types?

A
  1. open ended
  2. restricted items
  3. partially open ended
  4. rating scale
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what should you do before administering your questions of surveys to participants?

A

run pilot testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what are open ended items>

A

allow participants to respond using their own numbers words or lists
comes in 3 types:
numerical open ended
descriptive open ended
list open ended

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

numerical open ended questions example

A

how many times have you watched the jersey shore?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

descriptive open ended example

A

what did you like about the jersey shore?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

list open ended question example

A

list shows like the jersey shore

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what are restricted items?

A

they provide specific alternatives,
the questions need to be listed in a logical order
a whole spectrum of answers need to be provided

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

what is an example of an restricted item

A

Did the queens gambit change your interest in chess?
a.) decreased my interest
b.) increased my interest
c.) did not impact my interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what are partially open ended items?

A

provides specific response alternates plus an other category where participants can provide clarification as needed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

what is an example of a partially open ended question?

A

when do you usually stream movies?
a.)morning
b.) midday
c.) evening/night
____ other

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what is a rating scale item?

A

provides a graded response to a question
-they include points and anchors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

what is an example of a rating scale question?

A

would you buy Disney+ for a single movie?

very 1 2 3 4 5 very
unlikely likely

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

what is a point?

A

the value of a choice (usually on a scale of 1-5/7)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

what is an anchor?

A

labels that give meaning to the points
ex.) very unlikely

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

what are the specific rating scale names?

A

visual analog scale
likert scale
likert type scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

what is a visual analog scale?

A

removes all points
participants mark a line where they think is appropriate
line placement is measured to retrieve a score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

what are likert scales?

A

the extent to which a participant agrees about a statement using a 5 point scale
the anchors always range from strongly agree to strongly disagree

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

what is a likert type scale?

A

similar to a likert scale but doesnt use agree

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

what is an example of a likert type scale

A

angela duckworths grit scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

it is important that your survey has

A
  1. continuity and logic
    aka related questions should be ordered together
  2. not leading the participant
    aka the questions should not give away your hypthesis
  3. understandable and easy to read
  4. not too long
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

what are the methods of distribution for surveys?

A
  1. mail
  2. phone
  3. internet
  4. face to face
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

mail surveys

A
  • mail the questionnaire to the participant
    +it is the best way to get a near random sample because you randomly select from a public list
    -has a very high nonresponse bias because most people do not respond
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

how do you encourage people to respond to mail surveys?

A

include money in the envelope
make multiple attempts

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

telephone surveys

A

call the participants and ask them the questions
- either have real people calling or have an automated response system
+can access older adults better
-high non response bias
(land lines used to make it near random sampling method)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

internet survey

A

create the questionnaire online and either send a direct file, link, or social media post to reach the participant
+can access very large samples
- biased toward tech users and younger generatiosn

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

what are examples of internet survey tools

A

qualtrics
google forms
microsoft forms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

face to face interviews

A

talk to each participant directly
+highest response rate
-less likely to admit unpopular behavior and opinions
- more susceptible to interviewer bias due to the tone or demeanor of the questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

why do face to face interviewers have the highest response rate?

A

there is more social pressure to participate
response rate is highest when it is with members of the opposite sex

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

what are the three types of face to face interviews>

A

structured, unstructured, and semistructured interviews

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

what is a structured interview?

A

ask specific questions by reading prepared questions to the participant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

what is an undtructured interview?

A

no predetermined questions
-more similar to a discussion or conversation
can yield unexpected information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

what is a semistructured interview?

A

elements of both other types

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

what is a mixed model method?

A

use multiple data collection methods to collect data
+diversifies your example and increases the nukmber of responses
-new opportunities for errors
(responses will vary depending on how the survey is received)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

what is survey representativeness?

A

the survey sample should represent the intended population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

what are some ways to achieve a representative sample?

A
  • correct gender ratio
    -collect a nonbiased sample
    (note: even random sample can be biased by chance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

what is stratified sampling?

A

determines the relevant strata in your population and then select your sample to represent each strata equally

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

what is a strata?

A

groups within your intended variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

what is an example of a strata? How would you use that to create a stratified sample?

A

class sizes,, you would then take 10 students from each of the class size groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

what is a proportionate sample?

A

you select your sample to select the strata proportionately

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
52
Q

what is an example of how you would use this in a proportionate sample?

A

you would take 15% from class size A and then 45 from class size B,, etc.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
53
Q

how many people should be used in a sample?

A

enough to avoid sampling error
(get as many as possible)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
54
Q

what is sampling error?

A

when you use a sample too small to represent you population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
55
Q

what happens after you collect your data?

A
  • organizing the data
    -summarizing the data
  • graphing data
  • describing data
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
56
Q

we may use a ____ approach after collecting data

A

statistical

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
57
Q

what types of statistical approaches can we use?

A

descriptive statistics
-hypothesis testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
58
Q

when checking for data errors check for…

A
  1. missing data
    -someone didnt fill the question in
  2. impossible values
    -someones age is writted as 212
  3. ambiguous resopnses
    - youre unsure what their answer is
59
Q

what do we use spreadsheets for (excel)

A

a lot of things but namely organizing data

60
Q

what is included in your data summary sheet?

A

columns and rows

61
Q

columns should include

A

-1 variable per
(ie demographics, age, question, etc.)

62
Q

a row should include

A
  • 1 participant per (they get assigned a number)
63
Q

why do we use numbers for participants?

A

anonymity and organization purposes

64
Q

in the data summary sheet you should avoid

A

using text for data values because this limits your ability to analyze the data later

65
Q

what is a dummy variable

A

used to represent categories
when you assign a number value to a response so that you can analyze the data later

66
Q

graphs….

A

visually represent the data

67
Q

graphs have

A

2 dimensions (x)(y)

68
Q

the horizontal axis is the

A

x axis
predictor variable
levels of your independent variable

69
Q

the vertical axis is the

A

y axis
criterion variable
the performance of the dependent variable

70
Q

what is nominal data?

A

nata that fits into distinct categories
(restricted items)

71
Q

what is continuous data?

A
  • numerical open ended questions and rating scale items
72
Q

what type of graph goes with bar graphs?

A

nominal data

73
Q

what type of graph goes with line graphs?

A

continuous data (time)

74
Q

what type of graph goes with a scatter plot?

A

continuous data,, anything but time

75
Q

every graph is designed

A

the same way

76
Q

how do you describe direction and strength of a trend on a scatterplot?

A

positive relationship
-both increase or decrease
negative relationship
- one goes up while the other goes down
strong relationship
-variable change together
weak/no relationship
-variables change independently of one another

77
Q

what are common patterns in data?

A

monotonic and nonmonotonic

78
Q

what is a monotonic pattern?

A

data changes uniformly (either up or down)

79
Q

what is a nonmonotonic pattern?

A

data increases and decreases
- there is performance “sweet spot”

80
Q

what are the qualities that create a scientific graph?

A

-x and y axis labels
- sensible axis scale
- nothing in the background
-border around the chart space
- no numbers in the chart space
- font large enough to read
- high contrast
- no 3 d
- no title
- figure caption below graph

81
Q

numbers and graphs are often also used to

A

sway an audience

82
Q

how do numbers and graphs sway audiences?

A

incorrect numbers
correct numbers misinterpreted by a nonscientist
numbers are selectively used to be misleading
graphs are designed to mislead

83
Q

what is big duck data?

A

when design relies on graphic themes instead of accurate information
(more commonly used in business)

84
Q

where is a good place to start when trying to understand your data?

A

frequency
-rating scale questions
- continuous demographic data

85
Q

what should you use when trying to understand your data?

A

frequency
data distribution
outliers
measures of central tendency

86
Q

what are questions you can ask to better understand your data distribution

A

do your measures have a floor or ceiling effect?
is your sample biased

87
Q

distribution describes…

A

your sample

88
Q

what does normal distribution look like?

A

the sample data represents the population
humps in the middle of the graph

89
Q

does a skewed distribution look like?

A

the sample tends to one end or the other
humps toward the beginning or end

90
Q

what is an outlier?

A

extreme scores that pull on your average

91
Q

what are the measures of central tendency?

A

mean
median
mode

92
Q

what does the mean measure

A

thw average of all the data points

93
Q

what does the mode meaure

A

the most common value

94
Q

what does the median measure?

A

the middle value

95
Q

how do you test the effect of an outlier on the measures of central tendency?

A

put it into excel

96
Q

what in excel is used for calculations

A

“functions”

97
Q

how do you activate a function in excel?

A

type “=” into a cell

98
Q

what is the function of a histogram?

A

used to show outliers

99
Q

what is the measure of distribution spread?

A

standard deviation

100
Q

what is standard deviation?

A

the average distance of individual values from the mean

101
Q

what function do you use in excel to get the standard deviation

A

STDEV.S

102
Q

whenever you report a mean you also need to

A

report a standard deviation

103
Q

how do we use he median?

A

median split

104
Q

what is a median split

A

create two nominal predictor variables by splitting a continuous variable
-get a high group (above median) and a low group (below median)

105
Q

in median split you use ____ to quantify your low and high groups

A

dummy variables

106
Q

what are the steps in creating a median split:

A
  1. list all predictor values in order
  2. find median for predictor
  3. create new predictor categories
  4. compare criterion based categories
107
Q

what is significance?

A

determining if two groups are “actually” different
(p-value)
calculated using a T-test

108
Q

how do you calculate a t-test in excel?

A
  1. select data from both groups
  2. select two tail (alpha level)
  3. select equal variance
109
Q

why do we use two tail tests?

A

they have better accuracy

110
Q

what does the p value need to be in order to be signficant?

A

<.05 or 5%

111
Q

what do you use to evaluate variable relationships

A

pearsons correlation coefficient (r-value)

112
Q

what does correlation coefficient (r-value) do?

A

gives strength and direction of relationship
(each point on a scatterplot = 1 participant)

113
Q

how to calculate correlation coefficient in excel

A

=Correll( two arrays of numbers)

114
Q

the direction of a relationship can either be

A

positive or negative

115
Q

what does it mean to have a strong relationship?

A

.7<

116
Q

what value is considered very weak correlation

A

.1-.29

117
Q

what value is considered weak correlation

A

.3-.49

118
Q

what value is considered moderate correlation?

A

.5-.69

119
Q

correlation requires

A

variability
(low variability=low variation)
(this applies to skewed data too)

120
Q

correlation assumes

A

a linear realtionship

121
Q

data in a nonlinear trend that does not appear correlated but can be is called

A

nonmonotonic

122
Q

what was the 2014 Kramer study?

A

collaboration between facebook and cornell
-studied social emotional contagion
- almost 700k users recieved an altered news feed with either fewer positive posts or fewer negative posts
-then they monitored that groups future posting habits

123
Q

what did the Kramer study find

A

our media feed impacts our mood

124
Q

the kramer study recieved

A

negative criticism towards the researchers and the journal that published the study

125
Q

how did he kramer study get published even though it was unethical

A

the journal relied on the Cornells IRB, and the IRB was like idc your doing it on facebook and I want to have our name on a publication

126
Q

what journal published the Kramer study?

A

Proceedings of the national academy of sciences

127
Q

those who teach, research, or practice psychological science should:
and
should not:

A

promote accuracy, honesty, and truthfulness

steal cheat, engage in fraud, misrepresent facts

128
Q

failure to practice science ethically….

A

erodes trust

129
Q

what is a prime example of a study that misused science?

A

wakefield (1998) vaccines and autism study

130
Q

what was the Wakefield study about?

A

wakefield conducted a study that linked vaccines to the development of autism
(has 3000 citations)
gave rise to the modern anti vaccine movement
lead to several measles outbreaks

131
Q

why did the wakefield study misuse science so badly?

A

they lied about a lot of their data
- they left out some patient data
- they only used data from about 12 participants
- they made up and altered medical records
- funded by a law firm suing a MMR drug co.
-relied on parents own beliefs and memories of symptoms and timelines in order to diagnose autism
- the redaction took 12 years
(all 9 of his coauthors had no idea what Wakefield was doing)
(redaction means when the journal finally came out and said that they no longer support the study

132
Q

what can potentially harm research integrity?

A
  • plagiarism
  • falsification
  • fabricating
133
Q

what is plagiarism?

A

claiming another’s ideas, processes, or results without giving credit

134
Q

what is falsification?

A

altering or omitting data or parts of the method without acknowledgement

135
Q

what is fabrication?

A

reporting data or results that were made up

136
Q

what percentage of research involves misconduct?

A

25%

137
Q

what percentage of researchers see misconduct at some point in their careers?

A

50%

138
Q

why do people think its okay to commit misconduct?

A

“its okay if its just me”
self esteem as a scientist
(people want to know that they can do good science and feel good about their work, so they lie)

139
Q

what are some other reasons researchers may commit misconduct?

A

conflicts of interest
- want finnancial support for future research
- want academic promotion and tenure
(publish or perish)

140
Q

how can we prevent reaearch misconduct?

A

careful peer review
encourage replication
create a healthy research culture

141
Q

why is careful peer review important to stopping misconduct?

A

by making all data available to reviewers it will make it easier to pick out mistakes or lies

142
Q

why is study replication important to stopping misconduct?

A

it weakens incorrect results
by publishing nonsignificant findings it helps weaken incorrect siginificant findings

143
Q

why is it important to create a healthy research culture when preventing misconduct?

A

it encourages whistleblowing
penalties can be used as deterrents

144
Q

why are people so discouraged from whistleblowing?

A

70% of whistleblowers received negative consequences
-pressure to drop charges
- ostracization
-fired or not promoted
- counter complaints