JC Flashcards

1
Q

What are the observations?

A
  • personal
  • reported
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

explanation

A

can it already be found?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

hypotheses

A
  • null + alternative
  • testable
  • combine question with existing knowledge
  • predictions
  • experiments to test these predictions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

experimental design

A
  • iterations and improvements
  • does it test at multiple scales?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

findings

A
  • how are they written up and presented?
  • open
  • peer reviewed
  • conference/preprint
  • social media/blog
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

integration

A
  • into existing knowledge
  • general explanation/phenomenon
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

headlines

A
  • sensational?
  • solved/prevented/cured
  • accurate?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Observing/questioning tips

A
  • explain why the q matters to understanding the phenomenon
  • make observations in different contexts/places; check that the problem/phenomenon is real
  • financial feasibility
  • does it consult prior literature/theory/experts?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Observing/questioning pitfalls

A
  • oversimplifying an existing field/minimising prior work
  • not explaining why something is interesting/important
  • confirmation bias
  • not justifying why doing study matters
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

confirmation bias

A
  • assuming that a phenomenon exists or thinking that you know the answer, then forming a question retrospectively
  • only testing predictions to confirm/neutral
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Hypotheses tips

A
  • a priori
  • true alternatives
  • plausible
  • falsifiable
  • not tangential
  • not too broad
  • actually look at the question of interest
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

true alternatives

A

attempt to address the same phenomenon

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Prediction tips

A
  • clear
  • measurable given technical, time and financial constraints
  • pre-registration
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Hypotheses pitfalls

A
  • confusing with predictions
  • not mutually exclusive
  • answer a complementary q
  • post-hoc data mining
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what is the difference between a hypothesis and a prediction

A

hypotheses need context

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

post-hoc data mining

A

HARKing

17
Q

prediction pitfalls

A
  • confirmation bias
  • unrelated
18
Q

Gathering/analysing data tips

A
  • independent, representative sample
  • appropriate study system picked and justified
  • display, examine and present at all stages in a clear way
  • display raw data
  • appropriate stats test
19
Q

Gathering/analysing data pitfalls

A
  • p and R values
  • multiple tests without adjusting p value (p-hacking)
  • pseudoreplication, autocorrelation
  • confounding effects
20
Q

p-hacking

A
  • missing data analysis techniques
  • results in false significance
21
Q

give some examples of confounding effects

A
  • contamination
  • seasonal effects
  • observer influence
22
Q

Sharing/writing up findings tips

A
  • measured, objective language in conclusions
  • communicate clearly and fairly
  • simplify without exaggerating
  • discuss level of confidence in results
  • limit speculation/extrapolation
  • discuss possible alternative interpretations
  • discuss limitations
  • suggest further work
  • colour-blind friendly graphics
23
Q

Sharing/writing up findings pitfalls

A
  • prematurely assertive language
24
Q

prematurely assertive language

A
  • “conclusively shows”
  • “beyond doubt”
  • “proves”
  • “confirms”