01

Question 1

what are strategies for literature search?

Answer 1

• start with relatively recent articles
• start with reviews or meta-analyses
• narrow down the topic
• distinguish relevant from irrelevant articles

Question 2

how can you estimate relevance?

Answer 2

• How related is the article to your topic?
• In which journal was it published?
• How often was it cited?
• Who has published the article?

Question 3

why is knowing the literature important? it can help you …

Answer 3

• to generate a research question
• to evaluate the relevance of a research question
• to figure out whether a research question has already been investigated
• to place the research question in the existing literature
• to determine the optimal methodology to investigate the research question

Question 4

how to generate a research idea from the literature

Answer 4

• test a suggestion made in the discussion section of an article
• test the explanation offered by authors that was not tested yet
• test whether the conclusion of an article generalizes to a different domain or
  group
• adapt the methodology to a different research problem

Question 5

what defines a good research question? (6)

Answer 5

• Focused on a single problem
• Specific and not too broad
• Complex enough to be informative (not only yes/no)
• Feasible to be answered in a given time frame and with the available resources
• Researchable
• Original

Question 6

what to avoid regarding research questions?

Answer 6

• motivating a research question primarily by the method
• being too ambitious
• mistake a hypothesis for a research question

Question 7

what is a theory?

Answer 7

coherent explanation or interpretation of one or more phenomena

Question 8

what does a theory go beyond?

Answer 8

goes beyond the phenomenon it explains

Question 9

what does a theory include?

Answer 9

variables, structures, processes, functions or organizing principles

Question 10

4 things a theory does

Answer 10

(a) best summarizes existing empirical knowledge of the phenomenon
(b) organizes this knowledge in the form of precise statements of relationships
among variables (i.e., laws)
(c) proposes an explanation for the phenomenon

Question 11

what is a hypothesis?

Answer 11

a specific prediction about a new phenomenon that should be
observed if a particular theory is accurate

Question 12

when is a sample representative?

Answer 12

a sample is representative if it reflects the attributes of the target population

Question 13

when is a sample biased?

Answer 13

a sample is biased when it does not reflect the attributes of the target population

Question 14

what are examples of a self-report measurement?

Answer 14

• Questionnaire
• Conversation
• Interview
• Text/ narratives

Question 15

what are example of a behavior measurement?

Answer 15

• Reaction time
• Errors
• Kinematics
• Eye movements
• Traces of behaviour in
  environment or text

Question 16

what are examples of a physiology measurement?

Answer 16

• Activity of central nervous system
• Autonomous activity
• Somatic activity
• Hormonal activity

Question 17

what is reliability?

Answer 17

the consistency of a measure

Question 18

what is measurement?

Answer 18

the assignment of numerals to objects or events according to rules

Question 19

what is validity?

Answer 19

a measure is said to be valid if it measures what it is designed to measure

Question 20

with what can we determine the quality of a measurement?

Answer 20

validity and reliability

Question 21

what is reliability a direct function of?

Answer 21

the measurement error

Question 22

what is a direct function of the measurement error?

Answer 22

reliability

Question 23

what is the measured value a combination of? (reliability)

Answer 23

the measured value is a combination of a hypothetical true value
and the measurement error

Question 24

what does test-retest reliability measure?

Answer 24

test-retest reliability measures the consistency of results when you repeat the same test on the same sample at a different point in time

Question 25

which measures is test-retest reliability good for?

Answer 25

good for measures that are assumed to be relatively stabile over time

Question 26

what is essential for test-retest reliability and why?

Answer 26

timing is essential:
* if too long, the measured construct might have changed
* if too short, participants might remember how they answered at T1

Question 27

what are forms of reliability?

Answer 27

• test-retest reliability
• split-half reliability
• inter-rater reliability

Question 28

what is split-half reliability?

Answer 28

• split measure into two halves and compute the correlation
• measures the internal consistency of a test
• is quick and easy to apply

Question 29

when is split-half reliability good?

Answer 29

good if all items measure the same construct and there are many items

Question 30

what does inter-rater reliability measure/asses?

Answer 30

interrater reliability (also called interobserver reliability) measures the degree of agreement between different people observing or assessing the same thing
- assesses the external consistency of a test

Question 31

what does content validity ask?

Answer 31

*Does the content of a measure make sense in terms of the construct being measured

Question 32

what is face validity concerned with?

Answer 32

• Concerns whether the measure seems valid to those who are taking it
• Not very essential from a measurement perspective.
• Sometimes one even wants to avoid it (e.g. implicit measures)

Question 33

what does criterion validity determine?

Answer 33

determines whether the measure is related to some behavioural outcome or criterion that has been established by prior research

Question 34

what does predictive validity determine?

Answer 34

whether the measure can accurately forecast some future behavior

Question 35

what does concurrent validity determine?

Answer 35

whether the measure can accurately predict present criteria

Question 36

what does construct validity determine?

Answer 36

determines whether a test adequately measures some construct

Question 37

how has construct validity to be established and why?

Answer 37

because constructs cannot be observed directly, construct validity has to be
established indirectly

Question 38

what is convergent validity?

Answer 38

scores on a test measuring some construct should relate to scores on other tests that are theoretically related to the construct

Question 39

what is discriminant validity?

Answer 39

test measuring some construct should not be related to scores on other measures that
are theoretically unrelated to the construct