05 Flashcards

1
Q

what are factorial designs?

A

experimental designs with more than one independent variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what does the term “factor” refer to?

A

each manipulated independent variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what are two-factorial designs?

A

experiments with two independent variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what are experiments with two independent variables called?

A

two-factorial designs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what are factorial designs describes by?

A

described by the number of factors (independent variables) and the number of levels in each factor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

A two-factorial design with two factors having two levels each is described as a …

A

2 x 2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what do the number of conditions correspond to?

A

the number of cells in the design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what are the different factorial designs?

A
  • within-subject designs
  • between-subject designs
  • mixed designs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what is an interaction in factorial design?

A

In a factorial design, an interaction is said to occur when the effect of one independent variable
depends on the level of another independent variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what is a cross-over interaction?

A

In a cross-over interaction the effect of one variable reverses as a function of the other variable.
Furthermore, there is no main effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is a survey?

A

A survey is a structured set of questions or statements given to a group of people to measure their
attitudes, beliefs, values, or tendencies to act.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

examples of questionaires

A
  • paper
  • online
  • mailed
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

how can interviews be held?

A
  • Live
  • Telephone
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what can be used for data acquisition for a survey?

A
  • questionnaire
  • interview
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

name formats of questions

A
  • open-ended question
  • closed question
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what is an open-ended question?

A

participants provide narrative information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what is a closed question?

A

Participants should respond to pre-formulated answers.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what are the advantages of open-ended questions?

A
  • eliciting a wide range of responses, including some not even conceived of by the researchers
  • increase the sense of involvement of the respondents
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what are the disadvantages of open-ended questions?

A
  • open-ended questions are difficult to score
  • take a lot of time to analyse
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

when are open-ended questions useful?

A
  • asking an open-ended question at the end of closed questions
  • using open-ended questions in a pilot study to get an idea of potential answers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

types of closed questions?

A
  • simple answer
  • likert scale
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

what is an advantage of closed questions?

A
  • Can be summarized in a quantitative way (e.g. means, standard deviation)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what should be considered when using closed questions?

A
  • number of answer options (three, five, seven)
  • some items should be formulated favourably and other unfavourably
  • sequence of items (sensitive questions towards the end)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

when should demographic information be added and why?

A

Should be added at the end (not to bore participants)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

what are example of demographic information?

A

age, gender, socioeconomic status, marital status, education

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

what does the type of demographic information depend on?

A

the research question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

what should you avoid when wording survey questions? (3)

A
  • ambiguity
  • double-barreled questions
    -leading questions
28
Q

what are double-barreled questions?

A

Question that touches upon more than one issue, yet allows only for one answer.

29
Q

what are leading questions?

A

A question that is structured in a way that makes it likely to produce an answer desired by the
asker.

30
Q

3 types of leading questions

A
  1. Leading questions that are based on assumptions
  2. Leading questions based on interconnected statements
  3. Leading questions based on coerciveness
31
Q

what is the researcher’s goal with surveys?

A

try to draw conclusions about the population based on the sample

32
Q

which sampling procedures should be used?

A

One should use probabilistic sampling procedures

33
Q

what does the sample need to be/should not be?

A

It is crucial that the sample is representative and not biased.

34
Q

what is psychometrics?

A

Psychometrics is a scientific discipline concerned with the question of how psychological constructs
(e.g., intelligence, depression) can be optimally related to observables (e.g., outcomes of psychological tests)

35
Q

general steps of scale construction (8)

A
  1. Determine what you want to measure (e.g. paranormal beliefs)
  2. Generate an item pool
  3. Content adequacy assessment
  4. Questionnaire administration
  5. Factor analysis
  6. Internal consistency assessment
  7. Construct validation
  8. Replication
36
Q

determine what you want to measure (4)

A
  • definition of the construct
  • objective of the scale
  • population
  • content of the scale
37
Q

what are the two general approaches to item generation?

A
  • inductive approach
  • deductive approach
38
Q

what is the inductive approach?

A
  • generate a pool of items first
  • use statistical methods to generate scales (e.g. factor analysis)
39
Q

when is the inductive approach used?

A

used when investigating an unfamiliar topic

40
Q

what is the deductive approach?

A

uses a theoretical definition of a construct which is then used as a guide for the creation of
items

41
Q

when is the deductive approach used?

A

when clear theoretical assumptions about the construct exists

42
Q

what should one be aware of when generating the items?

A

when generating the items one should be aware of the response format (e.g. Likert scale)

43
Q

what is the goal of the item generation process?

A

The goal of the item generation process is to generate much more items than are needed for the final scale
because one will select the best items based on their psychometric properties.

44
Q

what should you think about when generating items?

A
  • redundancy
  • writing process
  • positive and negative wording of items
45
Q

what are bad items (4)?

A
  • Exceptionally lengthy
  • Unnecessarily wordy
  • Multiple negatives
  • Double-barreled items
46
Q

what are good items?(2)

A
  • Unambiguous
  • Targets the appropriate reading level for the intended sample
47
Q

what is content adequacy assessment?

A

assesses whether items are really adequate for a specific construct

48
Q

common approach of content adequacy assessment

A
  • categorize or sort items based on their similarity to construct definitions
  • respondents are presented with construct definitions without titles and are asked to match
    items with a corresponding definition
  • can be done by experts or by non-experts
  • maximizes content validity
49
Q

how big should the sample size at least be?

A

Sample size should be at least 100 to 150 participants depending on the statistical approach

50
Q

what does the sample size also depend on?

A

The sample size also depends on the number of items (more items -> larger sample).

51
Q

what is a factor analysis?

A

Is a statistical method used to describe variability among observed, correlated variables in terms of
a potentially lower number of unobserved variables called factors.

52
Q

what is the general goal of the factor analysis?

A

to determine the structure of a specific construct and
investigate which items are most strongly related to a specific scale or subscale

53
Q

what is an exploratory factor analysis used for?

A

used to reduce the set of observed variables to a smaller, more parsimonious set of variables

54
Q

what is the objective of an exploratory factor analysis?

A

the objective is to identify those items that most clearly represent the content domain of the
underlying construct

55
Q

what does the confirmatory factor analysis assess?

A

Assesses the quality of the factor structure by statistically testing the significance of the overall
model.

56
Q

which items should be eliminated?

A

Items that do not ‘load’ on specific factors are eliminated.

57
Q

what should items of one scale be?

A

Items of one scale should be highly correlated

58
Q

what should items of different sales be?

A

Items of different scales should be less correlated.

59
Q

what should good items have?

A

large variance

60
Q

what does internal consistency determine?

A

how well the items of a scale measure the same construct.

61
Q

what is chronbachs alpha?

A
  • Indicates the degree of interrelationship among the items of a scale (how strongly they are
    correlated.
  • Items are deleted that impact the reliability of the scale negatively.
62
Q

types of construct validity (2)

A
  • convergent validity
  • discriminant validity
63
Q

what is convergent validity?

A

scores on a scales measuring a construct should relate to scores on other tests that are
theoretically related to the construct

64
Q

what is discriminant validity?

A

scales measuring some construct should not be related to scores on other measures that are
theoretically unrelated to the construct

65
Q

3 ways of replication

A
  • Replicate the findings in a different sample.
  • Alternatively one can also split the original sample and test the factor structure in the
    two halves of the sample.
  • One can use a confirmatory factor analysis for replication.