Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

DEV CAPSTONE > Measurement: Options, Issues, & Strategies > Flashcards

Measurement: Options, Issues, & Strategies Flashcards

1
Q

True or False: Operationalization can mean manipulation OR measurement

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Causal variables are both ________ & ________

A

manipulated, administered

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Predictor variables must be ________

A

measured

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

All outcomes must be what?

A

Measured

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Variables for statistical control are ______ while factors under experimental control are _______ and kept constant

A

measured, manipulated/administered

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are some pros to verbal report?

A

quick & easy
easy to train people
inexpensive
large N
cover wide range of variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are some cons to verbal report?

A

probs w/ accurate perception of children
wording can be hard for younger children
researcher could be biased in how they question
respondents rush
don’t understand questionnaires

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the acquiescence bias?

A

tendency to agree w/ everything

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the extremity or moderacy bias?

A

Overly harsh or all answers are in the middle

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is reference group bias?

A

Who you are comparing yourself to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the above-average phenomenon?

A

overestimate our good qualities

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the pros of tests?

A

direct assessment
avoid biases of self-reflective verbal report
less boring
objective

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the cons of tests?

A

not representative of real-world behavior
doesn’t sample full construct
ceiling or floor effects
likely smaller N than verbal report b/c of resources
if need to develop, can be time-consuming
potential subject to cultural bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the pros of observational measurements?

A

more accurate/valid than reflective self-perception
closest to natural behavior
can be less subject to social desirability bias
can be naturalistic or structured
often no complicated instructions to follow
can make lasting recordings of video, audio, physiological information/data
can capture a large range of behaviors/variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the cons to observational measurements?

A

can be too forced (if not naturalistic)
may capture “acting” (social desirability) if short in length
subject reactivity – subject knowing they are being observed affects their behavior
observer bias – observers see and record what they expect to occur, rather than what actually happens
lack of interobserver agreement
time-consuming to train coders, code, etc.
can’t infer motives, beliefs, attitudes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How can you reduce subject reactivity?

A

habituation
participant observation –use of someone who is already present in the setting to collect observations
disguise the fact that observations are being made (hidden cameras)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How can you reduce observer bias?

A

identify specific and objective behaviors/scoring categories
try to keep observer blind to full hypotheses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How can you reduce interobserver disagreement?

A

scoring system should be as clear and as specific as possible
calculate reliability and refine measurement until highly reliable
observers should be carefully trained before actual data input/collection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

You must decide whether your variable is _______ or _______ to guide your measurement

A

behavioral or psychological

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What does the overt-covert distinction mean?

A

Not all measures have noticeable behaviors; sometimes it is more general and less visible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is the sign-sample distinction?

A

whether the measure is an index (crying for a crying study) or an example of the target construct (crying is a sign that determines attachment rel.)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Give an example of a primarily psychological construct.

A

Love
Depression
Attitudes re: physical activity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Give an example of a behavioral construct or behavioral manifestation.

A

Social skills
Temperament
Fear

23
Q

What should you consider when deciding how to operationalize a measure?

A

See how other researchers are doing it

24
Q

What is an example of mono-operation bias?

A

Using only questionnaires when assessing autonomy-support

25
Q

What is an example of multi-measure approach (aka converging operations)?

A

Using questionnaires & observational measurement to assess temperament.

26
Q

True or False: the more abstract your idea is, the more measures you need

A

True

27
Q

True or False: Using multiple measures enhances your validity

A

true

28
Q

One measure of school readiness yields a wide range of scores on the assessment. This measure does not encounter what problem?

A

Restriction of range problem

29
Q

Most participants on the Bracken Scale Concept measure for School Readiness led to multiple subjects scoring on the higher end of the scale, thus skewing all the scores. What would this error be called?

A

Ceiling effect

30
Q

Mothers on the A-S observational measure scored low on their behaviors, skewing all their scores towards the end of the scale. What would this be called?

A

Floor effect

31
Q

School readiness scores clustered on the higher end of the scale. What can we do to increase the range of scores?

A

Using previously researched tasks/instruments
pilot testing to evaluate/refine measures

32
Q

Our study would like to examine school readiness for pre-schoolers vs 4th graders, thus studying multiple ages. The measure resulted in 4th grade EXCEEDING on the task, while pre-schoolers struggled and scored lower. What could be the potential problem with this?

A

Measurement equivalence; procedures & measures might not be equally valid for each group
resulting in ceiling & floor effects

33
Q

Martha attempts to answer the questionnaire “correctly,” as she wants to do well and be a high performing mom. What is this called?

A

demand characteristics

34
Q

What factors may influence demand characteristics?

A

information from other participants
setting
communication between participants & researcher

35
Q

Construct validity refers to

A

how well the variables in a study are measured or manipulated

36
Q

A measure contains multiplication problems and seeks to assess children’s multiplication skills. The measure appears to be correct. What type of validity is this?

A

face validity

37
Q

The temperament questionnaire is able to measure effortful control, and extraversion-surgency, but fails to yield consistent results for the negative affectivity factor. What type of validity is this lacking?

A

Content validity

38
Q

The SAT predicting GPA in college and how well you do in higher education is an example of what type of validity?

A

Criterion validity

39
Q

A vocabulary test correlating w/ a child’s performance in English is what type of criterion validity?

A

concurrent validity

40
Q

Scores on the CBCL, the child behavior checklist, predict externalizing disorders in later childhood. What type of criterion validity would this be?

A

Predictive validity

41
Q

What is the most important form of measurement?

A

Construct validity

42
Q

Attachment Q-Sort correlating w/ Mary Ainsworth’s Strange Situation attachment measure demonstrates what kind of validity?

A

Convergent validity

43
Q

Molitor et al., 2022 found that Structure & Autonomy-Support do not correlate w/ each other, thus suggesting that these two are two separate dimensions from each other. What kind of validity would this be?

A

Discriminant/divergent validity

44
Q

If I am interested in studying behavior, for example, crying, and would like to know the frequency of crying, what kind of validity would I be interested in?

A

Content validity

45
Q

What type of validity would be most important for autonomy support?

A

Construct validity

46
Q

IQ tests being a measure that predicts academic achievement would be what kind of validity?

A

Criterion validity

47
Q

The MBTI yields consistent results over time and can predict stable personality traits. What type of reliability is this?

A

test-retest reliability (temporal stability)

48
Q

Researchers use different forms of the Stanford Binet test and they yield high correlations & means between them. What kind of reliability is this?

A

Alternate-forms reliability

49
Q

The CBQ, a self-report form that measures temperament, yields great consistency of response across multiple items. What kind of reliability is this?

A

Internal consistency

50
Q

Dr. Molitor decides to divide the questionnaire into even and odd items for her measurement of the mother’s reaction to negative emotions. She compares the overall response of each set to each other and the results yield a high correlation. What kind of reliability is this?

A

Split-half reliability; a part of internal consistency reliability

51
Q

Dr. Ichiyama finds that his self-report measure on parental influences on alcoholism is yielding low internal consistency. What may be a potential reason for why this is happening?

A

His instrument is measuring multiple things; not just the influences

52
Q

Dr. Molitor’s study on Autonomy Support finds that perspective taking and affect sharing does not correlate with the other facets of A-S. What can she do?

A

Drop the item that doesn’t correlate
Factor-analyze the iitems

53
Q

Dr. Zwolinski is interested in testing personality for college students. She is seeking to find an assessment that looks at the Big 5. What kind of reliability would be important for her to establish?

A

Temporal stability (i.e. test-retest reliability)

54
Q

We’re interested in making sure the school readiness measure can yield a single score that represents a child who is prepared for school. What kind of reliability would be most important for this measure?

A

internal consistency

55
Q

Andrea & Kobe are interested in measuring maternal autonomy support during a teaching task with a mom and her child. They plan to study this observationally. What reliability would be important to establish for their research project?

A

Interrater reliability

56
Q

Andrea & Kobe are trying to achieve high interrater reliability, but their data analysis is computing a correlation below .60 for Affect Sharing during the lacing task. What are some ways they can improve their reliability?

A

Make scoring criteria as specific & objective as possible
Train scorers extensively
keep them blind to hypotheses
continue to monitor for reliability to catch drift

DEV CAPSTONE (4 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions