Chapter 4 Flashcards - Quantitative Study Designs

1
Q

What is the foundation for the design of the quantitative study?

A

Purpose statement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the study design supposed to show?

A

Methods of measurement, assessment and the statistical analysis

Quantitative designs can be used to address descriptive, predictive, and explanatory research problems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What type of study is the gold standard that helps understand cause and effect relationships?

A

Clinical Trials/Intervention Studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is validity in research?

A

How confident are we about the conclusion made as a result of the study we conducted

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is logical validity?

A

Refers to the quality of the researcher’s arguments, theory supporting needs of the study and appropriate interpretation of results based on the data.

I.e. If a study was conducted might be asked if you provided convincing justification for all the actions and outputs of your study

Essentially, if the researcher has recorded everything correctly, then the results should be right

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is construct validity?

A

Whether the measures used by researchers, test what they intended to measure (the idea/concept)

I.e. Measuring a child’s height on a growth chart mounted would likely give you the height of the child - the measures used accurately to get a proper test result

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the five questions asked to determine what type of experimental design a study may be conducted as?

A
  1. Are the people in the study assigned to groups?
  2. How many measurements are being used?
  3. What types of measures or observations are being used?
  4. Is there an interest in generalizing the findings to other populations or settings?
  5. Can you conclude that the findings are based on the manipulation of the independent variable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

If the answer is “No” to the question “Are people in your study assigned to groups?” then what type of experimental design could that be and why?

A

A non-experimental or Pre-experimental study design and this is because there is no other group to compare or there are two groups but they are not randomly assigned

Non-experimental means there is no manipulation of any variables or interventions that are in mind. Hence it’s not really experimental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the problem with pre-experimental study designs?

A

No pre-test, no control group meaning no comparison group either and finally no randomization to groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Saying Yes to the “Are people in your study assigned to groups?” and Yes to “Are people randomly assigned to groups?” what type of experimental design is it?

A

True experiment; study with two or more groups, individuals are assigned randomly to groups (control and experimental)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What would indicate a quasi-experimental design?

A

Having two or more groups but no random assignment to control and experimental

Essentially it’s studies that evaluate an intervention but do not use randomization groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is internal validity?

A

The researcher’s ability to claim that any change in the outcome is the result of a treatment or intervention and not the results of factors related to the measures, techniques or any threats

Basically a cause (study design) and effect (outcome) relationship was established in the research and no other factors actually affected it like selection bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is external validity?

A

Examining whether the study findings can actually be applied to other studies (generalized) but it would be difficult with internal validity being in a tightly controlled environment so it can’t be reproduced elsewhere

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

A true experiment has two things which are?

A

Experimental group (treatment or intervention group) & control group (not exposed to manipulation)

Textbook states: Any study that is designed with random assignment of participants, a control group, and manipulation of the independdnt variable is considered a true experiment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are extraneous variables?

A

Variables that are not the independent but can still change the outcome of the dependent

They are commonly considered control variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a randomized control trial and what are the two main RCT designs?

A

A randomized control trial is another name for a “true experiment” and it consists of:

  1. Pre-and post test-design
  2. Post-test only design
17
Q

What is a pre-and post-test design?

A

Examines change in the dependent variable that can be attributed to the independent variable. In this way we see which group changes more as a result of the manipulation

Example: Examining mood changes following a yoga activity, and participants complete a mood survey before and after the intervention

18
Q

What is a post-test only design?

A

You have the independent variable that will be manipulated, and people randomly assigned to groups, but you would go ahead with the experiment and compare the difference between the two groups at the end.

  • If there is a difference between the two groups then the post-test design worked

Essentially, it is a design that does not use a pre-test; no measures of anything before the intervention, only after.

19
Q

What is an Independent group design (between-group design)?

A

Where a participant is only assigned to one condition for example if there was a usual diet vs chocolate experiment a participant will only get assigned to the usual diet while another participant gets assigned to the chocolate diet

Advantages: No overlap btwn. conditions
Disadvantages: Larger N required & Not even groups

Note: Must always randomize these groups as if it wasn’t it would no longer fall under a “true experiment” design

20
Q

What is the repeated measures design? (Within group design)

A

Participants are assigned to more than one group or they’re all assigned to a specific group just in a random order (i.e. in the chocolate diet and usual diet group) but it is done at different times so one variable first then the other

Advantages: Smaller N & More sensitive to the effect of the experiment (Dependent variable)
Disadvantages: Carry over effects from one variable to the other

Can easily get rid of extraneous variables by measuring same people at different time points

  • Multiple levels of the independent variable and only an experimental group
  • NO CONTROL GROUP ONLY EXPERIMENTAL
21
Q

Well-designed experiments can be?

A
  • One IV with two levels (Measure something at baseline and then measure it 30 minutes after)
  • One DV
  • A control group and treatment group (if intervention study/clinical trials)
22
Q

What type of design is shown here?

R = random assignment, O = observation or measurement, X = treatment

A
  • The top is a pre-test post-test design in which you have the participants at a baseline, look at them before the intervention, make them go through the intervention and observe the result of the intervention on them after
  • Bottom is a post test only where you have no pre-test; only measure the affect of the experiment on one group and then compare the two groups at the end
23
Q

Explain how this is a repeated measures design

A

You assign a person to one of the three variables (Everyone get’s assigned to a independent variable) & you manipulate their diet every week to see what the dependent variable turns out as

I.e. Participant 1 gets assigned to every independent variable that participant 2 and 3 are assigned to but they start off in a different order for the variable, same with the others

24
Q

Why is a quasi study somewhat of a true experiment?

A

Although there are control groups and experimental groups, there is no random assignment + it is low on internal validity (cannot back up whether the results are because of the independent variable)

Generally thought of as weaker designs (compared to pre-post and hybrid) but still have value and uses PRE-POST TEST

25
Q

Basic formula for quasi-experimental designs

A
  1. People are studied in real-world settings
  2. An independent variable is introduced
  3. There is a dependent variable (the effect) that is measured
26
Q

Explain what is happening in each quasi-experimental study?

A
  • Non-equivalent is just observing a pre-test of two groups, one is the control and the other is the experimental and you administer the treatment and look at the observed results after
  • Interrupted time is observing the participants, then interrupting the time and putting the treatment in place and seeing the results of that. May need to register drug multiple times to get a couple of results
  • Equivalent time sample design is where you see a pattern, where you administer drug and observe, then you administer a placebo and observe
27
Q

One group post-test Pre-experimental design is?

A

Mainly a random pool of participants assigned to an independent variable and seeing what the effect (dependent variable) measures

  • Limitations: Lack of comparison group
28
Q

Pre-test post-test Pre-experimental deign with one group is?

A

You have a pre-test, you put a treatment/intervention in place and have a post test observation but no control group

29
Q

What is a static group comparison?

A

A.K.A Post-test only with non-equivalent groups

30
Q

What is a problem with Pre-experimental designs?

A

Since they’re not true experiments and lack control groups, randomization, etc, they are lacking in internal and external validity

31
Q

What are Pilot and Feasibility Studies

A

Studies that can be conducted to improve the chances of conducting a high-quality RCT - preliminary steps

Feasibility Studies: Assess whether a planned main study can be done, and the practicality of the study elements
Pilot Studies: Small scall feasibility studies, that is a prelimenary test of whether the critical elements of the main study will be feasible.

Pilot studies are small scale studies that you hope to blow up into a larger main study (see if the study can be done with the current elements)

32
Q

Explain how this is an example of Pilot and Feasible Studies turning into a high-quality RCT

A

Did a double blind experiment where they studied male physicians whether or not taking asprin every other day would lead to less Heart Attacks and they say the aspirin group has less heart attacks but they had to account for diet, exercise, etc.

  • Only able to do this because they had to make sure they could recruit people and whether or not they would adhere to the follow up questions (Done in the feasibility and pilot studies to allow for it to become a bigger RCT test)
33
Q

What are non-experimental research designs characterized by?

A

Non-experimental designs are the bulk of the study they are the descriptive designs

Characterized by:
* No randomization to groups
* No groups to randomize to
* No manipulation of the independent variable (i.e. Just putting an accelerometer on someone and tracking their exercise but no control groups or manipulating other variables)

34
Q

Example of Non-Experimental Designs?

A

Since this is not manipulating an independent variable an example could be asking preganant women if they smoke and if they don’t & putting them in two groups and just observe them and see the birth weight of their child

No manipulation; just comparing risk ratio to child birthweight

35
Q

Cross-sectional and longitudinal are descriptive studies in nature and they fall under Non-experimental research design. Explain what they are

A

Cross-sectional is where the participants assessed at one point in time while the longitudinal is observing patients over a long period of time. Nonetheless there is no manipulation of variables it’s mainly observation based

36
Q

What are measuring “assessing” techniques?

A
  1. Physical Measures - going and simply measuring things like height, weight, etc.
  2. Cognitive Measures - Testing people on their cognitive state (paper and pencil test)/ measuring cognitive abilities
  3. Affective Measures - measures that focus on capturing a person’s experience/emotions, etc.