Chapter 2: Research Tools Flashcards

1
Q

What do Research Resources consist of?

A

1) Library & Resources
2) Techniques of measurement
3) Statistics, computers & languages.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What can Measurement do? (4)

A
  • Provide limits to data
  • Measure both substantial and insubstantial data
  • Examine relationships mathematically
  • Set acceptable qualitative / quantitative standards
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Measurement can generally be considered as a ___________.

A

Comparison

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Define Measurement:

A

It is a thing or concept measured against a point of limitation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the 6 types of Validity in Measurement?

A

1) Face or Subjective Judgement
2) Criterion
3) Content
4) Construct
5) Internal
6) External

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Define Face Validity or Subjective Judgement:

A

The degree to which a procedure appears effective in terms of its stated aims (IQ)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Define Criterion Validity:

A

Two measures of validity where the second checks the accuracy of the first and become a sort of standard. (SAT, MCAT)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

When is Content Validity used?

A

Where data is unsubstantial.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Provide an example of Content Validity:

A

Does the exam ask questions about material that was taught.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Define Construct Validity:

A

How well a test measures the concept it was designed to study, any concept that cannot be measured / observed easily
- Honesty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Define Internal Validity:

A

Making certain that a change in the dependent variable is the result of independent variable, and not how you measured it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Define External Validity:

A

A process where conclusions are drawn from your sample may be generalized / extrapolated.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Provide an example of an External Validity:

A

Can the methodology and results be repeated, transferable, and replicable by others.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the bottom line in relating Measurement and Validity?

A

Is the measurement we are making actually measuring what we think we are measuring?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

We use _______ to measure outcomes and draw inferences about the study subjects based on the ________ of our measurements.

A

Tools, interpretations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

It is important to measure the _____________ things.

A

Obvious (Ex. Horizontal v. Vertical lines)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What can measurements be considered as?

A

A comparison

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the types of measurements?

A
  1. Nominal Level
  2. Ordinal Level
  3. Interval Level
  4. Ratio Level
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Define the Nominal Level of measurement:

A

One object is different from another

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Define the Ordinal Level of Measurement:

A

One object is bigger / better than the other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is an example of a Nominal Level of Measurement?

A
  • Assign a name to items or groups
  • Divide data into discrete categories (%)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is an example of an Ordinal Level of Measurement?

A
  • Example: Elementary, high school, college, etc.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Define Interval Level Measurement:

A

Equal units of measurement and a zero point established. arbitrarily assigned values.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is an example of an Interval Level Measurement?

A
  • Degrees
  • cm, m, etc.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Define Ratio Level Measurement:

A

One object is so many times taller/heavier/brighter.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Is Ratio Data and Interval Data quantitative or qualitative?

A

Quantitative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Is Ordinal Data and Nominal Data quantitative or qualitative?

A

Qualitative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are some ways we would know to use a Nominal Measurement?

A

If one object is different from another.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

How would we know to use Ordinal Measurement?

A

If one object is bigger or better or more of anything than the other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

How would we know to use an Interval level Measurement?

A

If one object has so many units (cm, m, etc.) more than another

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

How would we know to use a Ratio Level Measurement?

A

If one object is so many times as big or bright or as tall as another.

32
Q

What do we depend on from the measurement instrument to collect data we need?

A

Soundness and effectiveness

33
Q

What are the 6 types of validity in measurement?

A
  1. Face Validity or Judgement
  2. Criterion Validity
  3. Content Validity
  4. Construct Validity
  5. Internal Validity
  6. External Validity
34
Q

What is Face Validity or judgement?

A

Does our measurement tool record what it is supposed to and is our sample representative (can be a subjective judgement call)

35
Q

What is Criterion Validity?

A

Two measurements, with the first being confirmed by the second, or one predict the other.

36
Q

What is an example of Criterion Validity?

A

SAT vs GPA vs. MCAT

37
Q

What is Content Validity?

A

Whether the measurement is valid in getting the information needed.

38
Q

Provide an example of Content Validity:

A

Final exam of a course to assess learning - should cover all topics that was taught in the class and not include anything that was not covered.

39
Q

What is Construct Validity?

A

For concepts that cannot be measured or observed easily (honesty, intelligence) but can be measured by observing other indicators that are associated with it.
- Valuable in social sciences, where there is a lot of subjectivity to concepts.

40
Q

What is Internal Validity?

A

Change in dependent variable is truly a result of change in the independent variable.

41
Q

What is External Validity?

A

The extent to which you can generalize the findings of a study to other situations, people, settings and measures.
- In other words, can you apply the findings of your study to a broader context?

42
Q

What does it mean to have a reliable research tool?

A

How accurate is the research tool you’re using to measure your variable of interest.

43
Q

____________ is simply a tool of research for looking at data from different angles.

A

Statistics

44
Q

What tool can we use to help us lessen the degree of uncertainty in our understanding of relationships and causes we investigate.

A

Statistics

45
Q

What needs to be clearly stated when developing the research proposal and executing research activities?

A

Goals and objectives

46
Q

What type of thinking is required when resolving a problem & deriving new meaning about the problem by interpreting the results of your research efforts?

A

Analytical Thinking

47
Q

What are six key things to do when formulating a research problem?

A
  1. Use the least amount of words
  2. Use the exact word
  3. Use short words instead of long words as much as possible
  4. Ensure a logical, step-wise connection between ideas
  5. Discard superfluous words
  6. Be prepared to modify
48
Q

Define a Subproblem:

A

Small questions and challenges leading to your main question.

49
Q

How can we minimize subproblems?

A

Define terms of the research focus and state assumptions around the topic in question.

50
Q

What can we use to target a question?

A

Hypothesis

51
Q

Define a Null Hypothesis:

A

Any apparent relationship you
find is due to chance (it is not real).

52
Q

When do we use a Null Hypothesis?

A

We use the null hypothesis because statistical analysis tests the validity of the null hypothesis

53
Q

Define an Alternate Hypothesis:

A

There is a predictive pattern or relationship between variables that is not due to chance

54
Q

When do we accept a null hypothesis?

A

We accept the null hypothesis unless definite evidence of a pattern/relationship exists and we significantly minimize our speculation on what the relationship or outcome we found means.

55
Q

What are Multiple Hypotheses?

A

When you have competing hypotheses in your study and you can have combinations that are true and false.

56
Q

True or False: You may need more than one hypothesis to confirm your findings.

A

True.

57
Q

______________: We call these sub-hypothesis.

A

When you need more than one hypothesis to confirm your findings.

58
Q

When is a sub-hypothesis addressed in your study?

A

In the Problem Statement and the Introduction.

59
Q

How do we test a hypothesis?

A
  1. Directly measure the variables of interest
  2. Assess if the struggle surrogate variable(s) are strong indicators of a key variable that you cannot measure
60
Q

Define a Surrogate Variable:

A

Indirect or related variables when we cannot directly measure key variable.

61
Q

What kind of results can we get?

A
  • Positive
  • Negative
  • None at all
62
Q

IF your study is well designed, scientifically valid and well implemented the outcome will be useful as long as your hypothesis is __________.

A

Defensible.

63
Q

What are 6 benefits to running Pilot / Preliminary study?

A
  1. Validate question
  2. Practice study techniques
  3. Standardize approach to data collection.
  4. Add data to study
  5. Estimating study size
  6. Statistical analysis & change to practice some analysis on a small set of data.
64
Q

What are the two types of Data Collection Approaches?

A
  • Observational
  • Manipulative
65
Q

Define a Correlation Study:

A

A type of research design that looks at the relationships between two or more variables

66
Q

Define an Observational / Correlation Approaches:

A

Simply observing the focus variable (E.g., Tail feathers of long tailed birds)

67
Q

What kind of variation does Observational Studies use?

A

Natural Variation

68
Q

Define Manipulative Approaches:

A

Using artificial variation to examine data.

69
Q

True or False: Using both Observational and Manipulative Data Collection in a study is better than simply using one approach.

A

True

70
Q

Why is it important to be aware of Reverse Causation?

A

Because the association between two variables can be the reverse than you expect.

71
Q

If we cannot directly measure key variables then our indirect or related variables are called ____________.

A

surrogate variables

72
Q

Define Content Validity:

A

It evaluates how well an instrument (like a test) covers all relevant parts of the construct it aims to measure

73
Q

What does Validity determine?

A

That the results are reflective of the thing you are interested in.

74
Q

Provide an example of Reverse Causation:

A

Instead of X causing Y, as is the case for traditional causation, Y causes X

75
Q

What does the Problem Statement Identify?

A

It is the broad overarching issue, it does not specify any variables generally speaking.