Chapter 4-Non-experimental Methods

Question 1

Naturalistic observation

Answer 1

involves seeking answers to research questions by observing behavior in the real world. Is the hallmark of qualitative research. Is also used to collect numerical data and answer more focused research questions.

Question 2

What are the two main goals of naturalistic observation

Answer 2

Two main goals: 1. To describe behavior as it occurs in the natural setting without the artificiality of the laboratory 2. To describe the variables that are present and the relations among them

Question 3

In naturalistic observation it is important that the researcher does not do what and maintains what?

Answer 3

In naturalistic observation, it is important that the researcher not interfere with or intervene in the behavior being studied. They must remain unobtrusive to avoid influencing or changing the behavior of the participants being observed

It is important that they maintain partial concealment. Or else subjects could be aware of being watched but do not know who or what is being observed (person or video (Hawthorne effect))

Question 4

Participant observation

Answer 4

the researcher is part of the group

Question 5

what two types of participant observation are there?

Answer 5

active and passive

Question 6

active participant observation

Answer 6

Active- have a specific role within the group. Interpreter bias may occur

Question 7

passive participant observation

Answer 7

Passive- no function or role within the group (Rosenhan)

Question 8

Contrived observation

Answer 8

manipulate some aspect of the environment and record behaviors

Question 9

Hawthorne effect (reactivity)

Answer 9

Reactance/reactivity refers to the biasing of the participants’ responses because they know they are being observed.

Question 10

Example of the Hawthorne effect

Answer 10

Example: At the Hawthorne plant they were trying to gauge the relationship between lighting and productivity. Well. When the lights were dimmed, production was way up compared to normal levels. But this wasn’t because of the light, this was because they knew they were being watched and so produced more because they were paranoid

Question 11

Time sampling and advantages

Answer 11

Time sampling-involves making observations at different time periods in order to obtain a more representative sampling of the behavior of interest.
Selection of time periods may be determined randomly or in a more systematic manner
This use of time sampling may apply to the same or different participants

Advantages: provides information on the frequency and sequencing of behavior, observer has time to record what they have seen.
A disadvantage is that some behaviors will be missed when outside those intervals-the observation may not be representative

Question 12

Situational sampling and advantages

Answer 12

involves observing the same type of behavior in several different situations.

Advantages: offers two advantages- 1. By sampling behavior in several different situations, you are able to determine whether the behavior in question changes as a function of the context in which you observed it. 2. Second advantage involves the fact that researchers are likely to observe different participants in the different situations

Question 13

what is interobserver reliability?

Answer 13

When two individuals observe the same behavior, it is possible, to see how well their observations agree. The extent to which the observer’s agree is called interobserver reliability.

Low interobserver reliability- means the observers disagree about the behavior(s) observed
High- indicates agreement

Question 14

why is a measure of interobserver reliability important?

Answer 14

It can be important to have more than one observer, because the single observer may have missed or overlooked a certain behavior, and there may be some disagreement concerning what was seen and how it should be rated/categorized.

Question 15

How can you increase interobserver reliability?

Answer 15

How you can increase it- such factors such as fatigue, boredom, emotional/physical state, and experience can influence interobserver reliability.
If both researchers are well-rested, interest in their task, and in good physical/emotional health, high interobserver reliability should be obtained.

Question 16

What is a correlational study

Answer 16

involves the measurement and determination of the relation between two variables (hence the term co-relation)
measurement of the relation between two continuous variables.

Used when data on two variables can be measured but not manipulated
Can be used for prediction but cannot determine cause and effect

Question 17

Positive correlation

Answer 17

as one variable increases, scores on the other variable also increase, perfect = 1, Ex: when you study more you get better grades

Question 18

Negative correlation

Answer 18

as one variable increases the other variable decreases. Ex: when you drink sun on a hot day your thirst goes down, perfect = -1

Question 19

Zero correlation

Answer 19

indicate that the two variables under consideration are not related. Even if something is not perfectly zero, but 0.03, let’s say for example, this is still considered zero by researchers

ALWAYS ALWAYS ALWAYS REMEMBER!!! CORRELATION DOES NOT EQUAL CAUSATION

Question 20

R= 1.0, 0.00, -1.0, 0.6, -0.6

Answer 20

perfectly positive, zero/unrelated, perfectly negative, positively correlated, negatively correlated

Question 21

Surveys

Answer 21

Surveys typically request our opinion on some topic or issue that is of interest to that researcher. There are two basic types of surveys: descriptive and analytic.
Surveys- gather information from a large group: economical (time, money), anonymity (private, illegal behavior), need a representative sample

Question 22

Descriptive survey

Answer 22

used when you want to determine what percentage of the population has a certain characteristic, holds a certain opinion, or engages in a particular behavior, then you will use a descriptive survey.
Examples: gallup political poll, Nielsen TV ratings
summarize characteristics

When a researcher uses this type of survey, there is no attempt to determine what relevant variables there are and how they relate to the behavior in question. The end product is a description of a particular characteristic/behavior of a sample with the hope that this finding is representative of the population from which the sample was drawn

Question 23

Analytic survey

Answer 23

seeks to determine what the relevant variables are and how they might be related
Identify relevant variables and how they are related
Examples: does perception of success or accomplished success better predict self-confidence?
What family qualities best predict moral decisions?

Question 24

What is an ex post facto study? Give an example

Answer 24

This study is used when we work with variables that we cannot control or do not manipulate. It is a latin phrase meaning ‘after the fact’. When we conduct an ex post facto study we are examining the effects of a variable ‘after the fact’- it has already varied before we arrived on the scene. A great deal of detective work would seem to fall in this category.

Question 25

Validity

Answer 25

A test or inventory has validity when it actually measures what it is supposed to measure. If your research calls for a test that measures spelling achievement, you want the instrument you select to measure that ability, not another accomplishment altogether, such as mathematical proficiency

There are three different types of validity: content, concurrent, criterion

Question 26

Content validity

Answer 26

indicates that the test items actually represent the type of material they are supposed to test. Researchers often use a panel of expert judges to assess the content validity of test items

Question 27

Concurrent validity

Answer 27

can be established only when we already have another measure of the desired trait or outcome and can compare the score on the test/inventory under consideration with this other measure
Is established when a score on a test or inventory agrees with another measure (e.g. aggression score on a test agrees with a clinician’s assessment)

Question 28

Criterion validity

Answer 28

Criterion validity-

Established when a test score compares favorably with a predicted future outcome (e.g. SAT score and college success)

Question 29

Random sampling

Answer 29

when every member of the population has an equal likelihood of being selected for inclusion in the sample
Two types of random sampling- random sampling without replacement, random sampling with replacement

Question 30

random sampling without replacement

Answer 30

when a name is not eligible to be chosen after it is selected

Question 31

random sampling with replacement

Answer 31

when the chosen name can be returned to the population and be selected again

Question 32

Stratified random sampling techniques

Answer 32

involves dividing the population into subpopulations or strata and then drawing a random sample from one or more of these strata Ex: freshmen, sophomore, juniors, seniors

Question 33

An achievement

Answer 33

Achievement- evaluate level of mastery or competence
Example: doctors have to past a series of medical board examinations before they are allowed to practice medicine. Lawyers must pass the bar exam before they can practice law

Question 34

Aptitude

Answer 34

assess an individual’s ability or skill in a particular situation or job
Example- this Purdue Pegboard test is used to determine aptitude for jobs requiring manual dexterity. It consists of two parts- 1. Tip of the finger dexterity and gross movements of hands/fingers/arms

Question 35

Open-ended survey question. 3 advantages and 3 disadvantages

Answer 35

open-ended questions are questions that allow someone to give a free form answer describes the steps you took to prepare for your last exam
Advantages: 
Don’t shape/limit responses
Questions are easy to write
Exploratory, no expected outcome
Disadvantages:
Time consuming for subject
Get irrelevant responses
Difficult to score/analyze

Question 36

Closed-format/ended survey. 3 advantages and 3 disadvantages

Answer 36

questions that can be answered with yes or no, or they have a limited set of possible answers (such as: A, B, C, or all of the above)
Advantages:
Easy to complete, easy to score, get only relevant responses
Disadvantages:
Good questions are hard to write
It shapes/limits the responses
Available answers are based on researcher expectations