Measurements of Behavior Flashcards

1
Q

Operationalism

A

belief that scientific concepts must be defined in terms of observable operations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Operational Definition

A

a precise description of a procedure used to empirically test a theoretical concept

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Scientific Method

A
  • make observations
  • develop hypothesis
  • test hypothesis
  • gather data
  • evaluate data
  • evaluate results
  • replicate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Variables

A

aspect of a testing condition that changes with different conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Types of Variables

A
  • independent variables (IV)
  • dependent variable (DV)
  • confound variable (anything happening at the same time as the IV; undesired)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Writing Criteria for Operational Target Behavior Definitions

A
  • accurate
  • complete
  • concise
  • inclusions
  • exclusions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Characteristics of Good Definitions

A
  • objective : refers only to the observable
  • clear : readable and unambiguous
  • complete : delineate boundaries of definition
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Purpose of Good Definitions

A
  • precise and concise description
  • reliable observation
  • accurate recording
  • agreement and replication
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Testing a Definition

A
  1. can you count the number of occurrences? (should be yes)
  2. will a stranger know what to look for based on definition alone? (should be yes)
  3. can you break the target behavior down to smaller, more specific components? (should be no)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Behavioral Measurement

A
  • frequency / rate
  • duration
  • latency
  • locus
  • topography
  • force
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Taking data

A
  • event recording
  • timing
  • time sampling
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Event Recording

A

procedures for detecting and recording the number of times a behavior is observed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Time Sampling

A

variety of methods for observing and recording behavior during intervals or at specific moments in time

observation is divided into intervals, presence or absence of behavior recorded for each interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Partial Interval Recording

A

record whether the behavior happened at any time during the interval.

tends to underestimate high-frequency behavior and overestimate duration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Whole Interval Recording

A

at the end of each interval it is recorded if the behavior happened during the whole interval.

the longer the interval the more whole interval will underestimate the occurrence of the behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Momentary Time Sampling

A

recorder notes whether the behavior happens at the moment each interval ends.

not recommended for low frequency, short duration behaviors

17
Q

PLACHECK (Planned activity check)

A

momentary time sampling for group engagement

18
Q

Measuring Behavior by Permanent Product

A

measuring behavior after it has occurred by measuring its effects on the environment

all previous procedures can be applied to permanent product measurement

products can be a natural or contrived

19
Q

Advantages of Permanent Product Recording

A
  • practitioner free to do other tasks
  • measurement of complex behavior
  • easier data collection
  • possible measurement of inaccessible behavior
  • more accurate, complete, continuous
20
Q

Inter-Observer Agreement (IOA)

A
  • used in direct observation/recording of behavior
  • determines whether the target behavior is being recorded consistently
  • agreement does NOT equal accuracy
  • aka: inter-observer reliability or inter-rater reliability*
21
Q

Inter-Observer Agreement

A

IOA Procedure -

two people independently observe and record the same target behavior (DV) of the same individual during the same observation period

recordings of the two observers are compared

% of agreement between observers is calculated

22
Q

Types of IOA Data Collection

A
  1. continuous measurement - frequency + duration
  2. discontinuous measurement - interval recording
23
Q

IOA Calculations

A

frequency recording - divide smaller frequency by the larger (ex. 9/10 = 90% agreement)

duration recording- divide smaller duration by the larger (ex. 48/50 = 96% agreement)

interval recording- session is broken up into short intervals (ex. agreement/(agreement + disagreement) = 4/(4+1) = .80 = 80%)

24
Q

IOA Target %

A

80% = minimal acceptable level
90% or higher is preferred

25
Q

Indicators of Trustworthy Measurement

A
  1. validity
  2. accuracy
  3. reliability
26
Q

Validity

A
  • directly measures a socially significant behavior
  • measures a dimension of the behavior relevant to the question
  • ensures the data are representative
27
Q

Accuracy

A

observed values match the true values of an event

28
Q

Reliability

A

measurements yields the same values across repeated measurement of the same event

29
Q

Threats to Validity

A

indirect measurement

  • measuring a behavior other than the behavior of interest
  • requires inferences be made about the relationship between those behaviors
  • must provide evidence that the behavior measured is directly related to behavior of interest
30
Q

Measurement Artifacts

A

misleading data that result from the way behavior is measured:

  • discontinuous measurement
  • poorly scheduled observations
  • insensitive or limiting measurement scales
31
Q

Threats to Measurement Accuracy and Reliability

A
  • human error
  • poorly designed measurement system
    1. cumbersome
    2. difficult to use
    3. complex
  • inadequate observer training
    1. explicit and systematic
    2. careful selection
    3. train to competency standard
    4. on-going training to minimize observer drift
  • unintended influences on observers
    1. observer expectations of what the data should look like
    2. observer reactivity when she/he is aware that others are evaluating the data
    3. measurement bias
    4. feedback to observers about how their data relates to the goals of intervention
31
Q

Assessing the Accuracy of Measurement

A
  1. determines if data are good enough to make decisions
  2. discovery and correction of measurement errors
  3. reveal consistent patterns of measurement error
  4. assure consumer that data are accurate
32
Q

Assessing the Quality of Measurement

A

indicators of the quality of data include:
- IOA
- accuracy
- reliability

can report multiple indices to assess data quality