Finals Part 2 - Evaluating Operational Definitions

Question 1

The same variables can have many definitions, how can we know which definition is best?

Answer 1

Concepts of Reliability and Validity

Question 2

Reliability means…

Answer 2

Consistency and Dependability

Question 3

If we apply variable in more than one experiment, they ought to work in similar ways each time.

Answer 3

Reliability

Question 4

If possible, we select _________________ in measuring dependent variable because it is shown to be reliable.

Answer 4

Standardized test

Question 5

Types of Reliability

Answer 5

Inter-rater reliability
Test-retest reliability
Inter-item reliability

Question 6

The degree of agreement or consistency between 2 or more scorers regarding a measure

Answer 6

Inter-rater reliability

Question 7

Also known as inter observer, inter coder, inter scorers

Answer 7

Inter-rater reliability

Question 8

Reliability of measure by comparing scores of people who have been measured twice with the same instrument.

Answer 8

Test-retest reliability

Question 9

Also known as time sampling reliability

Answer 9

Test-retest reliability

Question 10

Different parts of a questionnaire, test, or other instruments designed to assess the same variable attain consistent results.

Answer 10

Inter-item reliability

Question 11

Inter-item reliability can be assessed by:

Answer 11

Split half method
Cronbach’s Alpha

Question 12

Principle of actually studying the variables intended to be manipulated or measured

Answer 12

Validity

Question 13

The degree to which a manipulation or measurement technique is self evident

Answer 13

Face validity

Question 14

Describes a judgement of how adequately a test samples representatives of the universe of behavior that the test was designed to sample.

Answer 14

Content Validity

Question 15

Index of the degree to which a test scores predict some criterion measure

Answer 15

Predictive Validity

Question 16

Index of the degree to which a test score is related to some criterion measure obtained at the same time.

Answer 16

Concurrent Validity

Question 17

Answers the question: Does the content of our measure fairly reflect the content of the quality are measuring?

Answer 17

Content Validity

Question 18

Answers the question: Do our procedure yield information that enables us to predict future behavior or performance?

Answer 18

Predictive validity

Question 19

Evaluated by comparing scores on the measuring instrument with another known standard for the variable being studied.

Answer 19

Concurrent Validity

Question 20

Established through a series in which a researcher simultaneously define some construct and develops the instrumentation to measure it.

Answer 20

Construct Validity

Question 21

Deals with the transition from theory to research application

Answer 21

Construct Validity

Question 22

Two types of Construct Validity

Answer 22

Convergent Validity
Divergent (Discriminant) Validity

Question 23

Newly developed test will be correlated with a related construct

Answer 23

Convergent Validity

Question 24

Newly developed test will be correlated with an unrelated construct

Answer 24

Divergent or Discriminant Validity

Question 25

The degree to which we can confidently infer a causal relationship between the variables

Answer 25

Internal Validity

Question 26

Variable other than the IV and DV. Not the focus of an experiment but can produce effects on the DV if not controlled

Answer 26

Extraneous Variable