Research Methods Flashcards
reliability
refers to the consistency of a research study or measuring test; if findings from research are replicated consistently, they are reliable
external reliability
the extent to which a measure varies from one use to another
test-retest reliability
a type of external reliability; the degree to which test scores remain unchanged when measuring a stable individual characteristic on different occasions; stability of the test over time; stability of scores; testing the same individual on two or more separate occasions should yield the same results
inter-rater reliability
a type of external reliability; refers to the degree to which different raters give consistent estimates of the same behavior; can be used for interviews; two people do the interviews/observing separately and come back and compare scores/notes, if the data is similar then it is reliable; if the data is not similar it can be improved - training observers in agreed techniques, ensuring behavior categories are operationalized (objectively define)
internal reliability
extent to which a measure is consistent within itself
split-half reliability
a type of internal reliability; measures the extent to which all parts of the test contribute equally to what is being measured; done by comparing the results of one half of a test with the results from the other half of the test; two halves provides similar results, this would suggest that the test has internal reliability; quick and easy way to measure reliability; only effective with large questionnaires b/c all questions measure the same construct
validity
a test is valid if it measures what it claims to measure
internal validity
refers to whether the effects observed in a study are due to the manipulation of the independent variable and not some other factor; there is a causal relationship between the IV and DV; can be improved by controlling extraneous variables, using standardized instructions, counterbalancing, and eliminating demand characteristics
external validity
refers to the extent to which the results of a study can be generalized to other settings (ecological validity), other people (population validity) and over time (historical validity); can be improved by setting experiments in more natural settings and using random selection in samples
content validity
how well an instrument (test, questionnaire) measures a theoretical construct
face validity
a type of content validity; the degree to which an assessment, or test, subjectively appears to measure the variable, or construct, that it is supposed to measure
construct validity
a type of content validity; how well the instrument measures what it claims to measure in terms of hypothesis and theory
criterion validity
refers to how well one measure predicts the outcome for another measure
concurrent validity
a type of criterion validity; demonstrated when a test correlates well with a measure that has previously been validated the two measures in a study are taken at the same time
predictive validity
a type of criterion validity; one measure occurs earlier and is meant to predict some later measure
scientific method
a set of assumptions, attitudes, goals, and procedures for creating and answering questions about nature (which is lawful, determined and understandable)
hypothesis
part of the scientific method; a somewhat tentative statement or proposition concerning a relationship among variables (always subject to empirical test, they must be capable of disproof)
theory
part of the scientific method; a proposition or integrated set of propositions that attempts to explain the available facts concerning some phenomenon; functions of a theory: to be scientifically useful, a theory must do both of the following - explanation (theories describe, organize and summarize available facts) and prediction (a theory must also predict new facts and relationships, not presently known)
pseudoscience
consists of statements, beliefs, or practices that claim to be both scientific and factual but are incompatible with the scientific method
variable
a property or measure whereby the members of a group or set differ from one another (ex: age, gender, test scores, performances on specified tasks, etc.)
independent variable (IV)
aka factor or treatment; any variable that is either systematically manipulated or purposefully selected, in order to determine its effect on behavior
manipulation check
secondary evaluation of an experiment; used to determine the effectiveness of the manipulation; a way to help ensure that the IV has effectively been manipulated or that the participants understood the IV in the way that the researcher planned