Week 3 - Research Methods Flashcards
What is evidence-based research VS eminence based?
Evidence:
- basing clinical services and health care policy, whenever feasible, on REPLICATED evidence gathered from scientific studies
Eminence:
- recommendations are ACCEPTED because the person delivering them is seen as an EXPERT
What are 6 common errors in thinking?
1) faulty reasoning (argument MISLEADING/INACCURATE)
2) false dilemma (reduce range of options TWO EXTREMES)
3) golden mean fallacy (MOST VAILID = stands true for both)
4) the straw person argument (mischaracterization)
5) affirming the consequent (causation does NOT equal correlation)
6) appeal to ignorance (NO evidence = must be true)
What are the 3 steps in scientific approach to problems?
1) formulate hypothesis
2) test hypothesis
3) acting on best evidence
What is internal validity?
Extent of which the study RULES out or makes implausible explanations of the results
If results ATTRIBUTED TO INDEP VARIABLE = INTERNALLY VALID
What is external validity?
Extent to which results of a study can be GENERALIZED beyond the conditions of the experiment to OTHER circumstances
What are some threats to internal validity?
History
Maturation
Testing
Instrumentation
Statistical regression
Selection biases
Attrition
What are some threats to external validity?
Sample characteristics
Stimulus characteristics and settings
Reactivity of experimental arrangements
Reactivity of the assessment
Timing of Measurement
What are some types of research designs?
1) case studies (detailed presentation, new treatment innovation)
2) single case designs (A-B single case design)
3) correlational designs
4) quasi-experimental (contains some form of manipulation)
5) experimental (random assignment & experimental manipulation, randomized controlled trials)
What’s included in correlational designs?
****XCOME BACK
1) descriptive
2) factor analysis
3)
What is the process of selecting participants?
1) selecting the SAMPLE
2) selecting the SAMPLE STRATEGY
3) selecting the SAMPLE SIZE
What are some types of measurements?
Self-report (e.g.,questionnaires)
Informant-report measures (e.g.,parentorteacherreports)
Rater evaluations (objective assessor rating a behaviour)
Performance measures (e.g., visuospatial tasks, response time tasks)
Projective measures (e.g.,storytelling,inkblots)
Observation of behaviour (e.g., coding or rating of direct observation)
Psychophysiological/Biological measures
What is internal consistency?
Degree of consistency/homogeneity of the times within a scale
What is test-retest reliability?
Stability of test scores over time
What is inter-rater reliability?
Extent to which different assessors or raters agree on the score they provide when assessing
What does clinical significance mean?
The results of a study are at a magnitude that there are CHANGES in some aspects of the participants’ daily functioning
What are some threats to statistical conclusion validity?
Low statistical power
Multiple comparisons and error rates
Variability in the procedures
Participant heterogeneity
Unreliability of the measure
What is a systematic review?
The use of a systematic and explicit set of methods to identify, select, and critically appraise research studies
Steps:
• The focus of the review has to be stated as a set of clear, unambiguous questions that will guide the literature search
• Conduct an extensive electronic search
• Inclusion criteria are set
• Summary of results
• Interpretation of results, noting limit
What is a meta-analysis?
A set of statistical procedures for QUANTITIVELY summarizing the results of a research domain
• Uses effect sizes to COMBINE data from multiple studies
What are some purposes of a classification system?
CONCISE description
Common LANGUAGE used by professionals
For searching for TREATMENT
What are 3 approaches to classification?
1) categorical approach (object is determined to be part of a CATEGORY or NOT)
2) dimensional approach (object differs in which it possesses certain CHARACTERISTICS/PROPERTIES)
3) prototype model (members of a category may differ in the DEGREE to which they represent underlying concepts)