Psych 1111 Flashcards
what is critical thinking
evaluating sources of information and making judgements based on evidence
what are the 4 common sources that people refer to for information?
common sense, superstition and intuition, authority, tenacity
Common sense →
believing that information is correct because it is collectively agreed upon
Superstition and intuition
Gaining knowledge based on subjective feelings → issues with this include lack of knowledge of the source of information (cant evaluate), interpreting random events as causally related, patterns (people like them), caused by priming of attention, observations tend to occur together
Authority
Gain knowledge through authority figures → do they really know what they are talking about?
Tenacity
Gaining knowledge by hearing information so often you accept that it is true
Critical thinker =
scientific thinker
To be a critical thinker you must analyse evidence:
LOSAAR
- Rational
- Analytical
- Logical
- Skeptical
- Open minded
- Able to update your opinion based on the evidence
Assumptions of science
(TVD PEF)
parsimony, empirical, verifications, testability, falsification, determinism
Parsimony
the simplest explanation
Empirical
claims supported by evidence → systematic * The more unusual the claim, the stronger the evidence needs to be.
Verificationism
You must be able to provide evidence that supports your claim.
Testability
must prove claim
Falsification
It must be possible for you to find evidence that refutes your scientific claim. Your scientific claim should allow for the possibility that you are incorrect. Good scientific theories must be able to be falsified
Determinism
is an important assumption of the scientific method. In science determinism refers to the idea that every event in nature has a causes, or causes that account for the occurrence.
Understand the difference between independent and dependent variables
Independent variable is the manipulated variable → is randomly assigned to control for systematic differences → normally has two levels (such as drug and placebo)
Quasi independent variable → variables that the experimenter cannot be randomly allocated → Commonly used as grouping variables
Natural Variables
Country of birth
Biological Sex
Age
CAB
Attribute/person variables
Individual difference variables that fall on a spectrum
Level of risk taking
Anxiety
AIL
Dependent variables
* The dependent variable is the variable used to assess or measure the effects of the independent variable
* Dependent on the independent variable
* Measures a behaviour or response for each treatment condition of the experiment
* The dependent variable is NOT manipulated it is only ever measured
Define and understand the importance of operationalisation
Operationalise = to quantify (measure)
Operationalising variables allows you to specify exactly what you mean in your hypothesis/theory
Operational definition
* Detailed description of the procedures or operations used to measure or manipulate the variables.
* Providing clear instructions about
o Definition of variable
o How it is measured/quantified
* This is important it ensures that the hypothesis is clear.
Identify and apply the steps of the scientific method
Initial/past observations → hypothesis → test → analyse/conclude → update or discard (can go back to the hypothesis step and start again) → theory
Observation
Scientific studies begin with an initial observation.
* A point of interest for further investigation.
* You must be able to find a way to collect observable evidence.
‘Gap in research’
Past observations are important for the scientific method.
* Try to answer questions raised by existing theories.
* Replication is critical. → indicates confidence of results
Hypotheses
* A hypothesis is a very specific statement about the predicted/expected relationship between variables (both variables)
* It is usually phrased in the form: “If ___[I do this]___, then ___[this]___ will happen.”
* A hypothesis usually predicts the effect of a manipulated variable on a measured variable.
* States that a relationship should exist between variables, the expected direction of the relationship between the variables and how this might be measured
Test
The scientific method requires that you can test the hypothesis.
Design an experiment
Use good experimental design
Collect appropriate data
Control as many aspects as possible
Research Methods
Is the experiment reliable?
Are your measures valid?
Analyse and conclude
Consider whether the data supports your hypothesis
Is there sufficient evidence?
Are the results statistically significant?
Are further studies required?
Conclude
Conclusions are the researcher’s interpretation of the evidence
Based on the results of the experiment
Explain the results of the experiment
Update or Discard
The scientific method is dynamic
* Must be able to update your hypothesis when there is a lack of data to support it
* Must be able to discard your hypothesis when the evidence refutes it.
This requires many aspects of critical thinking
* Open to the possibility you are incorrect
* Evaluation of the evidence
* Ability to change your opinion with new evidence
Theories are NOT hypothesis → theory is based on years of work
Theory
* A theory is an organised system of assumptions and principles that attempts to explain certain phenomena and how they are related.
* Many hypothesis are tested and data collected before a theory is formed
* Provide a framework regarding the facts
* Theories can also lead to further questions and hypotheses
Identify and explain the goals of science
The goals of Science
Description → observing phenomena in a systematic manner, needed for prediction
Prediction → make predictions from one variable to another
Explanation → provide a causal explanation regarding a range of variables
Description
* You might want to observe a simple behaviour
* Are people taking “pills” at this festival?
* Might want to investigate something more complex
* Is there a relationship between the type of pill and rates of overdose?
* Need to describe types of pills being consumed
* Need to describe and measure contents
* Need to observe and describe the number of overdoses
Prediction
* Identify the factors that indicate when an event will occur
* Scientific prediction: We are able to use the measurement of one variable to predict the measurement of another variable
* The relationship between variables
* Does X occur with Y?
* Does X change in relationship to Y?
* We are looking at the correlation between two variables
Explanation
* The final goal of science is explanation
* This is the ultimate goal of science
* Is there a causal relationship between X and Y?
* Does X cause Y
* We need to test the causal relationship
* This requires research methods and experimental design
* This requires statistics to evaluate the data
Understand the difference between Pseudoscience and actual science
Science vs. Pseudoscience
* The main difference is that science usually modifies or abandons failed hypotheses/theories when flaws or new evidence have been identified
Unfalsifiable hypotheses/theories
Vague/Unclear/poorly defined concepts
Un-parsimonious hypotheses/theories
Using testimonials
* Need systematic observations
Biased sampling/groups allocation
Placebo Effects/Experimenter bias
* Double-blind control studies
Measurement and Error
- All measurements can be broken into at least two components
- The true value of what is being measured and measurement error
Measured Score = True Score + Error
X = T + e - However, we want: Measured Score = True Score
how do we reduce error?
- Error is reduced with:
Many participants – Individual differences error
Many measurements – Measurement error
Many occasion → able to replicate findings in different contexts - Averages of scores are more reliable than individual scores
Identify and define the types of reliability
Inter-observer reliability
* Degree to which observers agree upon an observation or judgement.
Can be frequency or categorical judgement.
Rating attractiveness.
Scoring rat behaviours.
Coding explanations/descriptions.
* Measure inter-Observer reliability with correlations
Inter-observer reliability
Measure inter-Observer reliability with correlations
* Positive relationship between the scores of each observer
To have high inter-observer reliability we want both observers to agree- Very important for scientific research
* The higher the correlation between observer judgements the more reliable the results are.
Internal/Split-half
Internal Reliability
The degree to which all of the specific items or observations in a multiple item measure behave the same way
* Measuring Intelligence: All the items should equally measure intelligence
High internal reliability shows the entire measure is consistently measuring what it should be
We want more items to measure to reduce error
* Very important that these items all consistently measure the construct we are interested in
Internal Reliability
How can we examine whether multiple items on a test equally measure the same thing?
Divide the test into two halves
Look at the correlation between individuals’ scores on the two halves
Split-Half reliability
- All items of an IQ test should measure intelligence
Need to compare like with like
* Don’t just split in half down the middle (group them and then split down the middle) (we want high correlations)
Look at the correlation between individuals’ scores on the two halves
* High correlation between scores indicates good internal reliability
Internal Reliability
The degree to which all of the specific items or observations in a multiple item measure behave the same way
High internal reliability shows the entire measure is consistently measuring what it should be
We want more items to measure to reduce error
* Very important that these items all consistently measure the construct we are interested in
Test-retest
Test-Retest Reliability
If we were looking at scores on a visual search task, we need the measurement to remain constant over time
Practice effects undermine test-retest reliability
Should counterbalance the order of presentation
Randomly assign people to differ orders
Test-Retest Reliability in practice
Brain Training example
Practice Effects
There is an improvement on scores in the game which indicates poor test-retest reliability
Practice effects – you get better because you do the same task several times
* If I asked you to play Pac-Man every day for 15 minutes and you improved your score, no one would be surprised!
Not a reliable measurement for cognitive improvement
Practice Effects
We have very reliable test-retest measures in these experiments testing the efficacy of brain training
* Shows the tests are reliable measures over time
* Scores on the external measure don’t change after training
* This has been found multiple times
So, these games don’t improve your brain function at all
Replication
The reliability of results across experiments
* Can we replicate the results when all variables and conditions remain the same
* Need clear and detailed method sections
Critical to the scientific method
* Must have evidence from multiple experiments
* More times a result is replicated the more likely it is the findings are accurate and not due to error
Replication Crisis
A lot of published psychological papers couldn’t be replicated
Understand the difference between reliability and replication
It means that if the same study is repeated under the same conditions, it should produce similar outcomes. Replicability, on the other hand, refers to the ability of other researchers to reproduce the results of a study using the same or equivalent methods and data.
Replication
The reliability of results across experiments
* Can we replicate the results when all variables and conditions remain the same
* Need clear and detailed method sections
Critical to the scientific method
* Must have evidence from multiple experiments
* More times a result is replicated the more likely it is the findings are accurate and not due to error