Best Practices Flashcards
What is replicability?
It’s whether a study’s result holds up on another study. Is a study able to produce similar results as the previous study?
What was the replicability crisis in psychology?
A widespread issue where key findings failed to replicate or replicated in a smaller effect size or were context-dependent results
What was did the replicability crisis call for?
More rigorous scientific methods:
Transparency
Larger and more diverse sample sizes
Preregistration
What is an example of a topic that failed to be replicated?
Narcissism and career success, it was said that narcissism led to career advancement but, that was only true on the short-tem as on the long run there was consequences
What factors led to the replication crisis?
Overuse and misuse of p-valued, which caused the file drawer problem and QRPs.
What is the p value?
It signifies statistical significance, how likely are the results if it’s just a coincidence, are we to find these results again if they were not true?
What does the p value depends on?
Size of effect
Sample size
Amount of error in the data
What is the publication bias and the file drawer problem?
The publication bias was only publishing statistically significant results (p<.05).
The file drawer problem was a consequence of this, where the studies that failed to reach statistical significance were unpublished
What is the consequence of the file drawer problem?
It becomes hard to know whether the effects as strong or consistent as they appear in the literature.
What are QRPs?
Not correcting for multiple comparisons
HARKing
p-hacking
What is HARKing?
Hypothesizing After Results are Known, creating hypotheses after analyzing the data and presenting them as if they were done before.
What is p-hacking?
Manipulating data collection, analysis or statistical testing to achieve statistically significant results. Might be redefining variables, selective reporting or running unplanned analyses.
What is “false positive” psychology?
Entertaining enough possibilities that achieving a significant results is basically a given, although not reliable.
What was recommended by the open science movement?
Less emphasis on the p, more on effect sizes
Larger samples
Pre-registration
Reporting clear and complete methods/ results even if not correct
Replicate!
What is pre-registration?
A formal process in which researchers specify their research plans and hypotheses before conducting a study, stopping HARKing and p-hacking.
What are the key ethical considerations? (6)
Informed consent
Confidentiality and privacy
Test validity and reliability
Use of results
Fairness, discrimination and cultural sensitivity
Commercialization of personality testing
What is impression formation?
The process by which people form judgements about others, taking into account a variety of types of information
How do you determine if the impression is accurate?
Convergent validity, done by assembling interjudge agreement and predictive validity.
What does accuracy depends on?
Moderator variables: the judge, the target, the trait and the information
What are strong situations and what are weak situations?
Strong situations are those that highly influence behaviour due to a heavy social script, allowing no individual differences in response. Weak situations are those that minimally influence behaviour and allow individual traits to be expressed.
What is the realistic accuracy model? RAM
It’s a model that defines the cues that affect accuracy utilized by the judge for judging the target.
It goes, from target to judge, relevance, availability, detection and utilization.
Relevance and availability make a good target, availability and detection makes a good trait and info and detection and utilization makes a good judge.
What are good moderator variables? (relating to RAM)
Good judge: picks up and uses the info, some ppl are better than others.
Good target: acts accordingly in an array of situations, some people are more judgeable than others.
Good info: enhances the range of behaviours, quality and quantity
Good trait: present in many situations, some are more overt.
