W3: The Future of Psychology Flashcards
L11, L12, PA 6, Marecek Article, Ch 8, Ch 10, Ch 11, Ch 12
What role does methodology play in psychology?
very important one!
important principles
- striving for clarity
- focus on testing
- attention to statistics, confounds, induction
- focus on empirical data & analyses
What is methodology vs methodolatry?
methodolatry is when you start worshipping method, which can become very superficial. its no longer true science because science is more than method, its an attitude (integrity, honesty
= bias towards increasing methodological rigour instead of the predictive power of theories
What are Mertons 4 core values in science?
- Communalism: scientific products belong to no one (theoretically, but in practice were not there yet)
- Universalism: truth claims are judged the same, no matter who makes them (theoretically, but in practice there are power structures in place, and underrepresentation of minorities)
- Disinterestedness: scientists have no interest in the outcome of research
- Organized skepticism: ideas are cracked down on and rigorously tested, regardless of who proposes them
What is meant by regulative ideals?
mertons norms & the scientific attitude are not actualized all the time, but this doenst make them useless
-> they are regulative ideals: things we strive for !
What is psychology’s 20th century paradigm? aka the standard of psych research in the 20th century
- create a theory (usually a verbal story)
- Come up with an experiment
(usually small n) - Test hypothesis (usually with a
significance test) - Publish results (usually without
full disclosure and without data)
What events contributed to the change in psych methodology?
- Vul’s Voodoo correlations (found impossible correlation of .88)
- Bargh’s fantastic effects (found strange results like ppl who are lonely take hotter showers)
- Bem showed evidence of clairvoyance but didnt seem to have done anything wrong
What are questionable research practices (QRPs)?
range of activities that intentionally or unintentionally distort data in favour of a researcher’s own hypotheses
What are some common Questionable Research Practices (QRPs)?
- p-hacking: manipulating data in order to obtain a desired (significant) p value (through deleting outliers, running extra participants to increase chances of significance, trying out several dependent variables, post hoc adding variables to the design etc.)
- publication bias: only publishing positive resutls (shown by funnel plots)
- HARKing: Hypothesizing After the Results are Known
- Dropping experimental conditions that “don’t work”
why do some authors believe we have overcome the replication crisis?
- we have identified the problems
- we can improve transparency in data & its analysis
- we can require preregistration
- we now have better bayesian stats
- we know value of replications
what 2 big things were achieved in psych methodology following the replication crisis?
- creation of repositiories
- publication of the TOP guidelines
What are 3 reasons why open science is necessary?
- cus errors in data analysis are likely,and conclusions made depend on these analyses
- makes it easy to run secondary data analysis
- makes big data research possible
what is meant by publish or perish?
refers to the practice in academia that a person will not be appointed or promoted unless they have a strong portfolio of scientific publications
define peer review
the evaluation of scientific work by research colleagues (peers) to decide whether the work is good enough to be published (or financed in case of grant applications)
what is the journal impact factor?
number that estimates the impact a journal has on a research area; based on the average number of citations to articles in the journal in subsequent years
what is a Declaration on Research Assessment (DORA)?
declaration that asks science funders and evaluators to look at the quality of the research itself rather than at the prestige of the outlets in which it was published
what is an open access journal?
journal that can be consulted without paying a subscription or fees for reading articles (usually via internet)
what is an article processing charge (APC)?
price asked by open access scientific journals to process a manuscript and publish it in the journal
define mega-journal
huge open access journal focused on methodological rigour rather than theoretical contribution; & articles on many topics can be included.
how has psych science publication changed in the past 100 years?
- many more published
- quality of journal increased
how is the quality of journal published evaluated? what was the consequence of this?
estimated on basis of average nr. of citations in a specified period aka JOURNAL IMPACT FACTOR
-> led to Declaration on Research Assessment since reliance on JIF had growing negative side effects
why did open access journals start appearing?
cus commercial publishers took over scientific journals from learned societies and research groups and asked increasingly higher subscription fees, even though the production costs went down
what is the business model of open access journals as opposed to commercial publishers? what was the consequence of this?
open access journals do not have an income from subscriptions so researchers have to pay an Article Processing Charge to get their article published
-> rise of mega journals & predatory journals
how did double dipping come about?
established publishers tried to profit from the new business model created by open access journals, by starting their own open access mega journals and offering open acces in their subscription journals (hybrid model)
why has there been an explosive growth of scientific papers in the past 100 years?
- cus more researchers were hired
- cus researchers were increasingly motivated to publish more (PUBLISH OR PERISH)