Week 3 Flashcards
Methodology or methodologism
Tendency to see methodological rigour as the only requirement for scientific research, at the expense of theory formation
Pseudoscience
Branch of knowledge that pretends to be scientific but that violates the scientific method on essential aspects
Hermeneutics
approach in psychology according to which the task of the psychologist is to interpret and understand persons on the basis of their personal and socio-cultural history
Humanistic psychology
psychological movement promoted by Rogers and Maslow as a reaction against psychoanalysis and behaviourism; stressed that people are human, inherently positive, endowed with free will and living within a socio-cultural context
Feminist psychology
movement in psychology aimed at understanding women; is particularly concerned with the way in which women are treated in mainstream psychology
Postcolonial psychology
movement in psychology addressing the issues of racism and the ways in which dominant groups treat other groups
Unconscious plagiarism
indicates how the scientific and the hermeneutic approach in psychology have influenced each other without the proponents being aware of it
Replicability
The probability of obtaining the same finding when a scientific study is rerun (in the same way)
Replication crisis
a crisis of confidence in scientific research, because many published findings cannot be repeated if studies are rerun, questioning the reliability of scientific findings
File drawer problem
issue that the scientific literature badly represents the research done because experiments that do not find significant differences are less likely to get published
Conceptual replication
replication in which an effect is investigated differently from the original study
Questionable research practices
research practices undermining the statistical conclusions that can be drawn from a study
P-hacking
Manipulating data in order to obtain a desired (significant) p-value
HARKing
unexpected significant finding in a statistical analysis is presented as an effect that was the focus of the research and, therefore, addresses an important theoretical question (Hypothesising After the Results are Known)
Registered report
a type of research article that is evaluated by scientific journals before the data are collected
Bayesian statistics
data analysis that deviates from the traditional hypothesis testing with p-values; estimates the relative probabilities of the null hypothesis and the alternative hypothesis; is hoped to correct existing misunderstandings of statistics
Pottery barn rule
In science is the moral obligation of a scientific journal to publish a failure to replicate a finding previously published in the journal
Open science
science practice where all relevant information is made easily available, so that other researchers can check the findings and integrate them in their own research
Repository
in science is a location where data and analysis programs are stored, so that others can retrieve them (typically on the internet)
Transparency and Openness Promotion (TOP) guidelines
list of criteria written by advocates of open science describing the extent to which journals adhere to the standards of open and reproducible science
Secondary data analysis
Reanalysis of existing data to address new research questions
Big data
Collection and use of large datasets for secondary data analysis
Publish or perish
refers to the practice in academia that a person will not be appointed or promoted unless they have a strong portfolio of scientific publications
Peer review
in science is the evaluation of scientific work by research colleagues (peers) to decide whether the work is good enough to be published (or financed in case of grant applications)
Journal impact factor
number that estimates the impact a journal has on a research area; based on the average number of citations to articles in the journal in subsequent years
Declaration on Research Assessment (DORA)
declaration that asks science funders and evaluators to look at the quality of the research itself (proposed and completed) rather than at the prestige of the outlets in which the research is published
Open access journal
Journal that ca be consulted without paying a subscription or fees for reading articles (usually via internet)
Article processing charge (APC)
Price asked by open access scientific journals to process a manuscript and publish it in the journal
Mega-journal
large-volume, peer- reviewed academic open access journal designed to make more scientific findings available by focusing on methodological rigour rather than theoretical contribution; has a large remit, so that articles on many topics can be included
Double dipping
Practice in science in which journals make money both by journal subscriptions and by article fees for open access
Predatory journal
scientific journal that gives the impression of being genuine (peer-reviewed, with mechanisms of error control, promise of longevity) without adhering to the standards; tries to lure scientists to pay APCs for very limited service
Quantitative research methods
research methods based on quantifiable data; are associated with the natural-science approach based on the hypothetico- deductive model
Illusory correlation
Perception of a correlation between events for which no independent evidence can be found
Quantitative imperative
A bias only to find measurable topics interesting because quantitative research methods require numerical data
Qualitative research methods
research methods based on understanding phenomena in their historical and socio- cultural context; are associated with the hermeneutic approach based on understanding the meaning of a situation
Ideographic approach
The conclusions of a study stay limited to the phenomenon under study
nomothetic approach
A study is run in search of universal principles that exceed the confines of the study
Bracketing
Requirement in qualitative research to look at a phenomenon with an open mind and to free oneself from preconceptions
Semi-structured interview
Interview in which each interviewee gets a small set of core questions, but for the rest of the time is encouraged to speak freely; achieved by making use of open-ended questions, non-directive questions
Focus group
Technique in which a group of participants freely discuss a limited set of questions, usually makes use of the same questions used in a semi-structured interview
Grounded theory
qualitative research method that tries to understand what is going on in a particular situation and which, on the basis of a qualitative analysis and induction, tries to come to a theoretical insight grounded in the data
Interpretative phenomenological analysis
Qualitative research method that tries to understand how a phenomenon is experienced by the people involved
Discourse analysis
Qualitative research method that aims to discover how social relations between people are determined by the language they use
What are strengths of quantitative research as a method
Lends itself well for statistical analyses of large datasets
Can produce precise predictions that can be tested
Makes comparison (between groups or subjects) possible/easier
Easier to investigate confounds and validity threats
What are weaknesses of quantitative research as a method
Little interest in the perception of participants
Research limited by what is measurable
Better suited to testing general theories than to finding solutions for specific problems
If you don’t have a well-developed theory yet, they aren’t very helpful; not suitable for generating theories
Assumes that psychological characteristics can be measured
What are 3 approaches to qualitative research and explain them
Grounded theory; analyses to build a specific theory
IPA; puts much emphasis on the subjective experience of the people that are studies
Discourse analysis; assumes that social reality is constructed by the way we communicate and tries to understand this by looking at language
What are 3 limitations to grounded theory and what was the solutions to these limitations
Assumes there is an objective reality to be discovered
Importance of verification and induction
Did not take into account that data consists of participants’ perceptions/interpretations
—> IPA was solution
What are strengths of qualitative research as a method
Direct involvement with situation
Generates theories and enables exploration
Responsive to the needs of participants
What are weaknesses of qualitative research as a method
Less suitable for demonstrating general laws
Little room for precise predictions/falsification
Less suitable for deciding between theories
Largely based on introspection/subjective evaluation
Involvement of researcher may be a disadvantage in high-stakes situations
What are 6 criteria that are important when doing qualitative research
Representativeness. Researchers must provide the criteria they used for their data analysis, so that the representativeness of the reported instances can be gauged.
Confirmability. Would someone else come to the same conclusions on the basis of an equivalent data analysis?
Credibility. Do the conclusions sound credible to the participants involved in the study?
Comparison of situations that differ on one critical aspect. Another way to check the validity of conclusions is to compare the data with those of similar cases that deviate in a critical aspect.
Alternative explanations. Could the data be explained differently?
Refutability. Is there evidence that refutes the conclusions? This principle very much
resembles the falsification test in quantitative psychology.
What are 4 misconceptions about qualitative research according to Marecek
Qualitative and quantitative provide the same kind of understanding
Qualitative research is a first exploration
Qualitative research is purely inductive
Qualitative research is the same as quantitative psychology but without numbers
Who coined the term social constructionism and was he happy with how it progressed
Latour
What did postmodernism entail
It rejects the assumptions and principles in modernity, rests on social constructionism which states that our social reality is a construction of our minds, took this very far and extended it to biology/physics/etc. as well. It says that everything is relative and that there’s no such thing as objective reality.
What did Alan Sokal do and why
He was a physicist and published an article in a postmodernist journal about how physics proved that there is no objective reality. This was a hoax with fake evidence however, and with this he tried to show the political consequences of a relativist view and how the journal would publish anything that looked good and proved their view
Explain the cargo cult science and who tells the story
Richard Feynman; In WW-2 the Americans built bases on pacific islands to refuel their jets, people that lived on the islands had never seen such a thing so when the Americans left a variety of religious practices arose among the islanders aimed to bring them back —> supposedly a metaphor for science; even though they do this, the planes don’t land —> it looks like science but it isn’t
What are Merton’s 4 core values and what do they mean
Communalism - scientific products belong to no one
Universalism - truth claims are judged the same, no matter what makes them
Disinterestedness - scientists have no interest in the outcome of research
Organized skepticism - ideas are cracked down on and rigorously testes, regardless of who proposes them
What is the problem with meltons norms and what are these norms or ideas called
They are not always actualized, but that does not make them useless; they are regulative ideas = things we strive for
What are 4 examples of pseudo-science cases and what happened
Vul’s voodoo correlations - many correlations between psychological constructs and brain areas were reported that were so high that they were basically impossible
Barth’s fantastic effects - priming people with words like old and elderly led to slower walking etc.
Bem’s Feeling the Future - “proved” that clairvoyance was real, turned out that they engaged in QRP’s
Stapel - published really amazing results, turned out that data for 55 papers was entirely made up
What is publication bias
Only publishing positive results
What are funnel plots and how do they help us
They show the effect size in smaller to larger sample sizes; larger sample sizes should mean the results deviate less from the actual effect size —> for publication bias we see that there are data points missing so it looks like smaller sample sizes are more accurate than they should be
What are the 3 pillars of open science
open data
open materials
preregistration
What is Psychological Science Accelerator (PSA)
It can replicate findings very fast, it employs huge distributed studies to evaluate research findings
What are 6 criticisms of open science
Increased bureaucracy and more work for researchers
Most data are never downloaded, many preregistrations aren’t adhered to, badges aren’t checked
Too much focus on replication, not enough on creativity
Open science in expensive and can compound inequalities
Open science is not always feasible or desirable
Some approaches may decline (e.g. field studies, qualitative research)
What were the 4 elements of Diltheys approach
Psych should be content based, focus on what the mind comprises and not how it functions
Subject matter of psych is the human experience in its totality
A persons life is embedded in context, cannot be studied in isolation
Natural-scientific research method cannot grasp the totality of mental life within its context, appropriate method for psych is understanding
What are the 3 levels of understanding according to dilthey
Elementary forms of understanding used to solve simple problems of life
Empathy through which an observer can re-experience someone else’s experience
The hermeneutic level of understanding, by which an observed person can be better understood than they understand themselves
Who founded humanistic psychology
Rogers and Maslow
What are 3 basics of critical psychology
idealism instead of realism
science is a social construction
psychologists have a moral responsibility because psych affects reality
What is a problem with conceptual replications
Failure does not say much about the original study because it wasn’t exactly the same, but success adds weight to the success of the studied you replicated
What were 5 negative consequences of the journal impact factor
Increased power of the Web of Science company
Further cemented the dominance of research published in English
Books became less important than journal articles
Some practices emerged to improve the amount of citations
The JIF was sometimes misinterpreted
What are the 8 levels of the TOP guidelines
Citation standards (for data and materials)
Data transparency
Analytic methods (code) transparency
Research materials transparency
Design and analysis transparency
Preregistration of studies
Preregistration of analysis plans
Replication
What are 4 reasons psych is not seen as a science
Little overlap between stereotypical view of scientist vs psychologist
Difference between psychology researchers and practitioners
Unlike scientific results, psych findings are easy to understand
Not all psychologists are convinced of the added value of the scientific method
What are 6 ways in which we can check the validity of qualitative research
Representativeness; must provide criteria used for data analysis
Confirmability; would someone else come to the same conclusions
Credibility; do the conclusions sounds credible to participants
Comparison of situations that differ in one critical aspect
Alternative explanations
Refutability (falsification)
What is the phenomenological perspective
An extension of the qualitative approach, tries to develop an interpretative methodology, focuses on intentionality, consciousness and qualia instead of behavior —> understanding instead of explanation
What was Gergen’s most important contribution
He argues that psych transforms reality, instead of only passively describing it; theories should therefore be evaluated based on their ability to generate new openings for action instead of their truth
What are the 6 phases of TA
Becoming familiar with the data
Generating initial codes
Searching for themes
Reviewing themes (quality control)
Naming and defining the themes
Writing the report
