Chapter 2- Sources of information Flashcards
Comparison group
Like a control group- will you still get the same effect if compared to a group that didn’t undergo the treatment? Research asks “compared to what?” Personal experience has no comparison group- we won’t know what the outcome would have been if we had or hadn’t done something.
Confounds
Confounds are other explanations for an observation- they “confuse” our interpretation of a result. This occurs when you think one thing caused an outcome, but other things changed at the same time, so you don’t know what the actual cause was. This is why we need a similar baseline in research to make sure outcomes aren’t due to original differences between groups.
Bushman’s study
Study on the effect of catharsis on aggression- it’s a systematic comparison that controls for potential confounds. Had 600 participants write an essay, then had a confederate criticize the essay. Then, an experimental group was asked to punch a punching bag while imagining the confederate’s face, and had a very high level of aggression. The group punching the bag just for exercise had a slightly higher than average amount of aggression. The group that sat quietly had a much lower than average amount of aggression. The group imagining the confederate’s face had the highest level of aggression. This was the catharsis group, so they should have been the most calm if venting aggression actually worked. In this case, what made intuitive sense wasn’t supported by research.
Probabilistic
Behavioral research is probabilistic, which means that its findings are not expected to explain all the cases all the time (there are exceptions). In practice, scientific conclusions are based on patterns that emerge only when researchers set up comparison groups and test many people. Your own experience is only one point in that overall pattern- the research can suggest a strong possibility of an outcome, but your personal experience could be different. That doesn’t invalidate the research.
Ways that intuition could be biased (5)
- We are often swayed by good stories- they seem to make sense
- Availability heuristic
- Present bias
- Confirmation bias
- Bias blind spot
Availability heuristic
Being persuaded by what comes easily to mind- we more vividly remember shocking news or events. Americans are about as likely to die from heart disease as they are from cancer, but people are much more likely to be concerned about cancer. This could be because the media reports on cancer more often. Our attention can be drawn disproportionately to certain events (especially if they annoy us) and lead to overestimation.
Present bias
We tend to remember more when things happen than when they don’t happen (we fail to think about what we can’t see). Example- managing anger. You tend to notice the times when both the treatment (venting) and the desired outcome (feeling better) are present, but don’t notice the times when we didn’t vent and still felt better. In these cases, the treatment was absent but the outcome was still the same.
Confirmation bias
Focusing on evidence we like best- we’re more likely to look for examples to support our beliefs. Without scientific training, we aren’t very rigorous in gathering evidence to test our ideas. As a result, people tend to only gather a certain kind of information and then conclude that their beliefs are supported.
Bias blind spot
Failure to notice your own biases and thinking that you’re objective. Memory can be biased too. This type of thinking makes it difficult to initiate the scientific theory-data cycle, thinking that we already know a conclusion is correct, so we don’t have to test it.
When encountering a news item, what questions should we ask? (4)
- Could this be an example of disinformation?
- Can I cross check this story on some other sites I know are legitimate?
- What is the context of this story?
- Is the journalist politically biased?
Why is experience confounded?
In everyday life, too many things are going on at once. For example, your Himalayan salt lamp might have made you feel better, but maybe you’re also getting regular massages and practicing yoga at the same time. There’s no way to really determine which caused your positive mood. In research, scientists use controls to make sure they’re only changing one factor at a time.
Why can intuition be wrong?
Intuition is using our hunches about what’s “natural” or attempting to think things through “logically”. We believe intuition is a good source of information, but it can lead us to make less effective decisions. Humans are not natural scientific thinkers
Why are we swayed by good stories?
We often accept a conclusion because it feels natural or aligns with “common sense”. Example- the Scared Straight program. Intuitively, it makes sense that young people susceptible to criminal activity would be deterred by stories of people in prison. However, research shows that the program is ineffective and sometimes even causes more crime. Sometimes a good story can be accurate, but often empirical evidence can contradict what your intuition tells you.
What is the difference between the availability heuristic and present bias?
The availability heuristic plays a role in this bias, but the present/present bias adds the tendency to ignore “absent” cells. The outcome considered in the present/present bias isn’t necessarily “shocking” like the availability heuristic. To avoid the present/present bias, ask “compared to what?”.
Empirical journal articles
Report the results of an empirical research study for the first time. They have details about methods, statistical tests used, and the results of the study.
Review journal articles
Summarize all the published studies that have been done in one research area. Can use meta analysis- combines the results of many studies and gives a number that summarizes the magnitude (effect size) of a relationship. A meta analysis weighs studies appropriately without cherry picking
Psychological scientists usually publish their research in 3 kinds of sources
- Journal articles
- Edited books- the authors contributes one chapter
- Full length scholarly books
Components of an empirical journal article (6)
- Abstract
- Introduction
- Methods
- Results
- Discussion
- References
Abstract
Short summary of the article, describes the hypotheses, method, and major results- use this to decide whether you want to read the article
Introduction
First paragraphs explain the topic of the study, middle paragraphs give background for the research (what have past studies found, why is the current study important). The last paragraph has the specific research questions, goals, and hypotheses for the study.
Method
Explains how the researchers conducted the study. An ideal method section gives enough detail so if you wanted to repeat the study just using that section, you could.
Results
Describes quantitative or qualitative results, including statistical tests the author used to analyze the data. Might not understand the statistics, but can usually understand the basic findings from the tables and graphs
Discussion
Summarizes the study’s research question and methods and indicates how well the results supported the hypotheses. Talks about the importance of the study (maybe they have new methods or a new demographic of participants). Then, authors discuss alternative explanations for their data and pose interesting questions raised by the research
What 2 questions should you ask while reading empirical journal articles?
What is the argument, and what is the evidence to support the argument?
An empirical journal article reports on
Data generated to test a hypothesis, and the hypothesis is supposed to test a theory.
How can you identify the argument in an empirical journal article?
Read the abstract first, then the end of the introduction to learn about the primary goals and hypotheses. Then read the rest of the introduction to learn about the theory the hypotheses are testing. Can also look at the first paragraph of the discussion to find the argument of the paper- the authors summarize their key results and say how well the results supported the hypotheses.
What 2 issues should we think critically about when encountering science in the popular media?
- Journalists can select a more sensational story and overlook its flaws- when journalists report on a study, have they chosen one that has been conducted rigorously and peer reviewed?
- Even when studies are conducted well, journalists might not describe them accurately- Sometimes journalists don’t have the scientific training or time to understand the original science very well
Disinformation
Disinformation (“fake news”) isn’t just journalism that you don’t agree with. Disinformation is the deliberate creation and sharing of information known to be false- it can take many forms. Disinformation matters. It has made some people disengage from voting, and has made others act drastically.
Motives of disinformation (4)
- Propaganda, passion, and politics motivate some to drive votes and enhance political support.
- Provocation- people want to provoke an emotional reaction in their audiences
- Profit- false scientific claims about herbal supplements and other items might be accompanied by a shopping website.
- Parody- sites like The Onion are satirical