11/5 Hypothesis Testing Flashcards
Social perception and interaction involve hypothesis testing how?
Candidate for job, student for course, etc.
Attempt to acquire info to test hypothesis.
Snyder and Swan. What experiment?
Test hypothesis: introvert or extrovert. Beginning of experiment, might read profile of introvert and extrovert.
To test hypothesis, people chose a series of questions to ask person you are interviewing to test the hypothesis. Choose 12/26 questions. Some oriented to one or another others are totally neutral.
Slides have the example of questions. Questions are biased “What things do you **DISLIKE **about loud parties?” begin with assumptions “When do you seek out new friends?”
**We pick the questions for what we are investigating. **
Many were critical of types of questions offered to participants. Trope and Liberman crticised them
Trope and Liberman criticism of hypothesis testing experiment.
Trope is “Mr. Diagnosticity”: why? How? What did he do?
Diagnosticity: the extent to which the subjective likelihood of obtaining some evidence differs if the hypothesis is true from when the hypothesis is false
Greater the difference, greater diagnosticity of evidence. P(X) Given (|) hypothesis true vs. alternative.
he argued that the Swam and Synder questions did not even allow for diagnosticity.
How can we determine diagnosticity?
Question Operationalization: how well would the answer to this question discriminate between introvert and extravert?
Sample Introvert:
High Diagnostic: doing things alone more than with others? do they dislike going places with new people?
Low diagnostic: do they study on weekends and watch PBS?
Sample Extrovert:
High diagnostic: strike up convos with people they don’t know well?
Low diagnostic: does this person like beer, are they attractive?
New experiment adding diagnosticity ratings, but what else do we add?
Questions extraverts are more likely to say yes to.
Extorverts: say yes to parties
Questions introverts more likely to say yes to.
Results of looking at testing diagnosticity (Devine Hirt and Gehrke)
People more often chose diagnostic questions, and more questions that have to do with the hypothesis being tested too.
BUT
People also show bias for response to question they are going to get a “yes” to.
Questions where you’ll get a Yes for what you’re looking for. Confirmation bias, positive test strategy.
Aria Kruglanskis’s Theory of Lay Empistemics: motives and process.
What is this? What was he talking about?
**This card: 2 General Epistemic Motivations
- Need for closure. Some of us want closure or to reach a conclusion quickly. I just need closure, need to have answer. Accentuated by pressure or fatigue or no resources.
- Need to avoid closure (fear of invalidity): avoid inaccuracy. Accentuated by accountability, evalutaiton apprehension. Don’t want to waste $ on car.
- Need to seek specific closure
- Need to avoid specific closure
Don’t want conclusion that you’re about to die or bad person. Favor certain conclusions. Test it to information processing situations.
The difference is: are we trying to avoid closure in general, or a specific conclusion? Sometimes it’s not just a quick or accurate conclusion we’re looking for, it’s a specific one.
Illustrative Experiment: Kruglandski and Freund (1983) (Theory of Lay Epistemics)
what does it illustrate?
Illustrates people arriving at conclusion early on a little info or delay until more info.
Ps beleive in study of personnel (employee) selection. Individual head of company, likely candidate for president of company. You test hpyothesis that this person will be successful as company president given how they have been as department head.
Listen to oral recording with + and - behaviors in department head: interst in employee welfare, sensitive to client needs, disorganized, unpersuasive.
Key variable: description is ORGANIZED. Sequence manipulation: + first or - first?
Do people give more weight to what comes first? See difference based on privacy effect. **According to Glancy’s theory, Should be more likely to see primacy effect under certain conditions. **
IVs:
1. manipulate evaluation apprehension (need to avoid closure). Told participants that at the end, participate in discussion where you justify your conlusion to the others in the group. If wrong, you look dumb.
2. Time pressure (need for closure). 2x2 design, put under time pressure.
Likelihood of succeeding at a job on 10 point scale.
DV: data coding to which judgment reflect primacy effect. Higher numbers in positive condition that you have positive judgemetn. Negative condition first, ran with negative to make negative judgement.
Higher numbers = went with info presented first, more primacy effect.
Results:
3 examples of primacy, exception is low time pressure, but evaluation is high. High time pressure: conclude quickly. Low time pressure: make slower decision, AND if you’re worried about how others will see you, you evaluate more information. Avoid primacy effect when you are highly motivated and have plenty of time. Reflects high need to avoid closure (in general, don’t want peers to judge) and low need for closure (specifically, don’t have time pressure).
Depends on balance of these two factors. Remember what they are (a decision vs. specific decision).
Webster and Kruglanski (1994)
Need for Closure Scale
Used to think of closure an individual difference.
40 items, 5 factors, controversial, but useful.
Need for closure scale (NFC): referes to desire of an answer, any answer, compared to confusion and ambiguity.
Sample item: “I don’t like uncertainty” “I feel irriated when one person disagrees with what everyone else in the group believes” “I want solutions quickly”
Okdie, Rempala, and Garvey (2016)
Need for closure and political ads.
Sample of politically unaffiliated.
- what party do you most closely affiliate? (none, indpendent, or unaffiliates)
Expose to youtube political ads. 2010 US senate race in Colorado. No clear indication of candidate’s political party. Found ads where party not mentioned. No indication of party.
Watch ads in given order. Do people like ad they saw first more? Yes, IF they have a high need for closure.
Krug’s theory gives us a way to think about it. You want decision, go with the first thing you see.
Trope and Liberman (1996)
2x2 experiment, Doesn’t focus on motives, uses different language, ends up in same place as last experiment.
How do they do it?
Actual state of affairs: Hypothesis true or false
Decision: Accept or Reject
Hypothesis True/accept = correct acceptance. (also correct rejection)
If true and reject: false rejection (omission)
If false and accept: false acceptance (commission)
We’ve all see the hypothesis table (type 1 and 2).
Decisions about acceptance always have to involve some thershold of confidence.
Reach certain level in information acquired before you know enough to say you can accept or reject the hypothesis.
In different situations, our willingness to falsely accept or reject hypothesis might not be equal.
Trope and Liberman’s Model:
The hypothesis table, but what is the point of it?
how long do I continue acquiring information?
Cost of errors vs. cost of information.
Sometimes high cost of information acquisition: need conclusion quick, accentuated by time pressure, fatigue. Then we aren’t concern about errors, want quick conclusion.
High costs of error: Desire to avoid inaccuracy. Accentuated by accountability, evaluation apprehension.
Sometimes it’s not just a quick or accurate conclusion we’re looking for, it’s a specific one.
False rejection costs more than false acceptance, OR does false acceptance cost more than false rejection?
Value of Error Reduction
Measure used in Trope and Liberman’s cost ratio analysis.
AKA value of confidence increase.
What is the value of acquiring addtional piece of information to reduce error liklihood? Value of confidence.
Value of that opposed to cost of acquiring extra information.
Futher hypothesis testing is function of Value/Cost Ratio.
What are the 3 measures used in Trope and Liberman’s Cost of erros and information model?
- Value of Error Reduction
- Cost of Unit of Information
- Value/Cost Ratio
According to Trope and Liberman, what determines whether we will engage in futher hypothesis testing?
Value/Cost ratio