Decision Problems Flashcards
3 components of a decision problem.
- ACTIONS
- OUTCOMES
- PREFERENCES
Definition of PREFERENCE.
Is a binary relationship on the set of actions A.
Can be WEAK, STRICT, INDIFFERENT.
A preference is said to be:
- COMPLETE if there are not indecisiveness;
- TRANSITIVE if there are no cycles.
If a preference is either complete and transitive then it’s RATIONAL.
Definition of UTILITY FUNCTION (also called payoff function).
Is an arbitrary quantification u(q) of the goodness coming from some input q.
When is a player RATIONAL?
- They act for their own good;
- They are aware of all consequences of their acts.
UPDATED DEFINITON:
A player facing a decision problem with a payoff function u(.) over
outcomes is rational iff he chooses an action a∊A that maximizes his expected payoff.
Definition of LOTTERY.
Is a set P of probability distributions p: X -> [0, 1] where X is a finite set X = {x1, …, xn} of outcomes.
von Neumann–Morgenstern (VNM) utility theorem and axioms.
Under certain axioms of rational behavior, a decision-maker faced with risky (probabilistic) outcomes of different choices will behave as if he or she is maximizing the expected value of some function (see the expected utility theory).
Axioms:
1. Preference is complete and transitive;
2. Indipendence
3. Continuity
3 types of RISK ATTIDUTE.
- Risk neutral: a player sees A and B as perfect substitute choices;
- Risk averse: a player prefers a degenerate lottery (the sure thing);
- Risk loving: reverse.
Backward induction exercize.
- Classify all nodes with P’s action into groups;
- Compute expectations.