Week 8 UAS

Question 1

the agent’s preferences are captured by?

Answer 1

utility function

Question 2

what is expected utility?

Answer 2

an action given the evidence

Question 3

The Basic of Utility Theory?

Answer 3

1. Orderability
   Given any two lotteries, a rational agent must either prefer one to the other or else rate the two as equally preferable.
2. Transitivity
   Given any three lotteries, if an agent prefer A to B and prefer A to C, then the agent must prefer A to C.
3. Contiunity
   if some lottery B is between A and C in preference, then there is some probability p for which the rational agent will be indifferent between getting B for sure and the lottery that yields A with probability p and C with probability 1-p.
4. Monotonicity
   suppose two lotteries have the same two possible outcome A and B. If the agent prefer A to B, the agent must prefer the lottery that has a higher probability for A (and vice versa).
5. Decomposability
   compound lotteries can be reduce to simpler ones using the laws of probability.

Question 4

The purpose for using utility theory in decision making?

Answer 4

to create a mathematical model to aid the process. It gives the decision maker the ability to quantify the desirability of certain alternatives.

Question 5

Decision Network?

Answer 5

Decision network represents information about the agent’s current state, its possible actions, the state that will result from the agent’s action, and the utility of that state.

Question 6

the three types of nodes in Decision Network?

Answer 6

1. Chance nodes (ovals) represent random variables, just as they do in Bayesian networks. The agent could be uncertain about the construction cost, the level of air traffic and the potential for litigation, and the Deaths, Noise, and total Cost variables, each of which also depends on the site chosen
2. Decision nodes (rectangles) represent points where the decision maker has a choice of actions. In this case, the AirportSite action can take on a different value for each site under consideration. The choice influences the cost, safety, and noise that will result.
3. Utility nodes (diamonds) represent the agent’s utility function. 9 The utility node has as parents all variables describing the outcome that directly affect utility. Associated with the utility node is a description of the agent’s utility as a function of the parent attributes

Question 7

What is probability theory?

Answer 7

Probability theory describes what an agent should believe on the basis of utility theory describes what an agent wants, and decision theory puts the two together to describe what an agent should do.

Question 8

What is Markov Decision Process?

Answer 8

A sequential decision problem for a fully observable, stochastic environment with a Markovian transition model and additive rewards

Question 9

Sequential decision problems menggunakan function apa?

Answer 9

additive utility function

Question 10

What is Value Iteration?

Answer 10

Value iteration Algorithm for calculating an optimal policy. The basic idea is to calculate the utility of each state and then use the state utilities to select an optimal action in each state.

Question 11

Game Theory can be used in at least two ways?

Answer 11

1. Agent design

2. Mechanism design

Question 12

Markov decision processes (MDP) are defined by?

Answer 12

1. transition model

2. reward function

Question 13

What is game theory?

Answer 13

Game theory describes rational behavior for agents in situations in which multiple agents interact simultaneously.