2 Environments

Question 1

6 kinds of environments

Answer 1

• accessible vs inaccessible
• deterministic vs non-deterministic
• episodic vs non-episodic
• static vs dynamic
• discrete vs continous
• reactive vs proactive

Question 2

• accessible vs inaccessible

Answer 2

An accessible environment is one in which the agent can obtain complete, accurate, up-to-date information about the environment’s state.
Most moderately complex environments are inaccessible.
The more accessible an environment is, the simpler it is to build agents to operate in it.

Question 3

• deterministic vs non-deterministic

Answer 3

A deterministic environment is one in which any action has a single guaranteed effect — there is no uncertainty about the state that will result from performing an action

Question 4

• episodic vs non-episodic

Answer 4

In an episodic environment, the performance of an agent is dependent on a number of discrete, independent episodes, with no link between the performance of an agent in different scenarios.

Question 5

• static vs dynamic

Answer 5

A static environment is one that can be assumed to remain unchanged except by the performance of actions by the agent
A dynamic environment is one that has other processes operating on it, and which hence changes in ways beyond the agent’s control

Question 6

• discrete vs continous

Answer 6

An environment is discrete if there is a fixed, finite number of actions and percepts in it.
The real world is a continuous environment.

Question 7

• reactive

Answer 7

Focused on fast reactions/responses to changes detected in the environment