week 2 Flashcards
chp 2
INTRODUCTION
TO INTELLIGENT
AGENT (definition)
An intelligent agent is an autonomous entity
that perceives its environment through
sensors and acts upon that environment
using actuators to achieve specific goals.
history
1950: Turing Test
1956: First Dartmouth College Conference on AI
1970-1980: Expert systems
1974-1980: First AI winter
1980: Natural language processors
1987-1993: Second AI winter
1990: Intelligent Agents
2011: Virtual assistants
2016: Sophia
2018: BERT by Google
2020: Autonomous AI
2022: GATO by Deep Mind
2022: vehicleDRX by Algotive
CHARACTERISTICS
OF AN
INTELLIGENT
AGENT
Autonomy
Social Ability
Reactivity
Proactiveness
Learning and Adaptation
AUTONOMY (definition, importance, examples)
Definition:
- The ability of an
agent to operate
without the direct
intervention of
humans or other
systems.
Importance:
- Empower systems
to make
independent
decisions. - Essential for real-
time applications
where human
intervention can be
slow or impractical.
Examples:
- Autonomous drones
navigating
obstacles. - Self-driving cars
making lane-change
decisions.
SOCIAL ABILITY (Definition, Importance, Examples)
Definition:
- The capability of an
agent to interact
with other agents,
systems, or humans
effectively.
Importance:
- Allows agents to
gather, share, and
act upon collective
information. - Crucial for systems
where collaboration
enhances efficiency.
Examples:
- Chatbots engaging
in human-like
conversations. - Multi-agent systems
collaborating to
solve complex
problems.
REACTIVITY (Definition, Importance, examples)
Definition:
The ability of an agent to
perceive and respond to
its environment in real-
time.
Importance:
Enables agents to adapt
to changing conditions.
Vital for safety-critical
applications.
Examples:
Industrial robots adjusting
to unexpected obstacles.
Voice assistants reacting
to vocal commands.
Proactiveness (definition,importance, examples)
Definition:
- The capability of an
agent to take
initiative based on
predictive modeling
and anticipation of
future events.
Importance:
- Enables agents to be
forward-looking,
planning actions
ahead of time. - Provides
competitive
advantage in
dynamic
environments.
Examples:
- Smart thermostats
predicting user behavior to pre-adjust temperatures. - Trading bots
anticipating market
shifts and making
pre-emptive trades.
LEARNING AND ADAPTATION (definition, importance, examples)
Definition:
- The ability of an
agent to improve
its performance
over time by
learning from its
experiences and
adapting its
actions
accordingly.
Importance:
- Ensures
continuous
improvement and
refinement. - Allows agents to
remain relevant
and efficient in
evolving
scenarios.
Examples:
- Personalized
content
recommendations
based on user
history. - Adaptive AI in
gaming adjusting
to players’ skill
levels.
CRITERIA TO DESIGN
AN AGENT
PEAS(Performance, Environment, Actuators, Sensors)
example: designing an automated taxi driver
Performance measure:
safe, fast, legal, comfortable trip, maximize profits
Environment types:
-fully observable (vs partially observable)
-deterministic (vs stochastic)
-episodic (vs sequential)
-static (vs dynamic)
-discrete (vs continuous)
-single agent(vs multi-agent)
Fully Observable Environment:(give definition and example)
Partially Observable Environment:(give definition and example)
Fully Observable Environment:
* Definition: Agents can access all the states and details of the
environment at any point in time.
* Example: A game of Chess where all pieces and their positions are
visible to both players.
Partially Observable Environment:
* Definition: Agents have limited access to the states or details of
the environment. Some information might be hidden or unknown.
* Example: A card game like Poker where players can’t see each
other’s hands.
Deterministic Environment:
(give definition and example)
Stochastic Environment:
(give definition and example)
Deterministic Environment:
* Definition: Outcomes of actions are predetermined and certain.
* Icon/Image: Dominoes, symbolizing predictability.
* Example: Chess (Given a state and a move, the resulting state is always the
same).
Stochastic Environment:
* Definition: Outcomes of actions are probabilistic and can vary.
* Icon/Image: A branching or splintering arrow, symbolizing multiple possible
outcomes.
* Example: Stock market predictions (Actions or decisions can lead to various
outcomes due to many unpredictable factors).
Static Environment:
(give definition and example)
Dynamic Environment:
(give definition and example)
Static Environment:
* Definition: The environment remains unchanged until the
agent performs an action.
* Example: A puzzle game like Sudoku. The game board
remains the same until a player makes a move.
Dynamic Environment:
* Definition: The environment can change while the agent is
deliberating, either due to external factors or other agents.
* Example: Stock market trading. Prices of stocks can
fluctuate based on various factors even if a trader hasn’t
made any decisions.
Discrete Environment: (give definition and example)
Continuous Environment:
(give definition and example)
Discrete Environment:
* Definition: The environment has a finite number of distinct,
separate states or outcomes.
* Example: A chess game, where an intelligent agent has to choose
from a set number of legal moves at any given point in the game.
Continuous Environment:
* Definition: The environment can take on an infinite number of
states within a given range.
* Example: An autonomous vehicle navigating through traffic.
single-agent environment(give definition and example)
multi-agent environment(give definition and example)
Single-Agent Environment:
* Definition: Only one agent operates and makes decisions. The success of its
actions depends solely on its own decisions and not on the decisions of other
agents.
* Example: A vacuum cleaner robot operating in a room. Its sole task is to
clean, and there aren’t any other agents it needs to interact or negotiate with.
Multi-Agent Environment:
* Definition: Multiple agents operate simultaneously, and the success of their
actions may depend on the actions of other agents. Agents might collaborate
or compete with each other.
* Example: Multiple self-driving cars navigating a busy intersection. Each car
must not only navigate based on traffic rules but also predict and react to the
actions of other cars.
AGENT FUNCTIONS
& PROGRAM
- An agent is completely
specified by the agent
function mapping
percept sequences to
actions. - Agent = Architecture +
Program
Environment types: (give examples)
Task
environment, Observable, Deterministic, Episodic, Static, Discrete, Agents
Crossword
puzzle: Fully, Deterministic, Sequential, Static, Discrete, Single
Chess: Fully, Strategic, Sequential, Static, Discrete, Multi
Taxi driving: Partially, Stochastic, Sequential, Dynamic, Continuous, Multi
Medical diagnosis: Partially, Stochastic, Sequential, Dynamic, Continuous, Single
Agent types (Types of intelligent agents)
Simple reflex agents, model-based agents, goal-based agents, utility agents, learning agents
how u draw and design the agents (Simple reflex agents, model-based agents, goal-based agents, utility agents, learning agents)
draw on paper(slide 25 until slide 34)
APPLICATIONS OF INTELLIGENT AGENTS
- Personal assistant (e.g. Alexa,
Siri, Google) - Autonomous vehicles
- Recommender systems
*Health Monitoring
FUTURE OF
INTELLIGENT AGENTS
- Integration with IoT devices
- Increasing human-like interaction
capabilities - Ethical considerations in AI agents
- Potential challenges: safety,
security, trustworthiness
conclusion:
Nature of Intelligent Agents,
Architectural Diversity, Applications in Real-world,
Future Landscape,
The Imperative to Understand
1.Nature of Intelligent Agents: At their essence, intelligent agents are autonomous entities that
perceive their environment, reason, and make decisions to achieve specific goals. Their
applications range from simple automated systems to sophisticated AI-driven tools.
2.Architectural Diversity: We delved into various architectures underpinning different type of
agents, from simple reflex agent up to learning agents. Different features that being added in
the architecture to serve the purpose and improving the performance of an agent.
3.Applications in Real-world: The ubiquity of intelligent agents in our daily lives, from virtual
assistants to recommendation systems, highlights their growing significance in modern
technology.
4.Future Landscape: With deeper integration into IoT devices and the pursuit of human-like
interaction capabilities, the future of intelligent agents is laden with opportunities. However,
this evolution is not without challenges. Ensuring ethical alignment, safety, and trustworthiness
remain at the forefront of our concerns.
5.The Imperative to Understand: As the lines between our digital and physical worlds blur,
understanding the mechanics, potentials, and pitfalls of intelligent agents becomes crucial. Not
only do they hold the promise to redefine industries and elevate user experiences, but they
also pose philosophical and ethical questions about the role of machines in our lives.
QUESTION 1
For each of the following agents, develop the PEAS description of the
task environment and determine their environment types:
a. Robot soccer-player
b. ChatGPT
c. Roomba (Automated Vacuum Cleaner)
d. Wearable Fitness Tracker
e. Drone (For package delivery or surveillance)
a. Robot Soccer-Player
Score goals, assist teammates, avoid penalties, maintain ball possession. Soccer field, dynamic, competitive with other players, changing positions of the ball and teammates. Motors for movement, servos for kicking and dribbling, communication systems for coordination. Cameras for vision, gyroscopes for orientation, GPS for positioning, and touch sensors for ball interaction. Dynamic, partially observable, and competitive.
b.ChatGPT Provide coherent and contextually relevant responses, maintain user engagement, and answer queries accurately. Text-based conversational platform, user queries can vary widely. Text generation (output responses).
Natural language processing (input from users), context tracking. Static (once a query is received, the environment doesn’t change), fully observable.
c. Roomba (Automated Vacuum Cleaner) Clean floors efficiently, avoid obstacles, return to charging station when low on battery. Indoor home environment, varying layouts, and obstacles like furniture. Motors for movement, brushes for cleaning, suction mechanisms. Bump sensors (for obstacles), cliff sensors (to avoid stairs), dirt detection sensors. Dynamic, partially observable.
d. Wearable Fitness Tracker Accurately track fitness metrics (steps, heart rate), provide feedback, and sync data with apps. Wearer’s body and surroundings, can vary in activity levels and conditions (indoor/outdoor). Vibration motor for alerts, display for feedback. Accelerometer, heart rate monitor, GPS (in some models). Semi-dynamic, partially observable.
e. Drone (For package delivery or surveillance) Deliver packages to designated locations, avoid obstacles, maintain stability, capture images (for surveillance). Airspace with varying weather conditions, geographical features, and urban landscapes. Propellers for movement, gimbals for camera stabilization, payload release mechanisms. GPS for navigation, cameras for visual input, ultrasonic sensors for distance measurement. Dynamic, partially observable.
