Module 1 Flashcards

1
Q

Provide a simple definition of AI

A

Machines performing tasks that normally require human intelligence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What test did Allan Turing develop

A

He developed a test to determine whether or not a machine is intelligent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What did Allan Turing believe a machine had to do to be considered AI

A

Its must provide responses that fooled an interviewer into thinking it was human

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the common elements in most definitions of AI

A

Technology – the use of technology and specific objectives for the technology to achieve
Autonomy – some level of autonomy by the technology to achieve those objectives
Human involvement – need for human input to train the technology and identify objectives for it to follow
Output – the technology produces output such as performing tasks, solving problems, or producing content

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is Machine Learning?

A

The process of training machines to display AI behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Why is AI considered a socio-technical system?

A

Because AI influences society and society influences AI

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Why is there risk in AI?

A
  • Complexity of AI systems
  • AI data will change over time
  • Usually implemented in very complex environments
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What does the OECD Framework help organizations do?

A
  • Classify AI systems
  • Examine risks
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

List the 5 dimensions in the OECD Framework

A
  • People and planet
  • Economic context
  • Data and input
  • AI model
  • Tasks and output
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Describe the “People and planet” dimension of the OECD Framework

A

Considers the individuals and groups that may be affected by the system
Focused on how the system impacts things like human rights, environment, and society in general

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Describe the “Economic context” dimension of the OECD Framework

A

The system is looked at according to the economic and sectoral environment which it operates
- Sector
- Business function or model
- Is it critical to operations
- How it was deployed
- Impact of the deployment
- Scale of the system
- Technological maturity of the system – a newer system hasn’t been tested on as much data over time and as it becomes more mature it may grow more effective

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Describe the “Data and input” dimension of the OECD Framework

A

Considers:
- What type of data was used
- Whether expert input was used (human knowledge that gets codified into rules)
- How the data was collected
- Data collection method (machine or human)
- Structure of the data
- Data format

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Describe the “AI model” dimension of the OECD Framework

A

Considers:
- Technical type
- How the model is built
- How it is used

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Describe the “Tasks and outputs” dimension of the OECD Framework

A

Considers:
- Tasks the system performs
- It’s outputs
- Resulting actions from those outputs
- System tasks, systems that combine tasks and actions together
- Evaluation methods that are used to look at how the system performs the tasks that it does

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

List some common AI use cases

A
  • Recognition (images, speech, face)
  • Event detection
  • Forecasting
  • Personalization
  • Interaction support
  • Goal-driven optimization
  • Recommendation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

List examples of the “Recognition” AI use case

A
  • Determine if the individual’s face can be matched to another picture
  • Retailer product matches – individual can take a picture of the product they want
  • Teaching manufacturing machines to detect defects
  • Plagiarism detection
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Provide examples of the “Event detection” AI use case

A
  • Fraud detection – ex. credit cards, government programs – they are looking for patterns of fraudulent behaviour
  • Sports video – when a particular activity occurred (such as when a touchdown was scored)
  • Cyber event & systems management
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

List examples of the “Forecasting” AI use case

A
  • Business forecasting – sales, revenue, demand
  • Ride sharing – when there might be the most demand, and price adjusting
  • Weather forecasting
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

List examples of the “Personalization” AI use case

A
  • Unique customer profiles are created to provide relevant experiences to individuals
  • Provides a unique experience for each customer and ultimately can increase sales in retail
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

List examples of the “Interaction support” AI use case

A
  • Virtual assistants
  • Chatbots
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

List examples of the “Goal-driven optimization” AI use case

A
  • Finding many solutions
  • Optimizing supply chain issues
  • Driving routes and idle time
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

List examples of the “Recommendation” AI use case

A
  • Product recommendations
  • Viewing recommendations
  • Decision support systems
    • Healthcare providers making diagnosing diagnosis
    • Government for adjudicating disability cases, help identify the best benefits according to the case
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What 3 high-level categories can AI be grouped into?

A
  • Artificial Narrow Intelligence (ANI)
  • Artificial General Intelligence (AGI)
  • Artificial Super Intelligence (ASI)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Describe Artificial Narrow Intelligence (ANI)

A
  • Designed to perform a single or a narrow set of related tasks at a high level of proficiency
  • May seem intelligent; however, they operate under a narrow set of constraints and limitations, which is why this type of AI is commonly referred to as weak AI
  • While limited in scope, artificial narrow intelligence systems can help boost productivity and efficiency by automating repetitive tasks, enabling smarter decision making and optimization through trend analysis.
  • A system designed to play chess is an example of artificial narrow intelligence.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Describe Artificial General Intelligence (AGI)

A
  • Also known as Strong, Deep or Full AI
  • Intended to closely mimic human intelligence
  • Has been a goal of AI development for decades but, as of today, it remains beyond our reach
  • Experts expect AGI systems will do the following things at a level that is similar to or on par with human capabilities:
    • Have strong generalization capabilities
    • Be able to think, understand, learn and perform complex tasks
    • Achieve goals in different contexts and environments
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Describe Artificial Super Intelligence (ASI)

A
  • A category of AI systems with intellectual powers beyond those of humans across a comprehensive range of categories and fields of endeavor
  • Capable of outperforming humans
  • Does not yet exist
  • However, experts expect this type of system would be self-aware, capable of understanding human emotions and experiences and evoking its own, thus experiencing reality like humans
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is broad artificial intelligence?

A
  • A category of AI more advanced in scope than artificial narrow intelligence, capable of performing a broader set of tasks, but not sophisticated enough to be considered AGI
  • Often involves reliance on a group of artificial intelligence systems, capable of working together and combining decision-making capabilities, but still lacking the full human-like capabilities experts expect of AGI
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

How does Machine Learning work?

A
  • Leverages the use of data and algorithms to enable systems to learn and make decisions repeatedly
  • Improves over time without being explicitly instructed or programmed to do so
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

How are Machine Learning technologies categorized?

A

Based on the type of training model they rely on

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

List the types of Machine Learning training models

A
  • Supervised
  • Unsupervised
  • Reinforcement
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Describe supervised ML models

A
  • Supervised learning models learn from a pre-labeled and classified data set
  • An algorithm analyzes the input data and associated labels to produce an inferred function, which can then become the basis for the system to make predictions based on new, previously unseen inputs
  • Supervised learning models can also compare their outputs with the correct or intended output, to identify errors and improve their prediction skills
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Provide examples of supervised ML model

A
  • A model that analyzes images of road signs labeled to define the sign’s meaning or purpose
  • Having a bunch of images labelled Cat and Dog, having a model identify whether a new image is of a cat or a dog
  • Text recognition and spam detection
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

List the 2 categories of supervised learning models

A
  • Classification
  • Regression
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Explain what the classification category of supervised learning models does

A

Produce outputs in the form of a specific categorical response; for example, whether an image contains a puppy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Explain what the regression category of supervised learning models does

A

Predict a continuous value; for example, estimating a stock price

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

List 2 widely used supervised learning models

A
  • Support Vector Machine (SVM), used for classification and regression tasks but most widely used for classification objectives
  • Support Vector Regression (SVR), most commonly used to produce continuous values.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What does SVM stand for?

A

Support Vector Machine

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What does SVR stand for?

A

Support Vector Regression

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Describe unsupervised ML models

A
  • Do not rely on labeled datasets
  • Designed to identify differences, similarities, and other patterns without the aid of human supervision
  • Tend to be more cost-efficient and require less effort but are susceptible to producing less accurate outputs and can display unpredictable behaviours
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

List the 2 categories of unsupervised learning models

A
  • Clustering
  • Association rule learning
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Explain what the clustering category of unsupervised learning models does

A

Automatically groups data points that share similar or identical attributes; for example, looking for similarities or patterns in DNA samples

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Explain what the association rule learning category of unsupervised learning models does

A

Identifies relationships and associations between data points; for example, understanding consumer buying habits

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

Describe reinforcement ML models

A
  • Use a reward and punishment matrix to determine a correct or optimal outcome
  • Rely on trial and error to determine what to do or not to do and are rewarded or punished accordingly
  • Do not ingest pre-labeled data sets and learn solely through action and repetition, changing or not changing state or by getting feedback from their environment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Provide an example of reinforcement ML model

A
  • Self-driving cars
  • Robot navigating a maze or organizing and stocking shelves in a large warehouse
  • Generating predictive text (making the model mimic human writing based on feedback)
  • Improve the placement of online ads in real-time bidding
  • Real example: Amazon’s Warehouse Supply Chain Optimization
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

How do reinforcement ML models learn?

A

Actions and decisions that result in a reward reinforce the triggering behavior, incentivizing the model to follow the same tactic in the future. Conversely, errors trigger a penalty and reduce the reward, proportional in size to the scale of the error.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

Provide an example of unsupervised ML model

A
  • Detecting fraudulent behaviour in banking data
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

What do ANI, AGI and ASI stand for?

A
  • Artificial Narrow Intelligence
  • Artificial General Intelligence
  • Artificial Super Intelligence
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

What is semi-supervised learning?

A
  • Using a combination of supervised and unsupervised learning processes
  • Generally uses a small amount of labeled data and a large amount of unlabeled data
  • Aim is to leverage the benefits of both models, improving reliability while reducing costs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

In what situations are semi-supervised learning models very useful?

A
  • Scenarios where it is challenging to find or create a large, pre-labeled dataset
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

Provide examples of semi-supervised learning models

A
  • Image and speech analysis or categorization and ranking of web page search results
  • Large Language Models, or LLMs, often rely on semi-supervised learning models
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

What are Large Language Models?

A

They are a form of AI using deep learning algorithms to create models trained on massive text data sets to analyze and learn patterns and relationships among characters, words, and phrases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
52
Q

What does LLM stand for?

A

Large Language Model

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
53
Q

Describe robotics

A
  • Multi-disciplinary field that encompasses the design, construction, operation and programming of robots
  • Stems from engineering and computer science and aims to design machines that can perform tasks, usually specific tasks or duties, without human intervention
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
54
Q

What benefit does AI bring to robotics?

A

AI can introduce efficiency and effectiveness to exponentially improve robotic processes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
55
Q

What benefit do robotics bring to AI?

A

Robotics can allow AI systems and software to interact with the physical world without human intervention

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
56
Q

Provide an example of robotics working with AI

A

Rumba

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
57
Q

What is the Fourth Industrial Revolution or Industry 4.0?

A

The next stage of industry and manufacturing advancements, enabled by increased interconnectivity and smart automation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
58
Q

What is machine perception?

A
  • Where systems are trained to process sensory information and mimic human senses
  • Robotic sensors can provide relevant data through cameras, microphones, pressure sensors, 3D scanners, motion detectors and thermal imaging
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
59
Q

Provide an example of using machine perception

A

A system that can touch, smell and taste produce could improve food production, preparation, or storage

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
60
Q

What does RPA stand for?

A

Robotic Process Automation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
61
Q

What is Robotic Process Automation?

A

An evolving technology using software robots to automate repetitive and rule-based tasks in business processes, mimicking human actions (like data entry and form processing)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
62
Q

What type of AI models can enhance RPA?

A

AI such as natural language processing or machine learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
63
Q

What is an expert system?

A

A form of AI intended to mimic the decision-making abilities of a human expert in a specific field

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
64
Q

List the three main elements that distinguish an expert system from other AIs

A
  • Knowledge base
  • Inference engine
  • User interface
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
65
Q

Describe the knowledge base of an expert system

A
  • Typically consists of an organized collection of facts and information from human experts
  • Focused on a specific field or domain
  • In some cases, the system is also allowed to gather additional information from external sources
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
66
Q

Describe how the inference engine of an expert system works

A
  • Extracts relevant information from the knowledge base and uses it appropriately to solve a problem
  • Normally uses a rule-based approach that maps data from the knowledge base to a series of rules, which the system uses to make decisions in response to input
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
67
Q

What is the purpose of the user interface of an expert system

A

Allows the end user to interact with the expert system

68
Q

How do expert systems provide transparency?

A

They often include a module that allows users to review its decision-making process

69
Q

Provide an example of an expert system

A

A medical diagnosis system designed to help doctors determine a cancerous growth’s type and stage

70
Q

Are expert systems designed to replace humans?

A

No, these systems are usually designed to support and assist humans, rather than replace them

71
Q

What do linguistic variables do?

A

Describe concepts in natural language terms, such as “low,” “medium,” or “high” and “warm,” “hot,” or “very hot.”

72
Q

What do fuzzy rules do?

A

They express relationships between variables using if-then statements

73
Q

Provide an example of a fuzzy rule

A

A rule might state, “If the temperature is ‘very hot,’ then set the fan speed to ‘high’”

74
Q

What are the steps that a fuzzy logic system uses?

A
  1. Fuzzification
  2. Rule evaluation
  3. Aggregation
  4. Defuzzification
75
Q

In a fuzzy logic system, describe the fuzzification step

A

Input data is converted into fuzzy data sets

76
Q

In a fuzzy logic system, describe the rule evaluation step

A

Rules are applied to determine the degree of matching between the rules and input data

77
Q

In a fuzzy logic system, describe the aggregation step

A

Rule outputs are combined

78
Q

In a fuzzy logic system, describe the defuzzification step

A

Fuzzy outputs are converted back into specific values

79
Q

Provide examples of common fuzzy logic systems

A
  • Climate control systems
  • Image recognition systems
  • Traffic management systems
80
Q

What is an AI model typically comprised of?

A
  • Input data
  • Pattern-matching algorithm
  • Output classification
81
Q

Provide examples of software used to develop, test, deploy and refresh AI applications

A
  • Google Cloud Platform
  • Microsoft Azure
  • Amazon Web Services
82
Q

What features do AI platforms provide?

A
  • Centralize data analysis
  • Streamline development and production workflows
  • Facilitate collaboration
  • Automate systems-development tasks
  • Monitor models and systems in production
83
Q

Provide examples of AI use cases

A
  • Autonomous vehicles
  • Chat bots
  • E-commerce
  • Education
  • Facial recognition
  • Finance
  • Health care
  • Human resources
  • Marketing
  • Navigation
  • Robotics
  • Social media
84
Q

List 3 common model types

A
  • Linear and statistical models
  • Decision trees models
  • Machine learning models
85
Q

Describe linear and statistical models

A

They use a linear equation to model the relationship between two variables

86
Q

Provide an example of a linear and statistical model

A

A model used to determine how sales of a product are related to changes in pricing based on historical data

87
Q

What are 2 benefits of linear and statistical models?

A
  • They are not a black box
  • They are more explainable
88
Q

Provide an example of decision trees models

A

Predict an outcome based on a flowchart of questions and answers

89
Q

What is the benefit of decision trees models?

A

They are not a black box

90
Q

What are the disadvantages of decision trees models?

A
  • Changing just a little bit of the training data can have a significant impact on the algorithm
  • Subject to security attacks and hacks
91
Q

What are the disadvantages of ML models?

A

Types of models that do have a black box capability, there is a lack of transparency and explainability

92
Q

Provide an example of ML models

A

Neural network

93
Q

What is a neural network?

A
  • Based on the human brain and has nodes (like neurons) in a layered structure to continuously improve the ability to find the right answer
  • They do not have to be trained to make complex non-linear inferences in unstructured data
  • Commonly behind technology such as facial recognition
94
Q

List the types of ML models

A
  • Computer vision models
  • Speech recognition models
  • Language models
  • Reinforcement learning models
95
Q

What are computer vision ML models used for?

A

Used to recognize images and video

96
Q

What are speech recognition ML models used for?

A

Used in products like Alexa and transcription software, analyze speech using factors such as pick, tone, language and accent

97
Q

What are language ML models used for?

A
  • For example, natural language processing, allows computers to understand human language using machine learning and deep learning models as well as linguistics
  • Can be used to process large amounts of communications data as well as respond. Examples, customer service chatbots.
98
Q

What are reinforcement ML models used for?

A

Train a model to optimize their actions within a given environment to achieve a specific goal

99
Q

How are reinforcement ML models trained?

A
  • Trial-and-error interactions
  • Simulated experiences that do not require external data
100
Q

List the 2 things that are pushing AI forward

A
  • Algorithmic innovation
  • Accumulation of available data (supervised, collected in interactive environments, structured, unstructured)
101
Q

What drove AI in the beginning?

A

Phenotypic and image data capture systems, particularly as a response to genomic research

102
Q

What is a GPU?

A

Graphical Processing Unit

103
Q

How has advancement in GPU technology thrust AI forward?

A
  • They offload a lot from the CPU
  • They are specialized chips that give better performance
  • As algorithms have become more complex, there has been an accompanying increase in GPU and what they are able to support
  • They are better at matching hardware to the AI models for optimal performance
  • That is the key to determine AI performance, matching the hardware to the AI model requirements
104
Q

When looking at infrastructure, what is the key to AI performance?

A

Matching the hardware to the AI model requirements

105
Q

What does Serverless mean?

A
  • Not being limited to a particular server or piece of hardware
  • Code can run on any number of hardware devices
106
Q

What 2 important functions does serverless infrastructure provide?

A
  • Loose coupling
  • Scalability
107
Q

What does loose coupling mean in serverless infrastructure?

A

Data can come from a variety of sources; you are not limited to the particular network storage or file share you are attached to

108
Q

What does scalability mean in serverless infrastructure?

A

You can run multiple instances of the code because it is not attached to a server

109
Q

What is high-performance compute?

A
  • An isolated cluster of compute power
  • High speed networking
  • Specialized chipsets
  • Quantum computing – processing data in 3 dimensions, horizontally and vertically
  • Trusted execution environments
    • Good from a privacy perspective
    • The human is taken out of the picture
110
Q

List the 4 different stages of AI

A
  • Ingestion
  • Preparation
  • Training
  • Output
111
Q

What do you need to consider when choosing a storage solution to use with AI?

A
  • Massive amounts of data – you need a low-cost storage solution
  • Storage types – file, object, image
  • Structured vs unstructured – easier to process structured data
  • Flexible storage – gives you the ability to do AI at scale
112
Q

What network requirements does AI have?

A
  • They need to be fast – you need a high-speed network to deliver training data in time to the algorithm
  • You need training and inference at scale
113
Q

How does high-speed compute provide the network requirements you need for AI?

A

In high performance compute the underlying infrastructure is housed in the same data center, usually the same rack, and connected via fibre connections. They have a high-speed network.

114
Q

What is edge computing?

A
  • IoT
  • IO devices
115
Q

What do you need to consider when working with edge computing?

A
  • Tremendous amount of data
  • This data needs to be fed into AI models – you need to get it to the storage, over the network, to the AI model
  • You need network protocols that are based on a congestion-free design
116
Q

What does it mean to have network protocols that are based on a congestion-free design?

A
  • Unlike TPS (transmission control protocol) that required you to send a packet then you get an acknowledgement and another back; this takes a lot of time
  • With AI you need data to fly around at sub-millisecond standards
117
Q

Describe AI democratization

A
  • “AI for everybody”
  • You don’t have to be a Data Scientist to do AI anymore
  • No-code and low-code software, simple AI interfaces
118
Q

List 3 software implications of AI

A
  • Tuning
  • Transformation
  • Labelling
119
Q

What function does tuning provide in AI?

A

Allows you to customize your models to generate the most accurate outcomes and the most valuable insights into your data

120
Q

What are some challenges related to tuning?

A
  • Variability due to model type, scale, and complexity
  • Usually done trial and error by changing hyper-parameters
121
Q

What is the difficulty with trial and error tuning?

A

If the model is very complex the hyper-parameters you use to tune can be numerous and they vary greatly on the model type and complexity

122
Q

How do you resolve the issues of trial and error tuning?

A

Move from trial and error to educated tuning

123
Q

Why must you transform data for an AI model?

A
  • Increase data compatibility
  • Optimize data quality
124
Q

What decision do you need to make before transforming data?

A

Determine where and when you are going to do the transformation:
- Internal/external
- Pre- or post-processing

125
Q

Why should you label data for use in AI?

A
  • Enriches the data
  • Pre-tuning, pre-transformation step that has a tremendous impact and determines the quality of the AI model and results
126
Q

What are the challenges of labelling data?

A
  • Low quality data labels, data labels need to be of high quality and standard
  • It is a challenge to scale high quality data labelling operations
  • Lack of quality assurance (going back and verifying that the quality is sufficient)
127
Q

What are hyperparameters?

A

Parameters or values adjusted for an AI model or algorithm to tune it toward desired outcomes

128
Q

List 3 common hyperparameters

A
  • Learning rate
  • Number of epochs (one cycle through the full training dataset)
  • Momentum (the amount of history included in the equation)
129
Q

Why are data and AI observability key to the success of any AI project?

A

They provide:
- Indices and metrics for performance
- In-depth analysis of AI data and models
- The capability to investigate, resolve and prevent AI model issues

130
Q

What is the purpose of data observability?

A

Monitor the overall health and status of your organization’s data ecosystem

131
Q

What is AI observability?

A

A subcomponent of data observability, focused on monitoring:
- The AI algorithm
- The data going in and coming out of your AI algorithm
- The metrics of the AI system

132
Q

List 3 challenges of AI observability

A
  • Data integrity
  • Data drift
  • Testing for bias and discrimination
133
Q

Describe how data integrity can be a challenge in AI observability

A
  • Data quality and inconsistency issues can provide inconsistent results
  • The data that you train on is not relevant or close enough to the data that the analysis is going to be based on
134
Q

Describe how data drift can be a challenge in AI observability

A
  • Similar to data integrity issues when you train on a specific type of data and then you apply the algorithm to a distinct, other type of data
  • Can have significant effects such as faulty predictions, series of future mistakes, inaccurate data pipelines
135
Q

Describe how testing for bias and discrimination can be a challenge in AI observability

A
  • Bias is common, we as humans are creating the AI algorithms, they inherit any biases that we have
  • Outcome validation, ensuring the outcomes we are looking for are delivered and align with the AI model and they can be more or less predicted through our tuning and transformations
136
Q

What are the advantages of open-source AI frameworks?

A
  • Gives companies greater freedom to innovate with AI
  • Community creates its own massive feedback loop which drives the free spread of ideas for applying AI (transformation, tuning best practices, and turning these into valuable businesses or assets for your organization)
137
Q

What are 2 examples of open-source AI frameworks?

A
  • pytorch
  • tensorflow
138
Q

What is a drawback of open-source AI frameworks?

A

You have to have a deep knowledge of AI but there are overlays you can apply to make it relatively low-code or no-code

139
Q

When was AI born as a distinct field?

A

In the US in the summer of 1956 during a seminal conference at Dartmouth College

140
Q

Describe the state of AI before the Dartmouth Conference

A
  • Various strands of research across disciplines like psychology, computer science, linguistics, and engineering formed the bedrock of what would eventually become AI
  • However, these efforts were mostly isolated, and the concept of an “intelligent” machine was not yet formalized
141
Q

What was proposed at the Dartmouth Conference?

A

They proposed that “every aspect of learning or any other feature of intelligence can in principle be so precisely described that a machine can be made to simulate it.”

142
Q

Who penned the proposal for the Dartmouth Conference?

A

John McCarthy, assistant professor of mathematics at Dartmouth, and three senior researchers, Marvin Minsky, Nathaniel Rochester and Claude Shannon

143
Q

Who participated at the Dartmouth Conference?

A
  • Leading researchers in fields relevant to AI
  • Attendees included Allen Newell and Herbert Simon, who introduced the Logic Theorist (considered by many to be the first AI program)
144
Q

How long was the Dartmouth Conference planned to last?

A

2 months

145
Q

How was the Dartmouth Conference structured?

A

It was less structured, with many brainstorming sessions that allowed ideas to flow freely

146
Q

What was the significance of the Dartmouth Conference?

A
  • During the conference, the term “artificial intelligence” was adopted, effectively creating AI as a field of research
  • Participants left the conference with a collective sense of mission to develop machines capable of simulating human intelligence
147
Q

What are the AI summers and winters?

A

Artificial intelligence’s growth has been a series of fluctuations known as AI summers and winters: periods of intense development and increased skepticism, respectively

148
Q

Describe the 1st AI summer

A
  • Mid-1950s to mid-1970s (following the Dartmouth Conference)
  • Period of optimism and funding
  • AI research labs were established at top universities
  • John McCarthy created the first AI programming language, LISP
  • Joseph Weizenbaum at MIT developed ELIZA, which simulated a Rogerian psychotherapist by rephrasing a patient’s statements as questions and posing them to the patient (one of the earliest examples of natural language processing)
149
Q

Describe the 1st AI winter

A
  • Mid-1970s to mid-1980s
  • Early promises of AI failed to materialize, leading to a period of skepticism and funding cuts
  • Critiques like the Lighthill Report in the UK questioned AI’s feasibility and practicality, causing a significant slowdown in AI research
150
Q

Describe the 2nd AI summer

A
  • Mid-1980s to late 1980s
  • A renewed interest in AI was sparked by the advent of expert systems, computer systems that emulate decision-making ability of a human expert
  • The Japanese government’s Fifth Generation Computer Systems project, aimed at developing AI-powered computers, also gave the field a significant boost
151
Q

Describe the 2nd AI winter

A
  • Late 1980s to late 1990s
  • The high cost of maintaining expert systems and the end of the Cold War led to a decline in interest and funding
152
Q

Describe the AI renaissance and the era of Big Data

A
  • Late 1990s to present
  • The tide turned for AI when IBM’s Deep Blue defeated the world chess champion in 1997, signifying a notable advance in AI capabilities
  • Simultaneously, the emergence of the internet led to an explosion of data, marking the beginning of the “Big Data” era
  • A wealth of data, along with advancements in computational power and machine learning, led to significant improvements in AI capabilities
  • AI’s impact started to be felt in everyday life, from recommendation algorithms in online shopping to voice assistants in smartphones
153
Q

Describe the state of AI today

A
  • Today, we are witnessing an AI boom, fueled by the advancements in deep learning, a subfield of AI that involves training neural networks on vast amounts of data
  • Google’s AlphaGo’s victory over Go world champion Lee Sedol in 2016, and OpenAI’s GPT showcasing language models’ remarkable capabilities, are two milestones in recent years showing AI’s progress and potential
154
Q

Describe the Foundations era of data science

A
  • 1960s to 1980s
  • Most data handling was manual, and the concepts of data mining and analytics were in their infancy
  • The term “data science” was introduced by Peter Naur in 1960 as an alternative to “computer science”
    • It was defined as “the science of dealing with data, once they have been established, while the relation of the data to what they represent is delegated to other fields and sciences”
    • the term didn’t take hold until much later
155
Q

Describe the Age of Databases era of data science

A
  • 1980s-1990s
  • As technology advanced, organizations started using databases to store and manage data
  • This period was marked by the advent of Relational Database Management Systems (RDBMS) and Structured Query Language (SQL), transforming how businesses dealt with data
156
Q

Describe the Advent of the Internet era of data science

A
  • 1990s-2000s
  • Led to a substantial increase in the volume of data produced
  • The term “Big Data” started gaining traction to describe the exponential growth of data
  • Around the same time, “data mining,” a process of discovering patterns in large data sets, emerged as a key concept
157
Q

Describe the Rise of Data Science era of data science

A
  • 2000s-2010s
  • With the increasing importance of data-driven decision making, the term “data science” gained prominence in the 2000s
  • In 2001, William S. Cleveland proposed to expand statistics to include advances in computing with data in his article, “Data Science: An Action Plan for Expanding the Technical Areas of the Field of Statistics”
  • In 2006, the launch of Hadoop, open-source software for storing data and running applications on clusters of commodity hardware, provided a significant boost to data storage and processing capabilities
158
Q

Describe the current trends in data science

A
  • 2010s-present
  • The era of “Big Data” has arrived
  • Data scientists are now vital assets in industries ranging from health care to finance, leveraging statistical and machine learning methods to extract insights from data
  • The explosion of machine-generated data, including IoT and social media data, has also led to the growth of real-time analytics and a need for advanced data processing techniques
159
Q

List 5 modern drivers of AI and data science

A
  • Cloud Computing
  • Mobile Technology and Social Media
  • Internet of Things (IoT)
  • Privacy Enhancing Technologies (PETs) and Blockchain
  • Computer Vision, AR/VR, and the Metaverse
160
Q

Describe how cloud computing is a modern driver of AI and data science

A
  • By offering on-demand, scalable computing resources, cloud technology has made high-powered computing accessible to everyone
161
Q

Describe how mobile technology and social media are a modern driver of AI and data science

A

The proliferation of smartphones and the rise of social media platforms have led to a data explosion, offering AI models a wealth of information to learn from

162
Q

Describe how IoT is a modern driver of AI and data science

A

IoT devices generate a massive amount of data, further feeding data-hungry AI models and contributing to the growth of data science

163
Q

Describe how PETs are a modern driver of AI and data science

A

PETs are emerging as a viable approach to addressing data security and privacy concerns, helping to ensure continued, responsible AI and data science growth

164
Q

Describe how blockchain is a modern driver of AI and data science

A

Blockchain technology was originally designed to provide an interface for secure financial transactions
- It can also enhance data privacy and security in certain contexts
- However, it is important to note that blockchain is not universally applicable to all data privacy and AI challenges

165
Q

Describe how computer vision, AR/VF and the metaverse are a modern driver of AI and data science

A

By enabling machines to understand the world through images and videos, computer vision opens doors to safer, more efficient and interactive human-machine interactions

166
Q

Describe how AR/VR is a modern driver of AI and data science

A
  • These technologies have had ups and downs and some periods of slow progress, but are now on a trajectory toward integration
  • They find applications in diverse fields, from gaming to therapy and medical contexts
  • The potential for steady expansion in these areas suggests a bright future for AR/VR technologies
167
Q

Describe how the metaverse is a modern driver of AI and data science

A
  • The metaverse is an ambitious concept, envisioning a shared virtual space where individuals interact, socialize, conduct business and explore other possibilities
  • While it holds immense promise, it is a vision that may be ahead of its time
  • Similar to early experiments with Google Glass, the metaverse may need another decade to fully materialize into something practical and widely accessible