Introduction to Artificial Intelligence Flashcards
Course 2 / 10
What is AI?
- Anything that simulates human intelligence through computer systems,
- Utilises algorithms and data to function,
- Enables machines to perform tasks requiring human intelligence
How should you think of AI?
AI should be thought of as augmented intelligence. AI should not replace human experts but merely extend their capabilities by doing things that humans or machines could not do on their own.
What is innate intelligence?
Innate intelligence is the intelligence that governs every activity in our bodies. For example, this intelligence is what causes an oak tree to grow out of a little seed.
How does AI learn?
Machines are provided with the ability to examine and create machine learning models.
This is done in various ways such as supervised learning, unsupervised learning and reinforcement learning.
What can AI be described by?
Strength, breadth, and application.
What is weak or narrow AI?
This is AI that is applied to a specific domain. For example, language translators, self-driving cars, and recommendation engines.
Applied AI can perform specific tasks, but not learn new ones, making decisions based on programmed algorithms and training data.
What is strong or generalised AI?
This is AI that can interact and operate a wide variety of independent and unrelated tasks.
It can learn new tasks to solve new problems, and it does this by teaching itself new strategies.
Generalised intelligence is the combination of many AI strategies that learn from experience and can perform at a human level of intelligence.
What is Super AI or Conscious AI?
This is AI with human-level consciousness, which would require it to be self-aware.
Because we are not yet able to adequately define what consciousness is, it is unlikely we will be able to create Super AI in the near future.
How is AI multi-disciplinary?
- Computer Science and Electrical Engineering determine how AI is implemented in software and hardware.
- Mathematics and Statistics determine viable models and measure performance.
- Because AI is modelled on how the human brain works, psychology and linguistics play an essential role in understanding how AI might work.
- Philosophy provides guidance on ethical considerations and intelligence.
Artificial Intelligence vs. Generative AI (GenAI)
Artificial Intelligence is an augmented intelligence that helps experts scale their capabilities while machines handle time-consuming tasks such as recognising speech, playing games, and making decisions.
Generative AI, on the other hand, is an AI technique that can generate new and unique data ranging from images and music to texts and virtual worlds.
How does GenAI differ from conventional AI?
Conventional AI relies on predefined rules and patterns while GenAI uses deep learning techniques and relies on large datasets to generate new data.
Generative AI and LLM
Large Language Model (LLM) is a type of AI that uses deep learning techniques to process and generate natural language.
Generative AI can develop new and powerful LLM algorithms or architectures.
Generative AI can also incorporate LLM into a larger, more advanced AI system.
What are the benefits of Generative AI?
- Creativity and Innovation
- Cost and time savings
- Personalisation
- Scalability
- Robustness
- Exploration of new possibilities
What are some use cases for GenAI?
- Healthcare and precision medicine
- GenAI can identify genetic mutations
- Provide personalised treatment options
- Help doctors practice procedures and develop treatments
- Agriculture
- GenAI can optimise crop yields
- Develop new, more resistant crop varieties
- Biotechnology
- Generative AI can aid in the development of new drugs and therapies by:
- identifying potential drug targets
- simulating drug interactions
- forecasting drug efficacy
- Generative AI can aid in the development of new drugs and therapies by:
- Forensics
- Generative AI can help solve crimes by:
- analysing DNA evidence
- identifying suspects
- Generative AI can help solve crimes by:
- Environmental conservation
- Generative AI can support the protection of endangered species by:
- analysing genetic data and suggesting breeding and conservation strategies
- Generative AI can support the protection of endangered species by:
- Creative
- Generative AI can produce unique digital art, music, and video content for:
- advertising and marketing campaigns
- and generate soundtracks for films and video games
- Generative AI can produce unique digital art, music, and video content for:
- Gaming
- Generative AI can create interactive game worlds and
- generate new characters, levels, and objects in real-time
How does AI mean different things to different people?
For a video game designer, AI means affecting the way bots play or how the environment adapts to the player; whereas for a data scientist, AI is a way of exploring and classifying data to meet specific goals.
What is the reason we are able to talk to virtual assistants such as Alexa and Siri?
It is because of AI algorithms that learn by example. The natural language processing and natural language generation capabilities that come with AI aid our interactions with these virtual assistants so they can talk back to us.
How does Generative AI work?
It works by leveraging machine learning and deep learning techniques to learn patterns and generate original content
What does Generative AI do?
It enables applications to create, generate, and simulate new content
Name and describe different types of AI
The different types of AI include:
Diagnostic/descriptive AI: Focuses on assessing the correctness of behavior by analyzing historical data to understand what happened and why.
Predictive AI: Concerned with forecasting future outcomes based on historical and current data.
Prescriptive AI: Focuses on determining the optimal course of action by providing recommendations based on data analysis.
Generative/cognitive AI: Involved in producing various types of content, such as code, articles, images, and more.
Reactive AI: Designed to respond to specific inputs with predetermined responses.
Limited memory AI: Have the ability to use past experiences to inform current decisions.
Theory of Mind AI: Advanced type of AI that aims to understand human emotions, beliefs, and intentions.
Self-aware AI: Represents the most advanced form of AI, which has its own consciousness and self-awareness.
Narrow AI (Weak AI): Designed to perform a specific task or a limited range of tasks.
General AI (Strong AI): Can understand, learn, and apply knowledge across a wide range of tasks like human intelligence.
Diagnostic/descriptive AI
Diagnostic/descriptive AI
Diagnostic or descriptive AI focuses on assessing the correctness of behavior by analyzing historical data to understand what happened and why. This type of AI is instrumental in identifying patterns and trends, performing comparative analyses, and conducting root cause analyses.
Capabilities:
Scenario planning: Helps in creating different future scenarios based on historical data.
Pattern/trends recognition: Identifies recurring patterns and trends within data sets.
Comparative analysis: Compares various data points to find correlations and insights.
Root cause analysis: Determines the underlying reasons behind specific outcomes.
Predictive AI
Predictive AI
Predictive AI is concerned with forecasting future outcomes based on historical and current data. This type of AI is used extensively in predicting customer behavior, market trends, and other forward-looking insights.
Capabilities:
Forecasting: Predicts future trends and events.
Clustering and classification: Groups similar data points and classifies them into predefined categories.
Propensity model: Assesses the likelihood of specific outcomes based on current data.
Decision trees: Utilize a tree-like model of decisions to predict outcomes.
Prescriptive AI
Prescriptive AI
Prescriptive AI focuses on determining the optimal course of action by providing recommendations based on data analysis. It goes beyond prediction by suggesting actions that can help achieve desired outcomes.
Capabilities:
Personalization: Tailors recommendations and experiences to individual needs.
Optimization: Identifies the most efficient ways to achieve goals.
Fraud prevention: Detects and prevents fraudulent activities through analysis.
Next best action recommendation: Provides actionable insights on the next steps to take.
Generative/cognitive AI
Generative/cognitive AI
Generative or cognitive AI is involved in producing various types of content, such as code, articles, images, and more. This type of AI mimics human creativity and cognitive processes to automate and assist in content creation.
Capabilities:
Advises: Offers expert advice and recommendations.
Creates: Produces new content, such as text, images, and code.
Protects: Enhances security measures through intelligent analysis.
Assists: Provides assistance in various tasks, improving efficiency.
Automates: Automates repetitive tasks to save time and resources.
Reactive AI
Reactive AI
Reactive AI systems are designed to respond to specific inputs with predetermined responses. They do not have memory or the ability to learn from past experiences, making them suitable for tasks that require immediate reactions.
Capabilities:
Rule-based actions: Executes specific actions based on predefined rules.
Instant responses: Provides immediate responses to inputs.
Static data analysis: Analyzes current data without considering past interactions.
Limited memory AI
Limited memory AI:
Limited memory AI systems have the ability to use past experiences to inform current decisions. They can learn from historical data to improve their performance over time. This type of AI is commonly used in autonomous vehicles and recommendation systems.
Capabilities:
Learning from data: Uses historical data to make informed decisions.
Pattern recognition: Identifies patterns over time to improve accuracy.
Adaptive responses: Adapts responses based on previous interactions.
Theory of Mind AI
Theory of Mind AI:
Theory of Mind AI is an advanced type of AI that aims to understand human emotions, beliefs, and intentions. It is still in the research stage and seeks to interact more naturally with humans by comprehending their mental states.
Capabilities:
Emotion recognition: Identifies and responds to human emotions.
Social interaction: Engages in more natural and human-like interactions.
Intent prediction: Predicts human intentions based on context and behavior.
Self-aware AI
Self-aware AI:
Self-aware AI represents the most advanced form of AI, which has its own consciousness and self-awareness. This type of AI can understand and react to its own emotions and states. It remains a theoretical concept and has not yet been realized.
Capabilities:
Self-diagnosis: Evaluates its own performance and health.
Autonomous learning: Learns independently without human intervention.
Adaptive behavior: Adjusts behavior based on self-awareness.
Narrow AI (Weak AI)
Narrow AI (Weak AI):
Narrow AI is designed to perform a specific task or a limited range of tasks. It excels in a single area but lacks generalization capabilities. Most current AI applications fall under this category.
Capabilities:
Task specialization: Excels in performing specific tasks.
High accuracy: Achieves high performance in its designated area.
Efficiency: Operates efficiently within its scope of specialization.
General AI (Strong AI)
General AI (Strong AI):
General AI, like human intelligence, can understand, learn, and apply knowledge across a wide range of tasks. It can also transfer knowledge from one domain to another and adapt to new situations autonomously.
Capabilities:
Cross-domain learning: Applies knowledge across various domains.
Autonomous decision making: Makes decisions independently in diverse scenarios.
Human-like understanding: Understands and processes information similar to humans.
What are some known applications of GenAI?
- GPT-4
- ChatGPT
- Bard
- GitHub CoPilot
How do cognitive systems interpret the information they read?
Cognitive systems use processes similar to the decision-making process of humans to interpret and generate hypotheses about the information they read.
What do cognitive systems rely on to understand the intent and context of a user’s language?
Cognitive systems rely on natural language governed by rules of grammar, context, and culture.
How do cognitive computing systems differ from conventional computing systems?
They differ in that they can:
- Read and interpret unstructured data, understanding not just the meaning of words but also the intent and context in which they are used.
- Reason about problems in a way that humans reason and make decisions.
- Learn over time from their interactions with humans and keep getting smarter.
What are the differences between artificial intelligence, machine learning, deep learning and neural networks?
- artificial intelligence is a branch of computer science dealing with the simulation of intelligent behaviour
- machine learning is a subset of AI that uses computer algorithms to analyse data and make intelligent decisions based on what it has learned, without being explicitly programmed
- deep learning is a subset of machine learning that uses layered neural networks to simulate human decision-making
- neural networks in AI are a small collection of computing units (neurons) that take incoming data and learn to make decisions over time
What behaviours do AI systems seek to demonstrate?
People Love Reading Poems, Kids Pref Magic Marvels, Cats Sing Incredibly
They seek to demonstrate behaviours associated with human intelligence such as:
- planning
- learning
- reasoning
- problem-solving
- knowledge
- perception
- motion
- manipulation
- creativity
- social intelligence
What are some characteristics of machine learning algorithms
- machine learning algorithms are trained with large sets of data
- they learn from examples
- they do not follow rules-based algorithms
What enables machines to solve problems on their own?
Machine learning
What can deep learning algorithms do?
They can label and categorise information and identify patterns.
How does machine learning differ from traditional programming?
- In traditional programming, you have data and create algorithms in order to find answers.
- this algorithm will not change
- In machine learning, you already have the data and the answers and are using that information to create an algorithm.
- What you get at the end is a set of rules that determine what the machine learning model will be.
What does machine learning rely on?
Defining behavioural rules by examining and comparing large data sets to find common patterns.
What is supervised learning?
A type of machine learning where an algorithm is trained on human-labeled data. The more data you provide a supervised learning algorithm, the more precise it becomes in classifying new data.
What is unsupervised learning?
A type of machine learning that relies on giving the algorithm unlabelled data and letting it find patterns by itself. You provide the input, but not labels, and let the machine infer qualities.
What is reinforcement learning?
A type of machine learning that relies on providing a machine learning algorithm with a set of rules and constraints and letting it learn how to achieve its goals. You define the state, the desired goal, allowed actions, and constraints.
What is a machine learning model?
The algorithm used to find patterns in the data without the programmer having to explicitly program these patterns.
What are the three categories of supervised learning?
- Regression
- Classification
- Neural networks
How are regression models built?
By looking at the features - X and the result - Y, where Y is a continuous variable.
Essentially, regression estimates continuous values.
What do neural networks refer to?
Structures that imitate the structure of the human brain.
What is classification?
The process of predicting the class of given data points.
What does classification focus on?
It focuses on discrete values it identifies.
We can define discrete class labels - Y based on many input features - X.
What are some forms of classification?
- Decision trees
- Support vector machines
- Logistics regression
- Random forests
What are features?
Distinctive properties of input patterns that help in determining the output categories or classes of output.
What is the meaning of training, in an ML context?
It refers to using a learning algorithm to determine and develop the parameters of your model.
What do you typically do with data sets in machine learning?
You split them into 3 sets:
1. Training set
2. Validation set
3. Test set
What is the training set for?
It is for training the algorithm
What is the validation set for?
It is used to validate results and fine-tune the algorithm’s parameters
What is the test set for?
It is used to evaluate how good the model works on unseen data.
What does deep learning do?
It layers algorithms to create a neural network, an artificial representation of the structure and functionality of the brain
What does deep learning enable AI systems to do?
Continuously learn on the job and improve the quality and accuracy of results.
How are deep learning algorithms developed?
- Developers and engineers configure the number of layers and the type of functions that connect the outputs of each layer to the inputs of the next
Which older generation issue is fixed by deep learning, and how?
The efficiency and performance of older-generation machine learning algorithms plateau as the datasets grow. Deep learning algorithms plateau continue to improve as they are fed more data.
Which tasks has deep learning proved to be very efficient at?
- Image captioning
- Voice recognition
- Facial recognition
- Medical Imaging
What is the name of the process that neural networks use to learn?
Backpropagation.
How does backpropagation work?
- backpropagation uses a set of training data that match known inputs to desired outputs
- first, the inputs are plugged into the network, and outputs are determined
- then, an error function determines how far the given output is from the desired output
- finally, adjustments are made in order to reduce errors
What is a collection of neurons called?
A layer
What do layers do?
They take in an input and provide an output.
What do neural networks always have?
One input layer and one output layer. They will also have more than one hidden layer which simulates the type of activity that goes on in the human brain.
What do hidden layers do?
They take in a set of weighted inputs and produce an output through an activation function.
What do you call a neural network having more than one hidden layer?
A deep neural network.
What are the simplest and oldest types of neural networks?
Perceptrons.
What are perceptrons?
They are single-layered neural networks consisting of input nodes connected directly to an output node.
Input layers forward the input values to the next layer, by means of multiplying by a weight and summing the result.
What property to input and output nodes have?
Bias
What is bias?
A special type of weight that applies to a node after the other inputs are considered.
What determines how a node responds to its inputs?
An activation function.
How does an activation function work?
The function is run against the sum of the inputs and bias, and then the result is forwarded as an input.
What is a critical component to the success of a neural network?
The type of activation function chosen.
What are Convolutional Neural Networks (CNNs)?
They are multi-layered neural networks that take inspiration from the animal visual cortex.
Where are CNNs useful?
They are useful in applications such as image processing, video recognition, and natural language processing.
What is a convolution?
It is a mathematical operation where a function is applied to another function and the result is a mixture of the two functions.
What are convolutions good at?
They are good at detecting simple structures in an image and putting those simple features together to construct more complex features.
What are Recurrent Neural Networks?
Recurrent Neural Networks or RNNs are multi-layered neural networks that perform the same task for every element of a sequence, with prior outputs feeding subsequent stage inputs.
How are Recurrent Neural Networks recurrent?
They are recurrent because they perform the same task for every element of a sequence, with prior outputs feeding subsequent stage inputs.
What is the unique characteristic of Recurrent Neural Networks (RNNs) in handling sequence data?
RNNs make use of information in long sequences, each layer of the network representing the observation at a certain time.
How is input processed in a general neural network?
- an input is processed through a number of layers
- and an output is produced with an assumption that the two successive inputs are independent of each other, but that may not hold true in certain scenarios.
Give a scenario where a recurrent neural network would work better than a general neural network
- In a general neural network, output is produced with an assumption that the two successive inputs are independent of each other, but that may not hold true in certain scenarios
- For example, when we need to consider the context in which a word has been spoken, in such scenarios, dependence on previous observations has to be considered to produce the output.
- RNNs can make use of information in long sequences, each layer of the network representing the observation at a certain time.
What are the most common areas of AI?
- Natural Language Processing
- Speech
- Computer Vision
What is Natural Language Processing?
Natural Language Processing (NLP) is a subset of artificial intelligence that enables computers to understand the meaning of human language, including the intent and context of use.
What does speech-to-text enable machines to do?
It enables them to convert speech to text by identifying common patterns in the different pronunciations of a word, mapping new voice samples to corresponding words.
What does speech synthesis enable machines to do?
It enables machines to create natural-sounding voice models, including the voices of particular individuals.
What does Computer Vision enable machines to do?
It enables machines to identify and differentiate objects in images the same way humans do.
What AI application areas do self-driving cars use?
Self-driving cars utilise NLP, speech, and most importantly, computer vision.
What is the hot topic in AI?
How to use it responsibly
What are the five pillars of AI ethics?
- Explainability
- Transparency
- Robustness
- Privacy
- Fairness
What is important to remember about AI ethics?
That they are not a “one-and-done” activity. These ethics need to be considered throughout the entire AI lifecycle.
What does facial recognition do?
It simply detects a human face in an image.
What does facial authentication do?
It provides a one-to-one authentication matching a single face image to another single face image.
What does facial matching do?
It provides a one-to-many matching to uniquely identify an individual from a database of images.
What is an example of an AI use case that raises ethical concern?
Using facial recognition technology to scan individuals in crowds without consent
What raises AI ethical concerns in the workforce?
Bias could permeate AI in decision-making. It could make discriminatory decisions based on race, age, and gender, for example if care isn’t taken.
What is an ethical concern about AI on social media platforms?
Marketing on social media is dependent on data collected from users on those platforms - but its not always explicit what data has been collected or if users have even provided consent to have their data collected.
What makes AI ethics a socio-technical challenge?
AI is pervasive in all aspects of our daily lives, whether we realise it or not.
For example, we encounter AI every time we buy something using a credit card online, when we search something on the web, or when we post, like, or follow somebody on a social platform.
Besides technical tools, what else do you need to build trustworthy AI?
You need to utilise principles, guardrails, well-defined processes, and governance.
What does it mean to build an use AI ethically?
It means embedding AI ethics into the design and development of the AI lifecycle.
What are IBM’s three guiding principles for AI?
- The purpose of AI is to augment - not replace - human intelligence
- Data and insights belong to their creator
- New technology, including AI, must be transparent and explainable
What are the five pillars supporting IBM’s guiding principles?
- Transparency
- Explainability
- Fairness
- Robustness
- Privacy
How can organisations put AI ethics into action?
- The first step to building AI ethics is developing awareness and understanding
- The second step is to put into place a governance structure that works at scale
- The third step is operationalisation
- It is critical that every contributor in the organisation knows what they need to do to support AI ethics
What does the operationalisation of AI ethics mean?
It means having clarity around the principles and pillars of AI ethics.
What is AI ethics?
It is a multidisciplinary field that investigates how to maximise AI’s beneficial impacts while reducing risks and adverse impacts.
When is AI explainable?
When it can show how and why it arrived at a particular outcome or recommendation.
When is AI fair?
When it treats individuals or groups equitably.
When is AI robust?
When it can effectively handle exceptional conditions, like abnormal input or adversarial attacks.
When is AI transparent?
When appropriate information is shared with humans about how the AI system was designed and developed.
When is AI private?
When it is designed to prioritise and safeguard humans’ privacy and data rights.
What does bias in AI do?
It gives systematic advantages to certain groups or individuals
How can bias emerge in AI?
- AI is trained using decisions that human decision-makers have mad in the past
- These human decision-makers may have been implicitly or explicitly biased, and those biases may then may reflected in the training data
- The sampling of the data could also introduce bias (for example, through overrepresentation or underrepresentation)
- Bias can be introduced through the data processing stage
- The way that a problem is conceptualised can also introduce bias
What are some high-level actions that can help mitigate bias in AI?
- The first step is assembling diverse teams
- Search for high-quality data sets
- There are many possible technical approaches to mitigating bias
What is a regulation?
A government rule enforceable by law