Lesson ? - Revision for Assessment 1 Flashcards
When was the Gestation and Birth Period of AI
Lesson 3
1943-1956
When were the Golden Early Years
1956-1969
When was the First AI winter?
1966-73
When was the rise of Knowledge-based and Expert Systems?
1969-89
When was the start of the rise of New paradigms
continuing until now
1986
When was the start of the birth of the Scientific Method, Big Data and Deep Learning?
Continuing until the present day
1987
what was Pitts-McCulloch’s paper about
the first description of a neural network
Marvin Minsky was a student of who?
Pitts and McCulloch
Who built the first neural net machine?
Marvin Minsky and Dean Edmonds
name of McCulloch-Pitts 1943 paper
A Logical Calculus of Ideas Immanent in Nervous Activity
1st work in AI
McCulloch Pitts 1943, A Logical Calculus of Ideas Immament in Nervous Activity
Who is credited with creating/popularising formal propositional logic
Russell and Whitehead
neurons
electrically excitable cells that process and transmit info through electrical and chemical signals
3 parts of the artificial neuron
Dendrite, Soma, Axon
phi is a ______ function
step-like
what is fed into a neuron
inputs with associated weights
what does the neuron do with the inputs and their associated weights
computes the weighted sum and passes it through a NON-LINEAR TRANSFER FUNCTION
McCulloch and Pitts showed that
all logical connectives/any computable function could be computed by a neural network
Donald Hebb
proposed an updating rule for modifying connection weights in artificial neurons allowing a network to be trained
Hebbian Learning
when neurons fire together, they adapt and form stronger connections with each other through repeated use
name and date of first neural net computer
SNARC, 1951
Who built the SNARC
Marvin Minsky and Dean Edmonds
SNARC was used to
model the behaviour of a rat in a maze searching for food
neural nets + GPUs =
deep learning
the 40 neurons in SNARC were simulated by
3000 vacuum tubes
Logic Theorist written by
Herbert Simon, Allen Newell, JC Shaw
Logic Theorist was called the first…
AI Program
Logic Theorist was created when?
1955-6
why was Logic Theorist labelled as the 1st AI program
the first program deliberated engineered to mimic the problem solving skills of a human
Simon, Newell and Shaw proved how many of Russell/Whitehead’s theorems?
38
Name of Russell and Whitehead’s paper
Principia Mathematica
How many theorems where in Whitehead and Russell’s Principia Mathematica
52
what did Shaw/Herbert/Newell do with the final of Whitehead/Russell’s theorems
create a shorter version
axiom
self-evident truth
Logic Theorist:
Given some… (APT)
Axioms (A), theorems previously proved (P) and a candidate theorem to prove
how many methods were applied by the Logic Theorist
4
the methods applied by the Logic Theorist
substitution, detachment, chaining forward, chaining backward
what is substitution (Logic Theorist)
change logic expression (e.g. T) into a logically equivalent one (e.g. axiom in A) by substition of varaibles/replacements of connectives
detachment is also known as
modus ponens
detachment in Logic Theorist
create sub-goals to prove expressions (e.g. S and S -> T in order to prove T)
chaining forward in Logic Theorist
subgoals : A -> C then A -> B and B-> C
chaining backward in Logic Theorist
subgoals: A -> C then B-> C and A -> B
3 new concepts introduced using logic theorist
reasoning as search, heuristics and list processing
reasoning as search
proof viewed as a search starting from a hypothesis root node
explain the mechanism of proof as defined by “reasoning as search”
expand the proof along different branches according to deductive rules and stopping when the proposition to be proved is obtained
heuristics (as introduced by Logic Theorist)
proof tree grows exponentially thus some branches need to be pruned using rules of thumb/heuristics to limit search space while (hopefully) not losing the path to the solution
List processing
the list processing programming language IPL
IPL
the list processing language implemented by the authors in Logic Theorist
IPL serves as the basis for which language
LISP
who created LISP
John McCarthy
at non-root nodes, state = ?
{hypothesis + derived propositions}
new states are obtained from old staets by…
applying deductive rules
objective of Dartmouth Conference (quote)
every aspect of learning/any other feature of intelligence can be so precisely described that a machine can simulate it
The Darmouth Conference wanted to make an attempt to find out how to make a machine do what 4 things? (LAPI)
use language, form abstractions/concepts, solve problems reserved for humans, improve themselves
which 4 researchers proposed the Conference
McCarthy, Minksy, Rochester, Shannon (John, Marvin, Nathaniel, Claude)
the Conference was attended by who else?
Solomonoff, Selfridge, More, Samuel, Simon and Newell (Ray, Oliver, Trenchard, Arthur, Herbert, Allen)
what is considered the birth point of AI
the Dartmouth Conference
the GEY was marked by
overoptimism
which 3 computer scientists were particularly overoptimistic
Simon, Newell and Minsky
who funded labs and which did they fund?
ARPA (Advanced Research Projects Agency) - Stanford, MIT
GPS
General Problem Solver
who created General Problem Solver and when?
1959 - Simon and Newell
the GPS was meant to reason…
in a human-like way to solve any formalised symbolic problem
means end analysis - aspect 1
given a current state and goal state, attempt to reduce differenec between the two
means end analysis - aspect 2
operations (from current state) + their outputs -> creates subgoals to reduce distance to overall goal as much as possible
when did Newell and Simon formulate the physical symbol system hypothesis
1976
what led to Newell and Simon formulating the physical symbol system hypothesis
success of GPS and related programs as models of cognition
physical symbol system hypothesis
a physical symbol system has the NECESSARY and SUFFICIENT means for general intelligent action
physical symbol system
takes symbols, combines them into expressions, and manipulates them to produce new expressions
the physical symbol system implies that…
any intelligent system must operate by manipulating symbols