Lesson 2 - The Turing Test and Searle's Chinese Room

Question 1

When did Turing propose his test?

Answer 1

1950

Question 2

How many electronic computers were in existence at the time Turing proposed his Turing Test?

Answer 2

4

Question 3

when was the Dartmouth Conference?

Answer 3

1956

Question 4

In which paper did Turing propose his Imitation Game?

Answer 4

Computing Machinery and Intelligence (1950)

Question 5

in his 1950 paper Computing Machinery and Intelligence, what question was Turing attempting to rephrase?

Answer 5

Can machines think?

Question 6

Who are the players in the imitation game?

Answer 6

A - a man, B - a woman, C - an interrogator of any gender

Question 7

alternative to having typed communication in the Imitation Game?

Answer 7

an intermediary

Question 8

which player would the machine take the role of?

Answer 8

player A (the deceptor)

Question 9

what is the specific question that replaces the old “Can machines think?”

Answer 9

will the interrogator decide wrongly as often when the game is played with a machine than as when he does when the game is played between a man and a woman?

Question 10

how does Turing regard the question “Can machines think?”

Answer 10

meaningless to discuss due to the ambiguity of the question

Question 11

What did Turing believe would happen in 50 years time?

Answer 11

it’ll be impossible for interrogators to make the correct distinction more than 70% of the time

Question 12

what is the computing capacity Turing predicts for the 2000s?

Answer 12

10^9

Question 13

what is Eugene Goostman

Answer 13

chatbot developed in St Petersburg by 3 Russian/Ukranian programmers to simulate a 13 year old Ukranian boy with EFL

Question 14

significance of the age of Eugene Goostman

Answer 14

not too old to know eveything but not too young to know nothing

Question 15

what happened with Goostman on the 60th anniversary of Turing’s death

Answer 15

claimed to have passed the Turing Test

Question 16

how many judges did Eugene fool after a 5 minute conversation?

Answer 16

10 out of 30

Question 17

what was important about the Loebner Competition

Answer 17

no computer had ever won the top prize for outright fooling the judges

Question 18

according to Daniel Bennett what was/wasn’t the Turing Test intended as?

Answer 18

WAS - a conversation stopper/a thought experiment
WASN’T - a platform for serious scientific research

Question 19

name of the 2023 study that used the online game to simulate the Imitiation Game

Answer 19

Human or Not? A Gamified Approach To The Turing Test

Question 20

how many participants in the first month of the May 2023 study

Answer 20

1.5 million

Question 21

how many guesses in the first month of the May 2023 study

Answer 21

10 million

Question 22

probability of a correct guess overall in the game for the May 2023 study

Answer 22

68%

Question 23

probability of a correct guess for the bot in the game for the May 2023 study

Answer 23

60%

Question 24

4 main objections to Turing’s Test

Answer 24

Theological , ‘Head in the Sand’, Argument from Conciousness, Lady Lovelace

Question 25

total # of objections that Turing had prepared in Computing Machinery and Intelligence

Answer 25

9

Question 26

Theological objection

Answer 26

thinking is a function of a man's immortal soul. God has given an immortal soul to every man and women but not to any other animal or to machines. Hence no animal or machine can think

Question 27

Turing's dismissal of the theological objection of the Imitation Game

Answer 27

it is entirely up to God whether or not a particular body is imbued with a thinking soul (perhaps He is waiting for an intelligent enough machine to give a soul to)

Question 28

The Head in the Sand Objection

Answer 28

the consequences of machines thinking would be too dreadful. Let us hope and believe that they cannot do so

Question 29

Turing's dismissal of the Head in the Sand Objection

Answer 29

the argument is insufficiently substantial. humans tend to believe they are superior to the rest of the creation

Question 30

The Argument from Consciousness is cited from who/where?

Answer 30

Professor Goeffrey Jefferson's Lister Oration for 1949

Question 31

The Argument from Consciousness

Answer 31

it's not until a machine can carry out actions based on its emotions (pleasure, grief, anger) not mere artificial signalling that we can conclude "machine equals brain"

Question 32

Turing's dismissal of the Argument from Consciousness

Answer 32

how can we tell that a machine that passes the Turing Test is not conscious? this risks falling into a solipsistic mode of thinking

Question 33

solipsism

Answer 33

the philosophy that only one's own mind can be known to exist

Question 34

Lady Lovelace's objection

Answer 34

"The Analytical Engine has no pretensions to originate anything. It can do whatever we know how to order it to perform"

Question 35

where does the most detailed information of Babbage's Analytical Engine come from?

Answer 35

a 1842 memoir by Lady Lovelace

Question 36

variants of Lady Lovelace's Objection

Answer 36

a machine can never do anything really new nor take us by surprise

Question 37

Turing's dismissal of Lady Lovelace's Objection (humans)

Answer 37

all creative acts can be seen as following from "seeds" planted from teaching - humans can never really do anything new either

Question 38

Turing's dismissal of Lady Lovelace's Objection (computers)

Answer 38

computers can surprise their programmers by producing answers that were not expected

Question 39

how many objections to the Turing Test did Copeland have?

Answer 39

4

Question 40

names of Copeland's 4 objections to the Turing Test

Answer 40

the Chimpanzee Objection, the Sense Organs objection, the simulation objection and the black box objection

Question 41

What sets Copeland's first objection apart from the other 3?

Answer 41

a negative outcome to the test would show nothing definite.

Question 42

The chimpanzee objection

Answer 42

if thinking animals can fail the Turing Test, then presumably, a thinking machine can too

Question 43

what does the chimpanzee objection imply about the relationship between the question "Can machines think?" and the Turing Test

Answer 43

the Test cannot completely replace that question

Question 44

Using terms of propositional logic, explain what the chimpanzee objection implies about the relationship between the question "Can machines think?" and the Turing Test

Answer 44

the Turing Test is not a necessary condition for thinking but might still be a sufficient one

Question 45

the sense organs objection

Answer 45

the Test only focuses on the computer's ability to use words, not of its ability to relate words to things in the world

Question 46

the sense organs objection implies that the Test is too...

Answer 46

weak

Question 47

how does the sense organs objection suggest that the Test can be improved?

Answer 47

give the machine sense organs such as a television eye

Question 48

Turing himself felt that the best way for a computer to be prepped for the Test is for it to do what?

Answer 48

have the best sense organs that money can buy and then subject it to an appropriate course of education

Question 49

the sense organ objection question whether verbal quizzing ...

Answer 49

is an adequate test of comprehension

Question 50

The Analytical engine was Turing Complete - true or false?

Answer 50

True

Question 51

the simulation objection

Answer 51

a computer that passes the Turing test has shown a good simulation of being a thinking entity but it is not the same as BEING a thinking entity

Question 52

simulation-1 type

Answer 52

the simulated object lack the essential features of the thing it is simulating (e.g. death, leather)

Question 53

simulation-2 type

Answer 53

the simulated objection is just like what is being simulated but produced in a different way (coal, voice)

Question 54

the black box objection

Answer 54

the intelligence of the machine is only concluding based on its output and not its inner workings

Question 55

why does Copeland refutes Turing's belief that we treat fellow humans as a black box?

Answer 55

our judgement is based on the fact of our biological similarity, not just an observation of their behaviour

Question 56

the two modifications Copeland would suggest for a machine to pass the Turing Test

Answer 56

outward and design criteria

Question 57

what would be the proposed outward criterion for the Turing Test

Answer 57

it passes the interrogation test

Question 58

what would be the proposed design criterion for the Turing Test

Answer 58

it passes a test to ensure the output is not just based on a giant lookup table or a pattern matching chatbot

Question 59

in what 2 ways could the deisgn criterion be met

Answer 59

if the machine works like a human. if the design is modular enough to extend to a robot with motor/sensory systems

Question 60

what is the key feature of creatures we are willing to deduce as "thinking"

Answer 60

their action-directing inner processes are massively adaptable

Question 61

intentional language

Answer 61

explaining/predicting an objects behaviour in terms of what it thinks/believes/wants

Question 62

have LLMs been doing well on reasoning tests

Answer 62

no

Question 63

who created the Abstration and Reasoning Corpus

Answer 63

Francois Chollet

Question 64

what is the Abstraction and Reasoning Corpus

Answer 64

a new kind of logic test for AI systems

Question 65

what is the main type of challenge proposed in the Abstraction and Reasoning Corpus

Answer 65

detect patterns in visual examples and apply them to new examples

Question 66

most researchers agree that the best way to test LLMs for abstract reasoning abilities and other signs of intelligence....

Answer 66

remains and open, unsolved problem

Question 67

other than reasoning, what other traits might we want to assess in AI

Answer 67

empathy, moral decision-making

Question 68

what thought experiment does Searle use to determine that the Strong AI Hypothesis cannot be true

Answer 68

Searle's Chinese Room Argument

Question 69

True or False: Searle claims the question (whether computers can think) is an empirical question?

Answer 69

FALSE

Question 70

what is an empirical question

Answer 70

one that can be settled by experiementation

Question 71

True or False: Searle claims his Chinese Room argument better settles the question than the Turing Test

Answer 71

True

Question 72

no amount of syntactic manipulation...

Answer 72

can lead to semantics

Question 73

what are arguments A and B for Searle's Chinese Room

Answer 73

A: the man doesn't know Chinese B: the room doesn't know Chinese

Question 74

a priori

Answer 74

knowledge independent of experience

Question 75

True or False: Searle's Chinese Room Argument is ignored by the AI community

Answer 75

True