Module 1 - chatbot and fundamentals

Question 1

A definite noun refers to a ____________ of a noun(s), while an indefinite noun refers to a of a noun(s)

Answer 1

A definite noun refers to a specific instance of a noun, while an indefinite noun refers to a general category of nouns

A women –> indefinite
thereafter,
The woman –> definite

Question 2

Phonetics and phonology:

Answer 2

how words are related to sounds that realize them

Question 3

Morphology:

Answer 3

how words are constructed from more basic meaning units

Question 4

Syntax:

Answer 4

how words can be put together to form correct utterances

What structural role each word plays in the sentence
What phrases are subparts of other phrases

Question 5

Lexical semantics:

Answer 5

what words mean

sole vs soul

Question 6

Compositional semantics:

Answer 6

how word meanings combine to form larger meanings

Question 7

Pragmatics:

Answer 7

how situation affects interpretation of utterance

Context matters

Question 8

Discourse structure:

Answer 8

how preceding utterances affects processing of next utterance

Friend 1: I’m hungry.
Friend 2: Let’s go to the Fuji Gardens. (restaurant)

Friend 1: It’s a beautiful day.
Friend 2: Let’s go to the Fuji Gardens.

Question 9

Morphology: How words are constructed from more basic units, called __________

Answer 9

How words are constructed from more basic units, called morphemes

adverb/adjective, pluralization, suffixes…

friend + ly = friendly
friend is the noun
suffic -ly turns it to an adjective (or for a verb, an adverb)

Question 10

Temporal Interpretation

a subset of Discourse

Answer 10

Understanding of time impacts your meaning of the sentence.

“Max fell. John pushed him”

him refers to Max; pushing happned before falling; the second sentence is an explanation for the first here.

Question 11

World Knowledge

a subset of discourse

Answer 11

What we know about the world and what we can assume our hearer
knows about the world is intimately tied to our ability to use language

I took the fugu from the plate and ate it.
refers to the dish made from fugu, not a live fugu fish.

Question 12

_ is a fundamental problem of computational linguistics. Resolving _ is a crucial goal.

Answer 12

ambiguity

Question 13

Normalization: Stemming is

Answer 13

the process of reducing a word to its stem/root word.

Question 14

Normalization: Lemmatization is

Answer 14

related to stemming, it reduces words to its cononical forms based on a word’s lemma. Dictionary form of the word.

better —> good

Question 15

Normalization: everything else

Answer 15

substitution and removal
- chars set to upper/lower
- remove numbers
- remove punctuation
- etc

Question 16

stop word removal

Answer 16

missed it

Question 17

Tokenization is

Answer 17

? single words basically

Question 18

POS tagging

Answer 18

Parts of Speech process of dtagging words in a sentince to a prtice POS based on its position in sentence and onctext or something like that

Question 19

N-grams are the combination of

Answer 19

multiple words used together.

used when we want to preserve sequence info in the doc, like what word is likely to follow a given one.

n- refers to number of words together e.g. bi-gram, tri-gram.

each individual word would be called a unigram. They dont’ contain any sequence ifo because each word taken individually.

Question 20

vectorization is

Answer 20

the process of converting text into numbers - machine readable.

Question 21

BOW

it is a method of __________

Answer 21

Bag of Words method for vectorization.

table iin lecture showed count of words in each sentence. it is missing the order of the words.

Question 22

Type of regular expression

Literals are

Answer 22

normal text characters

Question 23

Type of regular expression

Metacharacters are

Answer 23

characters that have special meanings in regex:

. & * + $ ? | \ ^ [ { (

Need escape character to use them literally.

Question 24

Use of metacharacter:

a.b

period

see regex101.com

Answer 24

wildcard, any character except a newline

matches acb or azb or a&b

Question 25

# Use of metacharacter: a*b | star ## Footnote see regex101.com

Answer 25

zero or more of the preceding character does not match a | matches b or aaab or ab

Question 26

# Use of metacharacter: a+b | plus

Answer 26

one or more of the preceding character | matches ab or aaaab

Question 27

# Use of metacharacter: a?b | question mark

Answer 27

preceding character is optional | matches b or ab or cab abb will match ab and b

Question 28

# Use of metacharacter: a{2,4}b | curly brace ## Footnote char{n,m}char

Answer 28

match the preceding character at least n times but not more than m times | If open-ended, will maatch the substring: example it will match aa*aaaab

Question 29

# Use of metacharacter: [ab] | square brace

Answer 29

match any single character present in the set inside of braces

Question 30

# Use of metacharacter: [^ab] | carat

Answer 30

negation, match anything but | matches x does not match a

Question 31

# Use of metacharacter: (abc) | parens

Answer 31

matches characters literally in order, case sensitive. | matches abc does not match acb does not match ABC

Question 32

# Use of metacharacter: a|A | pipe

Answer 32

or | matches both a and A

Question 33

# python regular expressions findall

Answer 33

returns a list containing all matches

Question 34

# python regular expressions Search/Match

Answer 34

Returns aMatch objectif there is a match anywhere in the string

Question 35

# python regular expressions split

Answer 35

Returns a list where the string has been split at each match

Question 36

# python regular expressions sub

Answer 36

Replaces one or many matches with a string

Question 37

FSA means

Answer 37

Finite State Automata AKA Automaton / Automata

Question 38

FSAs recognize ___________ represented by __________

Answer 38

FSAs recognize the **regular languages** represented by **regular expressions**

Question 39

what does q mean in an FSA

Answer 39

the states. Q is the set of states. q0 is the start state. qn is the final state.

Question 40

ε | epsilon, it's not sigma? check chapter 2

Answer 40

ε denotes the transition ε stands for the empty string (a string with no characters). In automata theory, epsilon transitions allow the automaton to move between states without reading any input symbol. Epsilon transitions are particularly useful in non-deterministic finite automata (NFAs).

Question 41

2 types of FSA

Answer 41

deterministic and non-deterministic

Question 42

deterministic FSA has how many transitions?

Answer 42

at most one transition (from each state)

Question 43

non-deterministic FSA has how many transitions?

Answer 43

a choice of several