Lecture 4 Flashcards

1
Q

What is Syntax in NLP?

A

Syntax is the set of rules that dictates the structure of sentences in a language, determining how words and phrases are organized.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define a Morpheme.

A

A morpheme is the smallest unit of language with meaning, which cannot necessarily stand alone, like prefixes and suffixes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is a Lexeme?

A

A lexeme is an abstract unit of meaning representing a group of words with the same root and meaning, like “run,” “running,” “ran.”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the difference between Stemming and Lemmatization?

A

Stemming reduces a word to its stem form (e.g., “running” to “run”), while lemmatization reduces it to the dictionary form (lemma), taking context into account.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are Compound Words?

A

Compound words are formed by combining two or more roots, such as “blackbird” (closed compound) or “credit card” (open compound).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Name three Lexical Categories.

A

Nouns, Verbs, and Adjectives are three major lexical categories or word classes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is Part-of-Speech (POS) Tagging?

A

POS tagging assigns a lexical category to each word in a sentence, helping identify the role of each word (e.g., noun, verb).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Why is POS Tagging challenging?

A

POS tagging is challenging due to ambiguity, as some words can serve different roles (e.g., “run” as a verb or noun), requiring context to determine the correct tag.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a Constituent in syntax?

A

A constituent is a group of words that function together as a single unit within a hierarchical sentence structure, such as a noun phrase or verb phrase.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Name the five types of Phrases in syntax.

A

Noun Phrase (NP), Verb Phrase (VP), Adjective Phrase (AdjP), Adverb Phrase (AdvP), and Prepositional Phrase (PP).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are Phrase Structure Rules?

A

Phrase structure rules specify how phrases combine to form larger structures, like S → NP VP for sentence structure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Describe a Syntax Tree.

A

A syntax tree visually represents the hierarchical structure of a sentence, showing how words and phrases relate to each other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is Dependency Parsing?

A

Dependency parsing analyzes the syntactic structure of a sentence by identifying relationships between words, represented as directed arcs.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is a Context-Free Grammar (CFG)?

A

A CFG is a set of recursive rules used to generate sentences, where each rule expands a symbol regardless of its context.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

List three types of verbs based on Grammar Rules.

A

Intransitive (no object), Transitive (one object), and Ditransitive (two objects).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is Construction Grammar?

A

Construction Grammar views syntax and the lexicon as interconnected, treating both words and phrases as carriers of meaning without strict hierarchical structure.

17
Q

How do Language Models handle word sequences?

A

Language models assign probabilities to sequences, predicting likely words based on context and training data.

18
Q

Define Entropy in the context of language models.

A

Entropy measures the average amount of information or uncertainty in language, quantifying how much information each word conveys.

19
Q

What is Perplexity in evaluating language models?

A

Perplexity measures a model’s uncertainty in predicting a sequence; lower perplexity indicates better predictive accuracy.

20
Q

What is Structural Priming in language models?

A

Structural priming tests if exposure to specific syntactic structures affects a model’s predictions, indicating learned structural patterns.