#1 Flashcards
Computational Linguistics
the filed concerned with using automatic computational methods to analyze and synthesize natural languages (text,speech,gesture)
Phonology
the study of sounds of a language
ex.
pat vs bat
distinction between words “p” and “b”
corpus
a computer-readable collection of linguistic production
plural form of corpus
corpora!
key factor of corpora
representativeness
kinds of corpora
balanced/imbalanced
written/spoken
lexicon
set of all words and phrases in a language
ex. “dog”, “cat”
“I’m going to the gym”
synsets
a tree structure (WordNet)
organized in near-synonym sets
resnik similarity
two words are more similar the higher the info content of their lowest common subsume
ex. finch, penguin –> bird
lesk similarity
overlap of glosses, two words are more similar the higher the lexical overlap
ex. Cat: feline mammal usually having thick
Lion: large gregarious predatory feline
Cat and Lion have higher semantic similarity, share the word feline
characteristic of natural images
ambiguous
valid hyponym of Dog
shpiz
hypernym of Melon
Fruit
compositional semantics
studies how the meanings of words and phrases are combined
pragmatics
analyze how context influences meaning
How we can reduce language ambiguity
By redundancy ( narrow down the possible interpretations of a language)
characteristics of natural language
conventional
redundant
a set of related systems
subjected to change
context dependent
Goals of Natural languages
infer the component symbols
formalize the rules
combine atomic meanings
understand large proportions
produce complex sentences
segmentation
splitting the text/speech into symbols
morphology
study the structure of words, including how they are formed and related to other words
ex. “walked” - ed stands fro past tense of verbs
syntax
set of rules, principles and processes for combining symbols according to the structure
ex. The cat chased the mouse
- analyzing the sentence will be ( a subject, verb, object)
lexical semantics
deals with the meaning of morphemes and words
ex. “car” and “automobile” used in different context
lexicon
list of words enriched w some attributes
ex, words with concreteness ratings
thesaurus
lists words and phrases that are related in meaning
ex. synonyms /autonyms
“joyful”, “pleased”
diachronic analysis
studies how the language changes over time
