Natural Language Processing

Question 1

tokenization

Answer 1

separating each instance (usually a relevant word) in a given character sequence usually the first part of nlp analysis

Question 2

part-of-speech (pos) tagging

Answer 2

assigning a word type (noun/verb/etc.) to a token

Question 3

dependency parsing

Answer 3

process of describing the relationship between tokens (subject/object/etc.), the grammatical structure of a sentence

‘rainy weather’ : weather is head, rainy is child, dependent

Question 4

lemmatization

Answer 4

extracting the base forms of a word or token

ex. base of was is be
ex. base of cats is cat

Question 5

sentence boundary detection (SBD)

Answer 5

finding and segmenting individual sentences

Question 6

named-entity-recognition (NER)

named entity identification

entity chunking

entity extraction

Answer 6

location and classify named entities (richmond) into a category (city)

Question 7

information extraction

Answer 7

automatically extracting structured information from unstructured or semi-structured data

Question 8

similarity

Answer 8

comparing documents to see how similar they are to each other

Question 9

text classification

Answer 9

assigning categorizes or labels to whole documents

Question 10

rule based matching

Answer 10

find words and phases in a document, as well as the tokens and their relationships