NLTK python

Question 1

find occurrence of a word in context in text1

Answer 1

text1.concordance(“word”)

Question 2

find words that occur in a similar context to a word (spits out a list of words)

Answer 2

text1.concordance(“word”)

Question 3

explore contexts that are shared by 2 or more words in text1

Answer 3

text1.common_contexts([“worda”, “wordb”])

Question 4

determine the location of a word or set of words in text1

Answer 4

text1.dispersion_plot([“worda”, “wordb”, “wordc”])

Question 5

generate text in the style of text5

Answer 5

text5.generate() note nothing goes between ()

Question 6

find the length of text5

Answer 6

len(text5)

Question 7

find and display distinct words in a text

Answer 7

set(text)

Question 7

find and display a sorted list of the distinct types (punctuation), words, and word types (e.g. capitalized) of the text1

Answer 7

sorted(set(text1))

Question 7

calculate lexical richness of text1 (how often each word is used on avg)

Answer 7

> > > from __future__ import division

|&raquo_space;> len(text3) / len(set(text3))

Question 8

see how often a word occurs in text3

Answer 8

text3.count(“word”)

Question 8

see what percentage of text5 is taken up by a specific word

Answer 8

100 * text5.count(“word”) / len(text5)

Question 8

write a function for lexical diversity

Answer 8

> > > def lexical_diversity(text):

… return len(text) / len(set(text)

Question 9

write a function to find the percentage of text made up by a word

Answer 9

> > > def percentage(count, total):

… return 100 * count / total

Question 10

count the occurrences of a word in text1

Answer 10

text1.count(“word”)

Question 11

find the index where a the word first occurs in text4

Answer 11

text4.index(‘awaken’)

Question 12

print the first sentence in a body of text as a list

Answer 12

sent1

Question 13

get the length of sentence2

Answer 13

len(sent2)

Question 14

count the occurrences of a word in text1

Answer 14

text1.count(“word”)

Question 15

find the index where a the word first occurs in text4

Answer 15

text4.index(‘awaken’)