W06 Sentiment Analysis Flashcards
Sentiment Analysis offers…
…direct insights on the firm’s relationship to (potential) customers
What is new in algorithm-aided sentiment analysis?
1 automated analysis
2 large amounts of text data
3 collected over the web
4 with objective predictive power
Where to find data for sentiment analysis?
traditional. ..?
new. …?
traditional:
surveys, interviews, written complaints
+structured , targeted
- limited responses, sugar-coated, too negative
new: harvesting social networks \+ free expression in large quantities -not structured -difficult to control -probably biased
Sampling Terminology:
- complete set of elements we study
- collecting data from every population member?
- collecting data from every population member voluntarily?
- subset of members selected from population…must be?
- population
- census
- referendum
- sample subset
- > same characteristics
- > to make inferences about population
- > “well selected” to “well represent”
Bias(sed sample)
positive or negative
misleading results
consider for different channels
negativity bias
Web Scraping
Extracting Sentiments from Online Sources
Python or Crapy
Efficiency dependent on search patterns
Ethically and legally “grey” area
Parts of an Opinion
1 Entity 2 Aspect 3 Sentiment 4 Owner 5 Date
Sentiment Analysis via supervised learning
-supervised learning
-score function
p(w I good) - p(w I bad)
/p(w I good) + p(w I bad)
-lexicon domain specific 1 score for word 2 score for switching words 3 score for contradictions 4 aggregate and weight