sentiment_classifier Documentation

Transcription

1 sentiment_classifier Documentation Release 0.4 Pulkit Kathuria January 07, 2015

2

3 Contents 1 Overview 3 2 Online Demo 5 3 Sentiment Classifiers and Data 7 4 Requirements 9 5 How to Install 11 6 Documentation 13 7 Script Usage 15 8 Python Usage 17 9 Library Usage History Test Run Negative Review Positive review i

4 ii

5 sentiment_classifier Documentation, Release 0.4 pip install sentiment_classifier Home pypi package Github Try Online Contents 1

6 sentiment_classifier Documentation, Release Contents

7 CHAPTER 1 Overview Sentiment Classifier using Word Sense Disambiguation using wordnet and word occurance statistics from movie review corpus nltk. For twitter sentiment analysis bigrams are used as features on Naive Bayes and Maximum Entropy Classifier from the twitter data. Classifies into positive and negative labels. Next is use senses instead of tokens from the respective data. Download Stats Provided by pypi-github-stats 3

8 sentiment_classifier Documentation, Release Chapter 1. Overview

9 CHAPTER 2 Online Demo 5

10 sentiment_classifier Documentation, Release Chapter 2. Online Demo

11 CHAPTER 3 Sentiment Classifiers and Data The above online demo uses movie review corpus from nltk, twitter and Amazon,on which Naive Bayes classifier is trained. Classifier using WSD SentiWordNet is based on heuristics and uses WordNet and SentiWordNet. Test results on sentiment analysis on twitter and amazon customer reviews data & features used for NaiveBayes will be Github. 7

12 sentiment_classifier Documentation, Release Chapter 3. Sentiment Classifiers and Data

13 CHAPTER 4 Requirements In Version 0.5 all the following requirements are installed automatically. In case of troubles install those manually. You must have Python 2.6. NLTK installed. NumPy SentiWordNet 9

14 sentiment_classifier Documentation, Release Chapter 4. Requirements

15 CHAPTER 5 How to Install Shell command python setup.py install 11

16 sentiment_classifier Documentation, Release Chapter 5. How to Install

17 CHAPTER 6 Documentation Try Online 13

18 sentiment_classifier Documentation, Release Chapter 6. Documentation

19 CHAPTER 7 Script Usage Shell Commands: senti_classifier -c file/with/review.txt 15

20 sentiment_classifier Documentation, Release Chapter 7. Script Usage

21 CHAPTER 8 Python Usage Shell Commands cd sentiment_classifier/src/senti_classifier/ python senti_classifier.py -c reviews.txt 17

22 sentiment_classifier Documentation, Release Chapter 8. Python Usage

23 CHAPTER 9 Library Usage from senti_classifier import senti_classifier sentences = [ The movie was the worst movie, It was the worst acting by the actors ] pos_score, neg_score = senti_classifier.polarity_scores(sentences) print pos_score, neg_score from senti_classifier.senti_classifier import synsets_scores print synsets_scores[ peaceful.a.01 ][ pos ]

24 sentiment_classifier Documentation, Release Chapter 9. Library Usage

25 CHAPTER 10 History 0.5 No additional data required trained data is loaded automatically. Much faster/optimized than previous versions. 0.4 Added Bag of Words as a Feature as occurance statistics 0.3 Sentiment Classifier First app, Using WSD module 21

26 sentiment_classifier Documentation, Release Chapter 10. History

27 CHAPTER 11 Test Run 11.1 Negative Review This is quite possibly the worst movie ever made. Even my 4 year old hated it and wanted to leave. I was using it as an excuse to nap in air-conditioning. Alas, it was so bad that my daughter insisted we leave. Not really a surprise for a Steven Paul film, but I m saddened that Jon Voight s career has fallen so low...and Scott Baio??? ARGH! Believe me, I ve had to sit through some bad kid flix, but this one is an all time loser. There is a woman with very large lips (Vanessa Angel) who almost makes it bearable, just for the pure fascination of watching whether or not they will explode. However, my suggestion would be that all prints of this film be sent to President Bush so he can see how harmful his education budget cuts have been. Results bash$ senti_classifier -c reviews loading pickle... loading pickle successful Training Bag Of Words... Training Bag Of Words successful This is quite possibly the worst movie e... positive= 0.0 negative= Even my 4 year old hated it and wanted t... positive= negative= 0.25 I was using it as an excuse to nap in ai... positive= 0.25 negative= Alas, it was so bad that my daughter ins... positive= 0.0 negative= 0.75 Not really a surprise for a Steven Paul... positive= 0.25 negative= positive= 0 negative= 0... positive= 0 negative= 0 and Scott Baio??? ARGH! Believe me, I ve... positive= 0.0 negative= There is a woman with very large lips (V... positive= 1.25 negative= However, my suggestion would be that all... positive= negative= positive= 0 negative= TOTAL POSITIVE= 2.5 NEGATIVE= reviews is NEGATIVE with score Positive review As for the spectacle of the battle and showdowns, while not at the scale of Lord of the Rings, I honestly cant think how it could have been done better as the film makers have intertwined heart stopping action with dramatic progressions in the narrative. Its actually more visceral and dynamic than the rather smaller scale battle of the brilliant novels (not to take anything away from Rowling s writing). Do I have any gripes? Yes I do. Although I applaud Steve Kloves 23

28 sentiment_classifier Documentation, Release 0.4 for a difficult screenplay adaption...i think he could still have done better at explaining some odd anomalies that only readers of the book will understand. This might annoy you if you haven t read the books. But its a small gripe because what we get is delightful. What an amazing achievement to faithfully bring Rowling s epic saga to the big screen with the same cast and largely the same crew, maintaining the brilliant quality right to the end. Results bash$ senti_classifier -c reviews loading pickle... loading pickle successful Training Bag Of Words... Training Bag Of Words successful As for the spectacle of the battle and s... positive= 1.0 negative= 0.5 Its actually more visceral and dynamic t... positive= 2.0 negative= positive= 0 negative= 0 Do I have any gripes? Yes I do... positive= 0 negative= 0.5 Although I applaud Steve Kloves for a di... positive= 0.0 negative= positive= 0 negative= 0... positive= 0 negative= 0 I think he could still have done better... positive= negative= 0.25 This might annoy you if you haven t read... positive= 0.0 negative= 0.5 But its a small gripe because what we ge... positive= 0.75 negative= positive= 0 negative= 0 What an amazing achievement to faithfull... positive= negative= positive= 0 negative= TOTAL POSITIVE= 6.5 NEGATIVE= reviews is POSITIVE with score Chapter 11. Test Run