COCKPIT FP Citizens Collaboration and Co-Creation in Public Service Delivery. Deliverable D2.3. Classification Multi-lingual Corpus

Transcription

1 COCKPIT FP Citizens Collaboration and Co-Creation in Public Service Delivery Deliverable D2.3 Classification Multi-lingual Corpus Editor(s): Responsible Partner: Ilias Spais, Christos Georgousopoulos ATC, INTRASOFT International S.A. Status-Version: Final v0.4 Date: 30/06/2011 EC Distribution: Restricted to other programme participants (including the Commission Services) Page 1 of 7

2 Project Number: Project Title: FP COCKPIT Title of Deliverable: Classification Multi-lingual Corpus Date of Delivery to the EC: 30/06/2011 Workpackage responsible for the Deliverable: Editor(s): WP2 Citizens Opinion Mining and Deliberation Ilias Spais (ATC), Christos Georgousopoulos (INTRASOFT) Ivan Ficano (ENG), Federica Bettio (Venice), Contributor(s): Panagiotis Kokkinakos (NTUA), Vassilis Michalitsis (YPES), M.T. Smits (CiTilburg), Yéhia TAHER (UnTilburg) Reviewer(s): Nidhi Rajshree (IBM) Approved by: All Partners Abstract: This report forms a complementary documentation to the source code files that are delivered as part of this Deliverable which is of type Prototype. It briefly describes the domain specific sentiment analysis lexicon of which the COCKPIT Opinion Mining module is equipped with, to define the polarity on citizens opinions stored on the Web 2.0 database. Keyword List: sentiment analysis, opinion mining, adjective, Web 2.0 sources, lexicon, phrases, polarity Page 2 of 7

3 Document Description Document Revision History Version Date Modification Reason Modifications Introduced Modified by v0.1 20/06/2011 v0.2 28/06/2011 v0.3 28/06/2011 v0.4 30/06/2011 Documentation of the report that is accompanied to the source code files supplied in the context of this deliverable that is of type Prototype. Delivery of final version of source code files. Internal review of documentation and verification of supplied source code files. Provision of comments Preparation of final version. Address of reviewing comments and final formatting. ATC INTRASOFT, ATC IBM INTRASOFT Page 3 of 7

4 Table of Contents EXECUTIVE SUMMARY FILES THAT ARE DELIVERED GREEK PILOT CASE ITALIAN PILOT CASE DUTCH PILOT CASE... 7 Table of Figures FIGURE 1: TRAINING PROCESS... 6 Page 4 of 7

5 Executive Summary This is a supplemenatry document that describes all the material needed in order to produse the domain specific sentiment analysis lexicon of which the COCKPIT Opinion Mining (OM) module is eqquipped with. The lexicon constitutes the training corpus of COCKPIT s Opinion Mining (OM) module, and its primarily objective is to automatically classify citizen s opinions, which are expressed in Web 2.0 sources, into negative and postitive polarities. The creation and evaluation process of a domain-specific corpus along with the training of OM component, was initially based on a demo case scenario ( UK immigration ) that was organised before the production of the lexicons associated to the public services that will be piloted. Results and lessons learned from the UK immigration demo case scenario were documented in deliverable D2.2.0 Opinion-mining demonstration in Web 2.0 approach and formed the basis for further guidance and directions towards the realisation of the piloting use cases trainning corpus. According to the project s work plan, the COCKPIT OM module will be utilised in three different pilot cases. The selected public services set the basis for the classification multi-lingual training corpus material, and the respective partners followed the guidelines of D2.2.0 to produce the requested material. The lexicon of each piloting public service is composed of the following information expressed into the local language: a list of positive and negative words (adjectives) that are indicative for sentiment analysis (Basic lexicon), a list of positive and negative phrases (training data) from different data sources manually filtered for eliminating the subjective ones. The COCKPIT s OM module provides a Web tool that presents the crawled data to the experts of the domain. Based on the aforementioned lexicon, the Web tool classifies the stored opinions to positive and negative. It is up to the expert of the specific domain to accept/reject web tool s proposal. The outcome of this process, which is known as active learning, forms the COCKPIT s training corpus. An extract of the corpus is used to evaluate the output of the classification module. The selection of this evaluation set is performed manually by the experts with the help of the Web tool. The guidelines that describe the creation process of the associated corpus material may be found in Deliverable D2.2.0, where the use of those corpus as illustrated in figure 1, within the OM process is described in detail in Deliverable D2.1. Page 5 of 7

6 Figure 1: Training process 1 Files that are delivered A description on the files associated with the lexicons of each pilot case is provided in the following sub-sections. 1.1 Greek pilot case Public service selected: o GR01 - Access, extracts of insurance record in Social Security Organization. Sentiment analysis lexicon: o IKA-adjectives.xlsx. Polarity adjectives for the Greek public service. o IKA-polarity-phrases.xlsx. Polarity phrases for the Greek public service. All the files are included in the directory: o \Greek pilot case\classification multi-lingual corpus Page 6 of 7

7 Web tool for the classification of citizens opinions: o Italian pilot case Public service selected: o IT04 - Integration between Iris and GeoLP. Sentiment analysis lexicon: o IRIS-adjectives.xlsx. Polarity adjectives for the Italian public service. o IRIS-polarity-phrases.xlsx. Polarity phrases for the Italian public service. All the files are included in the directory: o \Italian pilot case \classification multi-lingual corpus Web tool for the classification of citizens opinions: o Dutch pilot case Public service selected: o NL05 - Werkplein Job intermediation. Sentiment analysis lexicon: o Werkplein-adjectives.xlsx. Polarity adjectives for the Dutch public service. o Werkplein-polarity-phrases.xlsx. Polarity phrases for the Dutch public service. All the files are included in the directory: o \Dutch pilot case \classification multi-lingual corpus Web tool for the classification of citizens opinions: o Page 7 of 7