ARTICLE EXTRACTOR. Manual. Page 1 of 8. Manual. Tel & Fax: Web:

Transcription

1 Page 1 of 8 ARTICLE EXTRACTOR Sede opertiva: Piazza Vermicelli Rende (CS), Italy

2 Page 2 of 8 TABLE OF CONTENTS 1 APP documentation HOW IT WORKS Input data Output data Basic workflow example API documentation... 7

3 Page 3 of 8 1 APP DOCUMENTATION 1.1 HOW IT WORKS This APP allows to process a given article published on the web and to get semi-structured article metadata that can be stored in a database or processed using another APP. For example, if you process the following article of "El Pais" online newspaper (see Figure 1 - Example of a newspaper article to extract data. this service returns for this article the following structured data:

4 Page 4 of 8 Figure 2 - Example of returned structured data.

5 Page 5 of INPUT DATA This APP get urls of newspaper articles or any other type of web page containing a single article, as shown in the figure below (it takes urls field from a previous APP like News Extractor or Link Extractor). Figure 3 url field. This input data returns for the specified article some metadata such as the Title, Image, Text, 1.3 OUTPUT DATA This APP gives the following elements: a) Abstract: the abstract of the article. b) BodyArticle: text of the article. c) Image: image url of this article. d) Link: article url. e) Title: subtitle of the article. f) TitleArticle: title of the article. This set of elements is given back in an excel spreadsheet or a data cube whose metadata depend on the data extracted and presented in the output. You can see an example of output data in the following figure: Figure 4 - An example of output data. In this example the APP shows the metadata of an article about Ukraine published on El Pais online newspaper.

6 Page 6 of BASIC WORKFLOW EXAMPLE Article Extractor needs some APP before in the workflow that returns one or more article url, so you can create a simple flow, set input parameter and watch the results by the watcher button as shown in the following figures: Figure 5 - Simple article-extractor example. Figure 6 - The watcher panel.

7 Page 7 of 8 2 API DOCUMENTATION The Article Extractor API service allows to extract a collection of metadata (Title, Authors, ) related to an article and compliant with the given input parameter. The service provides in output a JSON object containing some output data. To consume the Article Extractor API, you will only need to perform a HTTP POST request on the following endpoint: sending following arguments in a JSON message: Arguments datakey url Description Specify: - The idapp of the previous APP in the contextual processing workflow. - Null if a previous APP in the contextual processing workflow doesn t exist. You can specify the url for an article. The following example illustrates the service request and response in JSON format: Request: { "datakey":"idapp of the previous APP in the workflow or null value", "url":"type the url of the single article you want to process" } Note: Use 'application/json' as header ContentType Response: {"result":{"@datakey":"idapp, a result could be for example 81f bf-11e3-8cb0-2cd05a939bb6 ","@error":"error messages or blank string"}} If you want to examine the results extracted from the query (data are stored in the database), you must include in the contextual processing workflow the APP to Excel, which will generate an excel file that contains the data resulting from the query performed. You can see the WADL to the following address: * Note: domain name and port values will be provided with the contract of the service.

8 Page 8 of 8 For more information about how to use Article Extractor API in your application, send us a message to info@altiliagroup.com.