Hercules Dalianis DSV/KTH-Stockholm University Ph: /

Size: px

Start display at page:

Download "Hercules Dalianis DSV/KTH-Stockholm University Ph: /"

Corey O’Connor’
5 years ago
Views:

Hercules Dalianis DSV/KTH-Stockholm University email: hercules@dsv.su.

1 Hercules Dalianis DSV/KTH-Stockholm University Ph: / Text processing Text summarization Key word extraction Information retrieval Interpretation of search queries Clustering Parallel texts Statistics and synonyms 2 1

2 is the method where a computer summarizes a text. An extract from a longer original text. A text is given to the computer and it returns a non-redundant shorter text The technique has it s roots in the 60 s. With the Internet and the WWW it has been an awakening interest in summarization techniques. 3 Best summaries are on news texts Summaries of longer texts have low quality The found key words give though a good overview of the content of the text 4 2

http://www.dsv.su.se/~hercules/hdbookmarks.html http://www.ics.mq.edu.au/~swan/summarization/projects_full.

3 Microsoft Word has a summarizer for document Intelligent Miner for Text -Summarization tool IBM Inxight (XEROX) Corporum Summarizer- Cognit AS (Norway) Pertinence (France) 5 Copernic Summarizer Automated Text Summarization (SUMMARIST) Columbia Newsblaster OracleContext Safari web reader for Mac under Safari->Services 6 3

4 SweSum Text summarizer for ten languages Swedish, Danish, Norwegian, English, German, French, Italian, Spanish, Greek and Farsi Is freely available on the Internet

5 Stemming Search bok (book in English) obtain hits on böcker, boken, bokens. Search book obtain hits on book, books, book s, though not booking 20 percent better precision and recall on Swedish 40 percent better precision and recall on German 50 percent better precision and recall on Finish 9 Spelling support Search on bks and obtain hits on books. Search on Eriksson and obtain hits on Ericsson 10 percent spelling errors Text extract Clearly see the context around the search queries hits 10 5

6 Similar text, according to content, are grouped. New clusters can be created Scirus.com search Capital punishment Vivisimo search Capital punishment

7 for cross language information All law texts about EU are translated to the other 22 EU-languages, so called parallel texts. Acquis - The laws are translated by experts Word alignment techniques will create dictionaries 14 7

8 Swedish: 2006/796/EG: Rådets beslut av den 13 november 2006 om evenemanget Europeisk kulturhuvudstad år 2010 Rådets beslut av den 13 november 2006 om evenemanget Europeisk kulturhuvudstad år 2010 (2006/796/EG) EUROPEISKA UNIONENS RÅD HAR BESLUTAT FÖLJANDE med beaktande av fördraget om upprättandet av Europeiska gemenskapen, med beaktande av Europarlamentets och rådets beslut nr 1419/1999/EG av den 25 maj 1999 om att inrätta en gemenskapsåtgärd för evenemanget Europeisk kulturhuvudstad för åren 2005 till 2019 [1], särskilt artikel 2.3 och 2.4, med beaktande av den rapport från juryn från april 2006 som lagts fram för kommissionen, Europaparlamentet och rådet i enlighet med artikel 2.2 i beslut nr 1419/1999/EG, English: 2006/796/EC: Council Decision of 13 November 2006 on the European Capital of Culture event for the year 2010 Council Decision of 13 November 2006 on the European Capital of Culture event for the year 2010 (2006/796/EC) THE COUNCIL OF THE EUROPEAN UNION, Having regard to the Treaty establishing the European Community, Having regard to Decision No 1419/1999/EC of 25 May 1999 of the European Parliament and the Council establishing a Community action for the European Capital of Culture event for the years 2005 to 2019 [1], and in particular Articles 2 paragraph 3 and 4, thereof, Having regard to the Selection Panel report of April 2006 submitted to the Commission, the European Parliament and the Council in accordance with Article 2 paragraph 2 of Decision 1419/1999/EC, 15 Extract the several translations Alternative translations become synonyms drunk-driving => rattfylleri / rattonykterhet We are creating an English-Chinese law dictionary, using word alignment techniques. 16 8

9 Demand Human Language Technology Stemming Spelling support Text extracts Clustering Dictionaries => synonyms Statistics => related search queries 17 9

Background Other summarizers Techniques Future improvements Applications Evaluation

DSV-SU-KTH e-mail:hercules@kth.se 070-568 13 59 / 08-674 75 47 Background Other summarizers Techniques Future improvements Applications Evaluation 1 2 is the method where a computer summarizes a text.