WordNets and TEI-LEX. John P. McCrae, Thierry Declerck

Transcription

1 WordNets and TEI-LEX John P. McCrae, Thierry Declerck

2 Global WordNet Grid

3 Princeton WordNet 3. 0 EuroWord Net BalkaNet Multi WordNet Indo WordNet Open WordNet PT Asian WordNet Open Multilingual WordNet

4 Problems Different relations used Different definitions of synonymy (tight, loose) Anglo-saxon view of Princeton WordNet Updates to Princeton break all other wordnets Different interpretations of relations Different coverage 25 synsets shared from 117,677 (0%) - Open Multilingual WordNet (Bond) 4

5 Solution: CILI - Collaborative Interlingual Index All open source wordnets linked to a single ILI Merge of concepts across all languages Princeton WordNet versions linked to ILI Adaptable by the open source wordnet community. Available as LOD and downloadable with open source license: CC-BY, CC-BY-SA. 5

6 How to define a concept 1.A unique, permanent URI 2.A proper (!) English gloss 3.Linked to at least one other synset 6

7 Cross-lingual Mapping Professore Lehrer Teacher Lehrerin Professoressa 7

8 Interlingual Mapping Teacher Professore Lehrer i i Lehrerin Professoress a 8

9 WordNet LMF, JSON and RDF WordNet LMF is LMF-like XML format Converter/validator Is om or ph i c RDF/XML Turtle SPARQL A profile of OntoLex WordNet JSON is JSON-LD based representation 9

10 The GWN WordNet Formats

11 GlobalWordNet Structure LexicalResource Lexicon+ LexicalEntry+ Lemma Form* Sense* SenseRelation* Synset* Definition* SynsetRelation* 11

12 GlobalWordNet XML: Header <?xml version="1.0" encoding="utf-8"?> <!DOCTYPE LexicalResource SYSTEM XML Declaration " <LexicalResource xmlns:dc=" Root element Dublin Core Namespace DTD for validation 12

13 GlobalWordNet XML: The Lexicon ID, label, version <Lexicon id="example-en" label="example wordnet (English)" version="1.0" Author/ citation Language (ISO-639) language="en" citation="cili: the Collaborative..." license=" url=" dc:publisher="global Wordnet Association"> Dublin Core properties Homepage License 13

14 GlobalWordNet XML: Lexical Entries Unique ID <LexicalEntry id="w1"> <Lemma writtenform="paternal grandfather" Matches ID ofpartofspeech="n"/> a Synset element <Sense id="example-en-1-n-1" Part-ofspeech from fixed list synset="example-en-1-n"> <SenseRelation reltype="derivation" target="example-en n-1"/> </Sense> Fixed list of </LexicalEntry> relations Matches ID of a Sense element 14

15 GlobalWordNet XML: Synsets <Synset id="example-en n" ili="i90287" Interlingual Identifier partofspeech="n"> <Definition language="en"> the father of your father or mother (Optional) Language </Definition> <SynsetRelation reltype="hypernym" target="example-en n"/> </Synset> 15 Like sense relations but applies to all synset members

16 Beyond Princeton WordNet: Wikipedia Linking

17 Lexical vs. Encyclopedic Yellow (in a dictionary) Is a verb, noun and adjective Secondary synonyms: cowardly, warning (especially in soccer) Yellow (in an encyclopedia) A colour 2 books 8 Films or TV shows 4 songs A butterfly 17

18 Princeton WordNet Is a lexical resource with some encyclopedic information This information is quite biased to Anglo-Saxon, American and even North Eastern US context. Paterson, NJ, USA Pop: 147,000 In Princeton WordNet Kawasaki, Japan Pop: 1,500,000 Not In Princeton WordNet 18

19 Wikipedia Wikipedia is open and most-widely used encyclopedia Many lexical concepts are included, e.g., Play (activity) 19

20 Overlap between lexical and encyclopedic resources Lexical Resourc e Encyclopedic Resource 20

21 Linking between resource types Lexical Encyclopedic Gold-standard, manual linking 21

22 Matching Exact Match to Title Paris Paris sometimes placed in subfamily Trilliaceae Paris a town in northeastern Texas Paris (Greek mythology) the prince of Troy who... All but 77 (1.0%) synsets haveparis, at Texas least one candidate Average of 21.6 Wikipedia artcles per synset Paris (Mythology) Paris, capital of France the capital and largest city of France... WordNet Synsets Paris (Romeo and Juliet) Count Paris Title matches up to first comma Title matches except for parentheses Redirect from matching title Wikipedia Articles 22

23 Category Matches (based on Suchanek s YAGO) National Capital Paris, capital of France the capital and largest city of France... Prague, Praha, Czech capital the capital and largest city of the Czech Republic Category:Capitals in Europe Paris Prague 23

24 Length based matches Diana (Mythology) Diana Princess Diana Princess of Wales Lady Diana Frances Spencer i94915 Princess Diana (comics) Wonder Woman Princess of Wales Lady Diana Frances Spencer Diana, Princess of Wales Longer matching strings are less ambiguous 24

25 Ranking Category matches Hypernym synset Wikipedia Category InstanceArticle matches s(h,c) = Σ(i,a) P(h,c) σ(i,a) Length of string matching s to a σ(i,a) = l(i,a) - if (i,a) is unambiguous σ(i,a) = -β otherwise Shortness Penalty Fixed Ambiguity Penalty 25

26 WordNet-Wikipedia Mapping Manually checked linking of 7,687 synsets to Wikipedia available at ces 26

27 Beyond Princeton WordNet: Colloquial WordNet

28 Princeton WordNet Release Schedule Princeton WordNet is infrequently released Version 2.1: Mar 2005 Version 3.0: Dec 2006 Version 3.1: Nov 2012 (fewer synsets) 28

29 English 12 years ago Spreading Tweeting Exit 29

30 English Now Manspreading Tweeting Brexit 30

31 31