Networking the Asian WordNet on WordNet Management System (WNMS)

Transcription

1 Networking the Asian WordNet on WordNet Management System (WNMS) Virach Sornlertlamvanich National Electronics and Computer Technology Center (NECTEC), Thailand, and Thai Computational Linguistics Laboratory (TCL), NICT, Thailand

2 Motivation Need of a computational ontology Implementation Quick start approach Reusability Less language resource Online collaborative environment Social networking Multilingual development Cross language web service Sharing Interoperability Evaluation Dissemination

3 Approaches Asian WordNet Development Translation approach Use of the existing bilingual dictionaries Synset assignment KUI for collaborative editing WNMS (WordNet Management System) Distributed WordNet service Service for cross language WordNet retrieval

4 Synset Assignment (CS=4) S 0 Accept the Synset that includes more than one English Equivalent with confidence score of 4. L 0 E 0 E 1 S 1 S 2 Example: L0: เป าหมาย E0: aim E1: target S0: purpose, intent, intention, aim, design S1: aim, object, objective, target S2: aim

5 Synset Assignment (CS=3) Accept the Synset that includes more than one English Equivalent from the synonym of the target language with confidence score of 3. S 0 L 0 E 0 L 1 E 1 S 1 S 2 Example: L0: จ อง L1: เพ งมอง Synonym E0: stare E1: gaze S0: stare S1: gaze, stare

6 Synset Assignment (CS=2) Accept the only Synset that includes the English Equivalent with confidence score of 2. L 0 E 0 S 0 Example: L0: ส ต แพทย E0: obstetrician S0: obstetrician, accoucheur

7 Synset Assignment (CS=1) Accept more than one Synset that includes each of the English Equivalent with confidence score of 1. L 0 S 0 E 0 S 1 E 1 Example: L0: ช อง S2 E0: hole E1: canal S0: hole, hollow S1: hole, trap, cakehole, maw, yap, gap S2: canal, duct, epithelial duct, channel

8 Asian WordNet Development Addition X-English Discussion X-English X-English Indonesian -English Lookup WN merged-wn AWN KUI GWN Thai-English X-English X-English X-English Correction Translation Voting Applications Dictionary Ontology CL-Search MT Summarization IE/IR.

9 KUI for AWN KUI (Knowledge Unifying Editor) In the initial stage, KUI was developed for collaborative editing to review and complete the translation. Advantage Suitable for building a community Disadvantages Translation is for word translation rather than sense translation Cannot show the relation between senses System is not fully distributed

10 WNMS for AWN WNMS (WordNet Management System) Sense based translation rather word based translation Show the relation between senses System is fully distributed connected through a standard Open API Collaborative editing tools based on KUI concept WMS for BalkaNet, GWC2004 WordNet Exploitation through a Distributed Network of Servers, I. D. Koutsoubos, and et. al.

11 WNMS (WordNet Management System)

12 Participation (Translate) Input a word to search Input a translated word, and select degree of confidence Input comment or memo if have Delete 2 1 3

13 Participation (Vote) Read the comment or memo 2 Vote vote up vote down 1

14 Distributed WordNet Service Distribute the WordNet service node Service node can be locally maintained Synset ID (or Synset Offset) is the key to link between nodes

15 Representation of Synset Translation

16 Types of Services sense Thai Sense (Get word translation by POS and SYNSET_OFFSET) Service URI : Service Name : sense Parameter : pos = PartOfSpeech {n,v,r,s}, synset_offset is an English Princeton WordNet v.3.0 offset, represented in 8 digits

17 Types of Services dictionary E-Dictionary (Get word translation by word entry) Service URI : Service Name : dictionary Parameter : type_of_dict = {en2th, th2en}, search_word is a word you want to search

18 Types of Services Auto complete (Get a list of words existing in WordNet by prefix auto completion) Service URI : Service Name : autocomplete Parameter : language = {en,th}, search_word is a word you want to get autocomplete (Result:limit 50 records found) WN-Browser (Browse WordNet and its semantic relations) Service URI : Service Name : browse Parameter : language = {en,th}, search_word is a word you want to get all semantic relations

19 Visualization of AWN ( English->Japanese Thai->English Thai->Indonesian Asian WordNet Function Visualization of Asian WordNet Cross language visualization 3 modes of visualization Progress (# of word) Thai Lao Japanese Korean Myanmar Indonesian Vietnamese Mongolian 2283 Bengali 1775 Sinhala 117 Collaboration TCL ADD members

20 Guideline in WordNet Translation Word entry must be translated into the appropriate WORD(s) by avoiding phrase and meaning explanation. Words in a Synset must be interchangeable.

21 Translational Issues There are many cases that a gloss need to be expressed in a phrase or explanation, especially in the case of technical terms and scientific vocabulary. Ex. Chaperon POS Synset Gloss Noun chaperon, chaperone one who accompanies and supervises a young woman or gatherings of young people Thai ผ ตามควบค มหญ งสาว These concepts are not general for Thai language

22 Translational Issues (cont.) A gloss can be expressed by two or more Thai words. These words have the core meaning but occur in different context. Should it be divided into more specific concept? Ex. Appear POS Verb Synset appear, come out Gloss be issued or published; "Did your latest book appear yet?"; "The new Woody Allen film hasn t come out yet Thai T1 = ต พ มพ ; T2 = ออกฉาย T1 occurs in the context of printed matter T2 occurs in the context of film or movie

23 AWN: A Platform for Collaboration

24 Current

25 AWN Partnership Hindi IITB (Indian Institute of Technology, Bombay), India Pushpak Bhattacharya Indonesian Japanese Lao BPPT (BADAN PENGKAJIAN DAN PENERAPAN TEKNOLOGI), Indonesia Hammam Riza NICT (National Institute of Information and Communications Technology), Japan Hitoshi Isahara Kou Kuroda Nanyang Technological University (NTU), Singapore Francis Bond NAST (National Authority of Science and Technology), Lao PDR Valaxay Dalaloy Mongolian NUM (National University of Mongolia), Mongolia Purev Jaimai

26 AWN Partnership Burmese Nepali Sinhala Thai MCF (Myanmar Computer Federation), Myanmar Myint Myint Than MPP (Madan Puraskar Pustakalaya), Nepal Laxmi Pd Khatiwada UCSC (University of Colombo School of Computing), Sri Lanka Ruvan Weerasinghe NECTEC (National Electronics and Computer Technology Center), Thailand TCL (Thai Computational Linguistics Laboratory), Thailand Virach Sornlertlamvanich Vietnamese VAST (Vietnamese Academy of Science and Technology), Vietnam Luong Chi Mai

27 Conclusion and Future Work Asian WordNet Community Language resource conversion and alignment Language technology sharing Collaborative development platform AWN and language technology web service Applications on digital heritage understanding etc. AsianWordnet Join us!