Chinese Agricultural Thesaurus and its application on data sharing & interoperability

Transcription

1 Chinese Agricultural Thesaurus and its application on data sharing & interoperability Prof. Xuefu Zhang,Xian Guojian and Sun Wei Agricultural Information Institute of CAAS Asia Pacific Advanced Network Meeting, 28 March, 2018, Singapore

2 Contents Chinese Agricultural Thesaurus Application in Chinese Agricultural Sci-tech Documents Database Application in CGRIS germplasm database CONCLUSIONS 2

3 Chinese Agricultural Thesaurus Chinese Agricultural Thesaurus (CAT) is the largest agricultural domain thesaurus in China. Covers areas including Agriculture, Forestry, Biology, etc. Organized in 40 Main Categories Contains more than 63 thousands concepts and most of them have English translation. Includes more than 130 thousands Use, UF, BT, NT and RT relationships. 3

4 4 CAT in SKOS and SKOS-XL

5 Mapping CAT to Other KOS LCSH AGROVOC NALT EUROVOC CAT 5

6 CAT Mapping to Other KOS Mapping at Concept Instance Level KOS Conceps Count exactmatch Match Scope AGROVOC 或 EUROVOC NALT 或 LCSH

7 Convert and Publish CAT as Linked Open Data Converting Tool RDF of CAT 7

8 Convert and Publish CAT as Linked Open Data Linked Open Data of CAT Concept:Rice SPARQL Query Endpoint of CAT 8

9 Contents Chinese Agricultural Thesaurus Application in Chinese Agricultural Sci-tech Documents Database Application in CGRIS germplasm database CONCLUSIONS 9

10 Chinese Agricultural Sci-tech Documents Database Chinese Agricultural Sci-tech Documents Database (CASDD), as agricultural bibliographic/abstracts database in China developed by CAAS, has the largest number of records and the longest time span of documents. Covering over 1000 kinds of agricultural academic journals and other materials, over 6 million bibliographic records, in the fields of agronomy, horticulture, plant protection, soil sciences, animal husbandry, veterinary, agricultural engineering, agricultural products processing, agricultural economic, etc. 10

11 It is the most comprehensive, reliable and accessible information resources of agricultural science and technology information from research institutions, education and related departments. So, making this data shareable and open is very meaningful and helpful to other countries. 11

12 Architecture of CASDD RESTful API RESTful API is a flexible way to provide different kinds of applications with data formatted in a standard way. The CASDD RESTful API aims to provide a lightweight and high performance solution to expose the records of CASDD to the third party applications as open and linked data. 12

13 The Architecture of CASDD RESTfulAPI 13

14 The key points are we adopt the Apache Solr as the backend full-text search engine, and also integrate the compatible IKAnalyzer The Architecture and lucene-skos of plugins the API to realize the text analysis and semantic indexing based on KOSs (CAT, AGROVOC and their mapping results). 14

15 The Architecture of the API 15

16 AGROVOC is a well-known multilingual controlled vocabulary covering all areas of interest of the Food and Agriculture Organization (FAO) of the United Nations, which consists of over Figure 32,000 concepts 1 is the available Architecture in 27 languages of the (e.g. API Chinese, English, French and German), and has already been published as a linked data set. 16

17 As a W3C s standard, the Simple Knowledge Organization System (SKOS) aims to build a bridge between the world of KOSs and the linked data community Different lingual KOSs described, mapped and interlinked with SKOS standard can provide a framework rich in semantics, to effectively process, open and interoperate multilingual data, as CASDD records and other data could be indexed with one or more KOSs concepts or concept URIs. Figure 1 is the Architecture of the API 17

18 AGRIS is a global public database holds over 8 million bibliographic records largely enhanced with AGROVOC. It s also a mash-up web application that links the AGRIS knowledge to related Web resources using the Linked Open Data methodology to provide as much information as possible about a topic within the agricultural The Architecture domain. of CASDD RESTfulAPI 18

19 The API provides several ways for the third party applications (e.g. AGRIS) to access the records, such as query with Chinese and English keywords, AGROVOC and Chinese Agricultural Thesaurus (CAT) concepts and their HttpURIs, The Architecture authors, publication of CASDD year and RESTfulAPI so on. 19

20 The RESTful API we developed just provides an easy access point to open CASDD records. In order to broaden the data usage, we interlinked with AGRIS s multilingual records, through creating mashup widget (Data from CAAS- CASDD) The Architecture for the API in of lower CASDD right RESTfulAPI of the AGRIS website pages. 20

21 Experimental Results We integrated these tools to advance the multilingual and semantic search capabilities. When configure Solr s Schema.xml file, we use label-based term expansion (expansiontype="label") and expanded type(type="pref Alt Broader Narrower"). if query CASDD with English term barley, the lucene-skos plugin will analyze, expand Figure and reconstruct 1 is the the Architecture query both from of languages the API and semantic relations aspects based on CAT, we can get Chinese records about and closely related with 大麦. 21

22 Linking CASDD Records with Box 22

23 Detail Info of a CASDD Record 23

24 More Related Records From CASDD 24

25 Contents Chinese Agricultural Thesaurus Application in Chinese Agricultural Sci-tech Documents Database Application in CGRIS germplasm database CONCLUSIONS 25

26 Germplasm Data of CGRIS CGRIS germplasm database is a central repository for all type of plant genetic resources information in China. At present, there are over 4000 MB data on 200 kinds of crops, 410,000 accessions of germplasm stored in CGRIS. 26

27 The Germplasm Restful API (Architecture) Third Part Application Redirect to Detail CGRIS Website AGROVOC Preflabel2URI Mapping Accessing & Linking CGRIS Germplasm Restful API CAT Container Reading Only Tomcat (Jersey API) CGRIS Germplasm Database

28 CGRIS Germplasm Mashup 28

29 Contents Chinese Agricultural Thesaurus Application in Chinese Agricultural Sci-tech Documents Database Application in CGRIS germplasm database CONCLUSIONS 29

30 CONCLUSIONS science is increasingly data driven, and more and more data resources will be opened, available and shared. Big data, linked open data and KOSs would be integral parts of the future web infrastructure. Our work would be a useful reference for similar organizations to open, interlink and interoperate their own data with other data or systems worldwide in multilingual context. 30

31 Thanks for Your Attention! 31