Agricultural bibliographic data sharing & interoperability in China

Transcription

1 Agricultural bibliographic data sharing & interoperability in China Prof. Xuefu Zhang,Xian Guojian and Sun Wei Agricultural Information Institute of CAAS Asia Pacific Advanced Network Meeting, 29 Aug., 2017, Dalian

2 Contents OPEN DATA, LINKED DATA AND KOS OPEN CHINESE AGRICULTURAL DATA AS RESTFUL API CONCLUSIONS 2

3 OPEN DATA, LINKED DATA AND KOS Open data is data that anyone can access,use and share (both commercially and non-commercially). Linked Data defines a set of guidelines, best practices or patterns for exposing, publishing, sharing, and connecting pieces of data, information, and knowledge on the Semantic Web using URIs and RDF. If data resources were opened with linked data, they would be five-star open data 3

4 The knowledge organization systems (KOSs), such as thesauri, classifications, subject headings and ontologies, have abundant formalized concepts, well-structured and organized semantic relationships. What s more, many KOSs have been mapped and interlinked each other. So, KOSs could play more important roles in the practice of opening and linking data. 4

5 So, following the idea of open data, taking the semantic advantages of linked data and KOSs, we attempted to explore one way to index, open, interlink and interoperate Chinese data resource in the international and multilingual environment. 5

6 Contents OPEN DATA, LINKED DATA AND KOS OPEN CHINESE AGRICULTURAL DATA AS RESTFUL API CONCLUSIONS 6

7 Chinese Agricultural Sci-tech Documents Database Chinese Agricultural Sci-tech Documents Database (CASDD), as agricultural bibliographic/abstracts database in China developed by CAAS, has the largest number of records and the longest time span of documents. Covering over 1000 kinds of agricultural academic journals and other materials, over 6 million bibliographic records, in the fields of agronomy, horticulture, plant protection, soil sciences, animal husbandry, veterinary, agricultural engineering, agricultural products processing, agricultural economic, etc. 7

8 It is the most comprehensive, reliable and accessible information resources of agricultural science and technology information from research institutions, education and related departments. So, making this data shareable and open is very meaningful and helpful to other countries. 8

9 Architecture of CASDD RESTful API RESTful API is a flexible way to provide different kinds of applications with data formatted in a standard way. The CASDD RESTful API aims to provide a lightweight and high performance solution to expose the records of CASDD to the third party applications as open and linked data. 9

10 The Architecture of CASDD RESTfulAPI 10

11 The key points are we adopt the Apache Solr as the backend full-text search engine, and also integrate the compatible IKAnalyzer The Architecture and lucene-skos of plugins the API to realize the text analysis and semantic indexing based on KOSs (CAT, AGROVOC and their mapping results). 11

12 Chinese Agricultural Thesaurus (CAT) was developed by AII of CAAS, which containing more than 60,000 Chinese descriptors and non-descriptors, most have corresponding English The Architecture of the API translations, and also include over 130,000 semantic relationships(e.g. UF, BT, NT and RT) 12

13 AGROVOC is a well-known multilingual controlled vocabulary covering all areas of interest of the Food and Agriculture Organization (FAO) of the United Nations, which consists of over Figure 32,000 concepts 1 is the available Architecture in 27 languages of the (e.g. API Chinese, English, French and German), and has already been published as a linked data set. 13

14 The two thesauri have already been mapped in an Agricultural Ontology Service (AOS) project. In addition, we also map and align CAT to other well-known KOS such as NALT, EUROVOC and LCSH automatically mainly based on their preflabels or altlabels exact mapping. 14

15 As a W3C s standard, the Simple Knowledge Organization System (SKOS) aims to build a bridge between the world of KOSs and the linked data community Different lingual KOSs described, mapped and interlinked with SKOS standard can provide a framework rich in semantics, to effectively process, open and interoperate multilingual data, as CASDD records and other data could be indexed with one or more KOSs concepts or concept URIs. Figure 1 is the Architecture of the API 15

16 AGRIS is a global public database holds over 8 million bibliographic records largely enhanced with AGROVOC. It s also a mash-up web application that links the AGRIS knowledge to related Web resources using the Linked Open Data methodology to provide as much information as possible about a topic within the agricultural The Architecture domain. of CASDD RESTfulAPI 16

17 The API provides several ways for the third party applications (e.g. AGRIS) to access the records, such as query with Chinese and English keywords, AGROVOC and Chinese Agricultural Thesaurus (CAT) concepts and their HttpURIs, The Architecture authors, publication of CASDD year and RESTfulAPI so on. 17

18 The RESTful API we developed just provides an easy access point to open CASDD records. In order to broaden the data usage, we interlinked with AGRIS s multilingual records, through creating mashup widget (Data from CAAS- CASDD) The Architecture for the API in of lower CASDD right RESTfulAPI of the AGRIS website pages. 18

19 Experimental Results We integrated these tools to advance the multilingual and semantic search capabilities. When configure Solr s Schema.xml file, we use label-based term expansion (expansiontype="label") and expanded type(type="pref Alt Broader Narrower"). As the test case shows, if query CASDD with English term barley, the lucene-skos plugin will analyze, expand and reconstruct the query both from languages Figure and semantic 1 is the Architecture of the API relations aspects based on CAT, we can get Chinese records about and closely related with 大麦. 19

20 Linking CASDD Records with Box 20

21 Detail Info of a CASDD Record 21

22 More Related Records From CASDD 22

23 Contents OPEN DATA, LINKED DATA AND KOS OPEN CHINESE AGRICULTURAL DATA AS RESTFUL API CONCLUSIONS 23

24 CONCLUSIONS In the era of big data, science is increasingly data driven, and more and more data resources will be shared, opened and available across the whole world. Big data, linked open data and KOSs would be integral parts of the future web infrastructure. This research would be a useful reference for similar organizations to open, interlink and interoperate their own data with other data or systems worldwide in multilingual context. 24

25 Thanks for Your Attention! 25