Hosted by ALCTS Continuing Education. Elissah Becknell and Sarah Beth Weeks September 18, 2013

Transcription

1 Hosted by ALCTS Continuing Education Elissah Becknell and Sarah Beth Weeks September 18, 2013

2 Formerly known as Google Refine, Open Refine is a free open source tool for cleaning up large data sets. It can also be used to create linkages between metadata sets. Open Refine can match and merge messy data filled with random spaces, stray punctuation, typos, odd capitalization and more! It is a desktop application - you need to download and run it locally. You can find it here:

3 Situation: Wanted to examine publication info of books in our general collection to see if any would be candidates to add to our Nordic American Imprints in special collections. Problem: Hard to search and compare because publication info is not controlled:

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25 Using Open Refine we were able to reduce the 3230 unique values for city (260 a) to just For publishers (260 b) we went from unique names for publishers to approximately This project helped to identify over 2,000 candidates for our Nordic American Imprints collection. The controlled publishers, cities of publications and dates will be added to a local 9xx field for faceting in our future special collections discover tool. Users will be able to browse our Nordic American Imprints collection by publisher, city or state.

26 Our project was done primarily matching publisher names to their most common names in our own dataset. We did not have a list of preferred forms of publisher names to match against (and certainly not a list that would be available in as linked open data). Going forward, we would like to identify preferred names for Nordic American Publishers so that we can add them to our records and create controlled access points.

27 An explanation of the project!!!

28 Zines: a self publication, motivated by a desire for self expression, not for profit.

29 Developed for a special collection of zines in Halifax, Canada

30 Open Metadata Registry allows people and organizations to identify, declare or publish metadata schemas

31 Our working group rebuilt the Anchor Archive Subject Thesaurus in the Open Metadata Registry

32 Open Metadata Registry allows us to map relationships within the Subject Thesaurus Broader Narrower Preferred ( Alternative ) Scope Notes

33 Open Metadata Registry also helps make these metadata schemas linkable by creating a SKOS framework for controlled vocabularies or thesauri This is a SKOS file that you can download and save somewhere

34 Open Refine is a free open source tool for cleaning up large metadata sets. It can also be used to create linkages between metadata sets. freeyourmetadata.org has instructions for using Open Refine to clean up metadata and link it to other data sets.

35 Step 1: Place your metadata in Open Refine. Step 2: Make sure you have the RDF extension. This RDF extension

36 Step 3: Using the RDF extension, you set up a reconciliation service. I will need to use based on RDF file.

37 Name the reconciliation service Upload your SKOS file from Open Metadata Registry make sure you check SKOS in the label properties area

38 Step 4: Select the column you want to reconcile, and navigate to start reconciling I want to match my Subject Headings

39 Step 5: Select your newly created reconciliation service In my case, it s AAST (Anchor Archive Subject Thesaurus)

40 Step 6: Open Refine will reconcile your metadata with the linked data of your choice. If you have lots of metadata, this is the Go get some Coffee step

41 Step 7: Select the best matches The blue headings are linked to the Anchor Archive Subject Thesaurus in the Open Metadata Registry Links!!!

42 You can match a single subject heading at a time

43 Or you can match multiple similar cells at once

44

45

46

47

48

49

50

51

52 Browse the properties at:

53 Elissah Becknell Librarian & Instructor Minneapolis Community & Technical College Sarah Weeks Head of Technical Services St Olaf College