CARARE Training Workshops

Size: px

Start display at page:

Download "CARARE Training Workshops"

Solomon Peters
5 years ago
Views:

1 CARARE Training Workshops Stein Runar Bergheim Asplan Viak Internet as CARARE is funded by the European Commission's ICT Policy Support Programme

2 Introduction to Repox An OAI-PMH tool developed within the TEL/Europeana family by the Technical University of Lisbon CARARE is funded by the European Commission's ICT Policy Support Programme

3 Outline Common OAI-PMH implementation scenarios in data providers The REPOX system For data providers For service providers and aggregators REPOX current status and future releases CARARE is funded by the European Commission's ICT Policy Support Programme

4 Harvesting Hierarchy Pure Service Provider Harvester Europeana Data & Service Providers Repository / Harvester Athena aggregator Spain CARARE aggregator Sweden Pure Data Providers Repository Local local CARARE is funded by the European Commission's ICT Policy Support Programme

5 Three OAI-PMH Scenarios Library/Archive/Museum Management System OAI-module provided by the vendor In-house OAI-PMH server development Standalone OAI server CARARE is funded by the European Commission's ICT Policy Support Programme

6 Vendor System OAI- module provided by the vendor CARARE is funded by the European Commission's ICT Policy Support Programme

7 Homemade In-house OAI-PMH server development CARARE is funded by the European Commission's ICT Policy Support Programme

8 Standalone Standalone OAI-PMH server CARARE is funded by the European Commission's ICT Policy Support Programme

9 Standalone OAI-PMH server Implementing an procedure in the library to transfer the metadata records into the OAI-PMH server Exporting the metadata records In libraries, typically in ISO2709 or MarcXchange Execute the metadata conversion Generating xml records in TEL, ESE, DC, CARARE Import the records into the OAI-Server This process should be automated as much as possible Ideally fully automatic CARARE is funded by the European Commission's ICT Policy Support Programme

10 Standalone OAI-PMH server Advantages Very easy to deploy May take just a few hours Requires only free open source software No software development needed In some cases, the metadata crosswalks may require software development Disadvantages High maintenance in cases where metadata transfer can t be fully automated CARARE is funded by the European Commission's ICT Policy Support Programme

11 The REPOX system Currently being developed by the Technical University of Lisbon May be deployed as a standalone OAI-PMH server For data providers May be deployed as an OAI-PMH aggregator For service providers CARARE is funded by the European Commission's ICT Policy Support Programme

12 The REPOX system An open-source solution (all developed in JAVA) that can be installed locally and provide an OAI-PMH Server to the exterior Able to manage multiple internal data sources and export multiple collection sets REPOX reuses other open-source software CARARE is funded by the European Commission's ICT Policy Support Programme

13 REPOX for data providers Provide a standalone OAI-PMH server which may be deployed without software development Data import: Supports any XML metadata format Supports several variations of the ISO2709 standard Metadata crosswalks User interface to define the metadata crosswalks CARARE is funded by the European Commission's ICT Policy Support Programme

14 System Requirements For training workshop Oracle Virtual Box (w/windows XP) Java SE (JDK) 6.24 Repox Can also run on Linux and Unix servers Any Java SE 1.6+ enabled platform CARARE is funded by the European Commission's ICT Policy Support Programme

15 Alternative repository tools Many tools of varying scope, complexity and platforms Dspace Greenstone Fedora OAI-CAT Eprints.org PHP OAI Data Provider XMLFile v2.2 (flat files) PMH is a standard not a software! CARARE is funded by the European Commission's ICT Policy Support Programme

16 OAI-PMH & Repox Exercises CARARE is funded by the European Commission's ICT Policy Support Programme

17 Installing Oracle Virtual Box Creating a safe, portable playground for our OAI-PMH installation and configuration CARARE is funded by the European Commission's ICT Policy Support Programme

18 Downloading Virtual Box In this workshop we will use Windows as a joint platform but binaries exists for both Windows, OS X, Linux and Solaris

19 Step 1 Click Run After double-clicking the VirtualBox executable, the following screen may appear on Windows Vista and Windows 7.

20 Step 2 Click Next Click Next to start the installation.

21 Step 3 Note Location Click Next Leave the default selection, note the installation location and click Next to proceed.

22 Step 4 Click Next

23 Step 5 Click Next

24 Step 6 Click Install

25 Step 7 Patience!

26 Step 8 If a confirmation window appears, confirm that you want to perform the installation Confirmation!!!

27 Step 9 Patience!

28 Step 10 Check Start Click Finish

29 Step 11 Click New

30 Step 12 Click Next

31 Step 13 Any name Always XP!

32 Step 14 >= 512 MB

33 Step 15 Choose Use existing

34 Step 16 Click Finish

35 Step 17 Select Start Select box

36 Installing Java SE CARARE is funded by the European Commission's ICT Policy Support Programme

37 Downloading Java SE JDK Similarly as for Virtual Box, binaries exists for all platforms including both Windows, OS X, Linux and Solaris

38 Step 1 Open Folder All installation files have been placed in a folder on your desktop

39 Step 2 Open JDK... Wait until the installation starts it may take some time especially on slower/older machines

40 Step 3 Choose Run... Follow on-screen instructions...

41 Step 4 Choose Next Follow on-screen instructions...

42 Step 5 Notice location Choose Next Make no changes in this dialog window but notice where you install the software and choose next...

43 Step 6 Patience! Follow on-screen instructions...

44 Step 7 Notice location Click Next Follow on-screen instructions...

45 Step 8 Patience Follow on-screen instructions...

46 Step 9 Click Finish Follow on-screen instructions...

47 Installing Repox CARARE is funded by the European Commission's ICT Policy Support Programme

48 Download Repox Repox is written in Java and runs independent of operating system. Most recent version is as per 28th of March 2011

49 Step 1 Dbl Click REPOX Double-click the JAR-file to start installation of Repox

50 Step 2 Click Next Proceed to the next screen by clicking Next

51 Step 3 Click Next Proceed to the next screen by clicking Next

52 Step 4 Accept license Click Next Repox is distributed under the GNU L-GPL License, check the radiobutton to accept it and click Next

53 Step 5 Notice location Click Next Don t change the default values here but notice where you install Repox for future reference

54 Step 6 Click OK The program directory will be created for you. Press OK to accept and proceed

55 Step 7 Check all boxes Click Next Leave the default settings and click next to proceed. Sources are not strictly necessary but may be useful for advanced users.

56 Step 8!!! Click Next Note password The REPOX URN should be a unique namespace, e.g. urn:repox.yourdomain.com: Port number could be 80 if free...

57 Step 9 Patience Please wait while the installation proceeds

58 Step 10 Click Next Once the installation is completed, click Next to proceed.

59 Step 11 Patience Click Next This step may take some time for the service to be installed, verified and started. Please wait until completed.

60 Step 12 Click Next The final window will give you details on where you have installed your Repox and how you may access it.

61 Step 13 Success! Click Done Upon completion of the installer, the program will confirm whether it has been installed successfully.

62 Testing Repox First look at the OAI-PMH web services for an empty repository CARARE is funded by the European Commission's ICT Policy Support Programme

63 Step 1 Click here Open in your web browser to verify that your Repox installation is up and running

64 Step 2 Click on the link OAI-PMH Tests to activate the test interface which allows you to send requests to your OAI-PMH repository web service

65 Changing static properties CARARE is funded by the European Commission's ICT Policy Support Programme

66 Changes to installation Directory: C:\Program Files\repox\jetty\webapps\repox\ WEB-INF\classes Config files: oaicat.properties configuration.properties Edit the files using Word Pad Restart Jetty Server after editing Services > Jetty > Restart CARARE is funded by the European Commission's ICT Policy Support Programme

67 Creating a data provider CARARE is funded by the European Commission's ICT Policy Support Programme

68 Step 1 Click here From the Repox home screen, click Create next to Data Provider

69 Step 2 Click Submit Before being allowed to create a data provider, it is necessary to log in using the username/password you configured during installation

70 Step 3 Click Save The data provider is configured with only three simple metadata items. Country, Name and Description. None are critical to the operation.

71 Step 4 Tools Your data provider has now been successfully configured and you may proceed to create a data source or edit the values entered in Step 3

72 Creating a data source CARARE is funded by the European Commission's ICT Policy Support Programme

73 Step 1 Click here A Data Source belongs to a Data Provider. Choose the Data Provider name you created in the previous section.

74 Step 2 Click here To create the new Data Source, click the link as shown above

75 Step 3!!! Configure your Data Source as shown above. A yellow box indicates that you are free to change the value.

76 Step 4 Once successfully created, the key information about the Data Source and harvesting/export options will be shown on the screen.

77 Step 5 Click here Click the button Ingest Now and wait for seconds to allow the initial harvesting to complete

78 Step 6 Update Check progress by pressing update. Once the harvesting is complete, you can view the outcome of the operation in the Log Files section.

79 Step 7 Press back in browser The log file shows the progress of the import. In this example, chunks of 1000 records are imported at a time giving us records.

80 Step 8 Click ListSets Click OAI- PMH You can now test your Data Source by choosing OAI-PMH Tests. Click ListSets to see that your Data Source is available for harvesting.

81 Step 9 Click ListMetadata Formats OAI-PMH can transport many metadata formats, choose ListMetadataFormats to verify the name of your format.

82 Step 10 Click ListRecords View results here Add the values you identified in Steps 8, 9 to the web form and choose ListRecords. After some seconds, your XML will appear on the right.

83 Harvesting another repository CARARE is funded by the European Commission's ICT Policy Support Programme

84 Step 1 Choose Data Provider name Select the data provider for which you will create a new data source

85 Step 2 Choose Create Data Source Choose create Data Source (well known by now)

86 Step 3a: Murberget Choose OAI- PMH in the left sidebar Click after entering OAI- URL When done, click Save This time, instead of the default Folder choose OAI-PMH and enter the values as shown in the form above

87 Step 3b: Sogn og Fjordane Choose OAI- PMH in the left sidebar Click after entering OAI- URL When done, click Save Repeat Steps 1,2 Enter the values as shown in the form above.

88 Step 3c: your neighbour Choose OAI- PMH in the left sidebar After entering correct URL, click Check When done, click Save Repeat Steps 1,2 All values shown in angular brackets <value> can be entered by you

89 Step 4 Choose Ingest Now from Data Source Once you have configured all your data sources, go to the overview screen and press Ingest Now

90 Step 5 Click Update after some time Have patience, and press the update icon after some time to check the progress.

91 Step 6 Test your repository Once the harvesting is done, you may test your repository using the OAI- PMH Tests tab and the detailed specified in Steps 3a, b, c

Appendix REPOX User Manual

Appendix REPOX User Manual D5.3.1 Europeana OAI-PMH Infrastructure Documentation and final prototype co-funded by the European Union The project is co-funded by the European Union, through the econtentplus programme http://ec.europa.eu/econtentplus