Outline of the course
|
|
- Marvin Carroll
- 6 years ago
- Views:
Transcription
1 Outline of the course Introduction to Digital Libraries (15%) Description of Information (30%) Access to Information (30%) User Services (10%) Additional topics (15%) Buliding of a (small) digital library Reference material: Ian Witten, David Bainbridge, David Nichols, How to build a Digital Library, Morgan Kaufmann, 2010, ISBN (Second edition) The Web FUB Vittore Casarosa Digital Libraries Part 6-1
2 Where are we Digital Libraries Description of information Metadata MARC Dublin Core MODS METS TEI EAD... Knowledge Representation FRBR RDF Interoperability FUB Vittore Casarosa Digital Libraries Part 6-2
3 Interoperability Interoperability is the ability of systems, services and organisations to work together seamlessly toward common or diverse goals. In the technical arena it is supported by open standards for communication between systems and for description of resources and collections, among others. Interoperability is of paramount relevance in the context of resource discovery and access. FUB Vittore Casarosa Digital Libraries Part 6-3
4 Interoperability in digital libraries (1/2) Interoperability between vendors Different databases and user interfaces Interoperability between different organisations Eg. using different library formats Interoperability between groups of users Eg. Public libraries/academic libraries Eg. libraries in different countries Interoperability between communities Eg. libraries, publishers, archives, museums Interoperability across time Preservation FUB Vittore Casarosa Digital Libraries Part 6-4
5 Interoperability in digital libraries (2/2) Traditional libraries interoperability Union catalogs (OPACs) Interlibrary loan Digital libraries interoperability Documents (digital objects, resources) Metadata Conceptual models Protocols Z39.50 OAI-PMH Queries Z39.50 queries (Type 1, Z39.58, CQL) SRU, SRW SPARQL FUB Vittore Casarosa Digital Libraries Part 6-5
6 Z39.50 "Information Retrieval (Z39.50); Application Service Definition and Protocol Specification, ANSI/NISO Z " Developed by NISO (National Information Standards Organization), the standards development organization serving libraries, publishing and dinformation services NISO was (is) the Z39 Committee of ANSI (American National Standards Institute), and Z39.50 was the 50th standard defined by NISO Current version (Version 3) was adopted in 1995, superceding earlier versions adopted in 1992 and 1988 (1984 version was rejected) Another revision, initiated in 2001, is still work in progress Z39.50 was heavily influenced by OSI, and was an application layer protocol that needed a full-duplex reliable OSI connection In Version 3 it runs over TCP/IP It is a wide ranging protocol for information retrieval between a client and a database server, which attempts to standardize shared semantic knowledge FUB Vittore Casarosa Digital Libraries Part 6-6
7 FUB Vittore Casarosa Digital Libraries Part 6-7
8 FUB Vittore Casarosa Digital Libraries Part 6-8
9 FUB Vittore Casarosa Digital Libraries Part 6-9
10 FUB Vittore Casarosa Digital Libraries Part 6-10
11 FUB Vittore Casarosa Digital Libraries Part 6-11
12 FUB Vittore Casarosa Digital Libraries Part 6-12
13 Z39.50 architectural model (1/2) A server houses one or more databases containing records. Associated with each database are a set of access points (indexes) that can be used for searching how to segment logical data into relations and how to name the columns in the relations are hidden (server-specific) Z39.50 includes a set of registries that provide each (application) domain with a an agreed-upon structure and attributes (query syntax, attribute fields, content retrieval format, etc.) A search (sent from the client - origin to the server - target) produces a set of records, called a "result set", that are maintained on the server The client thas also functions for search management t( (e.g. request progress reports for an active search, authorize the server to continue a resource intensive search, abort an active search) FUB Vittore Casarosa Digital Libraries Part 6-13
14 Z39.50 architectural model (2/2) Records from the result set can be retrieved by the client, which has many options for controlling the contents and format of the records that are returned (e.g. sorting a result set, selecting a subset of the result set, using the result set for a new search) The client has available also a general mechanism called "extended services" to invoke services on the server, which can survive past the end of the session (e.g. saving result sets across sessions, queuing result sets for print or electronic mail processing at the server, registering queries that would be executed periodically on the server) FUB Vittore Casarosa Digital Libraries Part 6-14
15 Z39.50 functionality FUB Vittore Casarosa Digital Libraries Part 6-15
16 Initialization facility Init service: establishes Z-association Oi Origini Init request Version, (id/password), option flags, message sizes, implementation information Target Init response Result, version, option flags, message sizes, implementation information FUB Vittore Casarosa Digital Libraries Part 6-16
17 Search facility Search service Origin Search request Search type, query, databases, result set limits for small, medium, large Target Search response Number of records found, number of records attached, status information, (records) FUB Vittore Casarosa Digital Libraries Part 6-17
18 Retrieval facility Present service Origin Present request Number of records, starting point, result set Target Present response Number of returned records, status, s (records) Segment service Allows a Present response that is larger than max size to be split in segments FUB Vittore Casarosa Digital Libraries Part 6-18
19 Sort facility Sort service Origin Sort request result set to sort, sorted result set, sort directives Target Sort response status FUB Vittore Casarosa Digital Libraries Part 6-19
20 Browse facility Scan service Origin Scan request database, term list, starting point, number of terms, (step size) Target Scan response status number of elements (elements) FUB Vittore Casarosa Digital Libraries Part 6-20
21 Delete service Result-set-delete facility Origin Delete request list of result sets to delete Target Delete response status FUB Vittore Casarosa Digital Libraries Part 6-21
22 Access-control service Access control facility Origin Request Target Access control response Security-challenge Access control request Security-challenge-response Response FUB Vittore Casarosa Digital Libraries Part 6-22
23 Accounting Resource control facility Resource-control service Trigger-resource-control service Resource-report report service Complex functionality to control and report resource usage Mostly used for fee based operation FUB Vittore Casarosa Digital Libraries Part 6-23
24 Termination facility Close service Terminates a Z-association FUB Vittore Casarosa Digital Libraries Part 6-24
25 Explain facility Explain service Gives access to information about the Z39.50 target Databases Access points Query languages Element sets... This information is maintained by the server in a specific data base, and therefore can be accessed using the Search and Retrieve facilities of Z39.50 The idea is that a (smart) client, when accessing a (unknown) data base, could be able to find its access points, its element sets and other info by querying the Explain data base FUB Vittore Casarosa Digital Libraries Part 6-25
26 Extended Service facility Extended Services service Persistent Result Set Extended Service Persistent Query Extended Service Periodic Query Schedule Extended Service Item Order Extended Service Database Update Extended Service Export Specification Extended Service Task package Used to create, modify or delete an Extended Service Request FUB Vittore Casarosa Digital Libraries Part 6-26
27 Queries Query types Type-0: proprietary between 2 parties Type-1: RPN (Reverse Polish Notation) Type-2: ISO 8777 Type-100: Z39.58 Type-101: Extended RPN (v 2) Type 102: Ranked List query FUB Vittore Casarosa Digital Libraries Part 6-27
28 Consists of Type-1 Query Reverse Polish Notation One or more operands linked (RPN style) with Boolean operators (AND, OR, AND_NOT) Every operand is a search expression consisting of 7 parts Example of query (operand)(operand)operator ( Mark Twain, 1:1003, 2:3, 3:1, 4:1, 5:100, 6:1) ( Clemence Clemence, Samuel, 1:1003, 2:3, 3:3, 4:101, 5:100, 6:2) AND_NOT - RPN + 2 * (3 + 5) * (7 2) * FUB Vittore Casarosa Digital Libraries Part 6-28
29 Operands in Type-1 queries 0. Term What you are looking for 1.Use Attributes Which abstract access point to use (e.g. title, author) 2.Relation Attributes Relation between the term and the data in the access point (e.g. less than, equals, phonetic equals) 3.Position Attributes Where in the access point should the term be? (e.g. first in field, first in subfield) 4.Structure Attributes How is the query term to be treated? (e.g. as phrase, as words, as date, as normalised name) 5.Truncation Attributes Should truncation be applied on the match? (e.g. left truncation, right and left truncation, no truncation) 6.Completeness Attributes What is the term to be matched against? (e.g. part of subfield, whole subfield, whole field) FUB Vittore Casarosa Digital Libraries Part 6-29
30 From Z39.50 to SRW/U Need for a generic Information Retrieval capability more suited to the Web Architecture Motivation to create an easy to implement protocol with (more or less) the power of Z39.50 Use existing off the shelf solutions where possible Re-evaluate Z39.50, a good idea at the time Avoid library-centric perspective Solution: SRU Search/Retrieve via URL SRW Search/Retrieve via Web Service (SRW is now called SRU over SOAP) FUB Vittore Casarosa Digital Libraries Part 6-30
31 Simple SRU query version=1.1& operation=searchretrieve& query=dinosaur& startrecord=1& maximumrecords=1& recordschema=dc FUB Vittore Casarosa Digital Libraries Part 6-31
32 SRU response in XML (1/2) <?xml version="1.0"?> <zs:searchretrieveresponse R xmlns:zs=' <zs:version>1.1</zs:version> <zs:numberofrecords>29</zs:numberofrecords> <zs:records>... details in a moment... </zs:records> </zs:searchretrieveresponse> FUB Vittore Casarosa Digital Libraries Part 6-32
33 SRU response in XML (2/2) <zs:record> <zs:recordschema>info:srw/schema/1/dc-v1 v1.1</zs:recordschema> 1</zs:recordSchema> <zs:recordpacking>xml</zs:recordpacking> <zs:recordposition>1</zs:recordposition> <zs:recorddata> <srw_dc:dc xmlns:srw_dc= dc="info:srw/schema/1/dc-schema" xmlns=" <title>fossils</title> <creator>lappi, Megan.</creator> <type>text</type> <publisher>new York, NY: Weigl Publishers</publisher> <date>2005</date> <language>en</language> <description>studying d i fossils -- Fossil facts -- Gone forever -- A fossil is born -- From bone to stone -- Insects in amber -- Dinosaur footprints</description> <identifier> </identifier> <identifier>urn:isbn: </identifier> </srw_dc:dc> </zs:recorddata> </zs:record> FUB Vittore Casarosa Digital Libraries Part 6-33
34 Contextual Query Language CQL (formerly known as Common Query Language) is the query language used in SRU The conceptual model of CQL is the same as Z39.50 The server has one or more databases, containing records The databases can be searched through access points, or indexes The language defines a number of defaults to make simple queries really simple Ar the same time it defines a number of Indexes, Relations, Relation Modifiers, Booleans and Boolean Modifiers to increase the expressing power of the language FUB Vittore Casarosa Digital Libraries Part 6-34
35 CQL search clause subject any/relevant "fish frog" index relation Relation modifier Search term Subject to context qualification FUB Vittore Casarosa Digital Libraries Part 6-35
36 Learning curves for query languages learn Ef ffort to SQL Google CQL Expressive Power FUB Vittore Casarosa Digital Libraries Part 6-36
37 FUB Vittore Casarosa Digital Libraries Part 6-37
38 FUB Vittore Casarosa Digital Libraries Part 6-38
39 FUB Vittore Casarosa Digital Libraries Part 6-39
40 FUB Vittore Casarosa Digital Libraries Part 6-40
41 FUB Vittore Casarosa Digital Libraries Part 6-41
42 Z39.50 and OAI-PMH It is interesting to see another protocol for resource discovery, namely the Open Archive Initiative (OAI-PMH) protocol Historical separation from Z39.50 OAI-PMH appears about 15 years after Z39.50 Cultural separation from Z39.50 Z39.50 originated in the traditional library community OAI-PMH originated i in the Web Community Conceptual separation from Z39.50 Z39.50 based on solid (but heavy and bulky) foundations OAI-PMH based on simple and pragmatic ideas FUB Vittore Casarosa Digital Libraries Part 6-42
43 OAI Open Archives Initiative The roots of OAI lie in the development e e of eprint archives (i.e. Institutional Repositories) such as arxiv, CogPrints, NACA (NASA), RePEc, NDLTD, NCSTRL, etc. Each repository offered a web interface for deposit of articles and for end-user searches It was difficult for end-users to work across archives without having to learn multiple different interfaces Initial experiments for single search interface to all archives Universal Pre-print Service (UPS) renamed OAI at the Santa Fe Convention (1999) FUB Vittore Casarosa Digital Libraries Part 6-43
44 Searching versus Harvesting Two possible approaches for single search interface to all archives cross searching multiple archives based on protocol like Z39.50 (possibly lighter) harvesting metadata into one or more central services Problems with cross searching Not scalable (overall performance determined by slowest server) Problems of deciding which servers to target (collection descritpions not consistent) Differences in interfaces and query languages Problems in the ranked merging of results (different types and size of targets can skew results) Browse interface very difficult to build Decision was to go with harvesting FUB Vittore Casarosa Digital Libraries Part 6-44
45 OAI - PMH OAI Protocol for Metadata Harvesting Data providers make metadata available for harvesting Service Providers harvest metadata Metadata can be centrally collected or aggregated Data Providers Are creators and keepers of the metadata for objects (repositories) and (possibly but not necessarily) archives of resources Handle deposit and publishing Service Providers Are harvesters of metadata for the purpose of providing a service such as a search interface, peer-review system, etc. FUB Vittore Casarosa Digital Libraries Part 6-45
46 OAI PMH overview Harvesting based on OAI-PMH Aggregator Searching based on Z39.50 or SRW Service providers FUB Vittore Casarosa Digital Libraries Part 6-46
47 OAI disclaimer The OAI use of the term archive in fact implies very little of what we normally associate with archives No preservation aspect is implied whatsoever (not what the protocol is about at all) No appraisal or provenance of eprints or digital objects is implied by this descriptive term The term simply pyrefers to a collection of digital objects (full text, learning objects, etc.) which might (only might) also have been harvested along with the metadata Archive is a term within the OAI PMH which serves to distinguish a collection of digital objects (the archive ) from the collected metadata associated with these objects, described as repositories In OAI repositories expose metadata about eprints (strictly there are no metadata archives) In OAI archives hold eprints (strictly there are no eprint repositories) FUB Vittore Casarosa Digital Libraries Part 6-47
48 Conceptual model of OAI data resource item = identifier all available metadata about David item Dublin Core metadata MARC metadata SPECTRUM metadata records FUB Vittore Casarosa Digital Libraries Part 6-48
49 OAI PMH records A record contains the metadata of a resource in a specific format It has three parts header (mandatory) identifier datestamp metadata (mandatory) XML encoded metadata with root tag, namespace repositories i must support Dublin Core may support other formats about (optional) rights statements provenance statements FUB Vittore Casarosa Digital Libraries Part 6-49
50 OAI-PMH Protocol Overview Protocol based on HTTP Request arguments as GET or POST parameters Six request types (verbs) Responses are encoded in XML syntax Supports any metadata format (Dublin Core mandatory for each data provider) Support selective harvesting logical set hierarchy (data providers) date stamps (last change of metadata set) Flow control (token to retrieve subsequent records) Error messages FUB Vittore Casarosa Digital Libraries Part 6-50
51 OAI PMH verbs Identify description of an archive ListMetadataFormats retrieve available metadata t formats from archive ListSets retrieve set structure of a repository ListIdentifiers abbreviated form of ListRecords, retrieving only headers ListRecords harvest records from a repository GetRecord retrieve individual metadata record from a repository FUB Vittore Casarosa Digital Libraries Part 6-51
52 Overview of OAI - PMH FUB Vittore Casarosa Digital Libraries Part 6-52
53 OAI PMH request Requests must be submitted using the GET or POST methods of HTTP Repositories must support both methods At least one key=value pair: verb=[requesttype] Additional key=value pairs depend on request type Example for GET request verb=listrecords& metadataprefix=oai_dc FUB Vittore Casarosa Digital Libraries Part 6-53
54 OAI PMH response Formatted as HTTP responses Content type must be text/xml HTTP compression optional in OAI-PMH XML declaration (<?xml version="1.0" encoding="utf-8"?>) Root element named OAI-PMH with three attributes (xmlns, xmlns:xsi, xsi:schemalocation) Three child elements ResponseDate (UTC datetime) Request (copy of the request that generated the response) a) error (in case of an error or exception condition) b) element with the name of the OAI-PMH request FUB Vittore Casarosa Digital Libraries Part 6-54
55 OAI PMH example verb=listidentifiers& from= & until= & 01 08& metadataprefix=oai_dc& set=doctypes:dissertations ListIdentifiers returns the record headers FUB Vittore Casarosa Digital Libraries Part 6-55
56 Response to ListIdentifiers (1/2) <?xml version="1.0" encoding="utf-8"?> <OAI-PMH xmlns=" hi /OAI/2 xmlns:xsi=" xsi:schemalocation=" org/oai/2 xsd"> <responsedate> t17:49:49+01:00</responsedate> <request verb="listidentifiers" from=" " until=" " metadataprefix="oai oai_dc dc" set="doctypes:dissertations"> <ListIdentifiers>... details in a moment </ListIdentifiers> </OAI-PMH> FUB Vittore Casarosa Digital Libraries Part 6-56
57 Response to ListIdentifiers (2/2) <ListIdentifiers> <header> <identifier>oai:huberlin.de: </identifier> <datestamp> </datestamp> <setspec>doctypes</setspec> y <setspec>doctypes:dissertations</setspec> <setspec>dnb</setspec> <setspec>dnb:dnb33</setspec> </header> <header> <identifier>oai:huberlin.de: </identifier> <datestamp> </datestamp> p <setspec>doctypes</setspec> <setspec>doctypes:dissertations</setspec> <setspec>dnb</setspec> <setspec>dnb:dnb27</setspec> </header> </ListIdentifiers> FUB Vittore Casarosa Digital Libraries Part 6-57
58 Where are we Digital Libraries Discovery of information Describing Information Metadata MARC Dublin Core MODS METS TEI EAD... Knowledge Representation FRBR RDF Interoperability Queries Z39.50 queries Common Command Language (CCL ISO 8777 or Z39.58) Protocols Z39.50 SRU/SRW OAI-PMH FUB Vittore Casarosa Digital Libraries Part 6-58
Corso di Biblioteche Digitali
Corso di Biblioteche Digitali Vittore Casarosa casarosa@isti.cnr.it tel. 050-315 3115 cell. 348-397 2168 Ricevimento dopo la lezione o per appuntamento Valutazione finale 70-75% esame orale 25-30% progetto
More informationDigital Libraries: Interoperability
Digital Libraries: Interoperability RAFFAELLA BERNARDI UNIVERSITÀ DEGLI STUDI DI TRENTO P.ZZA VENEZIA, ROOM: 2.05, E-MAIL: BERNARDI@DISI.UNITN.IT Contents 1 Interoperability...............................................
More informationMetadata Harvesting Framework
Metadata Harvesting Framework Library User 3. Provide searching, browsing, and other services over the data. Service Provider (TEL, NSDL) Harvested Records 1. Service Provider polls periodically for new
More informationUsing metadata for interoperability. CS 431 February 28, 2007 Carl Lagoze Cornell University
Using metadata for interoperability CS 431 February 28, 2007 Carl Lagoze Cornell University What is the problem? Getting heterogeneous systems to work together Providing the user with a seamless information
More informationOAI-PMH. DRTC Indian Statistical Institute Bangalore
OAI-PMH DRTC Indian Statistical Institute Bangalore Problem: No Library contains all the documents in the world Solution: Networking the Libraries 2 Problem No digital Library is expected to have all documents
More informationProblem: Solution: No Library contains all the documents in the world. Networking the Libraries
OAI-PMH Problem: No Library contains all the documents in the world Solution: Networking the Libraries 2 Problem No digital Library is expected to have all documents in the world Solution Networking the
More informationOAI-PMH implementation and tools guidelines
ECP-2006-DILI-510003 TELplus OAI-PMH implementation and tools guidelines Deliverable number Dissemination level D-2.1 Public Delivery date 31 May 2008 Status Final v1.1 Author(s) Diogo Reis(IST), Nuno
More informationhttp://resolver.caltech.edu/caltechlib:spoiti05 Caltech CODA http://coda.caltech.edu CODA: Collection of Digital Archives Caltech Scholarly Communication 15 Production Archives 3102 Records Theses, technical
More informationIntegrating Access to Digital Content
Integrating Access to Digital Content OR OAI is easy, metadata is hard Sarah Shreeves University of Illinois at Urbana-Champaign Why Integrate Access? Increase access to your collections 37% of visits
More informationEXTENDING OAI-PMH PROTOCOL WITH DYNAMIC SETS DEFINITIONS USING CQL LANGUAGE
EXTENDING OAI-PMH PROTOCOL WITH DYNAMIC SETS DEFINITIONS USING CQL LANGUAGE Cezary Mazurek Poznań Supercomputing and Networking Center Noskowskiego 12/14, 61-704 Poznań, Poland Marcin Werla Poznań Supercomputing
More informationThe Open Archives Initiative Protocol for Metadata Harvesting: An Introduction
DRTC Workshop on Digital Libraries: Theory and Practice March 2003 DRTC, Bangalore The Open Archives Initiative Protocol for Metadata Harvesting: An Introduction Documentation Research and Training Centre
More informationGuidelines for preparing a Z39.50/SRU target to enable metadata harvesting
ECP-2006-DILI-510003 TELplus Guidelines for preparing a Z39.50/SRU target to enable metadata harvesting Deliverable number Dissemination level D-2.3 Public Delivery date 30 th of June 2009 Status Author(s)
More informationJoining the BRICKS Network - A Piece of Cake
Joining the BRICKS Network - A Piece of Cake Robert Hecht and Bernhard Haslhofer 1 ARC Seibersdorf research - Research Studios Studio Digital Memory Engineering Thurngasse 8, A-1090 Wien, Austria {robert.hecht
More informationIMu OAI-PMH Web Service
IMu Documentation IMu OAI-PMH Web Service Document Version 1.1 EMu Version 4.00 IMu Version 1.0.03 www.kesoftware.com 2012 KE Software. All rights reserved. Contents SECTION 1 OAI-PMH Concepts 1 What
More informationIVOA Registry Interfaces Version 0.1
IVOA Registry Interfaces Version 0.1 IVOA Working Draft 2004-01-27 1 Introduction 2 References 3 Standard Query 4 Helper Queries 4.1 Keyword Search Query 4.2 Finding Other Registries This document contains
More informationCreating a National Federation of Archives using OAI-PMH
Creating a National Federation of Archives using OAI-PMH Luís Miguel Ferros 1, José Carlos Ramalho 1 and Miguel Ferreira 2 1 Departament of Informatics University of Minho Campus de Gualtar, 4710 Braga
More informationMetadata and Encoding Standards for Digital Initiatives: An Introduction
Metadata and Encoding Standards for Digital Initiatives: An Introduction Maureen P. Walsh, The Ohio State University Libraries KSU-SLIS Organization of Information 60002-004 October 29, 2007 Part One Non-MARC
More informationOpen Archives Initiative protocol development and implementation at arxiv
Open Archives Initiative protocol development and implementation at arxiv Simeon Warner (Los Alamos National Laboratory, USA) (simeon@lanl.gov) OAI Open Day, Washington DC 23 January 2001 1 What is arxiv?
More informationThe Open Archives Initiative and the Sheet Music Consortium
The Open Archives Initiative and the Sheet Music Consortium Jon Dunn, Jenn Riley IU Digital Library Program October 10, 2003 Presentation outline Jon: OAI introduction Sheet Music Consortium background
More informationORCA-Registry v2.4.1 Documentation
ORCA-Registry v2.4.1 Documentation Document History James Blanden 26 May 2008 Version 1.0 Initial document. James Blanden 19 June 2008 Version 1.1 Updates for ORCA-Registry v2.0. James Blanden 8 January
More informationExposing and Harvesting Metadata Using the OAI Metadata Harvesting Protocol: A Tutorial
Page 1 of 11 High Energy Physics Libraries Webzine Home Editorial Board Contents Issue 4 HEP Libraries Webzine Issue 4 / June 2001 Abstract Exposing and Harvesting Metadata Using the OAI Metadata Harvesting
More informationTutorial. Open Archive Initiative
Tutorial Open Archive Initiative Uwe Müller Computer- und Medienservice, Humboldt-Universität zu Berlin u.mueller@cms.hu-berlin.de Dr. Heinrich Stamerjohanns Institute for Science Networking, Universität
More informationSRW and CQL; Open Source at LC
SRW and CQL; Open Source at LC Overview: Motivations Explain Operation SearchRetrieve Operation Scan Operation CQL Implementations NISO Metasearch Initiative Rob Sanderson (azaroth@liv.ac.uk) SRW/U: Introduction
More informationRVOT: A Tool For Making Collections OAI-PMH Compliant
RVOT: A Tool For Making Collections OAI-PMH Compliant K. Sathish, K. Maly, M. Zubair Computer Science Department Old Dominion University Norfolk, Virginia USA {kumar_s,maly,zubair}@cs.odu.edu X. Liu Research
More informationMetadata aggregation for digital libraries
ICDAT 2005 Metadata aggregation for digital libraries Muriel Foulonneau () Grainger Engineering Library University of Illinois at Urbana-Champaign USA June 2005 Outlines Role and practices of actors in
More informationBuilding Interoperable and Accessible ETD Collections: A Practical Guide to Creating Open Archives
Building Interoperable and Accessible ETD Collections: A Practical Guide to Creating Open Archives Hussein Suleman, hussein@vt.edu Digital Library Research Laboratory Virginia Tech 1. Introduction What
More informationChuck Cartledge, PhD. 25 February 2018
Big Data: Data Wrangling Boot Camp Web Crawling with R and OAI-PMH Chuck Cartledge, PhD 25 February 2018 1/21 Table of contents (1 of 1) 1 Intro. 2 OAI-PMH What is OAI-PMH 3 Hands-on 4 Q & A 5 Conclusion
More informationPublishing Based on Data Provider
Publishing Based on Data Provider Version 16 and later Please note: Implementation of the following OAI tools requires an additional license agreement with Ex Libris. To learn more about licensing this
More informationDeveloping an Institutional Repository Service in Chinese Academy of Sciences
Developing an Institutional Repository Service in Chinese Academy of Sciences Zhongming Zhu, Jianxia Ma Lanzhou Branch of National Science Library, CAS Zhixiong Zhang National Science Library, CAS Sino-German
More informationarxiv, the OAI, and peer review
arxiv, the OAI, and peer review Simeon Warner (arxiv, Los Alamos National Laboratory, USA) (simeon@lanl.gov) Workshop on OAI and peer review journals in Europe, Geneva, 22 24 March 2001 1 What is arxiv?
More informationSMART CONNECTOR TECHNOLOGY FOR FEDERATED SEARCH
SMART CONNECTOR TECHNOLOGY FOR FEDERATED SEARCH VERSION 1.4 27 March 2018 EDULIB, S.R.L. MUSE KNOWLEDGE HEADQUARTERS Calea Bucuresti, Bl. 27B, Sc. 1, Ap. 10, Craiova 200675, România phone +40 251 413 496
More informationTable of contents for The organization of information / Arlene G. Taylor and Daniel N. Joudrey.
Table of contents for The organization of information / Arlene G. Taylor and Daniel N. Joudrey. Chapter 1: Organization of Recorded Information The Need to Organize The Nature of Information Organization
More informationOpen Archives Initiative Object Reuse & Exchange. Resource Map Discovery
Open Archives Initiative Object Reuse & Exchange Resource Map Discovery Michael L. Nelson * Carl Lagoze, Herbert Van de Sompel, Pete Johnston, Robert Sanderson, Simeon Warner OAI-ORE Specification Roll-Out
More informationInteroperability and Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH)
338 Interoperability and Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) Martha Latika Alexander J N Gautam Abstract Interoperability refers to the ability of a Digital Library to work
More informationExpected and Unexpected Synergies
Page 1 of 8 Search Back Issues Author Index Title Index Contents D-Lib Magazine February 2005 Volume 11 Number 2 ISSN 1082-9873 SRW/U with OAI Expected and Unexpected Synergies Robert Sanderson University
More informationGMA-PSMH: A Semantic Metadata Publish-Harvest Protocol for Dynamic Metadata Management Under Grid Environment
GMA-PSMH: A Semantic Metadata Publish-Harvest Protocol for Dynamic Metadata Management Under Grid Environment Yaping Zhu, Ming Zhang, Kewei Wei, and Dongqing Yang School of Electronics Engineering and
More informationBuilding Interoperable Digital Libraries: A Practical Guide to creating Open Archives
Building Interoperable Digital Libraries: A Practical Guide to creating Open Archives Hussein Suleman, hussein@vt.edu Digital Library Research Laboratory Virginia Tech 1. Introduction What is the OAI?
More informationFlexible Design for Simple Digital Library Tools and Services
Flexible Design for Simple Digital Library Tools and Services Lighton Phiri Hussein Suleman Digital Libraries Laboratory Department of Computer Science University of Cape Town October 8, 2013 SARU archaeological
More informationTexas Library Directory Web Services Application: The Potential for Web Services to Enhance Information Access to Legacy Data
Texas Library Directory Web Services Application: The Potential for Web Services to Enhance Information Access to Legacy Data By: Fatih Oguz and William E. Moen Oguz, F., & Moen, W. E. (2006). Texas Library
More informationFrom Open Data to Data- Intensive Science through CERIF
From Open Data to Data- Intensive Science through CERIF Keith G Jeffery a, Anne Asserson b, Nikos Houssos c, Valerie Brasse d, Brigitte Jörg e a Keith G Jeffery Consultants, Shrivenham, SN6 8AH, U, b University
More informationGetting Started with the Digital Commonwealth. Robin L. Dale Director of Digital & Preservation Services LYRASIS
Getting Started with the Digital Commonwealth Robin L. Dale Director of Digital & Preservation Services LYRASIS Introductions Name & organization / role Where are you in your digital project? What do you
More informationDigitisation Standards
Digitisation Standards Jeannette Frey, Alexandre Lopes BCU Lausanne LIBER-EBLIDA Digitization Workshop 2011 The Hague, October 5-7, 2011 Standards which standards? Standards are set by experts (not by
More informationVersion 2 of the OAI-PMH & some other stuff
Version 2 of the OAI-PMH & some other stuff 2 nd Workshop on the OAI, CERN Geneva, October 17 th 2002 Herbert Van de Sompel Los Alamos National Laboratory Carl Lagoze Cornell University about OAI-PMH v.2.0
More informationMetadata Standards and Applications
Clemson University TigerPrints Presentations University Libraries 9-2006 Metadata Standards and Applications Scott Dutkiewicz Clemson University Derek Wilmott Clemson University, rwilmot@clemson.edu Follow
More informationMetadata Workshop 3 March 2006 Part 1
Metadata Workshop 3 March 2006 Part 1 Metadata overview and guidelines Amelia Breytenbach Ria Groenewald What metadata is Overview Types of metadata and their importance How metadata is stored, what metadata
More informationCorso di Biblioteche Digitali
Corso di Biblioteche Digitali Vittore Casarosa casarosa@isti.cnr.it tel. 050-315 3115 cell. 348-397 2168 Ricevimento dopo la lezione o per appuntamento Valutazione finale 70-75% esame orale 25-30% progetto
More informationCorso di Biblioteche Digitali
Corso di Biblioteche Digitali Vittore Casarosa casarosa@isti.cnr.it tel. 050-315 3115 cell. 348-397 2168 Ricevimento dopo la lezione o per appuntamento Valutazione finale 70-75% esame orale 25-30% progetto
More informationA Repository of Metadata Crosswalks. Jean Godby, Devon Smith, Eric Childress, Jeffrey A. Young OCLC Online Computer Library Center Office of Research
A Repository of Metadata Crosswalks Jean Godby, Devon Smith, Eric Childress, Jeffrey A. Young OCLC Online Computer Library Center Office of Research DLF-2004 Spring Forum April 21, 2004 Outline of this
More informationMetadata: The Theory Behind the Practice
Metadata: The Theory Behind the Practice Item Type Presentation Authors Coleman, Anita Sundaram Citation Metadata: The Theory Behind the Practice 2002-04, Download date 06/07/2018 12:18:20 Link to Item
More informationThe Design of a DLS for the Management of Very Large Collections of Archival Objects
Session: VLDL Architectures The Design of a DLS for the Management of Very Large Collections of Archival Objects Maristella Agosti, Nicola Ferro and Gianmaria Silvello Information Management Research Group
More informationHarvesting Metadata Using OAI-PMH
Harvesting Metadata Using OAI-PMH Roy Tennant California Digital Library Outline The Open Archives Initiative OAI-PMH The Harvesting Process Harvesting Problems Steps to a Fruitful Harvest A Harvesting
More informationThe OAI2LOD Server: Exposing OAI-PMH Metadata as Linked Data
The OAI2LOD Server: Exposing OAI-PMH Metadata as Linked Bernhard Haslhofer University of Vienna Dept. of Distributed and Multimedia Systems Vienna, Austria bernhard.haslhofer@univie.ac.at ABSTRACT Many
More informationMuseKnowledge Hybrid Search
MuseKnowledge Hybrid Search MuseGlobal, Inc. One Embarcadero Suite 500 San Francisco, CA 94111 415 896-6873 www.museglobal.com MuseGlobal S.A Calea Bucuresti Bl. 27B, Sc. 1, Ap. 10 Craiova, România 40
More informationCodeSharing: a simple API for disseminating our TEI encoding. Martin Holmes
CodeSharing: a simple API for disseminating our TEI encoding 1. Introduction Martin Holmes Although the TEI Guidelines are full of helpful examples, and other inititatives such as TEI By Example have made
More informationNetwork Information System. NESCent Dryad Subcontract (Year 1) Metacat OAI-PMH Project Plan 25 February Mark Servilla
Network Information System NESCent Dryad Subcontract (Year 1) Metacat OAI-PMH Project Plan 25 February 2009 Mark Servilla servilla@lternet.edu LTER Network Office Department of Biology, MSC03 2020 1 University
More informationGuidelines for Developing Digital Cultural Collections
Guidelines for Developing Digital Cultural Collections Eirini Lourdi Mara Nikolaidou Libraries Computer Centre, University of Athens Harokopio University of Athens Panepistimiopolis, Ilisia, 15784 70 El.
More informationBIBLID (2004) 93:1 pp (2004.6) 209. NBINet NBINet 92
BIBLID 1026-5279 (2004) 93:1 pp. 209-235 (2004.6) 209 92 NBINet NBINet 92 Keywords HTTP Z39.50 OPENRUL OAI (Open Archives Initiative) DOI (Digital Object Identifier) Metadata Topic Maps Ontology E-mail:
More informationOAI AND AMF FOR ACADEMIC SELF-DOCUMENTATION
OAI AND AMF FOR ACADEMIC SELF-DOCUMENTATION Pavel I. Braslavsky Institute of Engineering Science Ural Branch, Russian Academy of Sciences Komsomolskaya 34 620219 Ekaterinburg Russia pb@imach.uran.ru Thomas
More informationData Exchange and Conversion Utilities and Tools (DExT)
Data Exchange and Conversion Utilities and Tools (DExT) Louise Corti, Angad Bhat, Herve L Hours UK Data Archive CAQDAS Conference, April 2007 An exchange format for qualitative data Data exchange models
More informationIndonesian Citation Based Harvester System
n Citation Based Harvester System Resmana Lim Electrical Engineering resmana@petra.ac.id Adi Wibowo Informatics Engineering adiw@petra.ac.id Raymond Sutjiadi Research Center raymondsutjiadi@petra.ac.i
More informationRDF and Digital Libraries
RDF and Digital Libraries Conventions for Resource Description in the Internet Commons Stuart Weibel purl.org/net/weibel December 1998 Outline of Today s Talk Motivations for developing new conventions
More informationPersistent identifiers, long-term access and the DiVA preservation strategy
Persistent identifiers, long-term access and the DiVA preservation strategy Eva Müller Electronic Publishing Centre Uppsala University Library, http://publications.uu.se/epcentre/ 1 Outline DiVA project
More informationContribution of OCLC, LC and IFLA
Contribution of OCLC, LC and IFLA in The Structuring of Bibliographic Data and Authorities : A path to Linked Data BY Basma Chebani Head of Cataloging and Metadata Services, AUB Libraries Presented to
More informationOpen Archives Initiatives Protocol for Metadata Harvesting Practices for the cultural heritage sector
Open Archives Initiatives Protocol for Metadata Harvesting Practices for the cultural heritage sector Relais Culture Europe mfoulonneau@relais-culture-europe.org Community report A community report on
More informationThe Open Archives Initiative Protocol for Metadata Harvesting
Page 1 of 34 The Open Archives Initiative Protocol for Metadata Harvesting Protocol Version 2.0 of 2002-06-14 Document Version 2003/02/21T00:00:00Z http://www.openarchives.org/oai/2.0/openarchivesprotocol.htm
More informationHow to contribute information to AGRIS
How to contribute information to AGRIS Guidelines on how to complete your registration form The dashboard includes information about you, your institution and your collection. You are welcome to provide
More informationUniversity of Bath. Publication date: Document Version Publisher's PDF, also known as Version of record. Link to publication
Citation for published version: Patel, M & Duke, M 2004, 'Knowledge Discovery in an Agents Environment' Paper presented at European Semantic Web Symposium 2004, Heraklion, Crete, UK United Kingdom, 9/05/04-11/05/04,.
More informationResearch Data Repository Interoperability Primer
Research Data Repository Interoperability Primer The Research Data Repository Interoperability Working Group will establish standards for interoperability between different research data repository platforms
More informationMetadata. Week 4 LBSC 671 Creating Information Infrastructures
Metadata Week 4 LBSC 671 Creating Information Infrastructures Muddiest Points Memory madness Hard drives, DVD s, solid state disks, tape, Digitization Images, audio, video, compression, file names, Where
More informationIntroduction to the OAI Protocol for Metadata Harvesting Version 2.0. Hussein Suleman Virginia Tech DLRL 17 June 2002
Introduction to the OAI Protocol for Metadata Harvesting Version 2.0 Hussein Suleman Virginia Tech DLRL 17 June 2002 Version 2.0 Already? Why? What are you guys thinking? But we didn t implemented version
More informationINTRO INTO WORKING WITH MINT
INTRO INTO WORKING WITH MINT TOOLS TO MAKE YOUR COLLECTIONS WIDELY VISIBLE BERLIN 16/02/2016 Nikolaos Simou National Technical University of Athens What is MINT? 2 Mint is a herb having hundreds of varieties
More information2nd Technical Validation Questionnaire - interim results -
2nd Technical Validation Questionnaire - interim results - Birgit Matthaei Humboldt-University, Berlin, Germany Electronic Publishing Group Computer- and Mediaservice birgit.matthaei@cms.hu-berlin.de Why
More informationAppendix REPOX User Manual
D5.3.1 Europeana OAI-PMH Infrastructure Documentation and final prototype co-funded by the European Union The project is co-funded by the European Union, through the econtentplus programme http://ec.europa.eu/econtentplus
More informationBuilding for the Future
Building for the Future The National Digital Newspaper Program Deborah Thomas US Library of Congress DigCCurr 2007 Chapel Hill, NC April 19, 2007 1 What is NDNP? Provide access to historic newspapers Select
More informationThe OAIS Reference Model: current implementations
The OAIS Reference Model: current implementations Michael Day, UKOLN, University of Bath m.day@ukoln.ac.uk Chinese-European Workshop on Digital Preservation, Beijing, China, 14-16 July 2004 Presentation
More informationInstitutional repositories: description of VITAL as an example of a Fedora-based digital assets management system.
Institutional repositories: description of VITAL as an example of a Fedora-based digital assets management system. ICADLA-2, Johannesburg, South Africa Nabil Saadallah Manager, Middle East and Africa VTLS
More informationBuilding Consensus: An Overview of Metadata Standards Development
Building Consensus: An Overview of Metadata Standards Development Christina Harlow DataOps Engineer, Stanford University Library cmharlow@stanford.edu, @cm_harlow Goals of this Talk 1. Give context on
More informationQuestionnaire for effective exchange of metadata current status of publishing houses
Questionnaire for effective exchange of metadata current status of publishing houses In 2011, important priorities were set in order to realise green publications in the open access movement in Germany.
More informationStandards in Library Automation and Networking
Standards in Library Automation and Networking L J Haravu Trustee, Kesavan Institute of Information & Knowledge Management 1 Introduction We live in an increasingly globalized and interconnected world.
More informationScienceDirect. Multi-interoperable CRIS repository. Ivanović Dragan a *, Ivanović Lidija b, Dimić Surla Bojana c CRIS
Available online at www.sciencedirect.com ScienceDirect Procedia Computer Science 33 ( 2014 ) 86 91 CRIS 2014 Multi-interoperable CRIS repository Ivanović Dragan a *, Ivanović Lidija b, Dimić Surla Bojana
More informationMetadata Standards & Applications. 7. Approaches to Models of Metadata Creation, Storage, and Retrieval
Metadata Standards & Applications 7. Approaches to Models of Metadata Creation, Storage, and Retrieval Goals for Session Understand the differences between traditional vs. digital library Metadata creation
More informationPublic User Interface Specification
Reviewed / revised Oct. 13, 2011/bdw Public User Interface Specification Posted to BaseCamp Oct. 13, 2011/bdw Reviewed / revised November 21, 2011/mam PI-1: General scope / description This specification
More informationMetadata Overview: digital repositories
Metadata Overview: digital repositories Presented during Pre-African Summit Workshop no 2: Building digital repositories in public, special and research libraries by Makaba Macanda macanmb@unisa.ac.za
More informationSobekCM. Compiled for presentation to the Digital Library Working Group School of Oriental and African Studies
SobekCM Compiled for presentation to the Digital Library Working Group School of Oriental and African Studies SobekCM Is a digital library system built at and maintained by the University of Florida s
More informationCorso di Biblioteche Digitali
Corso di Biblioteche Digitali Vittore Casarosa casarosa@isti.cnr.it tel. 050-315 3115 cell. 348-397 2168 Ricevimento dopo la lezione o per appuntamento Valutazione finale 70-75% esame orale 25-30% progetto
More informationSearch Interoperability, OAI, and Metadata
Search Interoperability, OAI, and Metadata An Introduction to the OAI Protocol for Metadata Harvesting Sarah Shreeves University of Illinois at Urbana-Champaign November 30, 2006 This work is licensed
More informationadore: a modular, standards-based Digital Object Repository
adore: a modular, standards-based Digital Object Repository Herbert Van de Sompel, Jeroen Bekaert, Xiaoming Liu, Luda Balakireva, Thorsten Schwander Los Alamos National Laboratory, Research Library {herbertv,
More informationMETADATA POLICIES FOR THE DESCRIPTION OF DIGITAL FOLKLORE COLLECTIONS
METADATA POLICIES FOR THE DESCRIPTION OF DIGITAL FOLKLORE COLLECTIONS Irene Lourdi Libraries Computer Centre National & Kapodistrian University Campus University, Ilisia Athens Greece elourdi@lib.uoa.gr
More informationA Comparative Study of the Search and Retrieval Features of OAI Harvesting Services
A Comparative Study of the Search and Retrieval Features of OAI Harvesting Services V. Indrani 1 and K. Thulasi 2 1 Information Centre for Aerospace Science and Technology, National Aerospace Laboratories,
More informationHarvesting Statistical Metadata from an Online Repository for Data Analysis and Visualization
Sem Gebresilassie Harvesting Statistical Metadata from an Online Repository for Data Analysis and Visualization Concept application on Theseus Helsinki Metropolia University of Applied Sciences Bachelor
More informationHow to Create a Custom Ingest Form
How to Create a Custom Ingest Form The following section presumes that you are using the Virtual Machine Image or are visiting http://sandbox.islandora.ca OR that you have installed and configured the
More informationCompound or complex object: a set of files with a hierarchical relationship, associated with a single descriptive metadata record.
FEATURES DESIRED IN A DIGITAL LIBRARY SYSTEM Initial draft prepared for review and comment by G. Clement (FIU) and L. Taylor (UF), with additional editing by M. Sullivan (UF) and L. Dotson (UCF), April
More informationOpen Archives Initiative Object Reuse & Exchange. Resource Map Discovery
Open Archives Initiative Object Reuse & Exchange Resource Map Discovery Michael L. Nelson * Carl Lagoze, Herbert Van de Sompel, Pete Johnston, Robert Sanderson, Simeon Warner OAI-ORE Specification Roll-Out
More informationIncreasing access to OA material through metadata aggregation
Increasing access to OA material through metadata aggregation Mark Jordan Simon Fraser University SLAIS Issues in Scholarly Communications and Publishing 2008-04-02 1 We will discuss! Overview of metadata
More informationSDMX self-learning package XML based technologies used in SDMX-IT TEST
SDMX self-learning package XML based technologies used in SDMX-IT TEST Produced by Eurostat, Directorate B: Statistical Methodologies and Tools Unit B-5: Statistical Information Technologies Last update
More informationThe MIND Approach. Fabio Crestani University of Strathclyde, Glasgow, UK. Open Archive Forum Workshop Berlin, Germany, March 2003
The MIND Approach Fabio Crestani University of Strathclyde, Glasgow, UK Open Archive Forum Workshop Berlin, Germany, March 2003 Outline Project organisation Motivations, assumptions and main issues Architecture
More informationoatd.org Discovery for Open Access Theses and Dissertations An ASERL Webinar, October 15, 2013 These slides:
oatd.org Discovery for Open Access Theses and Dissertations An ASERL Webinar, October 15, 2013 These slides: http://goo.gl/muxq15 Thomas Dowling dowlintp@wfu.edu I Can Haz ASERL ETDs? 34 of 37 ASERL universities
More informationHow to Build a Digital Library
How to Build a Digital Library Ian H. Witten & David Bainbridge Contents Preface Acknowledgements i iv 1. Orientation: The world of digital libraries 1 One: Supporting human development 1 Two: Pushing
More informationTeiid Designer User Guide 7.7.0
Teiid Designer User Guide 1 7.7.0 1. Introduction... 1 1.1. What is Teiid Designer?... 1 1.2. Why Use Teiid Designer?... 2 1.3. Metadata Overview... 2 1.3.1. What is Metadata... 2 1.3.2. Editing Metadata
More informationComparing Open Source Digital Library Software
Comparing Open Source Digital Library Software George Pyrounakis University of Athens, Greece Mara Nikolaidou Harokopio University of Athens, Greece Topic: Digital Libraries: Design and Development, Open
More information