CODA CATCHPlus Open Document Annotation. Hennie Brugman OAC II Project Review meeting Chicago July 26-27, 2012

Size: px

Start display at page:

Download "CODA CATCHPlus Open Document Annotation. Hennie Brugman OAC II Project Review meeting Chicago July 26-27, 2012"

Miranda Barton
5 years ago
Views:

1 CODA CATCHPlus Open Document Annotation Hennie Brugman OAC II Project Review meeting Chicago July 26-27, 2012

2 Annotation context Audiovisual ASR, language, gesture, oral history Text Semantic annotation Music lyrics, music notation Linguistic Annotation named entities Image annotation Programs: CATCH, CATCHPlus, CLARIN

3 CODA main use cases Queen s Cabinet (Henny van Schie/National Archive, Lambert Schomaker/Univ Groningen) Line strip and word zone annotations ML: search in manuscript images Add Named Entity annotations Sailing Letters (Nicoline van de Sijs/Meertens + consortium, Lambert Schomaker) Support manual annotation Line strip detection service

4 2

6 Line annotation tools (catchplus)

7 <txt>godefroit</txt> <id>navis-sal7316_0195-line-026 -y1=2094-y2=2317-zone-human -x=1145-y=105-w=315-h=116 -unshear=0.0-version=ortho </id> <user>mceunen</user> <time>wed Jan 26 16:37: </time>

8 OAC representation ImageAnnotation TextAnnotations hasbody ia:1 imagescan.jpg hastarget hastarget page:0 hasbody linestrip.jpg hasbody ia:2 Canvas1 constrains ct:2 constrains ct:1 line:1 constrains cb:1 ib:0 constrains cb:2 cnt:chars Dit is een beschrijving van Den Haag. En dit is een tweede zin. hastarget zone:2 hasbody Named Entity

9 OAC representation Named Entities! Annotation of annotations? ImageAnnotation TextAnnotations EntityAnnotation! Annotation ia:1 of segments ta:0 of ct:3 inline text? hastarget ea:1 InlineTextConstraint: hasbody hastarget hastarget hasbody constrains hastarget hasbody <rdf:description rdf:about="urn:uuid:533624bb-d565-40ba-a14a-2e95c19c20df"> <rdf:type rdf:resource=" <constrains Canvas1 xmlns=" ib:0 constrains ct:4 ib:1 imagescan.jpg rdf:resource=" constrains constrains cnt:chars %3Ad bf-40a8-a648-2cd5ebb9acfd"/> <constrainedby xmlns=" ct:1 cb:1 rdf:resource="urn:uuid:4f6b7d ab6-be89-a0feec9e7208"/> </rdf:description> constrains constrains cnt:chars location ta:1 <rdf:description rdf:about="urn:uuid:4f6b7d ab6-be89-a0feec9e7208"> ct:2 cb:2 <rdf:type rdf:resource=" Dit is een beschrijving van Den <rdf:type rdf:resource=" hastarget hasbody Haag. En dit is een tweede zin. <rdf:type rdf:resource=" ta:2 <chars xmlns=" "<textsegment offset="279" range="2"/>"</chars> <characterencoding xmlns=" UTF-8</characterEncoding> </rdf:description>

10 KdK-2-OAC conversion! Need for explicit representation of Sequence? Implicit line and page text! Search on text of ConstrainedTarget/Body? Word and line order Text offsets and ranges Spatial information Identifiers and annotatability Redundant text for searchability

11 KdK2OAC conclusions! For many annotation tasks OA may be overkill Bidirectional mapping is possible Compatible with SharedCanvas model OAC + Canvas links everything together Implicit information made explicit Supports alternative text segmentations OAC representation is extremely verbose

13 Open Annotation Service (OAS)! Upload Model annotation does not support RDF using Annotation SRU/Update sets Inlines external text and XML Bodies and authors Indexes OA and DC properties Assigns resolvable http URIs and resolves those Implementation: RDF store icw Solr, production quality software components (Meresco) Built-in OAI-PMH data provider and harvester for annotation sets Query: SRU/CQL, SPARQL, OAI-PMH Simple management dashboard (authentication and authorization, collection management, harvesting) Easy installation and Open Source

14 OAS: issues! In RDF, what are the boundaries of an annotation? Annotation publication Searchability: harvest and index Text search on external bodies Annotation boundaries Bypassing oac:constrains

16 Entity Recognition service URL or text service resolve OAS source_text URL or ID frog FoLiA_document entity annotations converter

17 frog and FoLiA Frog tool generates FoLiA XML document with Segmentation of text in paragraphs, sentences and words (tokens) XML hierarchy Part of speech, lemma, morphology, chunking, dependency structure and named entities Mix of inline and standoff annotation Frog does not keep track of character offsets Explicit ordering: numbering system in ids Trained for Dutch Widely used for Dutch corpora Made available by: Tilburg University

18 FoLiA-2-OAC conversion Reconstruct character offsets after tokenization Operates on inline text as published by OAS Construct and add entity text from tokens + sequence (the+hague!= hague+the) Two approaches 1. Minimal: extract entity annotations and tokens, and convert to OAC 2. Maximal: full conversion to OAC

19 Linguistic Annotation! Mix-in domain semantics as subtypes/subproperties?! Maximal OA mapping or embed linguistic standards?!! Layers, hierarchies (syntax) and Documents Sequence (e.g. entities, morpheme breakup)

21 Synchronized viewing client demo Demo/screenshot

22 Summary of OA issues! Annotation of annotations?! Annotation of segments of inline text?! Need for explicit representation of Sequence?! Search on ConstrainedTarget/Body?! For many annotation tasks OA may be overkill! Model does not support Annotation sets! In RDF, what are the boundaries of an annotation?

23 Future work Finalize and integrate software (with web services) Upgrade to new OA spec (incl OAS) Line strip detection web service Possible applications AV annotation in CATCHPlus Nederlab

24 Questions?

Persistent Identifiers for Audiovisual Archives and Cultural Heritage

Persistent Identifiers for Audiovisual Archives and Cultural Heritage Hennie Brugman Technical coordinator CATCHPlus Max-Planck-Institute for Psycholinguistics Netherlands Institute for Sound and Vision