Advanced JAPE. Mark A. Greenwood

Size: px

Start display at page:

Download "Advanced JAPE. Mark A. Greenwood"

Thomas Richard
6 years ago
Views:

1 Advanced JAPE Mark A. Greenwood

2 Recap Installed and run GATE Understand the idea of LR Language Resources PR Processing Resources ANNIE Understand the goals of information extraction Loaded ANNIE into GATE Constructed one or more gazetteer lists Created JAPE rules with simple RHS

3 Overview Simple RHS Limitations The RHS API Accessing Annotations and Features Adding New Annotations Hands-On

4 Simple RHS Limitations The simple RHS of a JAPE rule can only add simple annotations and features Feature values are hard coded or can be copied from annotations matched by the LHS You may need more complex processing Removing temporary annotations Building complex features... Fortunately the RHS of a rule can consist of arbitrary Java code the possibilities are endless!

5 The RHS API Java code provided as a RHS is used as the body of this method: public void doit(document doc, Map bindings, AnnotationSet annotations, AnnotationSet inputas, AnnotationSet outputas, Ontology ontology) throws JapeException This provides easy access to the document, rule bindings and annotations. DO NOT USE annotations IT IS DEPRECATED!

6 Accessing Annotations and Features Each labelled section of the LHS results in an Annotation Set These Annotation Sets can be retrieved from the bindings map AnnotationSet set = (AnnotationSet)bindings.get("labelname");

7 Accessing Annotations and Features When writing complex JAPE you will often need to access annotation features All features of an annotation are stored in a map FeatureMap map = annotation.getfeatures() Each feature is accessed by name Each feature is accessed by name Object obj = map.get( featurename )

8 Adding New Annotations New annotations should always be created in the outputas To create an annotation you need The annotation name The start and end offset A FeatureMap instance (can be empty) outputas.add(start,end,label,features)

9 Shorthand Notation for JAVA RHS Where a Java block refers to a single lefthand-side binding, JAPE provides a shorthand notation: Rule: RemoveDoneFlag ( {Instance.flag == "done"} ):inst --> :inst{ } Annotation theinstance = (Annotation)instAnnots.iterator().next(); theinstance.getfeatures().remove("flag");

10 Shorthand Notation for JAVA RHS A label :<label> on a Java block creates a local variable <label>annots within the Java block which is the AnnotationSet bound to the <label> label. The Java code in the block is only executed if there is at least one annotation bound to the label

11 Hands On: Extending the IE Example In the previous JAPE session you wrote a rule to annotate phrases such as Whitbread shares closed up 2p at 645p. Annotating the phrase is useful but there is lots of information which would be useful to extract as features Starting price Change in price Closing price

12 Hands On: Extending the IE Example You will need to Extract the closing price and change assume they are always in pence so you can get the value by removing the trailing p Get the minortype of the Lookup Calculate the starting price Create a new annotation with these values as features

13 Your Turn! Feel Free To Refer To The User Guide And To Ask For Help

14 Hands On: Extending the IE Example Phase: Shares Input: Token Organization Lookup Money Options: control = appelt Rule:ShareChange ( {Organization} ({Token})[0,3] ({Lookup.majorType=="change"}):lookup ({Token})[0,3] ({Money}):delta {Token.string == "at"} ({Money}):closing ):change --> { try { AnnotationSet change = (AnnotationSet)bindings.get("change"); Annotation delta = ((AnnotationSet)bindings.get("delta")).iterator().next(); Annotation closing = ((AnnotationSet)bindings.get("closing")).iterator().next(); boolean rise = ((AnnotationSet)bindings.get("lookup")).iterator().next().getFeatures().get("minorType").equals("Changes-up"); int deltavalue = Integer.parseInt(doc.getContent().getContent(delta.getStartNode().getOffset(),delta.getEndNode().getOffset()-1).toString()); int closingvalue = Integer.parseInt(doc.getContent().getContent(closing.getStartNode().getOffset(),closing.getEndNode().getOffset()-1).toString()); int startvalue = (rise? closingvalue - deltavalue : closingvalue + deltavalue); FeatureMap features = Factory.newFeatureMap(); features.put("rule","sharechange"); features.put("opening",startvalue+"p"); features.put("change",deltavalue+"p"); features.put("closing", closingvalue+"p"); features.put("direction", (rise? "up" : "down")); outputas.add(change.firstnode(),change.lastnode(),"sharechange",features); } catch (Exception e) { // ignore this for now } }

Advanced JAPE. Module 1. June 2017

Advanced JAPE. Module 1. June 2017 Advanced JAPE Module 1 June 2017 c 2017 The University of Sheffield This material is licenced under the Creative Commons Attribution-NonCommercial-ShareAlike Licence (http://creativecommons.org/licenses/by-nc-sa/3.0/)