Stream Reasoning Workshop Technical University Berlin SR2016

Transcription

1 Stream Reasoning Workshop Technical University Berlin SR2016 James Anderson < <

2 What Device Production Equipment Use Case : Traceability Device Production Logs Where

3 What Device Production Equipment Device Production Logs Where Use Case : Traceability

4 Traceability Start with a device identifier Trace through production to origin Determine : Involved equipment : failure analysis Supplied customer : claims analysis IP Interaction Use Case : Traceability Scenario

5 Use Case : datahub/awacs/roots federation Traceability application data-hub package awacs-hub stripid package awacs IndividualProduct roots Scenario packingunitid custname SPARQL: traceability-view custname AWACS navigation workorderid stripid workorderid packingunitid InputMaterialWorkorde r workorderexecution- ForDevice packingunitid logistics info data-hub SPARQL processor

6 construct { #... } where { { service < { values ($package $) { ('SOT1207' ' ') } [] a tr:individualproduct ; tr:name $ ; tr:package $package ; tr:fromstrip?stripid ; tr:ispresent?ispresent. filter (?ispresent = 'True') [] a tr:inputmaterialworkorder ; tr:name?stripid ; tr:workorder?workordersha1 ; tr:maprole?striprole. Use Case : Traceability SPARQL } } [] a tr:workorderexecutionfordevice ; tr:name?workordersha1 ; tr:package $package ; tr:endproduct $ ; tr:mapname?mapname ; tr:maprole?maprole ; tr:hasdevice?maphasdevice. filter (?maphasdevice = 'yes') [] a tr:workorderattributes ; tr:name?workordersha1 ; tr:workorderid?workorderid ; tr:workstationid?workstationid ; tr:timestamp?timestamp. bind(concat($package, '.', xsd:string($)) as?batch_marked) bind (iri(concat(' as?individualproduct) bind (iri(concat(' as?stage_uri) bind (if(?striprole = 'in', tr:mergepack, tr:assembly) as?stage) values (?maprole?inputoutputid_pred) { ('in' tr:inputid) ('out' tr:outputid) } bind (concat(substr(?mapname, 1, 2), lcase(substr(?mapname, 3, 1)), substr(?mapname, 4)) as?packingunitid) optional { service < { # lookup a known puid for SHIP stage [] ded:batch_lot_id?packingunitid ;

7 construct?individualproduct rdf:type tr:individualproduct?individualproduct tr:model?prod_12nc_fk_uri?individualproduct tr:batchmark?batch_marked?individualproduct tr:stage?stage_uri?individualproduct tr:stage?ship?stage_uri rdf:type?stage Traceability :?stage_uri tr:batchlotid?workorderid?stage_uri tr:sha1?workordersha1?stage_uri tr:location?workstationid?stage_uri?inputoutputid_pred?mapname?stage_uri tr:date?timestamp?ship rdf:type tr:ship?ship tr:batchlotid?packingunitid?ship tr:location?loc_cd_fk_ship?ship tr:shipto?cust_nbr_ship_fk?ship tr:purchaseorder?cust_po_nbr?ship tr:date?dt_ship Algebra Graph extend?ship : ( iri ( concat " ) ) extend?prod_12nc_fk_uri : ( iri ( concat " ) ) leftjoin extend?packingunitid : ( concat ( substr?mapname 1 2 ) ( lcase ( substr?mapname 3 1 ) ) ( substr?mapname 4 ) ) service < join < CUST_NBR_SHIP_FK PROD_12NC_FK LOC_CD_FK_SHIP DT_SHIP CUST_PO_NBR packingunitid bind (?maprole?inputoutputid_pred) : (("in" tr:inputid) ("out" tr:outputid)) extend?stage : ( if ( =?striprole "in" ) tr:mergepack tr:assembly ) extend?stage_uri : ( iri ( concat " ) ) extend?individualproduct : ( iri ( concat " ) ) extend?batch_marked : ( concat?package "." ( string? ) ) service < < filter ((?ispresent = 'True') && (?maphasdevice = 'yes')) join workordersha1 timestamp workstationid workorderid join stripid striprole maphasdevice maprole mapname package workordersha1 join ispresent stripid package bind (?package?) : (("SOT1207" " "))

8 CONSTRUCT?IndividualProduct rdf:type tr:individualproduct?individualproduct tr:model?prod_12nc_fk_uri?individualproduct tr:batchmark?batch_marked?individualproduct tr:stage?stage_uri?individualproduct tr:stage?ship?stage_uri rdf:type?stage?stage_uri tr:batchlotid?workorderid?stage_uri tr:sha1?workordersha1?stage_uri tr:location?workstationid?stage_uri?inputoutputid_pred?mapname?stage_uri tr:date?timestamp?ship rdf:type tr:ship?ship tr:batchlotid?packingunitid?ship tr:location?loc_cd_fk_ship?ship tr:shipto?cust_nbr_ship_fk?ship tr:purchaseorder?cust_po_nbr?ship tr:date?dt_ship extend ((?PROD_12NC_FK_URI ( iri ( concat " ) )) (?ship ( iri ( concat " ) ))) Traceability : Hub Plan serviceleftjoin < < select (?CUST_NBR_SHIP_FK?CUST_PO_NBR?DT_SHIP?LOC_CD_FK_SHIP?packingUnitID?PROD_12NC_FK) extend ((?packingunitid ( concat ( substr?mapname 1 2 ) ( lcase ( substr?mapname 3 1 ) ) ( substr?mapname 4 ) ))) CUST_NBR_SHIP_FK PROD_12NC_FK LOC_CD_FK_SHIP DT_SHIP CUST_PO_NBR packingunitid join bind (?inputoutputid_pred?maprole) : ((tr:inputid "in") (tr:outputid "out")) extend ((?BATCH_MARKED ( concat?package "." ( string? ) )) (?IndividualProduct ( iri ( concat " ) )) (?stage_uri ( iri ( concat " ) )) (?stage ( if ( =?striprole "in" ) tr:mergepack tr:assembly ))) service < < select (??ispresent?maphasdevice?mapname?maprole?package?stripid?striprole?timestamp?workorderid?workordersha1?workstationid) filter ((?ispresent = 'True') && (?maphasdevice = 'yes')) join workordersha1 timestamp workstationid workorderid join stripid striprole maphasdevice maprole mapname package workordersha1 join ispresent stripid package bind (?package?) : (("SOT1207" " "))

9 project ( ispresent maphasdevice mapname maprole package stripid striprole timestamp workorderid workordersha1 workstationid) servicejoin?location_workorderattributes?location_workorderattributes select (?timestamp?workorderid?workordersha1?workstationid) join workordersha1 timestamp workstationid workorderid bind (?host_workorderattributes?location_workorderattributes) : ((" " filter ((?maphasdevice = 'yes')) Traceability : Agent Plan servicejoin?location_workorderexecutionfordevice?location_workorderexecutionfordevice select (??maphasdevice?mapname?maprole?package?workordersha1) join ((QUOTE, (?host_inputmaterialworkorder = '*') ('*' =?host_workorderexecutionfordevice) (?host_inputmaterialworkorder =?host_workorderexecutionfordevice))) workordersha1 maphasdevice maprole mapname package bind (?host_workorderexecutionfordevice?location_workorderexecutionfordevice) : ((" " servicejoin?location_inputmaterialworkorder?location_inputmaterialworkorder select (?stripid?striprole?workordersha1) join stripid workordersha1 striprole bind (?host_inputmaterialworkorder?location_inputmaterialworkorder) : ((" " filter ((?ispresent = 'True')) servicejoin?location_individualproduct?location_individualproduct select (??ispresent?package?stripid) join ispresent stripid package bind (?host_individualproduct?location_individualproduct) : ((" " bind (??package) : ((" " "SOT1207"))

10 CONSTRUCT?IndividualProduct rdf:type tr:individualproduct?individualproduct tr:model?prod_12nc_fk_uri?individualproduct tr:batchmark?batch_marked?individualproduct tr:stage?stage_uri?individualproduct tr:stage?ship?stage_uri rdf:type?stage?stage_uri tr:batchlotid?workorderid?stage_uri tr:sha1?workordersha1?stage_uri tr:location?workstationid?stage_uri?inputoutputid_pred?mapname?stage_uri tr:date?timestamp?ship rdf:type tr:ship?ship tr:batchlotid?packingunitid?ship tr:location?loc_cd_fk_ship?ship tr:shipto?cust_nbr_ship_fk?ship tr:purchaseorder?cust_po_nbr?ship tr:date?dt_ship extend ((?PROD_12NC_FK_URI ( iri ( concat " ) )) (?ship ( iri ( concat " ) ))) serviceleftjoin < Traceability : Combined Plan < select (?CUST_NBR_SHIP_FK?CUST_PO_NBR?DT_SHIP?LOC_CD_FK_SHIP?packingUnitID?PROD_12NC_FK) extend ((?packingunitid ( concat ( substr?mapname 1 2 ) ( lcase ( substr?mapname 3 1 ) ) ( substr?mapname 4 ) ))) CUST_NBR_SHIP_FK PROD_12NC_FK LOC_CD_FK_SHIP DT_SHIP CUST_PO_NBR packingunitid join bind (?inputoutputid_pred?maprole) : ((tr:inputid "in") (tr:outputid "out")) extend ((?BATCH_MARKED ( concat?package "." ( string? ) )) (?IndividualProduct ( iri ( concat " ) )) (?stage_uri ( iri ( concat " ) )) (?stage ( if ( =?striprole "in" ) tr:mergepack tr:assembly ))) service < < servicejoin?location_workorderattributes?location_workorderattributes select (?timestamp?workorderid?workordersha1?workstationid) join workordersha1 timestamp workstationid workorderid bind (?host_workorderattributes?location_workorderattributes) : ((" " filter ((?maphasdevice = 'yes')) servicejoin?location_workorderexecutionfordevice?location_workorderexecutionfordevice select (??maphasdevice?mapname?maprole?package?workordersha1) join ((QUOTE, (?host_inputmaterialworkorder = '*') ('*' =?host_workorderexecutionfordevice) (?host_inputmaterialworkorder =?host_workorderexecutionfordevice))) workordersha1 maphasdevice maprole mapname package bind (?host_workorderexecutionfordevice?location_workorderexecutionfordevice) : ((" " servicejoin?location_inputmaterialworkorder?location_inputmaterialworkorder select (?stripid?striprole?workordersha1) join stripid workordersha1 striprole bind (?host_inputmaterialworkorder?location_inputmaterialworkorder) : ((" " filter ((?ispresent = 'True')) servicejoin?location_individualproduct?location_individualproduct select (??ispresent?package?stripid) join ispresent stripid package bind (?host_individualproduct?location_individualproduct) : ((" " bind (??package) : ((" " "SOT1207"))

11 (select (service?trafficservice (select ( (triple?reading < (:HAVING (>?avgspeed 70) (?passages (count?reading)) (?avgspeed (avg?speed)) (?timestamp (then)))) (extend (join (select ( (triple?incident < (triple?incident < (:HAVING (>?offenses 100) :GROUP-BY (?trafficcamera (??KEY-1 (year?timestamp)) (??KEY-2 (month?timestamp)))?trafficcamera (?offenses (count?offense)))) (select (filter ( (triple?trafficcamera < (triple?trafficcamera < (&& (>=?lat 30623/1275) (&& (<=?long 39079/1488) (&& (<=?lat 35191/1176) (>=?long 18923/800))))) (?trafficcamera)))?trafficservice (iri (concat (str?trafficcamera) "?revision=r/head/pt10m/pt01m"))) :QUERY-TEXT "SELECT ( COUNT (?reading ) AS?passages ) ( AVG (?speed ) AS?avgSpeed ) ( THEN ( ) AS?timestamp ) WHERE {?reading < } HAVING (? avgspeed > 70 ) ") (?trafficcamera?time?passages?avgspeed)) Use Case : Streaming SPARQL

12 Use Case : Streaming Algebra select (?time?trafficcamera?passages?avgspeed) filter ( >?avgspeed "70"^^< ) service?trafficservice select ((?passages ( count?reading ) ) (?avgspeed ( avg?speed ) ) (?timestamp ( then ) )) extend?trafficservice : ( iri ( concat ( str?trafficcamera ) "?revision=r/head/pt10m/pt01m" ) ) filter ( >?offenses "100"^^< ) (?reading < join select (GROUP-BY (?trafficcamera (??KEY-1 ( year?timestamp ) ) (??KEY-2 ( month?timestamp ) ) )?trafficcamera (?offenses ( count?offense ) )) select (?trafficcamera) filter ( ( >=?lat " "^^< ) && ( <=?long " "^^< ) && ( <=?lat " "^^< ) ( >=?long " "^^< ) ) (?incident < (?incident < (?trafficcamera lat?lat) (?trafficcamera long?long)

13 Case : Requirements Construct SPARQL dynamically Algebra Dataset designators Communication via standard protocols

14 Dydra: RSP SPARQL Query SPARQL Update GSP Request SPARQL Engine RDF Store Graph or Solu<on Response [2]

15 Dydra: RSP = media type Agri-Esprit : development / research / deployment spreadsheet sources (tablinker) text/csv text/tab-separated-values libpq clj-plaza clojure.jena clojure.sesame read view Sesame SAIL API Jena provider API DYDRA RDF Store read table write table stored proce dures text/csv text/arff learning sources (vector datasets) Persistent Storage Java Clojure PostgreSQL

16 Dydra: [2]

17 Dydra : Revision Clauses Constant absolute: REVISION UUID {... } relative : REVISION /HEAD(~[0-9]+)?/ {... } temporal : REVISION XPathDateTime {... } Variable SIP : {?subject :revision?revision }... REVISION?revision {... } Protocol : REVISION?revision {... } Intra-Repository : REVISION?revision {?subject a?class } Extra-Repository : SERVICE?revisionEndpoint {?subject a?class }

18 Dydra : Revision Designators Elementary absolute: UUID : relative : /HEAD(~[0-9]+)?/ : HEAD~1, HEAD~1..HEAD temporal : XPathDateTime : T180000Z Compound interval : ISOInterval : T180000Z/PT10M stream : ISORepeatingInterval : R/ T180000Z/PT10M/PT01M

19 Dydra : RSP Generation What Server-Sent Events[1] Fetch [2] How [1] : < [2] : <

20 Dydra : RSP Generation : Basis SPARQL protocol ( graph-store-response (resource request response) ;;... (:post ((resource /:account/:repository/sparql ) request response (request-type mime:application/sparql) (response-type mime:sparql-results)) ;; given a body with just the query text accept the entire body. (let ((query ( request))) (graph-store-query resource query request response request-type response-type))) ;;;... )

21 Dydra : RSP Generation : Extended server-side events ( graph-store-response (resource request response) ;;... (:post ((resource spocq.si:: /:account/:repository/sparql ) request response (request-type mime:application/sparql) (response-content-type MIME:text/event-stream)) (let ((query ( request))) (graph-store-stream-query resource query request response request-type response-content-type))) ;;;... ) (defun graph-store-stream-query (resource query request response request-type response-content-type) (declare (ignore request-type)) (with-event-stream (e-stream ( response)) (loop with stream-content-type = (mime:mime-type-parameter response-content-type :accept) for revision in (repository-revision-ids (resource-repository resource)) do (stream-write-header e-stream "Content-Type" (string (type-of stream-content-type))) (stream-write-header e-stream "Revision-ID" spocq.i::*revision-id*) (stream-write-header e-stream "Memento-Datetime" ( (repository-write-date revision))) (graph-store-query revision query request response mime:application/sparql-query stream-content-type))

22 Storage Model: Evolution 1. Next, "change id efficient HEAD access inefficient urn:uuid? access space efficient inefficient mutation at scale 2. Initially, "independent term id efficient HEAD access efficient urn:uuid? access space inefficient inefficient mutation at scale 3. Current, "time-slice based" (various) O HEAD access O urn:uuid? access space efficient efficient mutation at scale

23 Repository Model: 2nd Order SPARQL 1.1 extensions for a "revisioned store" Data model SPARQL 1.1 Graph Dataset SPARQL 1.1 RSP Graph Dataset Repository Store

24 Repository Model: 1.1 Semantics Extended 2nd Order Repository > default 1st Order (metadata) Repository > default graph > named graph * > named 1st Order Repository sequence Stream model Named-Graphs comprise "temporal entities" Default-Graph attributions via "timestamp predicate" Entailment extended Window operations yield 1st Order Repository Basic entailment applied to 1st Order Repository Temporal metadata implicitly present for The "temporal predicate" specification Version succession via PROV:wasRevisionOf "Transaction time predicate" specification : then()

25 Space ontology gist schema.org STW efo efo revisions files (MB) , quads total 47, , ,375 12,807, ,503 HEAD 849 9, , , ,503 store (MB) , bytes/quad

26 Dydra: Examples

27 Thank you <