IBM Informix Dynamic Server Working with XML Data and Documents in IDS Cheetah [M02]

Transcription

1 5/7/ AM to 12.10PM Informix Edge IBM Informix Dynamic Server Working with XML Data and Documents in IDS Cheetah [M02] Keshava Murthy Architect, IBM Informix Development XML is the lingua franca for supporting Information as a service. XML helps solve business integration and data integration problems. IDS Cheetah Release will have features for publishing IDS data as XML documents and searching for XPATH expressions inside XML documents. This talk will explain the XML usage scenarios, solutions for it and how to use IDS features to solve those issues. 1

2 Agenda XML usage Data-centric Integration scenarios IDS support for XML Support in Cheetah Roadmap for XML support 2

3 XML in Application Environment XML is ubiquitous and solves many problems Application Integration Data Centric Applications Document Centric Applications Heterogeneity XML and RDBMS Persistence XML in and XML out Application requirements XML support in IDS What s planned? <? xml version= 1.0?> <purchaseorder id= > <customer id= A6789 > <name>john Smith Co</name> <address> <street>1234 W. Main</street> <city>toledo</city> <state>oh</state> <zip>95141</zip> </address> </customer> 3 1. Business integration scenarios. 2. Using XML to solve business integration issues. 3. IDS Cheetah Features for XML. 1. Publishing Functions 2. Functions evaluating XPATH. 4. Putting it all together. 5. Further thoughts on upcoming features. 3

4 Integrated Logistics Solutions spanning the supply chain intranet Unix Linux Windows iseries Fleet Management RFID Warehouse Management Performance Management business intelligence Distributed Order Management Labor Management Transportation Procurement execution & optimization Reverse Logistics Management Transportation Planning and Execution Load Management extranet Unix Linux Windows Trading Partner Management collaboration Vendor Portal 4 4

5 Typical Application Information Flow Component interaction on MQ bus using Transport XML (txml) Exceptions Management Monitor Optimization Supply Delivery Shipment Consolidation MQ Message Bus Shipment Execution Delivery Execution Business Objects Business Rules Relationship Rules external environment ERP OMS/WMS WEB Interface Other Systems 5 5

6 Typical Transportation Application SOA Websphere App server Planning Optimization Engine Websphere MQ XML Business Logic Carrier Integration Lane Tracking Supplier integration JDBC based Database Layer MQ based Event handling ODBC Fetch Data JDBC Procurement Optimization Engine TP: Bid winners TPE: Shipment Informix Dynamic Server (IDS) Storage 6 6

7 Application design follows SOA Separation of business optimization services from Integration Services XML documents exchanged follows txml (transport XML) txml documents are shred to relational tables efficient storage query performance Application queries RDBMS to create and publish txml documents/reports txml rarely changes - schema evolution isn t a requirement, but performance is. 7 7

8 Customers And Supplier Applications XML XML XML XML PLANNING Forecast and Commit Capacity Collaboration EXECUTION Purchase Order Consumption Remittance Acknowledge Ship Notice Invoice VISIBILITY Inventory Order Status In-Transit XML XML XML XML B2B Platform (RosettaNet, etc) Handles XML Receipt of Customer Order Applications -- Handles XML Order Process And Planning Pick and Pack Ship Other Modules JDBC Database 8 8

9 Business Transaction Using Partner Interface Process Trading Partner A Backend Processing XML Service Interface Business Agreement XML Service Interface Trading Partner B XML Backend Processing Private Process Public Process Private Process 9 9

10 XML Standards Many XML based Standards Based Being developed Standard helps heterogeneous applications to interact Standards are stable B2B RosettaNet Transportation LEMA and txml Banking and Financial Markets IFX - Interactive Financial Exchange Trades, banking, consumer transactions, etc. Insurance ACORD Policy management, underwriting, indemnity, claims, etc. Health Care HL7 Patient Management Diagnosis, treatments, prescriptions, etc

11 IDS (XML Plans) HTTP/SOAP XML Publishing & Extraction with XPATH support XSLT Transformation XML aware FullText Index (with XPath Support) XML Schema Repository And Shredding Functions Websphere MQ Integration Websphere MQ JDBC IDS Web Service Provider J2EE Applications EGL Apps WORF/DADX WebSphere Application Server PHP Apache/Tomcat Server ESQL/C, ODBC,.NET applications Direct Applications 11 11

12 IDS Client genxml functions genxml() genxmlelem() genxmlqueryhdr() UDR invoking the XSLT4C and XML4C libraries within IDS XSLT4C Processor XML4C Parser IDS Client Extract functions extract() extracevalue() existsnode() idsxmlparse() Informix Dynamic Server ICU XSLT4C and XML4C 12

13 What s in Cheetah? XML Publishing Functions Genxml() and GenxmlClob() Genxmlqueryhdr() and GenxmlqueryhdrClob() Genxmlelem() and genxmlelemclob() XPath functions for pattern matching and extraction within XML document Extract() and Extractclob() ExtractValue() ExistsNode() 13

14 Genxml() and GenxmlClob() Genxml(row_for_publishing, doc name ) returns lvarchar(32739) Built-in function Aggregate function Output limited to max size of lvarchar bytes Resultset larger than that will raise error SELECT genxml(row(c.cno, c.fname, c.lname, o.ordid), cust_order') FROM customer c, orders o Where c.cno = and o.ord_date = 05/20/2006 c.cno = o.cno; GenxmlClob() -- Same except the return type is CLOB for larger docs 14

15 Genxml() and GenxmlClob() SELECT genxml( row, classes) from classes where classid < 5;; SELECT genxmlclob( row, classes) from classes where classid < 5; The output for both queries (type is different) : (expression) <row classid="1" class="125" subject="chemistry"/><row classid="2" class="250" subject="physics"/><row classid="3" class="375" subject="mathematics"/><row classid="4" class="500" subject="biology"/> 15

16 Genxmlelem() and GenxmlelemCLOB() Same as Genxml() except generates tags for each element separately SELECT genxml(row(c.cno, c.fname, c.lname, o.ordid), cust_order') FROM customer c, orders o Where c.cno = and o.ord_date = 05/20/2006 c.cno = o.cno; Example demo 16

17 Genxmlquery() and GenxmlqueryClob() Genxmlquery( docname, query) returns lvarchar(32760) GenxmlqueryClob( docname, query) returns Clob Makes it easier to generate queries for static queries No need to write the ROW( ) in the projection list. Only XML document is returned Query passed in will have to be prepared and executed everytime. The elements name will be same as the column names in projection list. 17

18 Genxmlqueryhdr() and GenxmlqueryhdrClob() EXECUTE FUNCTION genxmlqueryhdr('manufact_set','select * FROM manufact'); (expression) <?xml version="1.0" encoding="iso "?> <!DOCTYPE manufact_set SYSTEM "../manufact_set.dtd"> <?xml-stylesheet type="text/xsl" href="../manufact_set.xsl"?> <manufact_set> <row> <manu_code>smt</manu_code> (removed for brevity) <manu_code>nkl</manu_code> <manu_name>nikolus </manu_name> <lead_time> 8</lead_time> </row> <row> <manu_code>prc</manu_code> <manu_name>procycle </manu_name> <lead_time> 9</lead_time> </row> </manufact_set> 1 row(s) retrieved. 18

19 Extract() and ExtractValue() SELECT extract(col2, '/personnel/person[3]/name/given') FROM tab; SELECT extractvalue(col2, '/personnel/person[3]/name/given') FROM tab; execute function extract( <person><name><fname>john</fname><lna me>kelly</lname></person>, /person/name/lname ); select col1 from tab where existsnode(col2, 19 '/personnel/person/*/ ') = 1;

20 ExtractClob() and ExtractValueClob() SELECT extractclob(col2, '/personnel/person[3]/name/given') FROM tab_clob_neg; SELECT extractvalueclob(col2, '/personnel/person[3]/name/given') FROM tab_clob_neg; 20

21 ExistsNode() SELECT customer, extract(purchaseorder, ) AS purchase_orders FROM orders WHERE existsnode(purchaseorder, /purchaseorder[list/item/desc/text = Shoes ] ) = 1; 21

22 DEMO 22

23 IDS XML Roadmap 23

24 XML Publishing (In IDS Cheetah) Convert IDS result set into XML document. SELECT genxmlauto("employee", row(empid, emplname, empfname)) FROM employees; SELECT genxmlautoelem("employee", row(empid, emplname, empfname)) FROM employee; Support extraction of xml nodes from an XML document via XPATH expression SELECT customer, extract(purchaseorder, ) AS purchase_orders FROM orders WHERE XMLExists(purchaseOrder, /purchaseorder[list/item/desc/text= Shoes ] ); Support extraction of values from an XML document via XPATH expression SELECT customer, extract(purchaseorder, /purchaseorder/@orderdate ) AS purchase_orders FROM orders WHERE XMLExists(purchaseOrder, /purchaseorder[list/item/desc/text= Shoes ] ); 24 24

25 XSLT Transformation XSLT is used to transform XML documents XML to XML (transform to confirm different schema/standard) XML to HTML XML to PDF The XSLT DataBlade creates several UDRs that take an XML document and an XSL stylesheet as input and return the transformed document -- Transforming XML documents stored in tables select xslt_transform(s.style_doc, x.xml_doc) FROM style_sheets s, xml_docs x WHERE s.style_title = 'ecommerce_root.xsl' AND x.xml_transaction_id = 12345; -- Transforming dynamically generated XML documents select xslt_transform(s.style_doc, genxml( transaction, row(o.trnid, o.custid, o.addr))) FROM style_sheets s, orders o WHERE s.style_title = 'ecommerce_root.xsl' AND o.trnid = 12345; 25 25

26 XML Shredding Shredding is the mechanism to map XML schema into relational schema and shred the XML document into relational tables. Schema has annotations indicating how xml data is entered into database Based on actual values and serializations of input Applications register Schema with IDS. Then, simply use stored procedures to shred XML documents and insert into tables. xdbdecompxml(rschema,xmlschemaname,xmldoc,documentid, Validation_flag, ) 26 26

27 Fulltext Index for XML Use when you store XML documents into columns Helpful when looking for an XPath expression in the doc. Efficient because the XPath expression is evaluated by the index SELECT customer, address XML Document AS purchase_orders FROM orders WHERE XMLExists(purchaseOrder, /purchaseorder[list/it em/desc/text= Shoes ] ); XMLExists evaluates the document for XPath expression and XML aware index should handle it. 27 XPath Expression 27

28 Session: M02 Session Title: XML Support in IBM Informix Dynamic Server Current and Future Releases Thank You Keshava Murthy IBM 28 28