Coleman Leviter Arrow Electronics IT Software Systems Engineer

Transcription

1 XML Presentation Techniques for Sending/Receiving XML Packets Using SQL Developer 11g Release 2 Thursday, September 22, :45AM 11:45AM Developer Room 118 1

2 Techniques for Sending/Receiving XML Packets Using SQL Developer 11g Release 2 Coleman Leviter Arrow Electronics IT Software Systems Engineer cleviter@ieee.org Presentation #411 2

3 CV - WMS Group Thirteen years - VAX Rewrite (.for ) to UNIX (.c,.pc) - VAX Forms to Oracle Forms - TIFF file migration to Oracle - XML Development - WMS Development and Support - IOUG Select Contributor 06, 08 - ODTUG Journal 09 - NYOUG WEB SIG Chair, Steering Committee - IOUG Collaborate 07, 08, 09, 10, 11, '12 - Oracle Open World 10, '11 - IOUG Development Co-track Manager 10 - IOUG Education Co-Chair 11 - COLLABORATE 12 - IOUG FORUM CONFERENCE CHAIR 3

4 Presentation Objectives Introduction Background - Project Data Structures XML Packet Techniques XML Child Node Packets CLOB Packets Demo Questions 4

5 Oracle XML History 8i XML Api 9i XML Storage 10g 2004 XPath, Within 11g Binary XML 12g???? 5

6 Terminology XML 1 - Short for extensible Markup Language, a specification developed by the World Wide Web Consortium (W3C). It allows designers to create their own customized tags, enabling the definition, transmission, validation, and interpretation of data between applications and between organizations. Warehouse Management System - a component of the movement and storage of materials within a warehouse 1 6

7 Develop XSD Data Structures Temporary Tables Project Steps Use Oracle 11g XML DB for messages Use MQ Series for the communications layer guaranteed message delivery 7

8 XSD Design XML SPY XML Schema Definition (XSD) language is the current standard schema language for all XML documents and data. 8

9 Nodal Representation house room room room room kitchen living room dining room den oven range chair couch table lamp 9

10 Table Name: my_relat_table NAME ITEM kitchen sink kitchen oven kitchen refrigerator living_room pictures dining_room table dining_room chair dining_room chandelier den chair den lamp den étagère Table Data 10

11 XML Document <?xml version="1.0" encoding="windows-1252"?> <house> <item>sink</item> <item>table</item> <item>counter</item> <item>microwave</item> etc... </house> 11

12 EBS/SOA*-WMS Data Flow MQ Write Queue XML Request Message XML Request Message MQ Status Step 1 EBS/SOA* WMS Step 1 MQ Status XML Request Message XML Request Message MQ Read Queue * DTI Direct Transfer Interface 12

13 XML Producer / Consumer Model XML Document 1 XML Document 1 XML Document 2 PIPE XML Document 2 XML Document n XML Document n 13

14 Problem The pipe is 32k bytes XML Documents can range in size upwards past the 32k bytes size of the pipe How do know how big to make the pipe? Pipe size - 32k bytes? 64K bytes? 128K bytes? Where do you stop? 14

15 Possible Solutions Restrict XML Documents < 32k bytes? Create several different size pipes and use as needed? Break up the XML Document and ship through the pipe? 15

16 Data Structures --- original CREATE TABLE MY_RELAT_TABLE ( NAME VARCHAR2(20 BYTE), ITEM VARCHAR2(20 BYTE) ); --- xml, clob CREATE TABLE MY_XML_TABLE ( REF_ID NUMBER, XMLCOL SYS.XMLTYPE, CLOBCOL CLOB); --- reconstructed CREATE TABLE MY_RELAT_TABLE_XML_PARSED ( NAME VARCHAR2(20 BYTE), ITEM VARCHAR2(20 BYTE)); 16

17 XML Packet Creation XML Document > 32K Each XML Document < 32 K Parent Node Child Node 1 Parent Node Parent Node Child Node 2 Child Node 1 XML DB Parent Node Child Node 2 pl/sql Child Node 3 Child Node 3 Parent Node Child Node 4 Child Node n Parent Node Child Node n P I P E 17

18 XML Packet - Multiple Child Nodes <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>1</PacketNumber> <AnyMorePackets>Y</AnyMorePackets> <TotalPackets>4</TotalPackets> <house> child 1 <item>sink</item> child 2 <item>table</item> child 3 <item>counter</item> </house> </StandardHeader> 18

19 Producer - XML Create Child Node Packet Create Standard Header with root node house" <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>1</PacketNumber> <AnyMorePackets>Y</AnyMorePackets> <TotalPackets>4</TotalPackets> <house> <item>counter</item> <item>microwave</item> </house> </StandardHeader> 19

20 Producer - XML Create Child Node Packet Create Standard Header with root node house" <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>2</PacketNumber> <AnyMorePackets>Y</AnyMorePackets> <TotalPackets>4</TotalPackets> <house> <name>living_room</name> <item>pictures</item> <name>living_room</name> <item>chair</item> </house> </StandardHeader> 20

21 Producer - XML Create Child Node Packet Create Standard Header with root node house" <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>3</PacketNumber> <AnyMorePackets>Y</AnyMorePackets> <TotalPackets>4</TotalPackets> <house> <name>dining_room</name> <item>étagère</item> <name>dining_room</name> <item>chair</item> </house> </StandardHeader> 21

22 Producer - XML Create Child Node Packet Create Standard Header with root node house" <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>4</PacketNumber> <AnyMorePackets>N</AnyMorePackets> <TotalPackets>4</TotalPackets> <house> <name>den</name> <item>fireplace</item> <name>den</name> <item>table</item> </house> </StandardHeader> 22

23 XML Document Re-Construction Each XML Document < 32 K Parent Node XML Document > 32K Child Node 1 P I P Parent Node Child Node 2 Parent Node Child Node 3 XML DB pl/sql Parent Node Child Node 1 Child Node 2 E Parent Node Child Node 4 Child Node 3 Parent Node Child Node n Child Node n 23

24 XML Document <?xml version="1.0" encoding="windows-1252"?> <house> <item>sink</item> <item>table</item> <item>counter</item> <item>microwave</item> etc... </house> 24

25 Restored Table Data Table Name: my_relat_table_xml_parsed NAME ITEM kitchen sink kitchen oven kitchen refrigerator living_room pictures dining_room table dining_room chair dining_room chandelier den chair den lamp den étagère Q.E.D. (demo) 25

26 XML (CLOB) Packet Creation CLOB < 32 K XML Document > 32K XML Header 1 CLOB 1 XML XML DB XML Header 2 CLOB 2 XML Header 3 P I Document pl/sql CLOB 3 XML Header 4 CLOB 4 P E XML Header n CLOB n 26

27 Table Name: my_relat_table NAME ITEM kitchen sink kitchen oven kitchen refrigerator living_room pictures dining_room table dining_room chair dining_room chandelier den chair den lamp den étagère Table Data 27

28 XML Document <?xml version="1.0" encoding="windows-1252"?> <house> <item>sink</item> <item>table</item> <item>counter</item> <item>microwave</item> etc... </house> 28

29 CLOB Packet - 1 <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>1</PacketNumber> <AnyMorePackets>Y</AnyMorePackets> <TotalPackets>4</TotalPackets> </StandardHeader> <?xml version="1.0" encoding="utf- 8"?><house><item>sink</it em><item>table</it em><item>counter</ item><item>microwa ve</item><item>ove n </item></r* *cutoff point 29

30 CLOB Packet - 2 <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>2</PacketNumber> <AnyMorePackets>Y</AnyMorePackets> <TotalPackets>4</TotalPackets> </StandardHeader> oom><item>range</item> <item>refrige rator</item><name>living_room</na me><item>pictures</item><name>liv ing_room</name><item>chair</item> <name>living_room</name><item>television</item ><name>li* *cutoff point 30

31 CLOB Packet - 3 <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>3</PacketNumber> <AnyMorePackets>Y</AnyMorePackets> <TotalPackets>4</TotalPackets> </StandardHeader> ving_room</name><item>couch</item>< name>dining_room</name><item>table</item></roo m><name>dining_room</name><item>etagere< /item><name>dining_room</name><it em>chair</item><name>dining_room< /name><item>chandelier</item><nam e>den</name><item>fire* *cutoff point 31

32 CLOB Packet - 4 <StandardHeader> <DateTime>mm/dd/yyyy hh:mi:ss</datetime> <PacketNumber>4</PacketNumber> <AnyMorePackets>N</AnyMorePackets> <TotalPackets>4</TotalPackets> </StandardHeader> place</item><name>den</name><it em>table</item><name>den</name ><item>chair</item><name>den</ name><item>lamp</item><name>de n</name><item>étagère</item></house> 32

33 CLOB (XML) Document Construction 2 of 2 (CLOB + XML Header) < 32 K XML Header 1 XML Document > 32K CLOB 1 P I P E XML Header 2 CLOB 2 XML Header 3 CLOB 3 XML Header 4 CLOB 4 XML DB pl/sql XML Document XML Header n CLOB n 33

34 XML Document - Reconstructed <?xml version="1.0" encoding="windows-1252"?> <house> <item>sink</item> <item>table</item> <item>counter</item> <item>microwave</item> etc... </house> 34

35 Restored Table Data Table Name: my_relat_table_xml_parsed NAME ITEM kitchen sink kitchen oven kitchen refrigerator living_room pictures dining_room table dining_room chair dining_room chandelier den chair den lamp den étagère Q.E.D. (demo) 35

36 Technique Comparison - Summary XML Child Node Packets - multiple child relationship to one parent. May also apply to many children belonging to many parents. Complications - bookkeeping - accordion like effect Data Structures - agreement with both sides XML header prefixed to a CLOB packet The entire XML document is divided into arbitrary sections or CLOBs. The receiver must know the size of the XML header prior to any data transfer The XML header is segregated from the payload With all the CLOB pieces recovered, reconstruct the original XML document. 36

37 References 1 Wikipedia, 2 XML DB, 3 Wikipedia, 4 Oracle dbms_lob, 5 Wikipedia, 6 Wikipedia, 37

38 Questions 38