Type Based XML Projection

Transcription

1 1/90, Type Based XML Projection VLDB 2006, Seoul, Korea Véronique Benzaken Dario Colazzo Giuseppe Castagna Kim Nguy ên : Équipe Bases de Données, LRI, Université Paris-Sud 11, Orsay, France : Équipe Langage, DI, École Normale Supérieure, Paris, France

2 2/90, Outline 1 Introduction 2 Notations 3 Algorithm 4 Formal results 5 Experiments 6 Conclusion

3 3/90, Outline 1 Introduction 2 Notations 3 Algorithm 4 Formal results 5 Experiments 6 Conclusion

4 Main memory query (XQuery) processing 4/90,

5 4/90, Main memory query (XQuery) processing Pros : Lightweight system

6 4/90, Main memory query (XQuery) processing Pros : Lightweight system Easy to program and integrate into an existing architecture

7 4/90, Main memory query (XQuery) processing Pros : Lightweight system Easy to program and integrate into an existing architecture Cons : DOM like data-models are memory killers.

8 4/90, Main memory query (XQuery) processing Pros : Lightweight system Easy to program and integrate into an existing architecture Cons : DOM like data-models are memory killers.

9 We can use pruning to reduce the amount of data needed in main memory! 9/90,

10 9/90, We can use pruning to reduce the amount of data needed in main memory! Exemple : for $x in $doc/descendant-or-self::title/child::text() return $x

11 9/90, We can use pruning to reduce the amount of data needed in main memory! Exemple : for $x in $doc/descendant-or-self::title/child::text() return $x <bib> <book year="1994"> <title>tcp/ip Illustrated</title> <author><last>stevens</last><first>w.</first></author> <publisher>addison-wesley</publisher> <price>65.95</price> </book> <book year="1992"> <title>advanced Programming in the Unix environment</title> <author><last>stevens</last><first>w.</first></author> <publisher>addison-wesley</publisher> <price>65.95</price> </book>... </bib>

12 12/90, Projecting XML Documents, Amélie Marian and Jérome Siméon, VLDB Queries + document analysis to compute the pruning : + Algorithm is formally specied + Achieve high precision in pruning Does not take into account backward axis. Performances degrade in the presence of // Indeed, for some queries, pruning the document is more expensive than actually executing the query.

13 13/90, Solution : Queries + type based optimisations By using a DTD and a given set of queries, we can statically infer a projector for the set of queries and use it to prune the document. Main advantages : Ecient : no additional cost at runtime Take into account backward axis Soundness : executing the query on the projected document gives the same result as on the original. Precision (and even exact for a large class of DTDs and queries).

14 14/90, Outline 1 Introduction 2 Notations 3 Algorithm 4 Formal results 5 Experiments 6 Conclusion

15 15/90, Denition (DTD) A DTD is a pair (X, E) where X is a distinguished name (the root) and E is a set of productions of the form where each R i is of the form : {X 1 R 1,..., X n R n } a i [Regexp] or String where a i is a unique tag name and Regexp a regular expression of X i. Names(E) is the set of names occuring in E.

16 16/90, Denition (Projector) For a given DTD (X, E) a type projector for (X, E) is a set of names P such that : 1 P Names(E) 2 X i P there is at least one derivation from X to X i in E

17 17/90, Denition (Pruning) The pruning (or projection) of a document D valid w.r.t a DTD (X, E) with the projector P is a document D where every node not generated by a name in P is erased (replaced by the empty sequence).

18 17/90, Denition (Pruning) The pruning (or projection) of a document D valid w.r.t a DTD (X, E) with the projector P is a document D where every node not generated by a name in P is erased (replaced by the empty sequence). a <!ELEMENT a (b,c)> <!ELEMENT b <!ELEMENT c (d,e)> (d,e)> b c <!ELEMENT d (#PCDATA)> <!ELEMENT e (#PCDATA)> d e

19 for $x in $doc/descendant-or-self::c return $x 19/90,

20 for $x in $doc/descendant-or-self::c return $x X a a[x b, X c ] X b b[x d, X e ] X c c[x d, X e ] X d String X e String <a> <b> <d>lotsofdata</d> <e>superlongstring<e/> </b> <c> <d>bar</d> <e>foo<e/> </c> </a> 19/90,

21 for $x in $doc/descendant-or-self::c return $x X a a[x b, X c ] X b b[x d, X e ] X c c[x d, X e ] X d String X e String <a> <b> <d>lotsofdata</d> <e>superlongstring<e/> </b> <c> <d>bar</d> <e>foo<e/> </c> </a> P = {X a, X c, X d, X e } <a> <b> <d>lotsofdata</d> <e>superlongstring<e/> </b> <c> <d>foo</d> <e>bar<e/> </c> </a> 19/90,

22 for $x in $doc/descendant-or-self::c return $x X a a[x b, X c ] X b b[x d, X e ] X c c[x d, X e ] X d String X e String <a> <b> <d>lotsofdata</d> <e>superlongstring<e/> </b> <c> <d>bar</d> <e>foo<e/> </c> </a> P = {X a, X c, X d, X e } <a> <b> <d>lotsofdata</d> <e>superlongstring<e/> </b> <c> <d>foo</d> <e>bar<e/> </c> </a> 19/90,

23 23/90, Denition (XPath (1.0)) Q ::= Axis :: Test Axis :: Test[Expr] Q/Q Expr := Q Expr op Expr f(expr,..., Expr) Base Axis ::= self child descendant parent ancestor... Test ::= tag node() text() Denition (Simple path) Q ::= Axis :: Test Axis :: Test[Cond] Q/Q SPath ::= Axis :: Test Axis :: Test/SPath Cond := SPath Cond or Cond

24 24/90, Outline 1 Introduction 2 Notations 3 Algorithm 4 Formal results 5 Experiments 6 Conclusion

25 25/90, Overall process Static inference : DTD

26 25/90, Overall process Static inference : DTD Q1 XQuery Q2 Q3 Q4 Q5

27 25/90, Overall process Static inference : DTD XQuery Q2 Q3 Q1 Q4 Q5 P

28 25/90, Overall process Runtime : D1 D3 D2 D1

29 25/90, Overall process Runtime : D1 D3 D2 D1 P

30 25/90, Overall process Runtime : D1 D3 D2 D1 P D 1 D 1 D 2 D 1

31 D1 R3 R2 R1 25/90, Overall process Runtime : D1 D3 D2 D1 P D 1 D 1 D 2 D 1 XQuery Q2 Q3 Q1 Q4 Q5

32 32/90, Static inference Q1 XQuery Q2 Q3 Q4 Q5

33 32/90, Static inference XQuery Q2 Q3 Q1 Q4 Q5 XPath XPath 1 XPath 2 XPath 7 XPath 3 XPath XPath 1 XPath 6 XPath 4 XPath XPath 1 5

34 32/90, Static inference XQuery Q2 Q3 Q1 Q4 Q5 XPath XPath 1 XPath 2 XPath 7 XPath 3 XPath XPath 1 XPath 6 XPath 4 XPath XPath 1 5 SPath XPath 11 SPath 2 SPath 7 SPath 3 SPath XPath 1 XPath 6 SPath 4 SPath SPath 1 5

35 32/90, Static inference XQuery Q2 Q3 Q1 Q4 Q5 XPath XPath 1 XPath 2 XPath 7 XPath 3 XPath XPath 1 XPath 6 XPath 4 XPath XPath 1 5 SPath XPath 11 SPath 2 SPath 7 SPath 3 SPath XPath 1 XPath 6 SPath 4 SPath SPath 1 5 SPath 1

36 32/90, Static inference XQuery Q2 Q3 Q1 Q4 Q5 XPath XPath 1 XPath 2 XPath 7 XPath 3 XPath XPath 1 XPath 6 XPath 4 XPath XPath 1 5 SPath XPath 11 SPath 2 SPath 7 SPath 3 SPath XPath 1 XPath 6 SPath 4 SPath SPath 1 5 SPath 1 DTD

37 32/90, Static inference XQuery Q2 Q3 Q1 Q4 Q5 XPath XPath 1 XPath 2 XPath 7 XPath 3 XPath XPath 1 XPath 6 XPath 4 XPath XPath 1 5 SPath XPath 11 SPath 2 SPath 7 SPath 3 SPath XPath 1 XPath 6 SPath 4 SPath SPath 1 5 SPath 1 Type Projector Inference DTD Type Inference

38 32/90, Static inference XQuery Q2 Q3 Q1 Q4 Q5 XPath XPath 1 XPath 2 XPath 7 XPath 3 XPath XPath 1 XPath 6 XPath 4 XPath XPath 1 5 SPath XPath 11 SPath 2 SPath 7 SPath 3 SPath XPath 1 XPath 6 SPath 4 SPath SPath 1 5 SPath 1 Type Projector Inference DTD Type Inference P1

39 32/90, Static inference XQuery Q2 Q3 Q1 Q4 Q5 XPath XPath 1 XPath 2 XPath 7 XPath 3 XPath XPath 1 XPath 6 XPath 4 XPath XPath 1 5 SPath XPath 11 SPath 2 SPath 7 SPath 3 SPath XPath 1 XPath 6 SPath 4 SPath SPath 1 5 SPath SPath 12 3 DTD Type Projector Inference Type Inference P1 P2 P1

40 32/90, Static inference XQuery Q2 Q3 Q1 Q4 Q5 XPath XPath 1 XPath 2 XPath 7 XPath 3 XPath XPath 1 XPath 6 XPath 4 XPath XPath 1 5 SPath XPath 11 SPath 2 SPath 7 SPath 3 SPath XPath 1 XPath 6 SPath 4 SPath SPath 1 5 SPath SPath 12 3 Type Projector Inference DTD Type Inference P1 P2 P1 P

41 41/90, Type inference typeinf(dtd,{x},path) = T Type T is the set of names of types of nodes in the result.

42 41/90, Type inference typeinf(dtd,{x},path) = T Type T is the set of names of types of nodes in the result. T = query gives an empty result on any document.

43 41/90, Type inference typeinf(dtd,{x},path) = T Type T is the set of names of types of nodes in the result. T = query gives an empty result on any document. /self::a/child::b/child::d

44 Type inference typeinf(dtd,{x},path) = T Type T is the set of names of types of nodes in the result. T = query gives an empty result on any document. /self::a/child::b/child::d 1 typeinf(dtd,{x a },self::a)= {X a } a b c d e 41/90,

45 Type inference typeinf(dtd,{x},path) = T Type T is the set of names of types of nodes in the result. T = query gives an empty result on any document. /self::a/child::b/child::d 1 typeinf(dtd,{x a },self::a)= {X a } 2 typeinf(dtd,{x a },child::b)= {X b } a b c d e 41/90,

46 Type inference typeinf(dtd,{x},path) = T Type T is the set of names of types of nodes in the result. T = query gives an empty result on any document. /self::a/child::b/child::d 1 typeinf(dtd,{x a },self::a)= {X a } 2 typeinf(dtd,{x a },child::b)= {X b } 3 typeinf(dtd,{x b },child::d)= {X d } b a c d e 41/90,

47 Type inference typeinf(dtd,{x},path) = T Type T is the set of names of types of nodes in the result. T = query gives an empty result on any document. /self::a/child::b/child::d 1 typeinf(dtd,{x a },self::a)= {X a } 2 typeinf(dtd,{x a },child::b)= {X b } 3 typeinf(dtd,{x b },child::d)= {X d } P = {X a, X b, X d } b a c d e 41/90,

48 //*/self::b/child::d 48/90,

49 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) a b c d e

50 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) a b c d e

51 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) 1 typeinf(dtd,{x b },self::b/child::d)= {X d } a b c d e

52 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) 1 typeinf(dtd,{x b },self::b/child::d)= {X d } 2 typeinf(dtd,{x c },self::b/child::d)= b a c d e

53 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) 1 typeinf(dtd,{x b },self::b/child::d)= {X d } 2 typeinf(dtd,{x c },self::b/child::d)= 3 typeinf(dtd,{x d },self::b/child::d)= b a c d e

54 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) 1 typeinf(dtd,{x b },self::b/child::d)= {X d } 2 typeinf(dtd,{x c },self::b/child::d)= 3 typeinf(dtd,{x d },self::b/child::d)= 4 typeinf(dtd,{x e },self::b/child::d)= b a c d e

55 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) 2 typeinf(dtd,{x b },self::b)= {X b } a b c d e

56 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) 2 typeinf(dtd,{x b },self::b)= {X b } 3 typeinf(dtd,{x b },child::d)= {X d } b a c d e

57 48/90, //*/self::b/child::d 1 typeinf(dtd,{x a },//*) 2 typeinf(dtd,{x b },self::b)= {X b } 3 typeinf(dtd,{x b },child::d)= {X d } P = {X a, X b, X d } b a c d e

58 /self::a/child::b/child::d/parent::node()/child::d 58/90,

59 58/90, /self::a/child::b/child::d/parent::node()/child::d 1 typeinf(dtd,{x a },self::a)= {X a } 2 typeinf(dtd,{x a },child::b)= {X b } 3 typeinf(dtd,{x b },child::d)= {X d } b a c d e

60 58/90, /self::a/child::b/child::d/parent::node()/child::d 1 typeinf(dtd,{x a },self::a)= {X a } 2 typeinf(dtd,{x a },child::b)= {X b } 3 typeinf(dtd,{x b },child::d)= {X d } 4 typeinf(dtd,{x d },parent::node())= {X b, X c } b a c d e

61 58/90, /self::a/child::b/child::d/parent::node()/child::d 1 typeinf(dtd,{x a },{X a },self::a)= {X a } a b c d e

62 58/90, /self::a/child::b/child::d/parent::node()/child::d 1 typeinf(dtd,{x a },{X a },self::a)= {X a } 2 typeinf(dtd,{x a },{X a },child::b)= {X b } a b c d e

63 58/90, /self::a/child::b/child::d/parent::node()/child::d 1 typeinf(dtd,{x a },{X a },self::a)= {X a } 2 typeinf(dtd,{x a },{X a },child::b)= {X b } 3 typeinf(dtd,{x b },{X a, X b },child::d)= {X d } b a c d e

64 58/90, /self::a/child::b/child::d/parent::node()/child::d 1 typeinf(dtd,{x a },{X a },self::a)= {X a } 2 typeinf(dtd,{x a },{X a },child::b)= {X b } 3 typeinf(dtd,{x b },{X a, X b },child::d)= {X d } 4 typeinf(dtd,{x d },{X a, X b, X d },parent:: node())= {X b } b a c d e

65 58/90, /self::a/child::b/child::d/parent::node()/child::d 1 typeinf(dtd,{x a },{X a },self::a)= {X a } 2 typeinf(dtd,{x a },{X a },child::b)= {X b } 3 typeinf(dtd,{x b },{X a, X b },child::d)= {X d } 4 typeinf(dtd,{x d },{X a, X b, X d },parent:: node())= {X b } 5 typeinf(dtd,{x b },{X a, X b, X d },child::d)= {X d } b a c d e

66 58/90, /self::a/child::b/child::d/parent::node()/child::d 1 typeinf(dtd,{x a },{X a },self::a)= {X a } 2 typeinf(dtd,{x a },{X a },child::b)= {X b } 3 typeinf(dtd,{x b },{X a, X b },child::d)= {X d } 4 typeinf(dtd,{x d },{X a, X b, X d },parent:: node())= {X b } 5 typeinf(dtd,{x b },{X a, X b, X d },child::d)= {X d } b a c P = {X a, X b, X d } d e

67 67/90, Outline 1 Introduction 2 Notations 3 Algorithm 4 Formal results 5 Experiments 6 Conclusion

68 68/90, Soundness Theorem (Soundness) Let D be a document valid w.r.t a DTD (X, E) and p a path. Let P the type projector deduced from p. Let D be the projection of D with P. eval(p,d) = eval(p,d )

69 69/90, Completeness Pruning is precise...

70 69/90, Completeness Pruning is precise... Theorem (Completeness) P = {X 1,..., X n } the type projector associated with a path p and a DTD (X, E). Let P = P\{X i }. There exists D a document and it's projection D such that : eval(p,d) eval(p,d ) Completeness holds with : some restrictions on the DTD (star-guarded, non-recursive,... )

71 69/90, Completeness Pruning is precise... Theorem (Completeness) P = {X 1,..., X n } the type projector associated with a path p and a DTD (X, E). Let P = P\{X i }. There exists D a document and it's projection D such that : eval(p,d) eval(p,d ) Completeness holds with : some restrictions on the DTD (star-guarded, non-recursive,... ) some restrictions on the path (no upward axis in predicates,... )

72 69/90, Completeness Pruning is precise... Theorem (Completeness) P = {X 1,..., X n } the type projector associated with a path p and a DTD (X, E). Let P = P\{X i }. There exists D a document and it's projection D such that : eval(p,d) eval(p,d ) Completeness holds with : some restrictions on the DTD (star-guarded, non-recursive,... ) some restrictions on the path (no upward axis in predicates,... )

73 69/90, Completeness Pruning is precise... Theorem (Completeness) P = {X 1,..., X n } the type projector associated with a path p and a DTD (X, E). Let P = P\{X i }. There exists D a document and it's projection D such that : eval(p,d) eval(p,d ) Completeness holds with : some restrictions on the DTD (star-guarded, non-recursive,... ) some restrictions on the path (no upward axis in predicates,... )

74 74/90, Outline 1 Introduction 2 Notations 3 Algorithm 4 Formal results 5 Experiments 6 Conclusion

75 75/90, Protocol : Linux desktop, 512MB Ram, 3Ghz x86 CPU (and no swap). Implementation in OCaml. Validity of the result checked with the Galax query engine. Pruning tested on XMark and XPathMark benchmarks.

76 75/90, Protocol : Linux desktop, 512MB Ram, 3Ghz x86 CPU (and no swap). Implementation in OCaml. Validity of the result checked with the Galax query engine. Pruning tested on XMark and XPathMark benchmarks. Prunning is one pass buerless traversal of the document. In practice, computing the type projector is fast.

77 77/90, Memory (in MB) QM03 QM06 QM07 QM14 QM15 QM19 QP01 QP02 QP03 QP04 QP05 QP06 QP07 QP08 QP09 QP10 QP11 QP12 QP13 QP21 QP23 Original document Query Projected document Axes present in the query Runtime conditions Memory used to process a 56 MB document with Galax.

78 78/90, Gain QM03 QM06 QM07 QM14 QM15 QM19 Original Size (MB) Pruned Size(MB) 25 5, Memory Usage (MB) % of original size Gain in Speed ( faster)

79 79/90, Comparison with previous work Qualitative : type projectors are always comparable and serval times more precise.

80 79/90, Comparison with previous work Qualitative : type projectors are always comparable and serval times more precise. Performances : pruning is linear in time (in the size of the document) and constant in memory. It can be done while validating the document.

81 79/90, Comparison with previous work Qualitative : type projectors are always comparable and serval times more precise. Performances : pruning is linear in time (in the size of the document) and constant in memory. It can be done while validating the document. Features : handles backward as well as following/preceding axes.

82 82/90, Outline 1 Introduction 2 Notations 3 Algorithm 4 Formal results 5 Experiments 6 Conclusion

83 83/90, Conclusion Formal foundations ensure validity of the pruning and it's eciency.

84 83/90, Conclusion Formal foundations ensure validity of the pruning and it's eciency. Handle any XQuery query, either directly or by approximating it.

85 83/90, Conclusion Formal foundations ensure validity of the pruning and it's eciency. Handle any XQuery query, either directly or by approximating it. Whereas approximations are made for runtime conditions, the technique still preserve a high degree of precision.

86 83/90, Conclusion Formal foundations ensure validity of the pruning and it's eciency. Handle any XQuery query, either directly or by approximating it. Whereas approximations are made for runtime conditions, the technique still preserve a high degree of precision. No additional cost at runtime.

87 87/90, Future work Many directions : Adapt our approach to work on untyped documents by using data-guides or path summaries.

88 87/90, Future work Many directions : Adapt our approach to work on untyped documents by using data-guides or path summaries. Extend the formalism to handle XML-Schema rather than DTDs.

89 87/90, Future work Many directions : Adapt our approach to work on untyped documents by using data-guides or path summaries. Extend the formalism to handle XML-Schema rather than DTDs. Integration with classical databases techniques.

90 87/90, Future work Many directions : Adapt our approach to work on untyped documents by using data-guides or path summaries. Extend the formalism to handle XML-Schema rather than DTDs. Integration with classical databases techniques. Integration with a query engine.