Generating Efficient Execution Plans for Vertically Partitioned XML - PowerPoint PPT Presentation

Generating Efficient Execution Plans for Vertically Partitioned XML Databases Patrick Kling, M. Tamer ¨ Ozsu, and Khuzaima Daudjee University of Waterloo David R. Cheriton School of Computer Science VLDB 2011 1

The Problem • Centralized query evaluation techniques for XML well understood • These techniques do not scale to large collection sizes and heavy workloads • Goal: use distribution to improve scalability • Focus on end-to-end cost of query evaluation 2

Distributed XML Query Evaluation: Two Scenarios • Integrating multiple data sources • Fragmentation is determined by existing data sources • Need flexible fragmentation model to express this • Distribution for performance • Choose fragmentation to suit workload • Can use more constrained fragmentation model • Fragmentation specification allows for distributed query optimization 3

Outline 1 Fragmenting XML Collections 2 Querying Distributed XML Collections Query Model Distributed Query Evaluation Improving Performance 3 Performance Evaluation 4 Conclusion 4

Fragmenting XML Collections • Ad-hoc fragmentation • Structure-based fragmentation 6

Ad-hoc fragmentation • Cut arbitrary edges in document tree • Highly flexible (good for data integration) • No explicit fragmentation specification • Limited potential for exploiting fragmentation characteristics for query optimization • Not a suitable choice for this work 7

Structure-based Fragmentation • Fragmentation according to characteristics of data or schema • Yields a fragmentation specification that can be exploited for query optimization • Better choice when distributing for performance 8

Our Fragmentation Model • Focus on simplicity and precise fragmentation specification • Focus on partitioning collection (replication is orthogonal) • Follow semantics of relational fragmentation techniques • Horizontal fragmentation (based on predicates/selection) • Vertical fragmentation (based on partitioning of schema/projection) • Hybrid fragmentation (combination of horizontal and vertical steps) 9

Vertical Fragmentation author 2 P 1 → 2 P 1 → 3 13 14 f V 1 RP 1 → 2 RP 1 → 3 13 14 name 2 pubs 2 f V 3 first 2 last 2 Jane Dean f V 2 10

Vertical Fragmentation Specification Vertical fragmentation is specified by a fragmentation schema . ONCE author pubs OPT MULT agent book ONCE f V f V 1 3 ONCE MULT name chapter ONCE ONCE OPT ONCE first last reference f V 4 ∗ ∗ f V 2 11

Query model XQ, subset of XPath • Nested paths with child and descendant steps • Explicit node tests and wild cards • Value constraints (numeric or textual) • Q := σ | ∗ | Q // Q | Q / Q | Q [ q ] q := Q | . = / � = str | . = / � = / ≤ / < / ≥ / > num 13

Query Example “Find all references in publications written by authors whose first name is ‘William’ and whose last name is ‘Shakespeare’ ” 14

Query Example “Find all references in publications written by authors whose first name is ‘William’ and whose last name is ‘Shakespeare’ ” / author[ ./ name[ ./ first = “William”and ./ last = “Shakespeare”]] // reference 14

Query Example “Find all references in publications written by authors whose first name is ‘William’ and whose last name is ‘Shakespeare’ ” • Node tests / author[ ./ name[ ./ first = “William”and ./ last = “Shakespeare”]] // reference 14

Query Example “Find all references in publications written by authors whose first name is ‘William’ and whose last name is ‘Shakespeare’ ” • Node tests / author[ ./ name[ ./ first = “William”and • Value constraints ./ last = “Shakespeare”]] // reference 14

Query Example “Find all references in publications written by authors whose first name is ‘William’ and whose last name is ‘Shakespeare’ ” • Node tests / author[ ./ name[ ./ first = “William”and • Value constraints ./ last = “Shakespeare”]] // reference • Structural constraints 14

Tree Patterns author / // name reference / / first last .=’William’ .=’Shakespeare’ 15

Tree Patterns • Pattern nodes with node tests and value constraints author / // name reference / / first last .=’William’ .=’Shakespeare’ 15

Tree Patterns • Pattern nodes with node tests and value constraints author • Edges annotated with XPath / // name axes reference / / first last .=’William’ .=’Shakespeare’ 15

Tree Patterns • Pattern nodes with node tests and value constraints author • Edges annotated with XPath / // name axes reference • Extraction point nodes / / first last .=’William’ .=’Shakespeare’ 15

Evaluating Tree Pattern Queries author / // name reference a e 1 / / last first .=’Shakespeare’ .=’William’ author 4 name 4 pubs 4 first 4 last 4 book 4 Shakespeare William chapter 4 chapter 5 reference 4 16

Evaluating Tree Pattern Queries author / // name reference a e 1 / / last first .=’Shakespeare’ .=’William’ author 4 name 4 pubs 4 first 4 last 4 book 4 Shakespeare chapter 4 chapter 5 William reference 4 [ a e 1 = reference 4 ] 16

Evaluating Tree Pattern Queries • Various centralized approaches exist • Navigating document trees • Structural joins • We leverage these for distributed query evaluation 17

Querying Vertically Distributed XML Collections • Input • Fragmentation-unaware tree pattern query • Fragmentation schema • Tasks • Annotate tree pattern nodes with corresponding fragments • Decompose tree pattern into sub-patterns for individual fragments • Convert sub-patterns to local plans using existing techniques (each site is free to choose local strategy) • Generate distributed execution plan that specifies how results are combined 18

Querying Vertically Distributed XML Collections • Annotate tree pattern nodes • Decompose tree pattern • Convert sub-patterns into local plans • Generate distributed execution plan author / // name reference / / first last .=’Shakespeare’ .=’William’ 19

Generating Efficient Execution Plans for Vertically Partitioned XML - PowerPoint PPT Presentation

Generating Efficient Execution Plans for Vertically Partitioned XML Databases Patrick Kling, M. Tamer Ozsu, and Khuzaima Daudjee University of Waterloo David R. Cheriton School of Computer Science VLDB 2011 1 The Problem Centralized

Generating High Coverage Tests for SystemC Designs Using Symbolic Execution Bin Lin Department

Symstra: A Framework for Generating Object-Oriented Unit Tests using Symbolic Execution 1 3 1

Automatically Generating Malicious Disks using Symbolic Execution Junfeng Yang, Can Sar, Paul

Generating Plans in Concurrent, Probabilistic, Oversubscribed Domains Li Li and Nilufer Onder

Efficient Symbolic Execution for Software Testing Johannes Kinder Royal Holloway, University of

An Efficient Algorithm for Generating Symmetric Ice Piles Roberto Mantaci 1 Paolo Massazza 2

Generating Efficient Data Movement Code for Heterogeneous Architectures with Distributed-Memory

Optimizing Tensor Contractions in CCSD(T) for Efficient Execution on GPUs Jinsung Kim 1 , Aravind

Execution of Research, Development and The Creation of Efficient Technologies of Rare Earth

A Deliberation Layer for Instantiating Robot Execution Plans from Abstract Task Descriptions

Linking Abstract Plans of Scientific Experiments to their Corresponding Execution Traces Milan

Efficient Transient-Fault Tolerance for Multithreaded Processors Using Dual-Thread Execution Yi

System Architectures and Techniques for Efficient, Secure, and Trusted Code Execution Mario

Invisible Formal Methods: Generating Efficient Test Sets With a Model Checker John Rushby with

Recursive Definitions Generating Functions Lecture 18 Generating Functions A generating

Efficient Execution of Dependent Tasks on Many-Core Processors Hamza Rihani, Claire Maiza,

Partitioning and numbering meshes for efficient MPI-parallel execution in PyOP2 Lawrence Mitchell,

Elastic Efficient Execution of Varied Containers Sharma Podila Nov 7th 2016, QCon San Francisco

Efficient Concolic Testing of MPI Applications Hongbo Li Zizhong Chen Rajiv Gupta CC19,

MASTERING STRATEGY EXECUTION 18 BEST PRACTICES FOR STRATEGY EXECUTION STRATEGY EXECUTION AS

Activities related to monolithic and vertically Activities related to monolithic and vertically

Using Efficient Access Control To Protect Multi-Task Execution LI Yan Background Background

Execution Time Prediction for Energy- Efficient Hardware Accelerators Tao Chen, Alex Rucker, and

Efficiently Compiling Efficient Query Plans for Modern Hardware Thomas Neumann Technische