Channel Provisioning in Grid Overlay Networks Dinil Mon Divakaran - PowerPoint PPT Presentation

Channel Provisioning in Grid Overlay Networks Dinil Mon Divakaran Pascale Vicat-Blanc Primet INRIA ENS Lyon 1 st Workshop on IP QoS and Traffic Control INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 1 / 20

Outline Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 2 / 20

Outline Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 2 / 20

Outline Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 2 / 20

Outline Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 2 / 20

Outline Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 2 / 20

Outline Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 2 / 20

Introduction Introduction Growth of large-scale distributed systems Efficient utilization of network resources essential Network performance from the perspectives of users and operators Control mechanisms to ensure network performance Bandwidth provisioning INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 3 / 20

Introduction Problem of flow scheduling in Grids Huge data sets constrained by deadlines Scheduling of jobs affected by network bandwidth TCP gives importance to fair sharing; is not designed to provide guarantee No scheme to take care of dynamic network behaviours ⇒ Scheduling on a provisioned network is a possible solution. INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 4 / 20

Provisioning Different traffic types Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 5 / 20

Provisioning Different traffic types Traffic in grid networks Three main classes - bulk, real-time and best-effort Bulk data traffic class - demands throughput to meet deadlines Real-time traffic class - concerned about latency Best-effort traffic class - least priority traffic in grids. INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 6 / 20

Provisioning Need for provisioning Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 7 / 20

Provisioning Need for provisioning Why provisioning? Grid traffic imposes more stringent constraints Serve requests of each class; still avoiding congestion Attempted solutions - make active n/w measurements and route dynamically Network measurements - inaccurate and overloading Recent approaches - static provisioning, that serves dynamic traffic matrix. INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 8 / 20

Static bandwidth provisioning Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 9 / 20

Static bandwidth provisioning Basic model for existing networks - the hose model User specifies aggregate capacities for inbound and outbound traffic at each endpoint Simple for user, allows statistical multiplexing Find the minimum amount of bandwidth that has to be reserved on the physical links that satisfies every valid traffic matrix INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 10 / 20

Static bandwidth provisioning Two-phase routing A B Traffic from A to B, will be sent through all nodes INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 11 / 20

Static bandwidth provisioning Two-phase routing strategy First phase - traffic routed to intermediate nodes Second phase - intermediate nodes route the traffic to destination If ρ A is the capacity of node A, and N the number of nodes, bandwidth required for link { A , B } ⇒ ρ A N due to first phase of routing ⇒ ρ B N due to second phase of routing ⇒ a total of ρ A + ρ B N Longer path, less pre-allocated bandwidth Allows pre-configuration to support any valid traffic matrix INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 12 / 20

Multi-channel provisioning Routing in multi-channel provisioned network Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 13 / 20

Multi-channel provisioning Routing in multi-channel provisioned network Routing in multi-channel provisioned network A B Real-time traffic from A to B, will be sent directly INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 14 / 20

Multi-channel provisioning Routing in multi-channel provisioned network Channel provisioning ρ i = B i + R i ( B i is sum of best-effort and bulk data traffic) Use two-phase routing for bulk data traffic and best-effort traffic Route real-time traffic directly The total traffic through a link is R i + B i + B j N if k = R ρ , then the total link capacities 1 is � �� N � N − 1 2 ( 1 − k ) + kN � i ρ i N 1 The minimum required is 2 P N i ρ i − max i ρ i . INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 15 / 20

Multi-channel provisioning Routing in multi-channel provisioned network Channel provisioning (cont.) Traffic demand for each link computed Provision network for the corresponding demands Real-time traffic routed with minimum delay Best-effort traffic rate-limited at egress Bulk-data scheduling strategy can be developed on top of this easily. INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 16 / 20

Practical intricacies Practical intricacies Routing packets through different paths - not a good idea Split a flow into chunks Route the chunks Aggregate the chunks at the receiver INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 17 / 20

Summary Conclusion and future work Outline Introduction 1 Provisioning 2 Different traffic types Need for provisioning Static bandwidth provisioning 3 Two-phase routing Multi-channel provisioning 4 Routing in multi-channel provisioned network Practical intricacies 5 Summary 6 Conclusion and future work INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 18 / 20

Summary Conclusion and future work Conclusions and future work ⇒ Multi-channel provisioning will provide solution to traffic control in grid networks ⇒ Implement the proposed routing strategy on a statically provisioned network ⇒ Come up with a scheduling algorithm to schedule bulk data flows in a provisioned network. ⇒ Analyse different transport protocols that can be used for splitting and aggregating traffic. INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 19 / 20

Summary Thank you ! INRIA (RESO) Channel Provisioning in Grid Networks Dec. 2007 20 / 20