Follow the Sun through the Clouds: Application Migration for Geographically Shifting Workloads Zhiming Shen Cornell University Joint work with Qin Jia, Gur-Eyal Sela, Ben Rainero, Weijia Song, Robbert van Renesse, Hakim Weatherspoon 1
Supercloud Demo VM VM Nested VM 2
Supercloud Demo VM VM Nested VM HTTP 2
Supercloud Demo VM Nested VM VM HTTP 2
Highlights • Automatic VM placement and migration • Migrated VMs are LIVE • IP addresses are not changed • TCP connections are not broken 3
Demo (Full video available at http://supercloud.cs.cornell.edu) 4
Full Demo (http://supercloud.cs.cornell.edu) 5
Highlights • Automatic VM placement and migration • Migrated VMs are LIVE • IP addresses are not changed • TCP connections are not broken • Appears as a unified private cloud that spans all clouds • Controlled by the user! 6
Research Challenges • How to migrate across incompatible virtualization platforms? • How to keep IP addresses unchanged and TCP connections unbroken? • How to decide when and where to migrate? • How to make the system efficient? 7
Supercloud is the first system that supports automatic, efficient, and live VM migration across heterogeneous cloud providers without changing IP addresses or breaking TCP connections. 8
Supercloud Architecture • Computation Second-layer VM First-layer VM • Nested hypervisor: Xen-Blanket • Support all major platforms Cloud Provider 1 Cloud Provider 2 • Network Availability Zone 2 Availability Zone 1 User User User User User User • SDN overlay Dom0 Dom0 Second VMs VMs VMs VMs VMs VMs First • Support migration with public IP Layer Layer OpenStack OpenStack OpenStack Xen-Blanket Xen-Blanket Xen-Blanket • Storage: KVM/virtio KVM/virtio Xen/PV-on-HVM • Geo-replicated storage Software-Defined Network (SDN) Geo-replicated Image Storage • Optimized for serving VM images • Resource management Second-layer First-layer hypervisor • OpenStack platform hypervisor • Automatic scheduling framework 9
Supercloud Networking • Challenges: • Optimal routing without extra forwarding • Migration without changing IP addresses • Solution: VM Cloud 1 • VPN overlay with full-mesh tunnels vSwitch • Frenetic SDN controller vSwitch vSwitch vSwitch vSwitch Cloud 2 VM 10
Supercloud Networking • Challenges: • Optimal routing without extra forwarding • Migration without changing IP addresses • Solution: Cloud 1 • VPN overlay with full-mesh tunnels vSwitch • Frenetic SDN controller VM vSwitch vSwitch vSwitch vSwitch Cloud 2 VM 10
VM Migration with Public IP Address VM Pub IP front-end 54.172.26.213 54.172.26.213 11
VM Migration with Public IP Address VM Pub IP front-end 54.172.26.213 54.172.26.213 11
VM Migration with Public IP Address Dynamic DNS? • Can be delayed due to cache VM Pub IP • Can cause connection interrupts front-end • Some applications might not work 54.172.26.213 54.172.26.213 11
VM Migration with Public IP Address VM Pub IP front-end 54.172.26.213 Pub IP front-end 52.69.94.195 12
VM Migration with Public IP Address VM Pub IP front-end 54.172.26.213 Pub IP front-end 52.69.94.195 12
Centralized VM Image Storage Long latency; Low throughput VM Image 13
Geo-Replicated VM Image Storage VM Image Image 14
Geo-Replicated VM Image Storage VM Image Image 14
Geo-Replicated VM Image Storage VM Image Image Challenges: • Strong consistency requirement • Long latency and low throughput in WAN Supercloud VM image storage: • Decoupling consistency from data propagation. • Propagating data according to disk access patterns. 14
In the Paper • Comparison with application-level migration • Placement policies for different types of applications • Detail design of the image storage • Hierarchical network topology • Evaluations 15
Conclusion • Supercloud: application migration for geographically shifting workloads • Crossing heterogeneous cloud providers • Automatic placement and migration • Geo-replicated image storage • Wide-area SDN • A unified private cloud that spans all clouds • Controlled by the user! Thank You. Questions? • More at http://supercloud.cs.cornell.edu 16
Recommend
More recommend
