Virtual Machine Migration Pierre Riteau University of Rennes 1, - PowerPoint PPT Presentation

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Virtual Machine Migration Pierre Riteau University of Rennes 1, IRISA Inria Rennes - Bretagne Atlantique October 21, 2011 Journ´ ee Cloud France Grilles, Lyon Pierre Riteau Virtual Machine Migration 1/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Outline Hardware Virtualization 1 Migration 2 Pure stop-and-copy Live Migration Use Cases Live Migration Techniques 3 Live Migration in WANs 4 Live Migration Optimizations 5 Conclusion 6 Pierre Riteau Virtual Machine Migration 2/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Hardware Virtualization Presents a computer similar to a real physical one With CPU(s), memory, disk(s), network interface(s), etc. The virtual machine runs a full OS Full Virtualization vs Paravirtualization Hypervisors: VMware, Xen, KVM, etc. Virtual machines provide complete encapsulation of Applications Libraries Operating system Pierre Riteau Virtual Machine Migration 4/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Hardware Virtualization Userland Userland Userland Kernel Kernel Kernel Physical node Pierre Riteau Virtual Machine Migration 5/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Outline Hardware Virtualization 1 Migration 2 Pure stop-and-copy Live Migration Use Cases Live Migration Techniques 3 Live Migration in WANs 4 Live Migration Optimizations 5 Conclusion 6 Pierre Riteau Virtual Machine Migration 6/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Migration Relocate VM from one physical host to another Complete encapsulation → no OS support needed Transfer VM state over the network Processor state (CPU registers) Hardware devices state (hardware registers) Memory content (Possibly disk content) Pierre Riteau Virtual Machine Migration 7/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Pure stop-and-copy Simplest approach Suspend source VM on source host Copy all VM state over the network Resume source VM on destination host Used by the Internet Suspend/Resume project Pierre Riteau Virtual Machine Migration 8/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Pure stop-and-copy VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 9/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Pure stop-and-copy VM state transfer VM VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 10/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Pure stop-and-copy VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 11/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Live Migration of Virtual Machines Problem with pure stop-and-copy: long downtime Live migration Minimize downtime (milliseconds) Works by transferring state during execution Live Migration VM VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 12/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Live Migration of VMs in LANs Live migration initially proposed for LANs Clark et al., NSDI ’05 & Nelson et al., USENIX ’05 Transfer from source host to destination host of the same LAN What about storage and network resources? Shared storage (e.g. NFS) → no migration needed Network traffic redirected with gratuitous ARP/RARP frames Pierre Riteau Virtual Machine Migration 13/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Live Migration of Virtual Machines VM disk Switch ARP/RARP frame Shared FS Server VM VM Live Migration Source Host Destination Host Pierre Riteau Virtual Machine Migration 14/42

Hardware Virtualization Migration Pure stop-and-copy Live Migration Techniques Live Migration Live Migration in WANs Use Cases Live Migration Optimizations Conclusion Use Cases Offers many advantages Load balancing / Reduced energy consumption Migrate VMs in case of hotspots (c.f. Adrien L` ebre’s talk) Consolidate VMs on a subset of nodes Turn off unused physical nodes Entropy (Ecole des Mines de Nantes) Transparent infrastructure maintenance Pro-active fault tolerance Detect future faults from hardware events Preemptively migrate on another node Nagarajan et al., SC 07 Pierre Riteau Virtual Machine Migration 15/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration Traditional method used for migration of processes Iterative process Copy all memory content to the destination host (while the VM continues running) Do multiples iterations to copy modified memory pages during the previous period When enough iterations have been done, stop the VM and Copy the remaining modified memory pages Copy the CPU and device state Resume VM on destination host Method implemented by all production hypervisors Pierre Riteau Virtual Machine Migration 17/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration 1 2 3 4 VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 18/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration 1 2 1 3 4 Transfer page 1 VM VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 19/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration 1 2 1 2 3 4 Transfer page 2 VM VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 20/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration 1 2 1 2 3 4 Transfer page 3 3 VM VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 21/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration 1' 2 1 2 3' 4 3 VM VM Memory writes on page 1 and 3 Source Host Destination Host Pierre Riteau Virtual Machine Migration 22/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration 1' 2 1 2 3' 4 Transfer page 4 3 4 VM VM Source Host Destination Host Pierre Riteau Virtual Machine Migration 23/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration 1' 2 1' 2 3' 4 Transfer page 1' 3 4 VM VM New iteration Source Host Destination Host Pierre Riteau Virtual Machine Migration 24/42

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Pre-Copy Live Migration 1' 2' 1' 2 3' 4 3 4 VM VM Memory write on page 2 Source Host Destination Host Pierre Riteau Virtual Machine Migration 25/42

Virtual Machine Migration Pierre Riteau University of Rennes 1, - PowerPoint PPT Presentation

Hardware Virtualization Migration Live Migration Techniques Live Migration in WANs Live Migration Optimizations Conclusion Virtual Machine Migration Pierre Riteau University of Rennes 1, IRISA Inria Rennes - Bretagne Atlantique October 21,

Exploiting Live Virtual Machine Migration Jon Oberheide University of Michigan February 21,

On Selecting the Right Optimizations for Virtual Machine Migration Senthil Nathan N , Umesh

Multi-Agent Negotiation of Virtual Machine Migration Using the Lightweight Coordination Calculus

Joint Virtual Machine Placement and Migration in Dynamic Policy-Driven Data Centers Hugo Flores

Power Consumption of Virtual Machine Live Migration in Clouds Anusha Karur Manar Alqarni

Virtual Machines What is a Virtual Machine? Java Virtual Machine (Application Virtualization)

Machine Placement and Migration in Cloud Datacenters Authors: Liuhua Chen, Haiying Shen and

An Online Virtual Machine Placement Algorithm in an Over-Committed Cloud Siqi Ji*, Ming Da Li,

Virtual Machines Uses for Virtual Machines There are several uses for virtual machines:

Transparent migration of virtual Transparent migration of virtual infrastructures in large

The Java Virtual Machine The Java Virtual Machine interpret compile Native Binary Code Michael

A Tor gatewayed platform for everyday use Using a virtual machine stack with its own virtual

Virtual Machines Virtual Machines What is a virtual machine? Examples? Benefits?

MIPS Virtual what is the Java - what is the JVM ? lecture 25 Machine analogy ? - what is

Modern Virtual Machine Performance murphee (Werner Schuster)

WHY IS MIGRATION SO IMPORTANT? Why migration? German National Team 2014 Why migration?

Virtual Machines 1 questions/logistics office hours posted on website VM setup due Friday 2

Migration and Skills: EU legislation on Legal Migration DG HOME - Legal Migration and

Virtual Machine Monitors IBM VM/370 - Mainframe time-sharing 1990s VMware - MPP

Outline Introduction (VM) Virtual Machine Research goals (PM) Physical Machine

Mobitopolo: A Portable Infrastructure to Facilitate Flexible Deployment and Migration of

CloudNet : Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines Timothy

Nomad : Mitigating Arbitrary Cloud Side Channels via Provider-Assisted Migration Soo-Jin Moon,

PageRankVM A PageRank Based Algorithm with Anti-Collocation Constraints for Virtual Machine