VMScatter

Migrate virtual machines to many hosts

Lei Cui, Jianxin Li, Bo Li, Jinpeng Huai, Chunming Hu, Tianyu Wo, Hussain Al-Aqrabi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Citations (Scopus)

Abstract

Live virtual machine migration is a technique often used to migrate an entire OS with running applications in a non-disruptive fashion. Prior works concerned with one-to-one live migration with many techniques have been proposed such as pre-copy, post-copy and log/replay. In contrast, we propose VMScatter, a one-to-many migration method to migrate virtual machines from one to many other hosts simultaneously. First, by merging the identical pages within or across virtual machines, VMScatter multicasts only a single copy of these pages to associated target hosts for avoiding redundant transmission. This is impactful practically when the same OS and similar applications running in the virtual machines where there are plenty of identical pages. Second, we introduce a novel grouping algorithm to decide the placement of virtual machines, distinguished from the previous schedule algorithms which focus on the workload for load balance or power saving, we also focus on network traffic, which is a critical metric in data-intensive data centers. Third, we schedule the multicast sequence of packets to reduce the network overhead introduced by joining or quitting the multicast groups of target hosts. Compared to traditional live migration technique in QEMU/KVM, VMScatter reduces 74.2% of the total transferred data, 69.1% of the total migration time and achieves the network traffic reduction from 50.1% to 70.3%.

Original languageEnglish
Title of host publicationVEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments
Pages63-72
Number of pages10
DOIs
Publication statusPublished - 10 Apr 2013
Externally publishedYes
Event9th International Conference on Virtual Execution Environments - Houston, United States
Duration: 16 Mar 201317 Mar 2013
Conference number: 9

Conference

Conference9th International Conference on Virtual Execution Environments
Abbreviated titleVEE 2013
CountryUnited States
CityHouston
Period16/03/1317/03/13

Fingerprint

Merging
Joining
Virtual machine

Cite this

Cui, L., Li, J., Li, B., Huai, J., Hu, C., Wo, T., & Al-Aqrabi, H. (2013). VMScatter: Migrate virtual machines to many hosts. In VEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (pp. 63-72) https://doi.org/10.1145/2451512.2451528
Cui, Lei ; Li, Jianxin ; Li, Bo ; Huai, Jinpeng ; Hu, Chunming ; Wo, Tianyu ; Al-Aqrabi, Hussain. / VMScatter : Migrate virtual machines to many hosts. VEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. 2013. pp. 63-72
@inproceedings{37af2c2fafee41fba246afcc19ad9250,
title = "VMScatter: Migrate virtual machines to many hosts",
abstract = "Live virtual machine migration is a technique often used to migrate an entire OS with running applications in a non-disruptive fashion. Prior works concerned with one-to-one live migration with many techniques have been proposed such as pre-copy, post-copy and log/replay. In contrast, we propose VMScatter, a one-to-many migration method to migrate virtual machines from one to many other hosts simultaneously. First, by merging the identical pages within or across virtual machines, VMScatter multicasts only a single copy of these pages to associated target hosts for avoiding redundant transmission. This is impactful practically when the same OS and similar applications running in the virtual machines where there are plenty of identical pages. Second, we introduce a novel grouping algorithm to decide the placement of virtual machines, distinguished from the previous schedule algorithms which focus on the workload for load balance or power saving, we also focus on network traffic, which is a critical metric in data-intensive data centers. Third, we schedule the multicast sequence of packets to reduce the network overhead introduced by joining or quitting the multicast groups of target hosts. Compared to traditional live migration technique in QEMU/KVM, VMScatter reduces 74.2{\%} of the total transferred data, 69.1{\%} of the total migration time and achieves the network traffic reduction from 50.1{\%} to 70.3{\%}.",
keywords = "De-duplication, Live migration, Multicast, Placement, Virtualization",
author = "Lei Cui and Jianxin Li and Bo Li and Jinpeng Huai and Chunming Hu and Tianyu Wo and Hussain Al-Aqrabi",
year = "2013",
month = "4",
day = "10",
doi = "10.1145/2451512.2451528",
language = "English",
isbn = "9781450312660",
pages = "63--72",
booktitle = "VEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments",

}

Cui, L, Li, J, Li, B, Huai, J, Hu, C, Wo, T & Al-Aqrabi, H 2013, VMScatter: Migrate virtual machines to many hosts. in VEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. pp. 63-72, 9th International Conference on Virtual Execution Environments, Houston, United States, 16/03/13. https://doi.org/10.1145/2451512.2451528

VMScatter : Migrate virtual machines to many hosts. / Cui, Lei; Li, Jianxin; Li, Bo; Huai, Jinpeng; Hu, Chunming; Wo, Tianyu; Al-Aqrabi, Hussain.

VEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. 2013. p. 63-72.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - VMScatter

T2 - Migrate virtual machines to many hosts

AU - Cui, Lei

AU - Li, Jianxin

AU - Li, Bo

AU - Huai, Jinpeng

AU - Hu, Chunming

AU - Wo, Tianyu

AU - Al-Aqrabi, Hussain

PY - 2013/4/10

Y1 - 2013/4/10

N2 - Live virtual machine migration is a technique often used to migrate an entire OS with running applications in a non-disruptive fashion. Prior works concerned with one-to-one live migration with many techniques have been proposed such as pre-copy, post-copy and log/replay. In contrast, we propose VMScatter, a one-to-many migration method to migrate virtual machines from one to many other hosts simultaneously. First, by merging the identical pages within or across virtual machines, VMScatter multicasts only a single copy of these pages to associated target hosts for avoiding redundant transmission. This is impactful practically when the same OS and similar applications running in the virtual machines where there are plenty of identical pages. Second, we introduce a novel grouping algorithm to decide the placement of virtual machines, distinguished from the previous schedule algorithms which focus on the workload for load balance or power saving, we also focus on network traffic, which is a critical metric in data-intensive data centers. Third, we schedule the multicast sequence of packets to reduce the network overhead introduced by joining or quitting the multicast groups of target hosts. Compared to traditional live migration technique in QEMU/KVM, VMScatter reduces 74.2% of the total transferred data, 69.1% of the total migration time and achieves the network traffic reduction from 50.1% to 70.3%.

AB - Live virtual machine migration is a technique often used to migrate an entire OS with running applications in a non-disruptive fashion. Prior works concerned with one-to-one live migration with many techniques have been proposed such as pre-copy, post-copy and log/replay. In contrast, we propose VMScatter, a one-to-many migration method to migrate virtual machines from one to many other hosts simultaneously. First, by merging the identical pages within or across virtual machines, VMScatter multicasts only a single copy of these pages to associated target hosts for avoiding redundant transmission. This is impactful practically when the same OS and similar applications running in the virtual machines where there are plenty of identical pages. Second, we introduce a novel grouping algorithm to decide the placement of virtual machines, distinguished from the previous schedule algorithms which focus on the workload for load balance or power saving, we also focus on network traffic, which is a critical metric in data-intensive data centers. Third, we schedule the multicast sequence of packets to reduce the network overhead introduced by joining or quitting the multicast groups of target hosts. Compared to traditional live migration technique in QEMU/KVM, VMScatter reduces 74.2% of the total transferred data, 69.1% of the total migration time and achieves the network traffic reduction from 50.1% to 70.3%.

KW - De-duplication

KW - Live migration

KW - Multicast

KW - Placement

KW - Virtualization

UR - http://www.scopus.com/inward/record.url?scp=84875862015&partnerID=8YFLogxK

U2 - 10.1145/2451512.2451528

DO - 10.1145/2451512.2451528

M3 - Conference contribution

SN - 9781450312660

SP - 63

EP - 72

BT - VEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

ER -

Cui L, Li J, Li B, Huai J, Hu C, Wo T et al. VMScatter: Migrate virtual machines to many hosts. In VEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. 2013. p. 63-72 https://doi.org/10.1145/2451512.2451528