Virtualization Technologies in Web Conferencing Systems: A Performance Overview Pedro Roger Magalhães Vasoncelos
[email protected] Gisele Azevedo de Araújo Freitas
[email protected] Thales Guimarães Marques
[email protected]
Postgraduate Program in Electrical and Computer Engineering Federal University of Ceara Sobral, Ceara - Brazil
The 11th International Conference for Internet Technology and Secured Transactions - ICITST 2016 Barcelona, Spain
Agenda
Introduction Virtualization Video conferencing systems
Introduction Virtualization Video conferencing systems
KVM OpenVZ
KVM
Experimental Evaluation
OpenVZ
Macro benchmarks Micro benchmarks
Conclusions
Experimental Evaluation Macro benchmarks Micro benchmarks Conclusions 42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Introduction Virtualization
Virtualization
Introduction 2
Virtualization Video conferencing systems
I
Virtualization technologies allows partitioning the underlying hardware to multiple independent guests OSs
KVM
I
Provides useful features as server consolidation, power saving, live migration and faster server provisioning
Experimental Evaluation
OpenVZ
Macro benchmarks Micro benchmarks
Main advantages: I
Effective use of hardware
I
Reduced cost of servers, devices, cooling and power supply
I
Guest isolation
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Introduction Virtualization
There are various virtualization solutions using different approaches Introduction 3
I
I
Experimental Evaluation
Xen
Macro benchmarks Micro benchmarks
Conclusions
VMware
Hardware assisted virtualization I
I
OpenVZ
Binary translation I
I
KVM
KVM, VMware ESX
Paravirtualization I
I
Video conferencing systems
Full virtualization I
Virtualization
KVM
Operating system-level virtualization I
OpenVZ, Linux Containers 42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Introduction Virtualization
Introduction 4
Virtualization Video conferencing systems
Different virtualization solutions present:
KVM OpenVZ
I
Different set of features
I
Different set of supported guest OS
Experimental Evaluation Macro benchmarks Micro benchmarks
Conclusions
I
Different performance and virtualization overhead
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Introduction Virtualization
Introduction 5
Virtualization Video conferencing systems
Multiple virtualized applications differ in:
KVM OpenVZ
I
Experimental Evaluation
Resource usage I
Bottlenecks can occur in the concurrent access to those devices
I
Virtualization performance to the same resource can be different between VMMs
Macro benchmarks Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Introduction Virtualization
Introduction 6
Virtualization Video conferencing systems
Based in this analysis, it is essential:
KVM OpenVZ
I
Analyse the virtualization overhead between VMMs
I
Compare the efficiency of different VMMs
Experimental Evaluation Macro benchmarks Micro benchmarks
Conclusions
I
Investigate bottlenecks that may occur in the usage of virtual resources
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Introduction Video conferencing systems
Introduction
Video conferencing systems I
Has been useful for years to the work meetings and education
I
The increase in bandwidth of customers have contributed to the popularization of video conferencing systems
Virtualization 7
Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks Micro benchmarks
I
Conclusions
BigBlueButton (BBB) I
A popular web-based video conferencing system
I
Allow users to create rooms, share presentation, audio and video
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Introduction Video conferencing systems
Introduction Virtualization
Video conferencing systems
8
Video conferencing systems
KVM
I
Can benefit from server consolidation
I
Systems can run for long periods without use I
I
OpenVZ Experimental Evaluation Macro benchmarks Micro benchmarks
Which often can not justify the adoption of a dedicated physical machine
Conclusions
Can be deployed on virtualized commodity servers I
Economic advantage
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Introduction Video conferencing systems
Introduction Virtualization
Evaluate and be aware of the performance of different types of virtualization for such applications become a valuable information for:
9
Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks
I I
Micro benchmarks
Ensure quality of service
Conclusions
A significant contribution to enterprises from an economic point of view
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
KVM KVM - Kernel-based Virtual Machine Introduction Virtualization
KVM is a full-virtualization solution for the Linux kernel. I
Requires a processor with hardware virtualization extension
Video conferencing systems 10
OpenVZ
Full-virtualization: I
Experimental Evaluation
A layer, commonly called the hypervisor, exists between the virtualized OS and the hardware
I
This layer multiplexes the system resources between competing OS instances
I
Provides total abstraction of physical hardware
I
Does not require modification in the guest OS
KVM
Macro benchmarks Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
OpenVZ OpenVZ Introduction Virtualization
OpenVZ is an OS-level virtualization platform based on the Linux kernel and operating system.
Video conferencing systems
KVM 11
OS-level Virtualization: I
Experimental Evaluation Macro benchmarks
Allows a physical server to run multiple isolated OS instances, known as containers
I
Technology which works at OS layer
I
In practice, hypervisors works at the hardware abstraction level and OS-level virtualization at the system call layer
I
The physical host shares the same kernel with its containers
OpenVZ
Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
In this paper...
Introduction Virtualization Video conferencing systems
This paper evaluates the performance of two BigBlueButton systems deployed over different virtualization approaches
KVM 12
OpenVZ Experimental Evaluation
I I
KVM (Full virtualization)
Macro benchmarks Micro benchmarks
Conclusions
OpenVZ (OS-level virtualization)
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
In this paper...
Introduction Virtualization
We run a series of different benchmarks to measure the virtualization performance:
Video conferencing systems
KVM 13
I I
A real-world video conferencing workload A set of benchmarks that stress different virtualization aspects such as
OpenVZ Experimental Evaluation Macro benchmarks Micro benchmarks
I
Computing power
I
Memory, disk I/O and network bandwidth
I
Network latency
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Experimental Evaluation
Introduction
In our evaluation we use two BBB systems deployed on one KVM VM and one OpenVZ CT over the following hardware:
Virtualization Video conferencing systems
KVM
I
I
I I I
I
OpenVZ
IBM BladeCenter HS23 Intel Xeon CPUs E5-2620 of 2.00 GHz (with 6 cores and Hyper-Threading technology) 48 GB of RAM Local gigabit ethernet network 100Mbps Internet uplink
14
Experimental Evaluation Macro benchmarks Micro benchmarks
Conclusions
Proxmox VE kernel 2.6.32-37-pve amd64
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Experimental Evaluation
Introduction Virtualization Video conferencing systems
I
VM and CT configuration:
KVM OpenVZ
I
2 vCPUs, 4 GB of vRAM, 15 GB storage size and one virtual gigabit ethernet adapter
I
Ubuntu GNU/Linux 10.04.4 LTS amd64
I
15
Experimental Evaluation Macro benchmarks Micro benchmarks
Conclusions
BigBlueButton v0.81
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Experimental Evaluation
Introduction
I
To generate the desired workload we use: I
Video conferencing systems
Two workstations in the local network I
I
Virtualization
Each workstation uses the v4l2loopback module to simulate virtual webcams using video files
KVM OpenVZ 16
120 Amazon EC2 Instances
Experimental Evaluation Macro benchmarks Micro benchmarks
I
t2.micro instance
I
Running Windows 2012
I
Acting as conference clients
I
Mozilla Firefox v46
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Experimental Evaluation
Introduction Virtualization
I
Video conferencing systems
We use the Zabbix network monitoring software to collect data from the virtualized servers I
CPU usage
I
Memory usage
I
Disk O/I
I
Ingress and egress network traffic
I
Number of conference sessions
KVM OpenVZ 17
Experimental Evaluation Macro benchmarks Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Macro benchmarks
Introduction
We observe the performance and resource utilization of BBB while users are continuously joining the conference
Virtualization Video conferencing systems
KVM
I
One user joins the conference every 30 s.
I
The first two users are from the local workstations I I
OpenVZ Experimental Evaluation 18
They initiate the streaming of their virtual webcam One client starts desktop sharing
I
Each EC2 instance opens 4 conference sessions
I
The benchmark stops when it reaches 340 connected users
Macro benchmarks Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Macro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation 19
Macro benchmarks Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Macro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation 20
Macro benchmarks Micro benchmarks
Conclusions
Figure: CPU usage by connected users 42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Macro benchmarks
Introduction Virtualization Video conferencing systems
Related to CPU utilization, the BBB hosted into KVM VM presented:
KVM OpenVZ
I
Experimental Evaluation
A difference peak of 19.2% higher than OpenVZ 21
Macro benchmarks Micro benchmarks
I
Average CPU usage 8% higher than OpenVZ
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Macro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation 22
Macro benchmarks Micro benchmarks
Conclusions
Figure: Memory usage by connected users 42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Macro benchmarks
Introduction Virtualization Video conferencing systems
Related to memory consumption:
KVM OpenVZ
I
The KVM VM presents a value 11.6% higher than the OpenVZ CT
I
Can be explained by the minor footprint of OpenVZ CTs compared to a full Linux OS I
Experimental Evaluation 23
Macro benchmarks Micro benchmarks
Conclusions
Fewer processes, daemons, modules and virtualization layers
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks The micro benchmarks allow us to analyse the virtualization performance of individual resources.
Introduction Virtualization Video conferencing systems
CPU virtualization I
KVM
Evaluation software I
OpenVZ
Intel Optimized LINPACK I
Benchmark that solves a a dense system of linear equations
I
Hyper-Threading turned-off
I
NUMA topology exposed to VM
I
12 CPUs utilized
I
Matrices orders ranging from 1000 until 45000
I
Intensive float-pointing computing
Experimental Evaluation Macro benchmarks 24
Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks 25
Micro benchmarks
Conclusions
Figure: LINPACK benchmark 42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
The LINPACK test data show us that:
KVM
I
OpenVZ
OpenVZ follows native speed for most of the problems (matrices > 10000)
Experimental Evaluation Macro benchmarks
I
Compared to native speed:
26
Micro benchmarks
Conclusions I
The total average GFLOPS values for KVM and OpenVZ are about 86.05% and 95.42%, respectively
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction
Memory virtualization I
Virtualization Video conferencing systems
Evaluation software I
I
KVM
RAMspeed I
Measures cache and memory performance
I
Allocates memory space and starts writing to, or reading from it using continuous blocks
OpenVZ Experimental Evaluation Macro benchmarks 27
STREAM I
Measures the sustainable memory bandwidth and the corresponding computation rate for simple vector kernels
I
5 rounds tests on 24 CPUs
Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks 28
Micro benchmarks
Conclusions
Figure: RAMspeed benchmark 42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
The RAMspeed results show us that:
Introduction Virtualization Video conferencing systems
I
The effects of the three levels of on-chip cache (L1, L2 and L3) are observed in the throughput drops near 32 KB, 256 KB and 2MB I
The throughput stabilizes near 16 MB block sizes, when no cache is involved
I
All three systems reaches near same throughput while operations involves the cache system
I
For bigger block sizes, when there is no cache effect, KVM reaches 89.9% of native speed
I
OpenVZ follows native speed
KVM OpenVZ Experimental Evaluation Macro benchmarks 29
Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks 30
Micro benchmarks
Conclusions
Figure: STREAM benchmark 42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization
The STREAM results show us that:
Video conferencing systems
KVM
I
OpenVZ presents a better performance in all four components of STREAM I
OpenVZ Experimental Evaluation
Achieves 92% of native throughput
Macro benchmarks 31
I
I
Container-based systems have ability to return unused memory to the host, and to other containers
Micro benchmarks
Conclusions
KVM reaches 83.2% of native performance
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization
Disk virtualization I
Video conferencing systems
KVM
Evaluation software I
OpenVZ
IOzone I
Generates and measures the execution of various file operations
I
Tests executed over an ext4 partition mounted in the VM and CT
Experimental Evaluation Macro benchmarks
I
O_DIRECT flag allows bypass the buffer cache, thus the I/O goes directly to disk
I
8 GB test size
32
Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks 33
Micro benchmarks
Conclusions
Figure: IOzone throughput 42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
The IOzone results show us that:
KVM
I
OpenVZ
No losses in throughput for KVM and OpenVZ for write and rewrite operations I
Although, for read, reread, random read and random write operations I
KVM reaches 78.9%, 79.3%, 82.6% and 95.2% compared to native
I
OpenVZ reaches near native values in all operations
Experimental Evaluation Macro benchmarks 34
Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
Network virtualization I
KVM
Evaluation software I
OpenVZ
Netperf I
Measures the network throughput and end-to-end latency
I
An external server run the netperf server
I
Each virtual environment, and the physical host run the netperf client
Experimental Evaluation Macro benchmarks 35
Micro benchmarks
Conclusions
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks 36
Micro benchmarks
Conclusions
Figure: Netperf round-trip time latency
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization
The Netperf RTT result shows us that:
Video conferencing systems
KVM
I
Both virtualization approaches add some latency overhead I
I I
Experimental Evaluation
KVM adds 91.7% of latency, while OpenVZ increases it by 22%
For UDP I
I
OpenVZ
For TCP
Macro benchmarks 37
Micro benchmarks
Conclusions
KVM’s latency is 119.5% higher than native. OpenVZ is 11.9% higher
The increased number of layers and the use of a bridge interface, in the virtual network device can contribute to the higher latencies of KVM
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks 38
Micro benchmarks
Conclusions
Figure: Netperf bandwidth
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Micro benchmarks
Introduction Virtualization Video conferencing systems
The Netperf bandwidth test result shows us that:
KVM OpenVZ
I
I
All environments reach the native network performance, near the gigabit ethernet interface limit
Experimental Evaluation Macro benchmarks 39
Micro benchmarks
Conclusions
No losses in virtualized network bandwidth
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Conclusions
Introduction Virtualization
I
The conference system evaluated is a kind of application well suited to virtualization
I
OpenVZ presents a better overall performance
I
KVM presents a slight performance degradation in the most cases
I
OpenVZ shows a clear performance gain in some I/O operations
Video conferencing systems
KVM OpenVZ Experimental Evaluation Macro benchmarks Micro benchmarks
I
Disk read, reread and random read
I
Network latency
40
42
Conclusions
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Conclusions
Introduction Virtualization
I
Video conferencing systems
The higher round-trip time presented by KVM should be taken into account when designing services latency-sensitive
KVM OpenVZ
I
Experimental Evaluation
Like video conferencing and real-time systems
Macro benchmarks
I
This increased latency joint with high load of CPU and network, due to a large number of sessions I
Micro benchmarks 41
Conclusions
Can be determinant to a poor quality of these services.
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Conclusions
I
Introduction
OpenVZ demonstrates to be the most suitable virtualization platform for video conferencing workloads
Virtualization Video conferencing systems
KVM I
Presents minor container footprint I
OpenVZ Experimental Evaluation
Leads to a higher container density
Macro benchmarks Micro benchmarks
I
KVM presents a more convenient way for guest-independent virtualization I
42
Conclusions
The results can characterize a trade-off between performance gain and ease of use
42
The 11th International Conference for Internet Technology and Secured Transactions (ICITST-2016)
Thank you!
[email protected] [email protected] [email protected]
