Deploying Red Hat Enterprise Linux OpenStack Platform 5 on ...

Deploying Red Hat Enterprise Linux OpenStack Platform 5 on NetApp Storage  August 21, 2014   Bob Callaway  Technical Marketing Engineer, Cloud Solutions Group, NetApp  Colin Devine  Technical Partner Development Manager, Virtualization & OpenStack, Red Hat 1

© 2014 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only

Agenda 1)  Introductions 2)  Overview of RHEL-OSP5 3)  NetApp’s OpenStack Integrations 4)  Deploying RHEL-OSP 5 and NetApp in an HA configuration 5)  Manila: OpenStack File Share as a Service 6)  Q & A

2


Introductions Who are Bob & Colin?

3


Introductions

!  Technical Marketing Engineer, Cloud Solutions Group, NetApp

!  Technical Partner Business Development Manager, Virt/OpenStack

!  ATC on various OpenStack projects

!  8 years at Red Hat

!  PhD from NC State University

!  RHCE, RHCVA, CL210

4


Red Hat Enterprise Linux OpenStack Platform 5 Overview

5


WORKLOADS ARE EVOLVING

TRADITIONAL WORKLOADS ●

● ●

●

Typically resides on a single large Virtual Machine Cannot tolerate any downtime Needs expensive high availability tools found in VMware vSphere Application scales up rather than out

DOC144908

CLOUD WORKLOADS ●

●

●

●

Workload resides on multiple Virtual Machines Tolerates VM failure – if one fails, another quickly replaces it Fault tolerance often built into workload Application scales out rather than up

RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM

OPENSTACK CLOUD INFRASTRUCTURE FOR CLOUD WORKLOADS ● ●

DOC144908

Modular architecture, designed to easily scale out Based on (growing) set of core services


OPENSTACK CLOUD INFRASTRUCTURE FOR CLOUD WORKLOADS ● ● ●

Modular architecture, designed to easily scale out Based on (growing) set of core services It is dependent on the underlying Linux...

LINUX

DOC144908


RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM 4.0

OPTIMIZED FOR AND INTEGRATED WITH RED HAT ENTERPRISE LINUX

RED HAT ENTERPRISE LINUX

DOC144908


OPENSTACK ARCHITECTURE

●

Modular architecture

●

Designed to easily scale out

●

Based on (growing) set of core services

DOC144908


RED HAT CONTRIBUTION TIMELINE

DOC144908


RED HAT UPSTREAM FOCUS

●

Heavily engaged in community since 2011 ●

Established leadership position in community

●

Both in terms of governance and technology

●

Including several PTLs on multiple core services projects

●

Creating and leading stable tree

●

2nd largest contributor to Folsom Release

●

Largest contributor to Grizzly, Havana, and Icehouse releases ●

Note:

These statistics do not include external dependencies eg. libvirt, kvm, Linux components

DOC144908


RED HAT UPSTREAM FOCUS Top Contributor to Icehouse Release

●

3500

Overall commits per company (aggregated)

●

400 350

3000 2500 2000 1500 1000

Closed Tickets per company (aggregated)

Red Hat IBM HP Rackspace Mirantis SUSE OpenStack Foundation eNovance Intel

300 250 200 150 100

500

50

0

0

Source: Bitergia http://activity.openstack.org/dash/releases/index.html?data_dir=data/icehouse

DOC144908


Red Hat Others HP Mirantis IBM Rackspace Canonical OpenStack Foundation Dreamhost

RED HAT'S OPENSTACK LEADERSHIP WHY DO THESE STATISTICS MATTER?

●

Proof that Red Hat has skills, resources to: ● ● ● ●

●

●

Wide ranging participation, contrasts with most others who are more narrowly focused Important to highlight our leadership in the whole stack ●

●

DOC144908

Support customers Drive new features In;uence strategy and direction of project Enable partner collaboration

Linux, KVM, libvirt, etc

RHEL-OSP is an enterprise-grade distribution with ecosystem, lifecycle, and support that customers expect from Red Hat RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM

BUILDING A COMMUNITY

●

●

RDO Project ●

Community distribution of OpenStack

●

Packaged/tested for *EL6 and *EL7 and derivatives

●

Freely available without registration

●

Easy to install

Vanilla distribution – closely follows upstream ● ●

DOC144908

Upstream release cadence 6 month lifecycle – limited updates based on upstream RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM

OPENSTACK PROGRESSION

Bleeding edge upstream OpenStack source code

Bleeding edge upstream OpenStack packaged as RPMs

Unstable community Linux

Enterprise Linux distros (CentOS, RHEL, Fedora)

No certiCcations Community support Six month lifecycle

DOC144908

Enterprise hardened Red Hat OpenStack technology optimized for and integrated with Red Hat Enterprise Linux

No certiCcations Community support Six month lifecycle


Red Hat Support Red Hat ecosystem certi5cations 1+ year lifecycle

WHY RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM ●

All beneCts of community OpenStack and... ● ●

Co-engineered and integrated with Red Hat Enterprise Linux

●

Enterprise software lifecycle

●

World-class global support

●

Worlds largest OpenStack partner ecosystem

●

OpenStack training and certiCcation

●

DOC144908

Enterprise hardened code

Integrated with trusted Red Hat stack ● Red Hat CloudForms ● Red Hat Enterprise Virtualization ● Red Hat Storage RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM

THE IMPORTANCE OF INTEGRATION WITH LINUX... ●

●

●

DOC144908

A typical OpenStack cloud is made up of at least 10 core services (Nova, Cinder, Keystone, Neutron, glance, etc) + plugins to interact with 3 rd party systems – eg. storage arrays, network switches. These services run on top of a Linux distribution with a complex set of userspace dependencies, requiring tight integration A supported, stable platform requires integration and testing of each of the components



Many of the most complex features are provided by Linux with OpenStack providing management and orchestration ●

●

●

DOC144908

For example: virtualization provided by the KVM hypervisor, with libvirt management interface, interacting with Open vSwitch userspace switch, transitioning to the kernel's networking stack to handle network namespaces – Each potentially managed by diGerent OpenStack services.

These components need to be engineered & productized together OpenStack cannot be productized as a layered product RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM


Examples of RHEL optimized enablers for OpenStack: ●

● ● ● ●

●

DOC144908

Virtualization – guest performance, reliability, and Windows Security - SELinux enforcing guest isolation Network – SDN/OVS performance optimized Storage – vendor plugins, performance, thin provisioning Ecosystem – certiCcation of hardware, storage, and networks

The pairing of the Linux operating system and OpenStack is so tight that Red Hat Enterprise Linux OpenStack Platform is the only combination that can most eGectively support functionality, performance, security, system-wide stability, and ecosystem support RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM

RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM HYPERVISOR SUPPORT

Red Hat Enterprise Virtualization Hypervisor *Red Hat Enterprise Linux KVM ●

Lightweight / small footprint ●

Less overhead

●

Smaller attack surface

VMware vSphere *vCenter Driver ●

●

●

Co-exist with existing infrastructure assets Provides a seamless path to future migration to OpenStack Uses NSX1 plugin for Neutron

●

Cost effective

●

Closer to operating system DNA

NSX is only supported in production environments, per VMware's support requirements

●

Provides massive scale-out capabilities

*ESXi driver not supported

1

DOC144908


GUEST SUPPORT

Red Hat Enterprise Linux 3

●


●


●


●

SUSE Linux Enterprise Server 10

Windows XP SP3+1

●

●

SUSE Linux Enterprise Server 11

●

*32 and 64 bit for all versions

Windows 73

●

Windows 83 Microsoft SVVP Certified ●Windows Server 2003 SP2+3 ●

Windows Server 20083

●

Windows Server 2008 R22

●

*32 and 64 bit for all versions

Windows Server 20122

● 1

32 bit only 64 bit only 3 32 and 64 bit 2

DOC144908


WORLD'S LARGEST OPENSTACK PARTNER ECOSYSTEM Red Hat OpenStack Cloud Infrastructure Partner Network OEMs and IHVs

DOC144908

ISVs

System Integrators

Cloud Service Providers

Managed Service Providers

Channel Partners

●

Over 235+ members since launch in April 2013

●

Over 900 certified solutions in partner Marketplace

●

Over 4,000 RHEL certified compute servers

●

Over 13,000 applications available on RHEL

●

Large catalog of Windows certified applications RED HAT ENTERPRISE LINUX OPENSTACK PLATFORM

THREE WAYS TO GET OPENSTACK FROM RED HAT PURCHASE SUPPORTED PRODUCT

90-DAY EVALUATION

2 1

redhat.com/openstack/evalu ation

3

Learn more at: redhat.com/cloud DOC144908


DOC144908

RED HAT REDOPENSTACK HAT ENTERPRISE TECHNOLOGY LINUX OPENSTACK (TECHNICAL PLATFORM PRESO) | 2013

NetApp’s Integrations with OpenStack Overview

25


NetApp’s OpenStack Involvement !  OpenStack Foundation

!  1st Major Storage Provider

!  Charter member (Gold level) !  OpenStack Summit Sponsors

!  Upstream Contributions !  Production Deployments

!  Deployer of OpenStack

Grizzly Summit Sponsor

NetApp Joins

Essex Summit Sponsor

Folsom Summit Sponsor

Integration Announced

7-mode driver previewed

7-mode driver in Essex

Clustered ONTAP driver in Folsom

Direct Drivers in Grizzly

2011.10

2012.4

2012.10

2013.4

2011.3 26


Havana Summit Sponsor

Icehouse Summit Sponsor RHEL-OSP on FlexPod

Juno Summit Sponsor

Kilo Summit Sponsor

Swift on E-series

E/EF-series drivers in Icehouse

Manila Incubation*

2013.10

2014.4

2014.10

Integration Overview Shared Services Compute

Networking

Block Storage

Image

Shared Files

Object Storage

Clustered Data ONTAP

E/EF-Series

Persistent, rapid, space-efficient instances Block Storage Object Storage Image

27


FlashRay

StorageGRID

NetApp’s Core Competencies FAS

Continuous Operations

28

E-Series

Seamless Scaling Storage Efficiency

Simplicity

Horizontal Scaling

Consistency

Data Mobility

Data Protection

Unified Architecture

Density

Versatility

Vast Bandwidth

Quality of Service

Service Automation

Secure Multi-Tenancy

Broad Connectivity

Data Mobility

All-Flash


Glance on Data ONTAP Storage Efficient Image Registry & Repository


!  File or Swift backends !  Simplicity advantage to File !  Rapid instance creation capability with File

Glance on NetApp

90%+ Deduplication rates are often observed

29


RHEL

CentOS

Fedora

RHEL RHEL

RHEL RHEL

Fedora

CentOS CentOS

Fedora Fedora

CentOS CentOS

3 Copies… Commonly More Swift on JBOD Swift Deployment

Storage Node Storage Node

Any single object stored three or more times

30


Storage Node

Swift & Dynamic Disk Pools Efficient Storage and Scaling

DDP reduces disk rebuild times by

90%

!  Dynamic distribution / re-distribution of data “De-clustered” RAID !  Deploying Swift with NetApp E-Series reduces: !  !  !  !  31

Required storage capacity Ongoing cost of operations Deployment footprint Replication traffic between Swift nodes


Cinder deployment with NetApp Diverse Options for Diverse Use Cases pNFS Clustered ONTAP

7-mode

iSCSI NFS

NFS iSCSI

E-Series

EF-Series

32


iSCSI

iSCSI

Deliver Differentiated Block Storage Offerings Cinder Volume Types

!  Craft a catalog based upon tenant workload requirements

Cinder Volume Types Archival

Analytics

Streaming

Temporal

Database

!  !  !  ! 

netapp:raid_type netapp:disk_type

netapp:raid_type

netapp:qos_policy_group

netapp:disk_type

netapp:raid_type

netapp_mirrored


netapp:disk_type

netapp:raid_type

netapp_dedup

netapp_mirrored


netapp:disk_type

netapp:raid_type

netapp_nodedup

netapp_dedup

netapp_mirrored


netapp:disk_type

netapp_compression

netapp_nodedup

netapp_dedup

netapp_mirrored


netapp_thin_provisioned

netapp_compression

netapp_nodedup

netapp_dedup

netapp_mirrored


netapp_compression

netapp_nodedup

netapp_dedup


netapp_compression

netapp_nodedup


netapp_compression netapp_thin_provisioned

33


!  Compose Cinder volume types with: Efficiency Performance Availability Protection

Policy-Based Block Storage Service Boot 8 CentOS LAMP instances with 2TB of Silver please

Cinder Volume Types

Gold

Silver Silver

Bronze

Remote

Clustered ONTAP

SnapMirror

34


Enhanced Instance Creation Instant, storage efficient persistent root disks


Boot 8 persistent RHEL instances… •  Cloned, not copied •  Instances, instantly

Glance on NetApp RHEL

Fedora

CentOS

Cinder on NetApp

Hypervisor RHEL

RHEL

35

RHEL

RHEL

RHEL

RHEL


RHEL

RHEL

RHEL

RHEL

RHEL

RHEL

RHEL

RHEL

RHEL

RHEL

Highly Available Deployments of RHEL-OSP 5 and NetApp Storage

36


Architecture of a highly available OpenStack deployment Staypuft choices

!  With/without Neutron !  Database !  Messaging subsystem

37


NetApp Storage Layout Clustered DATA ONTAP

!  Individual Cinder volumes are represented by: !  A File on NFS export !  An iSCSI LUN

!  A Cinder backend should map to a storage virtual machine !  NFS is the recommended storage protocol !  More scalable than iSCSI !  Negligible performance degradation !  Proven solution with hypervisors for many years

38


Networking Best Practices !  Follow the best practices in the OpenStack Security Guide !  10GbE !  Separate storage management traffic from storage data traffic !  Use bonding (link aggregation) to provide resiliency to link failure & improved bandwidth !  NTP !  Use iSCSI multipath !  Jumbo frames for storage data traffic !  Load balancers with health checks for OpenStack services

39


Network Diagram

40


Logical Management Networks

41


Logical Data Networks

42


HA Reference Architecture Available today!

!  TR4323-DESIGN: “Highly Available OpenStack Deployments Built on NetApp Storage Systems” !  Solution Design document based on Icehouse !  Includes best practices for networking, storage, high availability

!  Available for download from http://www.netapp.com/openstack/ !  Follow us on Twitter for @openstacknetapp – we’ll tweet out a direct link when it’s posted !  Also NetApp’s OpenStack blog: http://netapp.github.io/openstack/

!  RHEL-OSP5 & NetApp Solution Deployment guide (based on TR4323) !  Scheduled to be published before Kilo design summit in Paris

43


Manila: The OpenStack File Share Service Brief Overview

44


%

65 * Per IDC report, 2012

45


storage sold in 2012 for Shared File Systems*

Create a “Marketing” share for 2 & 4

Share “R&D” with Instances 1 & 3

Manila

Nova


Hypervisor VM

Finance

46

R&D


Marketing

VM

VM

VM

VM

VM

Manila Architecture Processes & Interaction Control Path

REST

!  Not in the path of storage data traffic !  Closely mirrors architecture of Cinder !  API, Scheduler, Share processes !  Multiple backends supported !  Share types

Horizon

Manila Processes

manila-scheduler

manila-api

!  Interacts with Neutron !  Ensure shares are accessible over tenantspecific network !  Align multi-tenancy models between share backend and Neutron network

47


manila-share

manila-share

manila-share

Driver

Driver

Driver

Manila: NetApp Clustered Data ONTAP Driver !  Driver points at an existing Clustered Data ONTAP deployment !  A new storage virtual machine (SVM) is created for each share network !  Create a new Data Logical Interface (LIF) with the VLAN tag set to same VLAN tag of the Neutron network associated with the share network !  Access permissions are set at the controller for guests 48


mount -t nfs!

nova-compute

nova-compute

manila create!

Manila

NFS

Neutron

Control Path Data Path

Control Path

Manila: Gluster Driver

manila create! manila access-allow!

Data Path

Manila Processes

!  Use Gluster to provide a Distributed Scale Out File System backend for Manila File Shares

manila-scheduler

!  Current: Single Tenant GlusterFS driver using Gluster-NFS !  Future: Multi-Tenant driver that uses NFS Ganesha

manila-api

manila-share

manila-share

manila-share

Gluster Driver

Driver

Driver

Nova Compute

49


10.1.1.1

10.1.1.2

10.1.1.3

• Sales • Marketing

• Marketing • Eng

• Eng

/Gluster_Manila_Volume /Marketing

/Sales

/Eng

• 10.1.1.1 • 10.1.1.2

• 10.1.1.1

• 10.1.1.3

Summary

50


Red Hat Enterprise Linux OpenStack Platform 5 & NetApp A Winning Combination

!  The combination of RHEL-OSP 5 and NetApp allows you to: !  efficiently and effectively deploy OpenStack in an enterprise environment with strict SLAs !  take advantage of your current infrastructure investment !  make OpenStack consumable and safe for the enterprise

!  NetApp’s OpenStack Block Storage drivers are certified by Red Hat for use with: " NetApp clustered Data ONTAP & Data ONTAP operating in 7 Mode " NetApp E-Series & EF-Series " Both NFS and iSCSI storage protocols " Red Hat Enterprise Linux OpenStack Platform versions 3, 4, and 5

51


Questions?

52
