RSCT and Cluster Aware AIX together provide the foundation of strategic Power
Systems ... failure detection, and recovery to RSCT exploiters on Power / AIX.
VIOS ..... p7hb1.pdf. ▫ Technical Hands-On Movies. ▫ http://tinyurl.com/AIXmovies
...
Common Tagung VIOS, 9. Mai 2012
Virtual I/O Server Shared Storage Pools (Phase 2) René Akeret IBM Switzerland
© 2012 IBM Corporation
Agenda
1
PowerVM Editions
2
Cluster Aware AIX (CAA)
3
Shared Storage Pools (SSP)
4
Summary
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
PowerVM Editions PowerVM Editions Concurrent VMs
Express
Standard
Enterprise
2 per server
10 per core (up to 1000)
10 per core (up to 1000)
Virtual I/O Server NPIV Suspend/Resume Shared Processor Pools Live Partition Mobility Active Memory Sharing Shared Storage Pools (Phase 2) Active Memory De-duplication** Network Balancing Live Partition Mobility Performance Improvements ** Requires POWER7 System with eFW7.4
Q4 2011 Features Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
New PowerVM Features 4Q 2011 Feature
Function
Benefit
Shared Storage Pools
Creates pools of storage that can be used by virtualized workloads. This facility enables key functions like linked clones, snapshot / rollback and storage mobility.
Improves storage utilization, reduces storage infrastructure costs, decreases time to provision new VMs and reduces administration costs.
Active Memory De-duplication
Detects and removes duplicate memory pages in Active Memory Sharing configurations.
Optimizes physical memory usage for LPARs in Active Memory Sharing configurations. Allows more partitions to fit on a system if memory is constrained.
Network Balancing
Network traffic is balanced across multiple shared Ethernet adapters in HA environments
Improved utilization of shared Ethernet adapters in HA environments and better performance.
Live Partition Mobility Performance Improvements
Improvements in network components and this doubles the number of data movers from 8 to 16.
Allows Live Partition Mobility to operate faster which enables quicker system evacuation for maintenance activities. Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
New features requiring FW 7.4 Firmware 7.4 Is required for new selected Power enhancements Is available only new on MTM… 710 / 730: E1C & E2C 720 / 740: E4C & E6C 770 / 780: MMC & MHC No FW 7.4 support for older Power Systems
Product Feature
Express
Standard
Enterprise
Requires EFW 7.4
PowerVM: Active Memory De-duplication PowerSC: Trusted Boot
-Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
PowerSC Editions PowerSC Express
PowerSC Editions
Express
Standard
Basic compliance for AIX Security and Compliance Automation
PowerSC Standard Security and compliance for virtual & cloud environments
Trusted Logging Trusted Boot** Trusted Network Connect and Patch Management ** Requires POWER7 System with eFW7.4
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Agenda
1
PowerVM Editions
2
Cluster Aware AIX (CAA)
3
Shared Storage Pools (SSP)
4
Summary
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Cluster Aware AIX (CAA) Exploiters IBM Director
DB2
TSA
RSCT Consumers IBM Storage
HMC
Legacy RSCT
PowerHA System Mirror
HPC
RSCT With Cluster Aware AIX
Bundled Resource Managers Group Services
VIOS
Resource Mgr Services
Messaging API
Monitoring API
Cluster Admin UI
Cluster Messaging
Cluster Monitoring
Cluster CFG Repository
Bundled Resource Managers Group Services Messaging API
Resource Mgr Services Monitoring API
Cluster Admin UI
Cluster Layers Integrated Cluster to CAA Cluster CFG Redesigned Capabilities Messaging
Monitoring
Repository
Cluster Aware AIX CAA APIs and UIs
Legacy AIX Cluster Repository
Cluster Monitoring
Cluster Messaging
Cluster Events
RSCT and Cluster Aware AIX together provide the foundation of strategic Power Systems SW RSCT integration with CAA extends simplified cluster management along with optimized and robust cluster monitoring, failure detection, and recovery to RSCT exploiters on Power / AIX
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Agenda
1
PowerVM Editions
2
Cluster Aware AIX (CAA)
3
Shared Storage Pools (SSP)
4
Summary
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
VIOS Storage Options Shared Storage Pool
Whole local Disk & SAN LUN
SAN LUN
Logical Volume from VG Pool
LPAR
LPAR
LPAR
NPIV LUN
LPAR
VIOS
File backed from a file system
Power HyperVisor
vSCSI NPIV over vFC
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Extending Integrated Storage Virtualization Beyond a Single System
PowerVM
PowerVM with Shared Storage Pools
VIOS
LPAR
LPAR
LPAR
Power HyperVisor
VIOS
LPAR
LPAR
LPAR
Predominant PowerVM usage model today
LPAR
SAN
VIOS
Storage Pool
Power HyperVisor
LPAR
Storage Pool
LPAR
Storage Pool
LPAR
Power HyperVisor
LPAR
Power HyperVisor
VIOS
LPAR
LPAR
LPAR
LPAR
VIOS
LPAR
LPAR
LPAR
LPAR
VIOS
VIOS
LPAR
LPAR
LPAR
VIOS
Power HyperVisor
Power HyperVisor
Shared Storage Pool
SAN
High value extension of today’s model Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
VIOS Shared Storage Pool Clustering Model Ethernet
VIOS nodes are joined together to form a cluster
LPAR
LPAR
Power HyperVisor
Shared Storage Pool
SAN
Non managers communicate meta-data access and update via the ethernet Cluster-wide concurrent access to namespace and data available from any node
LPAR
LPAR
Power HyperVisor
VIOS
VIOS
LPAR
LPAR
Power HyperVisor
LPAR
VIOS
LPAR
LPAR
LPAR
One or more VIOS nodes are meta-data managers for sub-units of each storage pool
LPAR
All VIOS nodes are eligible to read and write user data via the SAN
VIOS
All VIOS nodes see all disks for storage pools they access
LUN
LUN
LUN
Based on Cluster Aware AIX (CAA), SF-Store and RSCT functions Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
VIOS Shared Storage Pool Motivation Simplify the aggregation of large numbers of disks Better utilize on a percentage basis the available storage
/pool1/vdev1:
/pool1/vdev2:
Simplify administration
A set of one or more disks managed as a block of storage that multiple file systems can reside within Managed as one entity with disks entering, leaving, and being managed thru a simplified set of commands File systems share this common storage pool unit Better storage utilization than the traditional dedicated storage that a (perhaps improperly sized) file system would necessitate Notion of a “file system quota” (follow-on)
Shared Storage Pool
Addressable on the VIOS thru a directory namespace rooted at /
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Thin or Thick Provisioning Motivation Storage utilization LPAR
LPAR
LPAR
LPAR
VIOS
A Client vSCSI device can be presented as a thinly or thickly partitioned device
Power HyperVisor
Thin provisioned device May present a much larger image than the current actual physical use Not fully backed by physical storage if the blocks are not in actual use
Thin
Thick
Storage Pool
Thick provisioned device Fully backed by physical storage no matter what the actual usage Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Snapshots on VM disks and Cloning
Persistently saved snapshot of a point in time, rollback to prior snapshot
LPAR #1
LPAR #2
Consistency group snapshots Sub-second creation No practical limit on the number of snapshots that can be persisted
Block virtualization /pool1/vdev1.0
/pool1/vdev1.1
/pool1/vdev1.2
Basis for: Capture / deploy Disaster Recovery Consolidated Backup / Restore
VIOS Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Live Storage Mobility Storage Mobility is a new function that allows data to be moved to new storage devices within Shared Storage Pools. Virtual machines remain completely active and available. This ability to move data to new devices can improve performance and allow for the retirement of old storage devices without incurring any application outages. Examples: Move I/O to newly acquired disk subsystem More evenly spread I/O load across devices Move the data to a different location (remote site) Remove data from retiring subsystem Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Live Storage Mobility (Replace Disk)
Ugly “other” vendor
Neat IBM
Fibre Channel
LPAR
LPAR
LPAR
vSCSI
LPAR
Power HyperVisor
VIOS
LPAR
LPAR
LPAR
LPAR
vSCSI
VIOS
LPAR
LPAR
LPAR
LPAR
VIOS
Power HyperVisor
Power HyperVisor
vSCSI
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Live Storage Mobility (Disk Space Move)* Storage Pool A
Storage Pool B Mirror Blocks
Move Blocks
Fibre Channel
LPAR
LPAR
LPAR
vSCSI
LPAR
Power HyperVisor
VIOS
LPAR
LPAR
LPAR
*Not on Phase 2
LPAR
vSCSI
VIOS
LPAR
LPAR
LPAR
LPAR
VIOS
Power HyperVisor
Power HyperVisor
vSCSI
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Shared Storage Pool Requirements Platforms: POWER6 & POWER7 only (includes Power Blades) VIOS Storage Pool (minimums): Direct fibre-channel attached LUNs: 1 for repository ~10 GB 1 or more for data, 10 GB in practice lots more [like 1TB+]
Pool Storage Redundancy: Repository & pool storage must be RAIDed VIOS name resolution to resolve hostnames Virtual I/O Server(s): Minimum CPU: 1 (shared, uncapped is good) Minimum Memory: 4 GB
Read the Release Notes http://www-01.ibm.com/support/docview.wss?rs=0&uid=isg400000876
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Shared Storage Pool Limits (Phase 2) Max nodes:
4 VIOS nodes
Max physical disks in a pool:
256
Max virtual disks (LUs) in a cluster:
1024
Number of Client LPARs per VIOS (that is, 40 clients per VIOS, or 40 clients per VIOS pair)
1 to 40
Storage Pool
40
40
Storage Pool
40
40
40
10GB to 128TB
Capacity of each Virtual Disk (LU) in Pool
1GB to 4TB
Number of Repository Disks
1 to 1 (CAA limit)
LPAR
Storage Capacity of Storage Pool (total)
VIOS
5GB to 4TB
VIOS
LPAR
VIOS
VIOS
LPAR
VIOS
LPAR
VIOS
LPAR
VIOS
LPAR
VIOS
Capacity of Physical Disks in Pool (each)
40
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Shared Storage Pools Dedicated Virtual Device
Shared Pool Virtual Devices
Dedicated Virtual Device
Power HyperVisor
Power HyperVisor
VIOS
VIOS block virtualization
/bar/l1:
/foo/f1:
block virtualization
/bar/f2:
SFStore Meta-Data
/foo/f3:
/bar/f4:
/bar/l2:
Store Shared Pool Dedicated LUN **
Dedicated LUN **
Store Storage Pool Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
**Not currently supported
User Interface Command line Some feature will remain command line only
like: cluster –create
cfgassist This is the VIOS version of smitty Menu driven interface for CLI Fully covers SSP functions
Graphical User Interface HMC (V7 R7.4)
System Director - Future release Already has Storage Pools concept and features Shared Storage Pool is just another storage pool type Then may adds new unique items – like VMControl appliance deploy to SSP disk space or cloning Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Agenda
1
PowerVM Editions
2
Cluster Aware AIX (CAA)
3
Shared Storage Pools (SSP)
4
Summary
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Shared Storage Pools transforming the datacenter
Dynamic Flexibility All operations online
Improved utilization Thin Provisioning Greater utilization percentage
LifeCycle Management (first time power is applied to the server’s retirement) Image Management: capture, deploy Agility (linked-clones)
Provisioning time Location transparency Availability Backup / Restore & Disaster Recovery Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Technical Information Announcement letter http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?infotype=AN&subtype= CA&htmlfid=897/ENUS211-354&appname=USN
Release notes http://www-01.ibm.com/support/docview.wss?rs=0&uid=isg400000876
VIOS 2.2 User Guide http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7hb1/ p7hb1.pdf
Technical Hands-On Movies http://tinyurl.com/AIXmovies Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
René Akeret IBM Switzerland
[email protected] Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Cluster Aware AIX (CAA) – What is it? A set of services/tools embedded in AIX to help manage a cluster of AIX nodes and/or help run cluster software on AIX IBM cluster products (including RSCT, PowerHA, and the VIOS) will use and/or call CAA services/tools. CAA services can assist in the management and monitoring of an arbitrary set of nodes and/or running a third-party cluster.
CAA does not form a cluster by itself. It is a tool set. There is no notion of quorum. (If 20 nodes of a 21 node cluster are down, CAA still runs on the remaining node). CAA does not eject nodes from a cluster. CAA provides tools to fence a node but never fences a node and will continue to run on a fenced node.
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Cluster Aware AIX (CAA) and RSCT
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Shared Storage Pools (SSP) SSP is a server based storage virtualizer that is clustered across multiple Power servers It’s an extension of PowerVM’s existing storage virtualization (VIOS vSCSI) Combines existing SCSI emulation with clustering technology and a distributed data object repository Distributed data object repository is an advanced filesystem-like function developed specifically for storage virtualization
SSP provides the same standard vSCSI Target interface to client host VIOS 2.2.1.0
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Why Shared Storage Pools? Fibre-Channel LUN & NPIV is complex SAN switch, SAN disk subsystem = hard work & weird GUI !! Typical LUN lead time: 4 minutes, 4 hours, 4 days, 4 weeks? With rapidly changing needs with mandatory responsiveness it is simply not good enough! Many smaller computer rooms have no dedicated SAN guy LPM hard work as most people don’t pre-Zone the target so have to Zone before the move = complexity, slow, error prone LPM = zero outage for Hardware & Firmware upgrades
Shared Storage Pool Allocate LUNs to the Virtual I/O Servers once One VIOS command to allocate space to a VM Or use: cfgassist (VIOS’s smitty) Or use: HMC Virtual Storage Management GUI LPM any time you like
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Shared Storage Pool Configuration (Phase 2)
Feature
Min
Max
Number of VIOS Nodes in Cluster
1
4
Number of Physical Disks in Pool
1
256
Number of Virtual Disks (LUs) Mappings in Pool
1
1204
Number of Client LPARs per VIOS node
1
40
Capacity of Physical Disks in Pool
5GB
4TB
Storage Capacity of Storage Pool
10GB
128TB
Capacity of a Virtual Disk (LU) in Pool
1GB
4TB
1
1
Number of Repository Disks
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
Shared Storage Pool Software Stack
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation
IBM Systems Director offers end-to-end platform management Other Systems Management Software
Enterprise Service Management Integrated Service Management
IBM® Systems Director Editions
Configuration
Automation
Update
System x & Blade Center
Status
Remote Access
System z
Virtualization
Core Director Services
Power Systems
Discovery
Configuration
Storage Configuration
Storage Control
Additional Plug-Ins
WPAR Manager
VMControl Image Manager
Service & Support Manager
BOFM
Transition Mgr for HP SIM
Network Control
Active Energy Manager
VMControl
$$
Advanced Managers & Priced Plug-Ins
Base Systems Director Managers & Hardware Platform Managers Resource Management Managed virtual and physical environments
Hardware
IBM and non-IBM hardware
Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation