Delivering Business Value with Grid Computing - Grid@Asia

Delivering Business Value with Grid Computing

Ronald Watkins IBM Grid Computing & Virtualization GRID@Asia Conference Seoul, Korea • December 11-13, 2006

© 2006 IBM Corporation

Grid Computing

AGENDA ƒ Evolution of IBM’s Grid Computing strategy ƒ IBM Grid Computing Products & Technologies ƒ Customer References ƒ IBM Infrastructure Solutions & Grid ƒ Conclusions

2

Evolution of Grid Computing

Phase 4

Factors driving Adoption Phase 3

Internet & Linux patterns are repeating…

Phase 2

2002 - 2005 “Grid Adoption reaches commercial enterprises”

1999 - 2001 “Grid Gains Traction and Standards Work Begins”

Phase 1 1990 -1998 “Grid is Born from Distributed Supercomputing”

ƒ Globus Toolbox 1.0 is released ƒ GGF is founded

ƒ Globus Project begins from the I-WAY project ƒ Teragrid is launched ƒ Basic job deployment functionality is built ƒ Scientific community begins to adopt grids

3

2006 - 2008 “Grids become an integral part of computing infrastructures”

ƒ Scheduling and resource management functionality emerges ƒ Academic environments begin to adopt grid technology

ƒ OGSA 2.0 is announced ƒ Application vendors begin grid-enabling their products ƒ GGF boasts members from the major US IT vendors ƒ Information virtualization, automated provisioning and workload management capabilities enhance grids ƒ Lines of Business within commercial enterprises adopt grid technology

ƒ GGF + EGA unite to create OGF. Grid standards solidify and are widely endorsed ƒ Many application vendors incorporate grid technology into their products ƒ Billing and metering, strong license management and network optimization functions complete the grid architecture ƒ Grid adoption extends across enterprise architectures

Grid and Virtualization

Virtualize Outside the Enterprise

IBM is focused on solutions that help clients realize value from the full spectrum of grid computing solutions

Virtualize the Enterprise

Suppliers, partners, customers and external resources

Virtualize Unlike Resources Enterprise wide Grids, Information Insight, and Global Fabrics

Virtualize Like Resources Heterogeneous systems, storage, and networks; Application-based Grids Cluster Single System (Partitioning) Simple (2-4)

Sophisticated (4+)

Homogenous systems, storage, and networks

Homogenous Single Organization Tightly Coupled 4

Heterogeneous Multiple Organizations Loosely Coupled

Realizing Increasing Levels of Business Value Virtualize Outside the Enterprise

Virtualize the Enterprise

Asset Utilization Workload Prioritization

Virtualize Unlike Resources

Infrastructure Flexibility

Virtualize Like Resources

Enabling Business Resiliency

Aggregating Information Cluster Single System (Partitioning) Simple (2-4)

Sophisticated (4+)

Application Acceleration Time to Results and Higher Quality

5

IT Simplification for Enterprise Optimization

Business Insight and Collaboration

IBM Infrastructure Solutions & Grid

Why are Organizations moving to Grid Computing & Virtualization ? • Existing computing capacity is highly underutilized • Operational costs far exceed the budget for new hardware

Cost of I/T Support vs. Servers Spending (USB$) $200

Installed Base (M Units) 35

$180

30

$160 25

$140 $120

20

$100

• Hardware and Software technology now exists that dynamically allocates servers & storage to applications ondemand

15

$80 $60

10

$40 5

$20 $0 1996 ’97 ’98 ’99 2000 ’01 ’02 ’03 ’04 ’05 ’06 ’07 ’08 New server spending (USM$) 3% CAGR

Cost of mgmt. & admin. 10% CAGR

Increases: Utilization of existing I/T assets. Reduces: I/T Support Costs, Administrative Complexity Improves: ROI, Quality of Service, Staff Productivity *IDC – CEO Study; Customer Adoption of On-Demand Enterprises.

6

© 2006 IBM Corporation

IBM Infrastructure Solutions & Grid

The Value of Open Standards Distributed Computing: Grid & Virtualization (Open Grid Forum ~ Globus ~ UNIVA) Applications: Services Oriented Architecture

Operating System: Linux Information: World-wide Web (html, http, j2ee, xml)

Networking: The Internet (TCP/IP)

7

Communications: e-mail (pop3,SMTP,Mime)

© 2006 IBM Corporation

IBM’ Grid Computing strategy is focused on Workload Virtualization and Information Virtualization Service Oriented Architecture

Application Virtualization

Information Virtualization

Workload Virtualization

(Distributed Data, Caching, Replication, Federation, Transformation)

(Dynamic Scheduling)

Resource Virtualization Servers

(Workload Management, Partitioning)

8

Storage

Networks

(Virtual Volume Management)

(Virtual Devices & Connectivity) © 2006 IBM Corporation

IBM’s Grid & Virtualization technologies provide Workload, Information and Resource Virtualization Service Oriented Architecture Application Virtualization Information Virtualization

Workload Virtualization - Tivoli Workload Scheduler - WebSphere XD - *** Grid Middleware partners

- IBM Information Server - TotalStorage SAN Volume Controller - GPFS

Resource Virtualization - Tivoli Provisioning Manager - Tivoli Intelligent Orchestrator

Servers

*** Grid Middleware Partners:

9

- Virtualization Manager - TotalStorage Productivity Center

Storage

Networks

Altair, Condor, DataSynapse, Moab, Platform, Torque, United Devices

© 2006 IBM Corporation

Tivoli Workload Scheduler & Tivoli Intelligent Orchestrator Business Goal: Improved IT asset utilization, lower costs, achieve SLA’s, align IT with business priorities

Data Center operator evaluates workloads to determine and manage computing resources

IT Goal: Allocate server resources between Cluster/GRID and nonGRID users based on workloads and business priorities 1)

Non-Grid

Cluster / Grid

Tivoli automatically provisions servers to Nongrid (Blue) cluster to match scheduling workload; Tivoli also provisions servers to grid pool to as needed and evaluates business policies

Resource Pool Tivoli provides policy based processes for scheduling, monitoring, managing, and controlling cross-enterprise resource capacity for optimal performance across heterogeneous IT environments 10

© 2006 IBM Corporation

Grid Computing

Grid Computing Industry Applications Manufacturing Financial Services Energy Seismic Analysis

Reservoir Analysis

Mechanical/ Electric Design

Derivative Analysis Actuarial Analysis Asset Liability Management

Process Simulation

Finite Element Analysis

Portfolio Risk Analysis Failure Analysis

Life Sciences & Health Care Drug Discovery Protein Folding

Government & Education Telco & Media Bandwidth Consumption Digital Rendering

Medical Imaging

Statistical Analysis

Collaborative Research

Gaming

Weather Analysis

High Energy Physics

Grid Infrastructure

11

© 2006 IBM Corporation

Grid Computing & Virtualization

Public Sector – Grid & Virtualization Opportunities

Government Government

ƒ Computing Infrastructure Transformation ƒ Data Sharing ƒ High Performance Computing Applications ƒ Economic Development

Health HealthCare Care&&Life LifeSciences Sciences

ƒ Medical Image Management ƒ Drug Discovery Research ƒ eMedical Records ƒ Information Based Medicine

Higher HigherEducation Education

ƒ Research Collaboration & Data Sharing ƒ High Performance Computing Applications: Weather Analysis, High Energy Physics, Visualization & Simulation, Life Sciences Research, Environmental Analysis, Nanotechnology, Earthquake Research

12

© 2006 IBM Corporation

IBM’s Breadth of Capabilities for Grid Computing IBM Global Services Grid & Virtualization Design Centers

Capacity on Demand Centers

Grid Whitepapers and Redbooks

Grid Sales & Technical Specialists

Grid Integration Center

DB2

Products Grid Enabled ISVs & Middleware Partners 13

Grid Computing Institute IBM Research

www.ibm.com/grid

Grid Computing

AGENDA ƒ Evolution of IBM’s Grid Computing strategy ƒ IBM Grid Computing Products & Technologies ƒ Customer References ƒ IBM Infrastructure Solutions & Grid ƒ Conclusions

14

World Community Grid • IBM has established a Global Public Grid for Philanthropic Research http://www.worldcommunitygrid.org/

• IBM is working with the Mayo Clinic, United Nations, EPA, World Health Organization and United Devices on this worldwide effort • An advisory Board with members from leading foundations, universities and public organizations is providing oversight to the research projects • Projects in the following disciplines are being implemented: •

Medical Research – Genomics, proteomics, epidemiology, and biological system research such as AIDS and HIV studies.

•

Environmental Research – Ecology, climatology, pollution, and preservation

•

Basic Research – Human health and welfare related studies

> Over 50 million results returned > Over 52,000 years of CPU processing time > Approximately 400k devices on the Grid 15

IBM Grid Computing

Harvard University - Crimson Grid Challenge

Solution

Provide grid computing to meet the needs of the faculty in Harvard's Division of Engineering Applied Sciences (DEAS) and Harvard's research community, while also enabling users to share complex programs, models, data and storage capacity

ƒIBM System p655 & BladeCenter servers ƒGlobus ƒIBM Global Services including: Bladecenter integration, GRID computing, benchmarking, systems planning and software porting Benefits and Impact ƒA scalable infrastructure for research computing ƒCollaboration platform which facilitates the sharing of software, data and storage ƒServes as a computing model for academic-industry partnerships

"We moved some of our ocean modeling to the Crimson Grid... we are not using the whole grid.. but have already increased our performance by a factor of 10.“ - Pierre Lermusiaux, Harvard oceanography researcher 16

2006 IBM Corporation

Diamond Computer Service Co., Ltd.

Enterprise Optimization

Grid Technology enables High Reliability and Continuity/Flexibility of Web Servers Challenge Quality improvement of Web application services and TCO reduction together by efficient operation ¾Reduce investment on servers, software licenses and operational costs by raising operation rates of IT resources ¾Build an environment that will enable application updates and server maintenance during system operation ¾Control transaction performance automatically with setting service efficiency per user level

Solution Components ¾IBM WebSphere Extended Deployment (XD) ¾IBM System x 336 ¾IBM Infrastructure Services

Technology Benefits: ¾Automatically deploy servers according to load dynamically and automatically control transaction priorities based on service efficiency set per user ¾Realize automatic detection and response to irregularities by centralized monitoring and management of massive application servers

Business Benefits: ¾Reduce TCO by increased server operation rates ¾Improve service efficiency by increased availability

““It It has has been been proved proved that that Grid Grid infrastructure infrastructure built built by by IBM IBM WebSphere WebSphere Extended Extended Deployment Deployment (XD) (XD) can can

significantly significantly increase increase reliability reliability and and service service efficiency efficiency of of Web Web applications applications with with reducing reducing TCO TCO dramatically. -Mr. -Mr. Tanaka, Tanaka, Diamond Diamond Computer Computer Service Service Co., Co., Ltd. Ltd. dramatically. ““ 17

© 2006 IBM Corporation

Grid Computing

The Higo Bank, Ltd. Grid adoption enhances bank’s financing business and customer service CHALLENGE Part of Higo Bank’s medium-term management plan was to improve customer credit risk management, and upgrade credit control and promotion of loan services. It needed to upgrade processes for collection and analysis of customer information in a systematic and chronologically accumulated fashion under centralized management, and reduce costs by streamlining loan service operations.

SOLUTION: IBM Global Services used leading technologies/solutions to build a grid infrastructure that virtually integrates disparate databases that have been controlled by separate operations and enables real time system interoperation. • IBM System p • WebSphere Information Integrator • TotalStorage

BENEFITS:

“We succeeded in creating a flexible and expandable system using existing system resources. We can expect efficient and upgraded loan operations and humanresource development..” Yuji Segawa, Manager, New Total Financing System Project Office

• The bank has enhanced its financing business to better service customers by integrating information from profit calculations and credit risk assessment for use in sales and screening. ƒ Increases profits by making loan screening activities quicker and more accurate ƒ Reduces costs by streamlining clerical operations

18

© 2006 IBM Corporation

Grid Computing

NDMA: National Digital Medical Archive Medical MedicalImaging ImagingGrid Grid

Requests

A national life-time archive of digital medical images and data, gathered from hospitals around the country and made available to patients and doctors Requests

User workstation

Annotation File

i3Archive “WallPlug”

Digital Images Replies

Annotation Workstation

DICOM

Viewing stations

CAD Results Hospital A

19

NDMA Archive managed by IBM

Grid Computing

Soochow University - China

Grid & Grow

Challenge: ƒ

Establish high performance computing and storage infrastructure to support the academic research and collaboration in Soochow Univ.

ƒ

Better utilize the equipment & lower the total operation cost

Solution: ƒ ƒ ƒ ƒ ƒ

20

IBM BladeCenter JS20 & HS20 IBM OpenPower 710 IBM DS4500 & DS4300 SUSE Linux, xCAT, Cluster Resources Torque, Maui Topspin Infiniband

Technology Benefits: ƒ IBM BladeCenter & OpenPower provide 700GFlops computing capacity ƒ Infiniband provide standards-based high performance server switching infrastructure ƒ Open & flexible infrastructure to support growth Business Benefits: ƒ Provide High Performance computing capacity to different users ƒ Simplify the system management for Heterogeneous platforms & storage system ƒ Generate the resource pool to support more users

IBM Infrastructure Solutions & Grid

Seoul National University (SNU) Challenge ƒ Provide students and researchers with an IT infrastructure to support HPC workloads ƒ Establish SNU as one of the leading universities in the world with high technology based education

IBM Solution Offerings 9 IBM BladeCenter ( 484 Power Nodes) 9 IBM Linux Cluster 1350 9 Grid System Gateway (IBM Web-based Grid Portal) 9 Globus 2.4 9 IBM LoadLeveler 9 IBM Storage FAStT700 Campus Grid

Benefits ƒ Facilitates high-performance computing capabilities with one of the largest Blade Linux cluster based supercomputer in Asia

ee-Teaching -Teaching &&Learning Learning

ee-Knowledge -Knowledge

ee-Management -Management

Seoul National University

ƒ Ranked 51th on Worldwide TOP500 list for Supercomputer site ( 5.148 Tflops ) ƒ Optimizes IT infrastructure by creating a shared computing environment with Web-based Grid Portal system, Grid System Gateway, to produce ‘SNU Campus Grid ‘ ƒ Allows SNU to share computing resources by expanding the grid infrastructure to Korea National Grid project (K*Grid)

KISTI

Korea National Grid

Pohang

Junjoo Pusan

21

© 2006 IBM Corporation

Grid Computing

AGENDA ƒ Evolution of IBM’s Grid Computing strategy ƒ IBM Grid Computing Products & Technologies ƒ Customer References ƒ IBM Infrastructure Solutions & Grid ƒ Conclusions

22

IBM Infrastructure Solutions & Grid

IBM’s strategy is to offer Infrastructure Solutions that incorporate strategic technologies that reduce the cost and complexity of running an I/T environment

HPC & Clusters

Grid Computing Autonomic Computing

Virtualization

SOA Linux

23

© 2006 IBM Corporation

IBM Infrastructure Solutions

IBM Infrastructure Solution Definition

IBM Global Services

+

IBM Software and/or Hardware

=

Infrastructure Solution

What makes it an IBM Infrastructure Solution? ƒ Each Infrastructure Solution contains: 9 Pre-integrated Software, Servers, and Storage 9 Technology services to implement the solution

24

© 2006 IBM Corporation

IBM Infrastructure Solutions & Grid

IBM Infrastructure Solutions & Grid ƒ Grid & Grow ƒ Optimized Analytics Infrastructure (“OAI”) ƒ Grid Medical Archive Solution (“GMAS”) ƒ IT Resource Optimization for Engineering ƒ Actuarial Grid

25

© 2006 IBM Corporation

IBM Infrastructure Solutions & Grid

IBM “Grid and Grow” Offering • Packaged set of Hardware, Software and Services for ~$50,000 (US$) • Simple, get started approach. Can serve as a Grid Computing “test bed” • Seven (7) blade BladeCenter

Application Application 11

Application Application 2 2

Grid Scheduler

• Choice of three (3) Grid middleware schedulers: IBM LoadLeveler, Platform LSF, Altair PBS Pro • IBM Global Services included to ensure a successful installation • Focused on compute intensive applications

26

POWER, Intel, AMD Blades

© 2006 IBM Corporation

IBM Infrastructure Solutions & Grid

The Optimized Analytics Infrastructure (“OAI”) solution addresses the challenges faced by Financial Services companies in creating an automated, low-latency, high performance, truly scalability analytics infrastructure Quant

Trading

Risk

Analytics

ApplicationWeb Step-changing enablement of Grid based application in three critical areas:

Hetrogenous Adaption

Virtualization of Middleware

Application Development Loadleveler PBS Pro

Existing

GPFS High Performance Parallel File System Deep Computing On-Demand Manager / Director OptimizedCluster AnalyticSystems Infrastructure - Introduction 27

IBM Internal Use Only

IBM Infrastructure Solutions & Grid

IBM’s Grid Medical Archive Solution (GMAS)

Storage Grid

IBM’s GMAS is a multi site, multi-tier, multi-application fixed content enterprise storage virtualization platform 28

IBM Infrastructure Solutions & Grid

Grid Medical Archive Solution – Key Concepts • GMAS is software technology that intelligently manages the interaction between an application and its storage resources • Is Location Independent: Central or Federated • Is Automated: Self Optimizing & Self Healing

Siloed Storage

• Is Heterogeneous: At the application & storage level • Has zero points of failure • Enables access to any image, anytime, anywhere from any system Virtualized Storage • Leverages existing investments

GMAS = Automated storage optimization & management for fixed content 29

IBM Infrastructure Solutions & Grid

ITRO for Engineering is an infrastructure solution designed to significantly improve the efficiency of the Industrial design / analysis cycle

Data mgmt

Preprocessing

ƒProcess integration & management

•Simulation Data Management •Simulation and Product Data Mgt integration •CAD /CAE integration

Analysis

•CAE application integration and optimization

Post – process

•Deep Computing visualization

ƒDesign optimization Resource Virtualization Infrastructure

30

•Engineering Grid •Storage Management •Deep Computing Capacity On Demand © 2006 IBM Corporation

IBM Infrastructure Solutions & Grid

ITRO for Engineering Solution Components Process integration and optimization Design Optimization

Workflow

Portals

CAE applications Crash simulation, Structures, CFD, etc……

on Demand IT infrastructure Enterprise Service Bus

IBM Websphere 31

Data Management MSC SimManager

Resource and Workload Management HPC Synergy, Platform LSF, etc

File Systems

Storage virtualization

GPFS, NFS V4

SAN Volume Controller, Tivoli Storage Manager © 2006 IBM Corporation

IBM Infrastructure Solutions & Grid

Actuarial Grid

• A Grid solution that addresses the performance and data issues facing actuaries using insurance applications for life, pensions and annuity valuations

Benefits include: ƒ Faster time to results for complex calculations ƒ Actuaries can run more models; fine tune models; increase data points ƒSupports better decision making including capital and reserve management ƒIncrease speed to market for new products

32

© 2006 IBM Corporation

IBM Infrastructure Solutions & Grid

Actuarial Grid components Actuarial Applications * MoSes, TAS, MG-Alfa, IWORKS Prophet, AXIS, Advise, GEMS

Grid Middleware

System Software

BladeCenter

IBM GlobalProvides: Services IBM Global Services ƒ

Technical assessment workshop & site readiness

ƒ

Grid middleware installation and configuration

ƒ

Application installation, configuration with grid scheduling middleware

ƒ

Functional testing with standard model

ƒ

Demonstrate and measure test job results

ƒ

Bladecenter installation; network connect; VLAN configuration; OS installation and configuration

ƒ

Project management; Skills transfer; documentation

* Example list; Not finalized 33

© 2006 IBM Corporation

Conclusions ƒ Grid has matured from an emerging technology – Well entrenched in HPC – Embodied into solutions for commercial applications ƒ But… challenges remain – Standards lagging and inhibiting increased adoption

ƒ IBM’s focus is to: – Play a leadership role in standardization – Include mature technology components into our products – Include mature products into our infrastructure solutions – Help our customers realize business benefits via solutions

34

© 2006 IBM Corporation

Grid Computing

IBM Grid Computing Customers ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ

Higo Bank St Judes Childrens Hospital Norwich Union Audi Petrobras – (Brazil Oil) Bowne Generations Plus Hewitt Associates Aventis Pharmaceuticals Hyundai – Kia Motors LandMark Graphics Magna-Steyer Intel Reuters Nippon Steel Karmann Sinopec Wachovia Royal Dutch Shell Yurion Digital Media Siemens Mobile Capital One Wachovia Bank NTT Data Credit Suisse Ford Bell South Novartis CC-2INP3

ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ ƒ

ƒ LSU Royal Bank of Canada ƒ Marist College CAA Motors ƒ National Cancer Institute Conoco Phillips ƒ FNMOC – Navy Weather Daimler Chrysler Development Bank of Singapore ƒ NCAR ƒ OneCleveland Diamond Computer Service ƒ Pfizer Charles Schwab ƒ Seoul National University SURA ƒ SuzHou University Iowa Health System ƒ Tokushima Hospitals Fitch Ratings ƒ University of Kaiserlautern Aegon Insurance ƒ Yamanouchi Pharmaceuticals Sal Oppenheim ƒ Indiana University MTU Aero Engines ƒ Nissan Paradigm ƒ Shell TaiKang Life Insurance ƒ University of Cambridge University of Texas ƒ Morgan Stanley i3Archive ƒ Toshiba Generations Plus University Health Care – Augusta ƒ BNP Arbitrage Fiat TeraGrid Gridƒ Infrastructure ƒ Ferrari China Grid DEISA ƒ Mizuho CB EPA ƒ HVB Group KISTI ƒ ESTECH CERN ƒ SGIB Canada WestGrid ƒ GeoPhysical Services Harvard ƒ SamSung Data Services Germany FZK ƒ Nordea Erste Bank ƒ BAE

IBM Grid Computing

Thank You

© 2006 IBM Corporation