1600 Cloud Solutions for Engineering Simulation using ANSYS - B Moore.pdf. 1600 Cloud Solutions for Engineering Simulati
Titelmasterformat KlickenSimulation bearbeitenusing Cloud Solutions fordurch Engineering ANSYS Bob Moore, CADFEM Ireland
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
1
Overview • •
Why do we need HPC Cloud HPC Options • • •
CADFEM Cloud ICHEC Amazon EC2 Cloud
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
2
Why do we need HPC? • Larger FE Models • Assemblies instead of single parts and defeaturing Lots of computations!!
• Mesh fidelity continues to increase • More equations to solve More computations!!
• More complex physics being analyzed • Nonlinear, Dynamics, Multiphysics More computations!!
• Parametric studies, Optimization More computations!!
© CADFEM 2015
3
OK, we need more computations so we just buy faster processors, right?
Wrong ! Main problem is you make processors faster by making transistors on a chip perform more operations per unit time. This uses more power and generates lots of heat. That’s why you won’t find many processors faster than about 3.6 GHz for several years now. Also why there are so many datacentres in Ireland – cooling much cheaper here !
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
4
How do we improve performance? We can sit around and wait for quantum computing (or some other magic bullet) to become mainstream OR …. • Multiple cores on a single chip • Parallel computing • Use GPUs • More and faster RAM • Faster storage (SSD) • Faster interconnections between cores • Faster interconnection between devices
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
5
HPC Configurations 1. Multicore Desktop Workstation 2. Compute Server + Thin client Terminals 3. Desktop Workstation + Compute Server 4. Blade Workstation + Thin client terminals 5. Compute Server + Blade Workstation + Thin client terminals 6. Thin client terminals + Cloud
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
6
I’ve got my superfast cloud access, but I have a few problems ! The 3D rendering of my models are jerky and frustrating to work with on the cloud • Nice DCV My simulations run blisteringly fast but it takes me forever to upload and download results – some time saving this is ! • CADFEM C.A.V.E. • Post process on the cloud and save to Amazon EC2 I can’t access licences from our office licence server on the cloud? • Open VPN / Corporate VPN • Consider putting the licence server in the cloud too I want to run a big job on the cloud but don’t have enough HPC packs and/or need extra licences temporarily? • eCADFEM © CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
7
Cloud Computing Options • CADFEM Cloud • • • •
Optimised for ANSYS Specialised viewer software for remote 3D rendering (Nice DCV) CADFEM CAVE to shrink results for local viewing High end solution
• ICHEC • Massively powerful • Suitable for batch jobs only • Still necessary to upload and download data
•Amazon Cloud • Very flexible – pay for what you use, scale machines as needed on the fly • Previously graphics could be a bit slow for 3D rendering, now addressed with GPU instances. • All pre- and post- processing done on the cloud • Can also use Nice DCV
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
8
Different cloud solution comparisons #1
CADFEM Cloud
Flexibility
Speed / Power
Support
Flexible Licensing model – in house / eCADFEM / Hybrid Solutions for minimising data transfer
Extremely powerful ANSYS optimised cluster - 2.6 Ghz
CADFEM Ireland / CADFEM Germany ANSYS Experts
E5 2697 V3 (22,120) / E5 2690 V3 (19,894)
ICHEC
Available on demand, batch only Upload/Download files necessary
Extremely powerful supercomputer Intel Xeon CPU E52660 v2 (13,659)
Direct support from ICHEC Ireland and CADFEM Ireland
Amazon EC2
Launch machines on demand Support email Store results on image or Amazon S3
Is a bit slower than equivalent bare metal clusters Intel Xeon® E5-2676 v3 (Haswell) (16,598)
CADFEM Ireland for FEA / CFD, email support from Amazon
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
9
Different cloud solution comparisons #2 Spec
Cost Core / Hr
Cost/GB RAM/Day
Cores
RAM (GB)
Windows
Linux
Windows
Linux
CADFEM Cloud
28
704
€0.30
€0.30
€0.28
€0.28
ICHEC
24
64
N/A
€0.06
N/A
€0.50
Amazon EC2
36
220
€0.20
€0.13
€0.77
€0.50
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
10
CASE STUDY: OpenHydro OpenHydro have used all 3 cloud solutions. • Blade Optimisation: • Batch mode, long runs, lots of compute power • ICHEC
• CFD Study: • Interactivity needed, 10 day runtime • CADFEM CLOUD100 core machine
• Smaller Day-to-Day FEA requirements • Amazon EC2
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
11
CADFEM Cloud
C.A.V.E. inside ANSYS • Compression of large quantities of result data
Flexible licensing model (in-house, eCADFEM, HPC packs … )
Dedicated compute node for large models (20 cores, 512 GB RAM)
NICE DCV Viewer for smooth graphics for large models
Additional Server for large batch jobs: 100 cores (Haswell CPUs) for comprehensive HPC-analyses models
ANSYS 15+16, RSM, MPI, etc. Installed, configured, and immediately available
256-bit AES encryption Data center certified according to DIN ISO 27001, based in Karlsruhe, Germany
Personal touch with cluster built by ANSYS professionals
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
12
CADFEM Engineering Simulation Cloud Hardware & Software Bundles • Hardware + Software Bundles • 1 x ANSYS Mechanical + HPC Workgroup 16 + 3D interactive Cloud-HW • 1 Week: € 2.700,• 1 Month: € 7.100,-
• 1 x ANSYS Mechanical Solver + 3 HPC Pack + 100 Haswell Cores (batch) • 1 Week: € 3.700,• 1 Month: € 9.700,-
• 1 x ANSYS CFD Solver + 3 HPC Pack + 100 Haswell Cores (batch) • 1 Week: € 3.700,• 1 Month: € 9.700,-
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
13
Sample Amazon Instance Types
m4.10xlarge
g2.2xlarge
• 20 Non HT cores • 160 GB RAM • 2.4 GHz Intel Xeon® E5-2676 v3 (Haswell) processors • 4,000 Mbps dedicated throughput • $5.02 per Hour (Windows) • $2.91 per Hour (Red Hat Enterprise Linux)
• 4 Non HT cores • 15 GB RAM • Intel Xeon E5-2670 (Sandy Bridge) Processors • High-performance NVIDIA GPUs, each with 1,536 CUDA cores and 4GB of video memory
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
14
Amazon EC2 – Build your own 100 core cluster 20 Core Linux Machine
Windows Machine with RDP or NICE DCV
20 Core Linux Machine
20 Core Linux Machine
20 Core Linux Machine
© CADFEM 2015
20 Core Linux Machine
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
15
Web Infrastructure Schematic #1
Internet
Office Network
eCADFEM for HPC packs / extra licences VPN
CADFEM Cloud / Amazon / ICHEC
ANSYS Licence Server
Engineer using cloud
© CADFEM 2015
Engineer using local machine
16
Web Infrastructure Schematic #2 - Amazon
Internet
eCADFEM for HPC packs / extra licences
Amazon
© CADFEM 2015
Office Network ANSYS Licence Server
Engineer using local machine
Engineer using cloud
17
The Future
Where we are now • Three separate cloud solutions • Pick the one you want to use • No interaction between them
Where we would like to go • Single port of call • Select the right tool for the job • Combine different clouds together • Share results across different cloud types
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
18
ICHEC • Now hand over to ICHEC
© CADFEM 2015
ANSYS Conference & 2nd CADFEM Ireland Users’ Meeting 24th & 25th September 2015 - Engineers Ireland, Dublin
19
