Oracle Cluster 3.3 Setup Solaris 10 x86 ( Vmware ) - WordPress.com

Oracle Cluster 3.3 Setup Solaris 10 x86 ( Vmware ) www.alessiodini.wordpress.com This is my list of hardware/software: •

• • • • • • •

Toshiba satellite Pro L630 – 12F 8gb ram , 1x I3 processor ( quad core. I need it for hardware virtualization support ; with this technology i can build 64 bit virtual machines. Without I can’t do this task. For 32 bit guests I suggest to use Sun Cluster express, it is like 3.2 version ) 50gb disk space available ( 10gb for 3 or 4 virtual machines and 5gb as shared LUN for quorum device ) Windows 7 Vmware 7.1.2 Solaris 10 u9 x86_64 Openfiler 2.99 x86_64 ( as storage ) Oracle Cluster / Sun Cluster 3.3 x86 EIS software ( not mandatory , but it’s better have it )

PART 1 – VMWARE GUEST SETUP Let’s begin! As I said in the first page I used Vmware, so I begun with guest setup ! 1. File -> new - > Virtual Machine

2. It appears a virtual machine wizard. I selected custom configuration

3. Let’s select the hardware compatibility

4. Installation window. I selected disc image file (.iso) with the full path of my Solaris iso

Now I selected the corret image  5. Virtual machine name. As for the hostnames I used clnode1 and clnode2

6. Process assignment. For our purpose 1 is enough.

7. Ram assignment. 768mb should be enough but I assigned 1gb 

8. Guest’s network setup , this is very important. I initially assigned 1 network interface as “host only”.

9. I/O controller. I selected the recommended

10. Virtual disk selection. I Selected “Create a new virtual disk”

11. Disk type. For disk’s Solaris naming, I selected SCSI:

12. Disk size. As I said let’s give 10gb

13. Disk file name. Vmware stores disk file with .vmdk extension.

14. The last windows before the installation. We can see every setting we did

PART 2 – SOLARIS INSTALLATION 15. Let’s start the virtual machine and wait for the boot! After some instant appears the first window, where we can choose the installation type. Select 3 for ZFS as root filesystem

16. Keyboard Layout Selection

17. Just press ENTER!

18. Language selection , ( I choosed English )

19. The installation program

20. System Identification

21. Network Setup. Let’s choose networked, this option will save us from manual configuration after the installation 

22. NO DHCP for that interface

23. As I previously said , let’s assign clnode1 as hostname

24. IP Address , i choosed 192.168.22.130/24 network for public interface

25. Subnet ( 1 )

26. Subnet ( 2 )

27. NO IPV6

28. I don’t need to configure any default router

29. Network information resume

30. Kerberos Security

31. Kerberos information resume

32. Name Service. At the moment I don’t need that , I will check it later

33. Name service information resume

34. NFS. I choosed the default

35. NFS information resume

36. Timezone Selection ( $TZ )

37. Country Selection ( in my case I selected Italy )

38. Date and Time

39. Timezone/Date information resume

40. Root Password

41. Remote Services. This is critical for the cluster. I did some test running netservices close command and during the cluster setup I saw the nodes were not able to speak with eachother through RPC. So the setup failed until I ran netservices open command. For this scenario ( test only) I don’t care about security , but for production a system engineer should check every service and verify it. In this window let’s select ‘Yes’ then

42. Oracle registration. I need to save time , so not now thank you!

43. Auto registration proxy

44. Interactive Installation

45. Automatically, even if virtual ;)

46. Auto reboot

47. Eject Information

48. Licensing

49. Geographic Region ( in my case Italy -> Southern Europe )

50. Local Selection ( I choosed the default )

51. Additional Products

52. Filesystem Type. This is important for the cluster setup. Using SVM I should make metadevices and metasets for shared disks. Using ZFS I save most of the time because I don’t need to create every metadevice ! So let’s choose ZFS

53. Software Selection. Oracle Cluster requires OEM support, so let’s select it

54. Disk Selection ( I assigned only 1 disk of 10gb from Vmware )

55. ZFS settings. It’s different from SVM , instead of metadevice it uses datasets . In my case I choose / and /var combined

56. Remote filesystems mount ( I don’t use )

57. Disk information summary

58. Finally the installation begins !

59. After step n.58 I saw the reboot and I waited the first boot

PART 3 – CUSTOMIZING CLNODE1 I wanted to configure this first node and save much time as possible ( during boot , shutdown , … ) In order I did: 1. Use bash ( I love it ), so I changed the root line from /etc/passwd file in: root@clnode1 # grep root /etc/passwd root:x:0:0:Super-User:/:/usr/bin/bash

2. Change PS1 value, I added the export to /etc/profile file: echo "export PS1=\$HOSTNAME\":>\"" >> /etc/profile su Oracle Corporation SunOS 5.10 Generic Patch

January 2005

3. Allow root login via SSH, so i changed the line in /etc/ssh/sshd_config file: grep -i permit /etc/ssh/sshd_config (…) PermitRootLogin yes

I restarted ssh with the command: svcadm restart ssh 4. Disable some service ( for time saving ) svcadm svcadm svcadm svcadm

disable disable disable disable

svc:/application/graphical-login/cde-login:default webconsole svc:/network/sendmail-client:default svc:/network/smtp:sendmail

5. /etc/hosts configuration ( I added clnode2 and openfiler entries ) root@clnode1 # cat /etc/hosts # # Internet host table # 127.0.0.1 localhost 192.168.22.130 clnode1 loghost 192.168.22.131 clnode2 192.168.22.133 openfiler

6.

SSH public key setup clnode1:>ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (//.ssh/id_rsa): Created directory '//.ssh'. Enter passphrase (empty for no passphrase): Enter same passphrase again:

Your identification has been saved in //.ssh/id_rsa. Your public key has been saved in //.ssh/id_rsa.pub. The key fingerprint is: 01:74:58:1e:68:80:d1:05:49:54:b2:b5:5c:81:9a:82 root@clnode1 clnode1:> cd /.ssh clnode1:> mv id_rsa.pub authorized_keys

7. EIS Setup EIS is property of Oracle Corporation. After that setup I have: clnode1:>su Oracle Corporation SunOS 5.10 Sourcing //.profile-EIS..... clnode1:>

Generic Patch

January 2005

8. Oracle Cluster software I copied the software in /sun-temp directory. 9. Vmware Tools installation 10. I did not patch the system, its’ boring  11. Shutdown , doing init 0 command. At this point I did all about the first node. With Vmware I don’t need to install the second node , I just need to clone this one !

PART 4 – CLONING CLNODE1 1. From VM menu select ‘Clone’ voice

2. It appears the clone wizard

3.

Clone Source

4. Clone Type. I selected the full one

5. Virtual Machine Name ( in this case it’s clnode2 )

6. The cloning begins!

PART 5 – CUSTOMIZING CLNODE2 From Vmware I see both clnode1 and clnode2 powered off. So let’s power on clnode2 and configure it ( at the moment it has clnode1 ip and hostname ). In order I did: 1. Hostname Update 1. Change /etc/hosts in: # Internet host # 127.0.0.1 192.168.22.130 192.168.22.131 192.168.22.133

table localhost clnode1 clnode2 loghost openfiler

2. Change /etc/hostname.e1000g0 file in: # cat /etc/hostname.e1000g0 clnode2

3. Check /etc/inet/ipnodes entries 4. Change /etc/nodename entry echo “clnode2” > /etc/nodename 5. Reboot the system # init 6

2. SSH public key setup Repeat the step n. 6 listed in “PART 3 – CUSTOMIZING CLNODE 1” except for the last mv command! 3. Power on clnode1 virtual machine 4. Copy the .pub file as authorized keys from clnode2 to clnode1 clnode2> scp id_rsa.pub root@clnode1:/.ssh/authorized_keys The authenticity of host 'clnode1 (192.168.22.130)' can't be established. RSA key fingerprint is 81:1c:1d:e6:00:07:1e:1a:76:88:37:d6:a3:fe:87:7f. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'clnode1,192.168.22.130' (RSA) to the list of known hosts. Password: id_rsa.pub 100% |************************************************************************* ********************************************| 222 00:00

5. Test the public key between the nodes clnode2:> ssh clnode1 Last login: Mon Sep 17 16:50:40 2012 from clnode2 Oracle Corporation SunOS 5.10 Generic Patch January 2005 Sourcing //.profile-EIS..... clnode1:> clnode1:> ssh clnode2 The authenticity of host 'clnode2 (192.168.22.131)' can't be established. RSA key fingerprint is 81:1c:1d:e6:00:07:1e:1a:76:88:37:d6:a3:fe:87:7f. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'clnode2,192.168.22.131' (RSA) to the list of known h osts. Last login: Mon Sep 17 16:00:44 2012 from 192.168.22.1 Oracle Corporation SunOS 5.10 Generic Patch January 2005 Sourcing //.profile-EIS..... clnode2:>

Nice! Now we have public keys , fast boot/shutdown and no boring messages from sendmail about the domain!

PART 6 – ORACLE CLUSTER 3.3 INSTALLATION

I cover about the cluster installation. It was really hard copy and paste here the perfect output with characters and spaces! For learning purpose , i choosed to install the framework after the vm cloning. Install the cluster a couple of times if more funny than one only :) So , i did this on both nodes: clnode1:> cd /sun-temp clnode1:> unzip –q solaris-cluster-3_3-ga-x86.zip clnode1:> ls Copyright License Solaris_x86 solaris-cluster-3_3-ga-x86.zip clnode1:> cd Solaris_x86/ clnode1:> ls Product installer release_info clnode1:> ./installer -nodisplay

README

Welcome to Oracle(R) Solaris Cluster; serious software made simple... Before you begin, refer to the Release Notes and Installation Guide for the products that you are installing. This documentation is available at http: //docs.sun.com. You can install any or all of the Services provided by Oracle Solaris Cluster. Copyright (c) 2000, 2010, Oracle and/or its affiliates. All rights reserved.



Before you install this product, you must read and accept the entire Software License Agreement under which this product is licensed for your use . You acknowledge that your use of this software is subject to (i) the license terms that you accepted when you obtained a right to use this software; or (ii) the license terms that you signed when you placed your software order with us; or, if neither (i) or (ii) are applicable, then, (iii) the Oracle Electronic Delivery Trial License Agreement (which you acknowledge that you have read and understand), available at edelivery.oracle.com .

Note: Software downloaded for trial use or downloaded as replacement media may not be used to update any unsupported software.

If you have read and accept all the terms of the entire Software License Agreement, answer 'Yes', and the installation will continue. If you do not accept all the terms of the Software License Agreement, answer 'No', and the installation program will end without installing the product. Have you read, and o you accept, all of the terms of the preceding Software License Agreement [No] {"