Professional Documents
Culture Documents
http://www.scribd.com/doc/2673166/Confi
guring-and-Managing-a-Red-Hat-
Cluster-for-Red-Hat-Enterprise-Linux-51
http://publib.boulder.ibm.com/infocenter
/tssfsv21/index.jsp?topic=/com.ibm.sanfs.
doc/fog0_t_configuring_rsa_adapter.html
Context
Use the documentation supplied with the RSA II adapter card for configuration
information. You need to change the factory-supplied IP address so that it is unique for
your network. In addition, the SAN File System uses certain configuration settings (you
will need to supply the configuration setting when you run the setupsfs command).
Note: You can use the setupsfs command to configure the RSA II adapter if it is not
already configured. However, you must use this procedure to set the IP address, to set the
user ID password to NULL, or to reset the user ID password.
This procedure assumes that you have properly cabled the RSA II adapter.
The RSA II adapters in the engines all come with the same default IP address. This
address is: 192.168.70.125.
Note: If you have multiple RSA II adapters on the network at the same time, all will have
the same IP address. If you use the Web interface to configure the RSA II adapter, you
will not be able to determine the RSA II adapter that you are updating. Instead, you can
update the IP address through the BIOS, and then use the Web interface to complete the
configuration.
The recommended IP addresses for the RSA II adapters in the cluster are 192.168.70.1
through 192.168.70.n, where n is incremented by 1 for each additional RSA adapter. A
cluster of eight engines would contain RSA adapters numbered from 192.168.70.1 to
192.168.70.8.
Number the engines and RSA adapters from 1 through n, starting with the top engine in
the rack and ending with the bottom engine in the rack.
Steps
Important: The password must contain only alphanumeric characters and it must
be at least 5 characters long.
This section is intended to be only an example to illustrate the installation steps from start
to finish for one specific combination of servers and storage. It should not be used as a
step-by-step guide for installing the SAN File System metadata server.
For specific installation details, see Installing the operating system and Metadata server
software installation and configuration. These sections contain additional information that
can apply to your configuration. For instance, the sample installation described in this
topic does not include upgrading the kernel or configuring the RDAC multipath driver, as
those tasks did not apply in this scenario. They might apply to your particular installation
scenario.
Table 1 and Table 2 provide overviews of the steps you need to complete to install SLES9
and the SAN File System software on an xSeries 346. The steps follow the tables.
Table 1. Installing SAN File System 2.2.2 on an IBM xSeries 346 - Server steps
Completed Step
Update flash BIOS
Update the diagnostics firmware
Update the Baseboard Management Controller (service processor firmware)
Configure the RSA II
Update the RSA II firmware
Update the Broadcom adapter firmware
Update the hard drive firmware
Configure the HostRAID controllers
Create a RAID device
Start the SLES9 installation
Configure the installation settings
Perform post-installation configuration
Set up NTP to keep the time in sync
Set up Ethernet bonding
Table 1. Installing SAN File System 2.2.2 on an IBM xSeries 346 - Server steps
Completed Step
Update flash BIOS
Update the diagnostics firmware
Create local users and groups for authentication
Verify IBMJava is not installed
Install and start IBMsdd
Table 2. Completing SAN File System 2.2.2 post-server installation steps
Completed Step
Set up ssh keys
Verify all servers discover the same number of LUNs
Verify that the LDAP server responds to queries
Verify that the multi-path device driver restarts
Install IBMJava2-142-ia32-JRE
Verify the server meets hardware and software requirements
Create a configuration file
Install SAN File System
Before you begin . . .
You need to get the SLES9 installation instructions and download firmware and
updates, as detailed here.
Get the SLES9 installation instructions
1. Ensure that your browser cookies are enabled to maintain the selections on
the Downloads and drivers Web page that you will see in several steps.
2. Go to the Personal Computing Support Web site:
www.ibm.com/pc/support
3. In the Browse list, choose Servers. A new page is displayed. Select the
choices displayed in Table 3.
Leave the Operating system field set to All operating systems listed. If you
choose any other value, you might not find all the links listed in Table 4.
4. Click Continue.
Take note of the information in the Original description field. The SLES9
installation has specific instructions based on the type of SCSI controller.
The type of SCSI controller that your model includes is listed in the
Original description field. (In this example, the SCSI controller is the
Adaptec AIC-7902 dual-channel 64-bit Ultra320 LVD SCSI PCI
controller.)
5. Click Downloads and drivers. From this page, various firmware and
drivers can be downloaded as shown in Table 4. Instructions for
downloading are provided for each package. Additional instructions are
noted in the table.
The following steps are provided as an example of installing SLES 9 on an xSeries 346.
These steps might not be the same for your model and type. However, they provide an
outline for an installation.
Note: During boot in the following steps, the following warning is displayed twice:
PCI device resource allocation failure
Follow the instructions in the readme.txt file that was extracted from the “Remote
Supervisor Adapter II Firmware Update” archive.
To start the SCSISelect Utility, reboot the machine, and then immediately
press Ctrl+A when the following message appears:
The drive that needs to be mirrored. This is the source drive that
contains all the data. In this example, the ID is m.
The location of the mirrored source drive. In this example, the ID
is n.
Create Array?
Click Yes.
After the array is created, the progress bar shows the status of the process.
This process takes 4 to 8 hours to complete depending on the size of the
source drive.
h. When the process completes, exit from the SCSI Select Utility by pressing
ESC.
i. Reboot your system to complete the configuration process. You are now
ready to use RAID 1.
Start the SLES9 installation:
a. Insert the SLES9 Service Pack 1 CD and reboot the system.
b. After the CD boots, you might see the message:
c. Select Installation from the menu, but do not press Enter yet. Do not
press Enter until step h.
d. In the boot options box, you must enter special values based on your SCSI
controller. See the Installing SUSE LINUX Enterprise Server 9 Products
document for your specific model for details. The following example
shows typical boot options:
When prompted enter a root password. The Network Configuration panel displays
a summary of the network settings. You can change the settings as follows:
To keep the time among servers and clients in sync, complete the following steps:
d. Edit the /etc/ntp.conf file and add server <IP address>, where <IP
address> is an NTP server. You can add multiple NTP server lines to
increase reliability.
e. Enter /etc/init.d/xntpd start .
f. Enter /sbin/hwclock --systohc.
g. Enter /sbin/hwclock --show.
/etc/init.d/network stop
cd /etc/sysconfig/network
There are two Ethernet configuration files: these files begin with ifcfg-eth-
id and end with the MAC address associated with each card. Edit each file
and change the values of BOOTPROTO and STARTMODE to the
following:
BOOTPROTO=’none’
STARTMODE=’off’
w. Restart networking:
/etc/init.d/network restart
If local users and groups will be used to authenticate SAN File System
administrative console access, create the users and groups.
groupadd Administrator
groupadd Operator
groupadd Backup
groupadd Monitor
useradd -g Administrator sfsadmin –m
passwd sfsadmin
Create additional users for the Operator, Backup and Monitor groups if needed.
rpm –e IBMJava-JRE
Install and start IBMsdd to manage multiple fibre-channel paths to IBM storage
LUNs (LUNs have already been created and mapped to this host).
y. Go to http://www-
1.ibm.com/servers/storage/support/software/sdd/downloading.html, and
then click Subsystem Device Driver downloads.
z. Click Subsystem Device Driver for Linux.
aa. Download SDD for the storage subsystem and OS you are using.
bb. Install the SDD driver:
rpm –U IBMsdd-1.6.0.1-4.i686.sles9.rpm
chkconfig –a sdd
sdd start
lsvpcfg
ff. Cat /proc/partitions on all servers and verify that the same number of
LUNs have been discovered on all servers. (You can also use
/proc/scsi/scsi and /proc/scsi/qla2xxx/* to verify that the servers see the
same number of LUNs).
gg. If you are running SDD, the lsvpcfg command can be used to show all
configured LUNS, the number of paths to each LUN, and the LUN serial
numbers. (You can also use the SDD command, datapath query device, to
show the same information).
19. Verify that the multi-path device driver restarts after a reboot
(example: SDD):
rpm -U /media/dvd/common/IBMJava2-142-ia32-JRE-1.4.2-
1.0.i386.rpm
This step uses the install_sfs-package script to verify that the server meets
hardware and software requirements. You need to complete this step for each
server in the cluster, but you can do it from the master metadata server.
CD mount point
Server IP address
System Management IP (RSA II)
Authorized RSA User
Authorized RSA Users Password
/media/dvd/SLES9/install_sfs-package-<version>.i586.sh –-
verify