UPS (Uninterruptible Power Supplies)

CLON cluster equipped with two big SYMMETRA RM 6000 Single-phase UPSes from APC Corporation. These UPSes are multi-battery systems.

Documentation: Installation Manual (pdf)

In case of something wrong with UPSes follow the instruction of UPS Troubleshooting.

Smaller UPSes ...

All UPSes are connected to emergency generator.

All connections (ether via Web interface or SSH) allowed only from local subnet.

web link to http://UPS_CHB1/ (device/apc)

web link to http://UPS_CHB2/ (device/apc)

SYMMETRA RM 6000 firmware upgrade

Enable SYMMETRA FTP service using its web interface. Download appropriate firmware from http://www.apc.com/ web site. Search not for SYMMETRA but for 'UPS Network Management Cards'. Last time apc_hw02_aos334_sy331.exe was used, it was listed as 'Network Management Card v3.3.1 Firmware Executable for Symmetra Single-Phase UPS with AP9617/8/9', part number SFSY331, file date 01/23/2007. To install, place it into CUE home directory, run metaframe and click on firmware file. Several files will be installed, upgrade program will be started and text GUI will shows up. Type SYMMETRA IP and admin username/password, start firmware installation and wait several minutes for completion. Repeat for all SYMMETRA devices (currently we have 2 of them). Remove all installed files from CUE home directory.

PowerChute Network Shutdown

That free software is used to shut down computers when UPS is running out of charge. Can be downloaded from http://www.apc.com/, 27-sep-2007 following files were downloaded for 'PowerChute Network Shutdown v2.2.1', part number SFPCNS221, file date 11/15/2006: Installation Guide, Linux, Solaris(Sparc), Solaris(x86), WindowsXP. Mac OS X version 10.2 is also supported as 'PowerChute Network Shutdown v2.0.0', part number SFPCNS200, file date 01/27/2003: Installation Guide, MacOSX.

Shortly, on every machine where it suppose to be installed, goto /usr/local/downloads directory; on Solaris(Sparc) run ./pcns221sol.bin, on Linux run ./pcns221lnx.bin; on Solaris(x86) goto /usr/local/downloads/PowerChute and run command java -cp .:install.jar:util.jar load. Follow instructions, choose /opt/PowerChute as installation directory, Typical Install, and UPS_CHB1's IP address as Management Card IP (we assume that UPS_CHB1 have bigger load then other UPSes). All other settings are default.

NOTE: on some platforms installation procedure requires java1.4, it does not work with java1.5 (at least on clon04 with RHEL4 - Sergey B., 28-sep-2007). If it happens, hide default java1.5 (for example mv /usr/bin/java /usr/bin/java.hide) and run installation procedure again. It will look for java in /usr/local/bin/jvm directory (I think it will install java there if necessary). After installation is completed, unhide java (mv /usr/bin/java.hide /usr/bin/java), procedure will still use java from /usr/local/bin/jvm.

After installation completed for every machine, login to UPS_CHB1, goto UPS->PowerChute->clients and fix client's IP addresses. For some reasons installation procedure uses not default network interfaces for multi-network sometimes, so it must be changed to 167 subnet manually (it may work through other subnets but since UPS_CHB1 is on 167 subnet, lets keep all clients there).

Now, set Low Battary Duration in UPS->Configuration->Shutdown menu to 7 minutes.

Now it is a time to configure clients. On any client's browser open localhost:3052 and goto Configure Shutdown. Check box Yes, I want to notify a user. Keep Notify all users selected. Set Run this command file (full name). to the desired shutdown command (Solaris: shutdown -y -i 5 -g 120, Linux: shutdown -h +2 "System going down on power outage"). Set The command file needs this much time to complete (seconds.) to 300 seconds. Uncheck Turn off the UPS after the shutdown finishes. (Not applicable to Silcon UPS) box.

In Configure Events menu, select following Events in Shut Down System column: ..

Repeat that for every client. Can access from the same page: goto UPS Information->Connected Servers" and click on desired client, or just type in your browser client's IP address and :3052.