IPMI

From Wikitech
(Difference between revisions)
Jump to: navigation, search
Line 1: Line 1:
−
Kyle,
 
  
 +
==IPMI 2.0==
  
−
It is the AOC-IPMI20 controller.  You should have an automatic update option with your IPMI cd that flashes the appropriate firmware, is this not the case?
+
The athlon nodes have IPMI 2.0 cards. These cards can be used to power toggle a machine (even when it is off), read out sensors, and even allows for a serial console via tcp/ip.
  
 +
[http://ipmitool.sf.net Ipmitool] can be used to configure and use the IPMI cards. We need version 1.8.8 or later.
  
−
It may be simpler to download the newest IPMI .iso from supermicro. This will also ensure we have the newest firmware package available:
+
The IPMI card can be used from the host machine itself, or from the network. To use the card from the host machine, the IPMI drivers from a recent 2.6 kernel are required. We use 2.6.17.3 with good results.
  
 +
Initial configuration needs to be done from the host machine, because the network settings need to be sensible before network access is possible.
  
−
ftp://ftp.supermicro.com/CDR_Images/CDR-0010_2.03_IPMI_Server_Managment.iso
+
Our machines are made by Supermicro, which means that the IPMI ethernet controller is actually a separate ethernet controller that shares one of the onboard network sockets. As a consequence, the IPMI interface needs to have a separate IP and MAC address from the onboard ethernet controller the OS sees.
  
 +
The wire is shared with the first NIC on the mb, which has the lowest MAC address. The NIC is also marked as eth1 in the back of the machine. It's the left one if you stand behind the machine.
  
−
Before updating you will want to locate the MAC address of your first network interface (either in linux with ifconfig or on a small white sticker inside of the system physically located near the network controllers in the rear of the chassis).
+
====Procedure to get IPMI working on an SSI node (old kernel)====
  
 +
Because the SSI nodes have such an old kernel, we will need to use a boot cd (e.g. a recent Ubuntu cd) to set the IP and password to allow ipmi control via the network.
  
−
After updating to the newest firmware, run ipnmac.exe (it may be buried a few directories down). Enter the desired IP address when prompted (must be different than your OS-level address) and then the MAC address from your first network interface.
+
1. flash ipmi card with downloadable image from Supermicro (DOS boot, takes 10 minutes!) <BR>
 +
2. run ipnmac.exe from DOS floppy (or the linux version!) to set IP. DO NOT ALTER THE MAC ADDRESS, it needs to be unique! <BR>
 +
3. boot into dapper live cd (desktop) and load the ipmi kernel modules:
  
 +
  modprobe ipmi_devintf
 +
  modprobe ipmi_msghandler
 +
  modprobe ipmi_poweroff
 +
  modprobe ipmi_si
 +
  modprobe ipmi_watchdog
 +
  modprobe ipmi_kcs_drv
  
−
After that, shut down the system, disconnect from power completely for 10 seconds, then power back up. You should be ready to go at that point.
+
4. You may have to create the ipmi device under /dev:
 +
 
 +
  mknod -m 0600 /dev/ipmi0 c 254 0
  
 +
5. Now acquire a copy of ipmitool (1.8.8 or later) - you may have to download/compile it on the live cd ramdisk - and configure user/password with ipmitool:
  
−
=== Macs ===
+
  ipmitool user set password 2 <yourpassword>
−
<pre>
+
−
Host  Mac eth0           
+
−
db4  00:30:48:59:df:62
+
  
−
sq11 00:30:48:59:DF:8C
+
6. Try remotely, from the admin network:
−
sq12 00:30:48:59:df:18
+
−
sq13 00:30:48:59:df:46
+
−
sq14 00:30:48:59:e0:ee
+
−
sq15 00:30:48:59:e0:fe
+
−
sq16 00:30:48:59:df:82
+
−
sq17 00:30:48:59:e0:b8
+
−
sq18 00:30:48:59:de:12
+
−
sq19 00:30:48:57:3c:f0
+
−
sq20 00:30:48:59:df:98
+
−
sq21 00:30:48:59:E1:08
+
−
sq22 00:30:48:59:e1:10
+
−
sq23 00:30:48:59:df:ce
+
−
sq24 00:30:48:59:de:72
+
−
sq25 00:30:48:59:e0:64
+
−
sq26 00:30:48:59:e0:e6
+
−
sq27 00:30:48:59:df:6e
+
−
sq28 00:30:48:59:e1:30
+
−
sq29 00:30:48:59:e1:18
+
−
sq30 00:30:48:59:e1:14
+
−
</pre>
+
  
 +
  IPMI_PASSWORD=<yourpassword> ./ipmitool -H <ipmi_box_ip> -I lan -U ADMIN -E lan print
  
−
We have started using IPMI on the Silicon Mechanics nServ A206 nodes. Feel free to get in touch. --[[User:AlexanderWaitZaranek|AlexanderWaitZaranek]] 16:22, 26 October 2006 (PDT)
+
7. SOL: bios is set to COM2, 19200n8
 +
 
 +
  IPMI_PASSWORD=<yourpassword> ./ipmitool -H <ipmi_box_ip> -I lanplus -U ADMIN -E sol activate
 +
 
 +
Error: Unable to establish IPMI v2 / RMCP+ session
 +
Error: No response activating SOL payload
 +
 
 +
This is an ipmitool v1.8.8/v1.8.9rc1 problem. With the ipmicli tool from supermicro, remote serial just works. There is a caveat: after the bios is done, and hands over to grub, you won't see the 'press any key...' prompt because of redrawing issues. Just press a key for the grub menu!

Revision as of 05:08, 29 October 2006

IPMI 2.0

The athlon nodes have IPMI 2.0 cards. These cards can be used to power toggle a machine (even when it is off), read out sensors, and even allows for a serial console via tcp/ip.

Ipmitool can be used to configure and use the IPMI cards. We need version 1.8.8 or later.

The IPMI card can be used from the host machine itself, or from the network. To use the card from the host machine, the IPMI drivers from a recent 2.6 kernel are required. We use 2.6.17.3 with good results.

Initial configuration needs to be done from the host machine, because the network settings need to be sensible before network access is possible.

Our machines are made by Supermicro, which means that the IPMI ethernet controller is actually a separate ethernet controller that shares one of the onboard network sockets. As a consequence, the IPMI interface needs to have a separate IP and MAC address from the onboard ethernet controller the OS sees.

The wire is shared with the first NIC on the mb, which has the lowest MAC address. The NIC is also marked as eth1 in the back of the machine. It's the left one if you stand behind the machine.

Procedure to get IPMI working on an SSI node (old kernel)

Because the SSI nodes have such an old kernel, we will need to use a boot cd (e.g. a recent Ubuntu cd) to set the IP and password to allow ipmi control via the network.

1. flash ipmi card with downloadable image from Supermicro (DOS boot, takes 10 minutes!)
2. run ipnmac.exe from DOS floppy (or the linux version!) to set IP. DO NOT ALTER THE MAC ADDRESS, it needs to be unique!
3. boot into dapper live cd (desktop) and load the ipmi kernel modules: 

  modprobe ipmi_devintf
  modprobe ipmi_msghandler
  modprobe ipmi_poweroff
  modprobe ipmi_si
  modprobe ipmi_watchdog
  modprobe ipmi_kcs_drv

4. You may have to create the ipmi device under /dev: 

 mknod -m 0600 /dev/ipmi0 c 254 0

5. Now acquire a copy of ipmitool (1.8.8 or later) - you may have to download/compile it on the live cd ramdisk - and configure user/password with ipmitool: 

 ipmitool user set password 2 <yourpassword>

6. Try remotely, from the admin network: 

 IPMI_PASSWORD=<yourpassword> ./ipmitool -H <ipmi_box_ip> -I lan -U ADMIN -E lan print

7. SOL: bios is set to COM2, 19200n8 

 IPMI_PASSWORD=<yourpassword> ./ipmitool -H <ipmi_box_ip> -I lanplus -U ADMIN -E sol activate

Error: Unable to establish IPMI v2 / RMCP+ session Error: No response activating SOL payload

This is an ipmitool v1.8.8/v1.8.9rc1 problem. With the ipmicli tool from supermicro, remote serial just works. There is a caveat: after the bios is done, and hands over to grub, you won't see the 'press any key...' prompt because of redrawing issues. Just press a key for the grub menu!

Retrieved from "http://wikitech-old.wikimedia.org/index.php?title=IPMI&oldid=10111"
Personal tools
Namespaces

Variants
Actions
Navigation
Ops documentation
Wiki
Toolbox